00000001:02000400:3.0F:1787830763.035583:0:3296:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg331-server.virtnet: executing set_hostid 00000001:02000400:3.0:1787830773.949460:0:3496:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg331-server.virtnet: executing load_modules_local 00000001:01000000:2.0F:1787830775.068741:0:3559:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 1163 MB/s 00000001:01000000:2.0:1787830775.318839:0:3559:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 1659 MB/s 00000001:01000000:2.0:1787830775.568732:0:3559:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 8767 MB/s 00000020:02000000:1.0F:1787830775.864230:0:3588:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_61_g678d580 00000400:02000000:2.0:1787830776.293446:0:3603:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.203.131@tcp [8/256/0/180] 00008000:02000000:2.0:1787830778.622448:0:3752:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:2.0:1787830825.549107:0:5717:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg331-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1787830837.027423:0:6466:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787830837.027507:0:6466:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1787830837.027509:0:6466:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1787830837.030789:0:6466:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000ba8cc66a 00000080:02000400:2.0:1787830837.030807:0:6466:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1787830837.042542:0:6466:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1787830837.042557:0:6466:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1787830837.042588:0:6466:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000b4279a57) 00000020:00000080:2.0:1787830837.042609:0:6466:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1787830837.102917:0:6466:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1787830837.103018:0:6466:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:1.0:1787830837.132685:0:6466:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1787830837.132918:0:6466:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1787830837.132927:0:6466:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787830837.132942:0:6466:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x95459fb9d1d283bc 00000020:01000004:1.0:1787830837.132951:0:6466:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:1.0:1787830837.132957:0:6466:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1787830837.132963:0:6466:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000ba8cc66a from MGS 00000020:01000004:1.0:1787830837.132968:0:6466:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1787830837.132998:0:6466:0:(genops.c:413:class_newdev()) Allocate new device MGS (0000000061293475) 00000020:00000080:1.0:1787830837.133012:0:6466:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1787830837.133137:0:6466:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000ba8cc66a from MGS, refs=2 00080000:01000000:1.0:1787830837.133142:0:6466:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787830837.133148:0:6466:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x95459fb9d1d283ca 00000100:00100000:1.0:1787830837.133254:0:6466:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1787830837.133413:0:6466:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1787830837.133422:0:6466:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1787830837.133949:0:6466:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1787830837.133956:0:6466:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1787830837.134583:0:6466:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0F:1787830837.134842:0:6466:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1787830837.134927:0:6466:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1787830837.135660:0:6466:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1787830837.135667:0:6466:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1787830837.137340:0:6466:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1787830837.137350:0:6466:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1787830837.140507:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830837.140514:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830837.140515:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830837.140938:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830837.140941:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830837.140942:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787830837.142823:0:6466:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1787830837.144044:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:3.0:1787830837.390736:0:6466:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 4531 MB/s 00000001:01000000:3.0:1787830837.640655:0:6466:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 5723 MB/s 00000001:01000000:3.0:1787830837.892154:0:6466:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 561 MB/s 00000001:01000000:2.0:1787830838.144643:0:6466:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 579 MB/s 00080000:10000000:2.0:1787830838.151597:0:6466:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000040:01000000:3.0:1787830838.166063:0:6466:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1787830838.175563:0:6482:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1787830838.175695:0:6466:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1787830838.175760:0:6466:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1787830838.176003:0:6466:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1787830838.176030:0:6466:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1787830838.176396:0:6466:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787830838.176578:0:6466:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1787830838.176584:0:6466:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1787830838.179051:0:6466:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1787830838.179067:0:6466:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1787830838.179395:0:6466:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1787830838.179402:0:6466:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1787830838.180649:0:6466:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1787830838.180675:0:6466:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.131@tcp' 00000020:01000004:3.0:1787830838.180677:0:6466:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1787830838.180736:0:6466:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.131@tcp (typ=mgc) 00000020:00000080:3.0:1787830838.180759:0:6466:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.131@tcp (000000003c170503) 00000020:00000080:3.0:1787830838.180778:0:6466:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1787830838.180928:0:6466:0:(ldlm_lib.c:102:import_set_conn()) imp 000000003a0a7a56@MGC192.168.203.131@tcp: add connection 192.168.203.131@tcp at head 00010000:00010000:3.0:1787830838.181099:0:6466:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.131@tcp-0 is initialized 00000040:01000000:3.0:1787830838.181106:0:6466:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.131@tcp ctxt 1 is initialized 00000100:00080000:2.0:1787830838.182835:0:6486:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00010000:00010000:1.0:1787830838.190112:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787830838.198057:0:6487:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1787830838.198167:0:6466:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.131@tcp (uuid 2a45944b-32e3-4193-a2a5-46f84222bc14) 00000020:00000080:3.0:1787830838.198199:0:6466:0:(genops.c:1385:class_connect()) connect: client 2a45944b-32e3-4193-a2a5-46f84222bc14, cookie 0x95459fb9d1d283d8 00000100:00080000:3.0:1787830838.198213:0:6466:0:(import.c:510:import_select_connection()) MGC192.168.203.131@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787830838.198220:0:6466:0:(import.c:624:import_select_connection()) MGC192.168.203.131@tcp: import 000000003a0a7a56 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:3.0:1787830838.198261:0:6466:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000064d2e82f x1874676443775104/t0(0) o250->MGC192.168.203.131@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787830838.198309:0:6466:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 2a45944b-32e3-4193-a2a5-46f84222bc14->MGS 00000020:01000004:3.0:1787830838.198338:0:6466:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1787830838.198344:0:6466:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1787830838.198361:0:6466:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000006a9b9149) 00000020:00000080:3.0:1787830838.198374:0:6466:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1787830838.200074:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000064d2e82f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2a45944b-32e3-4193-a2a5-46f84222bc14:3618:1874676443775104:0@lo:250: 00000100:00100000:0.0:1787830838.200190:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830838.200285:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443775104 00000100:00100000:0.0:1787830838.200293:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443775104 00000100:00100000:0.0:1787830838.200336:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787830838.200343:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007920cc0c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3618:x1874676443775104:12345-0@lo:250: 00010000:00080000:0.0:1787830838.200373:0:6483:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 2a45944b-32e3-4193-a2a5-46f84222bc14@0@lo t0 exp 0000000000000000 cur 129 last 0 00000020:00000080:0.0:1787830838.200401:0:6483:0:(genops.c:1385:class_connect()) connect: client 2a45944b-32e3-4193-a2a5-46f84222bc14, cookie 0x95459fb9d1d283e6 00000100:00080000:0.0:1787830838.200548:0:6483:0:(import.c:65:import_set_state_nolock()) 000000002b3bd1ba : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787830838.200604:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007920cc0c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+5:3618:x1874676443775104:12345-0@lo:250: Request processed in 260us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830838.200612:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787830838.201801:0:3618:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.203.131@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1787830838.201816:0:3618:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.131@tcp: connect to target with instance 0 00000100:00080000:0.0:1787830838.201828:0:3618:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.131@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1787830838.201833:0:3618:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1787830838.201836:0:3618:0:(import.c:65:import_set_state_nolock()) 000000003a0a7a56 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1787830838.201840:0:3618:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1787830838.201853:0:3618:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1787830838.201859:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000064d2e82f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2a45944b-32e3-4193-a2a5-46f84222bc14:3618:1874676443775104:0@lo:250: 00000100:00100000:3.0:1787830838.223618:0:6466:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787830838.224944:0:6466:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1787830838.224953:0:6466:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1787830838.227584:0:6466:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1787830838.227603:0:6466:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1787830838.228875:0:6466:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1787830838.228885:0:6466:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1787830838.229778:0:6466:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787830838.229967:0:6466:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1787830838.229973:0:6466:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1787830838.239067:0:6466:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1787830838.239082:0:6466:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1787830838.306615:0:6466:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787830838.310394:0:6466:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1787830838.310403:0:6466:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1787830838.324732:0:6466:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1787830838.324818:0:6466:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1787830838.325943:0:6466:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787830838.326133:0:6466:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787830838.326140:0:6466:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1787830838.326644:0:6466:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787830838.326651:0:6466:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1787830838.327349:0:6466:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787830838.327516:0:6466:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787830838.327522:0:6466:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1787830838.333035:0:6466:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787830838.333052:0:6466:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1787830838.334132:0:6466:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787830838.334324:0:6466:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787830838.334330:0:6466:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1787830838.335032:0:6466:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787830838.335041:0:6466:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1787830838.367276:0:6466:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787830838.367499:0:6466:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1787830838.367507:0:6466:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1787830838.368985:0:6466:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1787830838.368996:0:6466:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1787830838.370064:0:6466:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1787830838.370075:0:6466:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1787830838.371049:0:6466:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1787830838.371079:0:6466:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:0.0:1787830838.371086:0:6466:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.131@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1787830838.371209:0:6466:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.131@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787830838.371245:0:6466:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.131@tcp, index=0000, flags=0x20065 00000020:01000004:0.0:1787830838.371250:0:6466:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787830838.371252:0:6466:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787830838.371253:0:6466:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787830838.371255:0:6466:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787830838.371260:0:6466:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787830838.371261:0:6466:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787830838.371262:0:6466:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787830838.371264:0:6466:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787830838.371265:0:6466:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787830838.371267:0:6466:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787830838.371268:0:6466:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787830838.371270:0:6466:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787830838.371272:0:6466:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:0.0:1787830838.371274:0:6466:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787830838.371275:0:6466:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787830838.371276:0:6466:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787830838.371277:0:6466:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787830838.371278:0:6466:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787830838.371279:0:6466:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787830838.371280:0:6466:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787830838.371280:0:6466:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787830838.371281:0:6466:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787830838.371282:0:6466:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787830838.371283:0:6466:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787830838.371284:0:6466:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787830838.371312:0:6466:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1787830838.371330:0:6466:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008718ef3d pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:6466:1874676443775232:0@lo:253: 00000100:00100000:0.0:1787830838.371407:0:6466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830838.371555:0:6466:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c3bd6b5c going to sleep for 11 seconds 00000100:00100000:2.0:1787830838.372060:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443775232 00000100:00100000:2.0:1787830838.372069:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443775232 00000100:00100000:2.0:1787830838.372138:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787830838.372147:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000390c617f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+5:6466:x1874676443775232:12345-0@lo:253: 20000000:01000000:2.0:1787830838.372200:0:6485:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787830838.372203:0:6485:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:2.0:1787830838.372537:0:6506:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1787830838.372598:0:6485:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:0.0:1787830838.373151:0:6485:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787830838.374455:0:6507:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:0.0:1787830838.374700:0:6485:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787830838.374704:0:6485:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:0.0:1787830838.374710:0:6485:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:0.0:1787830838.374714:0:6485:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:0.0:1787830838.374726:0:6485:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:0.0:1787830838.374878:0:6485:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787830838.375341:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:0.0:1787830838.375356:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1787830838.375377:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:0.0:1787830838.375396:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:0.0:1787830838.375425:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:0.0:1787830838.375486:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:0.0:1787830838.375494:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:0.0:1787830838.375509:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:0.0:1787830838.375515:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:0.0:1787830838.375527:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:0.0:1787830838.375533:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:0.0:1787830838.375547:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:0.0:1787830838.375562:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:0.0:1787830838.375589:0:6485:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1787830838.375595:0:6485:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:0.0:1787830838.375602:0:6485:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787830838.378087:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:0.0:1787830838.378118:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1787830838.378148:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:0.0:1787830838.378167:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:0.0:1787830838.378182:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:0.0:1787830838.378197:0:6485:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:0.0:1787830838.378242:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:0.0:1787830838.378251:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1787830838.378264:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:0.0:1787830838.378280:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:0.0:1787830838.378292:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:0.0:1787830838.378301:0:6485:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:0.0:1787830838.378324:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:0.0:1787830838.378332:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:0.0:1787830838.378345:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:0.0:1787830838.378358:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:0.0:1787830838.378413:0:6485:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:0.0:1787830838.378433:0:6485:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1787830838.378440:0:6485:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:0.0:1787830838.379179:0:6508:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:2.0:1787830838.379378:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:2.0:1787830838.379404:0:6485:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.131@tcp for mdt 20000000:01000000:2.0:1787830838.379406:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.131@tcp (null) (null) (null) 00000040:00080000:2.0:1787830838.379421:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:2.0:1787830838.379429:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1787830838.379441:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:2.0:1787830838.379447:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.203.131@tcp (null) (null) 00000040:00080000:2.0:1787830838.379458:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:2.0:1787830838.379465:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1787830838.379476:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:2.0:1787830838.379492:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:2.0:1787830838.379521:0:6485:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:2.0:1787830838.379524:0:6485:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1787830838.379528:0:6485:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1787830838.379595:0:6485:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1787830838.379597:0:6485:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1787830838.380225:0:6509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:2.0:1787830838.380389:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:2.0:1787830838.380413:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:2.0:1787830838.380429:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:2.0:1787830838.380439:0:6485:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1787830838.380440:0:6485:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:1.0:1787830838.381140:0:6510:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:2.0:1787830838.381300:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:2.0:1787830838.381322:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:2.0:1787830838.381338:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:2.0:1787830838.381349:0:6485:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787830838.381352:0:6485:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:2.0:1787830838.381357:0:6485:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1787830838.381370:0:6485:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1787830838.381375:0:6485:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1787830838.381382:0:6485:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1787830838.381872:0:6511:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:2.0:1787830838.381999:0:6485:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:2.0:1787830838.392040:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:2.0:1787830838.392108:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:2.0:1787830838.392130:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:2.0:1787830838.392157:0:6485:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1787830838.392184:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000007d0efe64/0x95459fb9d1d283ed lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830838.392203:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007d0efe64/0x95459fb9d1d283ed lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830838.392214:0:6485:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000007d0efe64/0x95459fb9d1d283ed lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830838.392220:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000007d0efe64/0x95459fb9d1d283ed lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830838.392227:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000007d0efe64/0x95459fb9d1d283ed lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830838.392234:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000007d0efe64/0x95459fb9d1d283ed lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830838.392240:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000007d0efe64 already unused, calling callback (00000000f4040125) 00010000:00010000:2.0:1787830838.392244:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000007d0efe64/0x95459fb9d1d283ed lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830838.392263:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000007d0efe64/0x95459fb9d1d283ed lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830838.392278:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000007d0efe64/0x95459fb9d1d283ed lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830838.392286:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000007d0efe64/0x95459fb9d1d283ed lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830838.392291:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000007d0efe64/0x95459fb9d1d283ed lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787830838.392309:0:6485:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1787830838.419517:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000390c617f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+5:6466:x1874676443775232:12345-0@lo:253: Request processed in 47361us (48101us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830838.419533:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787830838.419940:0:6466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008718ef3d pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:6466:1874676443775232:0@lo:253: 10000000:01000000:0.0:1787830838.419959:0:6466:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1787830838.419962:0:6466:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787830838.419965:0:6466:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787830838.419966:0:6466:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787830838.419968:0:6466:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:0.0:1787830838.419969:0:6466:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787830838.419970:0:6466:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787830838.419971:0:6466:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787830838.419983:0:6466:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787830838.419985:0:6466:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1787830838.419986:0:6466:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787830838.419988:0:6466:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787830838.420012:0:6466:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000ba8cc66a from lustre-MDT0000 10000000:01000000:0.0:1787830838.420045:0:6466:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1787830838.420048:0:6466:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1787830838.420053:0:6466:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8d2312953370 10000000:01000000:0.0:1787830838.420057:0:6466:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787830838.420064:0:6466:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8d2312953370 from 1 10000000:01000000:0.0:1787830838.420067:0:6466:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787830838.420109:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: 000000009f828d4a/0x95459fb9d1d283f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830838.420120:0:6466:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: 000000009f828d4a/0x95459fb9d1d283f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830838.420129:0:6466:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: 000000009f828d4a/0x95459fb9d1d283f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830838.420148:0:6466:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008718ef3d pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:6466:1874676443775360:0@lo:101: 00000100:00100000:0.0:1787830838.420193:0:6466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830838.420255:0:6466:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ad87737f going to sleep for 11 seconds 00000100:00100000:2.0:1787830838.420353:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443775360 00000100:00100000:2.0:1787830838.420360:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443775360 00000100:00100000:2.0:1787830838.420405:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787830838.420414:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d7170f28 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+5:6466:x1874676443775360:12345-0@lo:101: 00010000:00010000:2.0:1787830838.420436:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787830838.420451:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007d0efe64/0x95459fb9d1d283fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d283f4 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830838.420474:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007d0efe64/0x95459fb9d1d283fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d283f4 expref: 6 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830838.420484:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007d0efe64/0x95459fb9d1d283fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d283f4 expref: 6 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830838.420508:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007d0efe64, rc 0) 00000100:00100000:2.0:1787830838.420555:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d7170f28 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+6:6466:x1874676443775360:12345-0@lo:101: Request processed in 142us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830838.420561:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787830838.424444:0:6466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008718ef3d pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:6466:1874676443775360:0@lo:101: 00010000:00010000:3.0:1787830838.424479:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: 000000009f828d4a/0x95459fb9d1d283f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d283fb expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830838.424492:0:6466:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: 000000009f828d4a/0x95459fb9d1d283f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d283fb expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830838.424616:0:6466:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c0fc0a1b pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:6466:1874676443775488:0@lo:501: 00000100:00100000:3.0:1787830838.424737:0:6466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830838.424783:0:6466:0:(client.c:2715:ptlrpc_set_wait()) set 000000007b0a6596 going to sleep for 11 seconds 00000100:00100000:2.0:1787830838.425080:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443775488 00000100:00100000:2.0:1787830838.425088:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443775488 00000100:00100000:2.0:1787830838.425142:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787830838.425149:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004fe930c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+6:6466:x1874676443775488:12345-0@lo:501: 00000100:00100000:2.0:1787830838.425253:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004fe930c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+6:6466:x1874676443775488:12345-0@lo:501: Request processed in 104us (516us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787830838.425261:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787830838.425344:0:6466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c0fc0a1b pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:6466:1874676443775488:0@lo:501: 10000000:01000000:1.0:1787830838.425382:0:6466:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787830838.425398:0:6466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: 000000009f828d4a/0x95459fb9d1d283f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d283fb expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830838.425406:0:6466:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: 000000009f828d4a/0x95459fb9d1d283f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d283fb expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787830838.425438:0:6466:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d2303f2e000 10000000:01000000:1.0:1787830838.425444:0:6466:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787830838.425448:0:6466:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8d2303f2e000 10000000:01000000:1.0:1787830838.425450:0:6466:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1787830838.425453:0:6466:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8d2303f2e000 from 1 10000000:01000000:1.0:1787830838.425456:0:6466:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1787830838.425485:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: 00000000af92423a/0x95459fb9d1d28402 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830838.425492:0:6466:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: 00000000af92423a/0x95459fb9d1d28402 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830838.425500:0:6466:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: 00000000af92423a/0x95459fb9d1d28402 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830838.425513:0:6466:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c9c778a6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:6466:1874676443775616:0@lo:101: 00000100:00100000:1.0:1787830838.425542:0:6466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830838.425555:0:6466:0:(client.c:2715:ptlrpc_set_wait()) set 000000002362d183 going to sleep for 11 seconds 00000100:00100000:2.0:1787830838.425682:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443775616 00000100:00100000:2.0:1787830838.425687:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443775616 00000100:00100000:2.0:1787830838.425706:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787830838.425711:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000054b8c7ec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+6:6466:x1874676443775616:12345-0@lo:101: 00010000:00010000:2.0:1787830838.425720:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787830838.425733:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d404d2cb/0x95459fb9d1d28409 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d28402 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830838.425749:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d404d2cb/0x95459fb9d1d28409 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d28402 expref: 7 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830838.425758:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d404d2cb/0x95459fb9d1d28409 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d28402 expref: 7 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830838.425766:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d404d2cb, rc 0) 00000100:00100000:2.0:1787830838.425800:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000054b8c7ec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+7:6466:x1874676443775616:12345-0@lo:101: Request processed in 89us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830838.425811:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787830838.425932:0:6466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c9c778a6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:6466:1874676443775616:0@lo:101: 00010000:00010000:1.0:1787830838.425943:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: 00000000af92423a/0x95459fb9d1d28402 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d28409 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830838.425950:0:6466:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: 00000000af92423a/0x95459fb9d1d28402 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d28409 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787830838.425962:0:6466:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1787830838.425984:0:6466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: 00000000af92423a/0x95459fb9d1d28402 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d28409 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830838.426001:0:6466:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: 00000000af92423a/0x95459fb9d1d28402 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d28409 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787830838.426007:0:6466:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787830838.426010:0:6466:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787830838.426014:0:6466:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8d2303f2e000 10000000:01000000:1.0:1787830838.426017:0:6466:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1787830838.426019:0:6466:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1787830838.426021:0:6466:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787830838.426034:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: 00000000b3b4d6a6/0x95459fb9d1d28410 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830838.426040:0:6466:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: 00000000b3b4d6a6/0x95459fb9d1d28410 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830838.426047:0:6466:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: 00000000b3b4d6a6/0x95459fb9d1d28410 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830838.426057:0:6466:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c9c778a6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:6466:1874676443775744:0@lo:101: 00000100:00100000:1.0:1787830838.426083:0:6466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830838.426106:0:6466:0:(client.c:2715:ptlrpc_set_wait()) set 000000002362d183 going to sleep for 11 seconds 00000100:00100000:0.0:1787830838.426164:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443775744 00000100:00100000:0.0:1787830838.426175:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443775744 00000100:00100000:0.0:1787830838.426206:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787830838.426212:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000db8aefa4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+7:6466:x1874676443775744:12345-0@lo:101: 00010000:00010000:0.0:1787830838.426220:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787830838.426228:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000303d313f/0x95459fb9d1d28417 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d28410 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830838.426242:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000303d313f/0x95459fb9d1d28417 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d28410 expref: 8 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830838.426250:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000303d313f/0x95459fb9d1d28417 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d28410 expref: 8 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830838.426257:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000303d313f, rc 0) 00000100:00100000:0.0:1787830838.426292:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000db8aefa4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+8:6466:x1874676443775744:12345-0@lo:101: Request processed in 81us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830838.426299:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787830838.426361:0:6466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c9c778a6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:6466:1874676443775744:0@lo:101: 00010000:00010000:1.0:1787830838.426371:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: 00000000b3b4d6a6/0x95459fb9d1d28410 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d28417 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830838.426378:0:6466:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: 00000000b3b4d6a6/0x95459fb9d1d28410 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d28417 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830838.426444:0:6466:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c9c778a6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:6466:1874676443775872:0@lo:501: 00000100:00100000:1.0:1787830838.426470:0:6466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830838.426489:0:6466:0:(client.c:2715:ptlrpc_set_wait()) set 000000002362d183 going to sleep for 11 seconds 00000100:00100000:2.0:1787830838.426542:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443775872 00000100:00100000:2.0:1787830838.426546:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443775872 00000100:00100000:2.0:1787830838.426575:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787830838.426582:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003498d26f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+8:6466:x1874676443775872:12345-0@lo:501: 00000100:00100000:2.0:1787830838.426738:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003498d26f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+9:6466:x1874676443775872:12345-0@lo:501: Request processed in 157us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830838.426745:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787830838.427045:0:6466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c9c778a6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:6466:1874676443775872:0@lo:501: 00000100:00100000:1.0:1787830838.427074:0:6466:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c9c778a6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:6466:1874676443776000:0@lo:503: 00000100:00100000:1.0:1787830838.427112:0:6466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830838.427141:0:6466:0:(client.c:2715:ptlrpc_set_wait()) set 000000002362d183 going to sleep for 11 seconds 00000100:00100000:0.0:1787830838.427201:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443776000 00000100:00100000:0.0:1787830838.427205:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443776000 00000100:00100000:0.0:1787830838.427235:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787830838.427241:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a62d11c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+9:6466:x1874676443776000:12345-0@lo:503: 00000100:00100000:0.0:1787830838.427327:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a62d11c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+9:6466:x1874676443776000:12345-0@lo:503: Request processed in 87us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830838.427334:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787830838.427412:0:6466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c9c778a6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:6466:1874676443776000:0@lo:503: 00000100:00100000:1.0:1787830838.428039:0:6512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c9c778a6 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:6512:1874676443776128:0@lo:502: 00000100:00100000:1.0:1787830838.428079:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830838.428110:0:6512:0:(client.c:2715:ptlrpc_set_wait()) set 0000000075a69264 going to sleep for 11 seconds 00000100:00100000:0.0:1787830838.428165:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443776128 00000100:00100000:0.0:1787830838.428170:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443776128 00000100:00100000:0.0:1787830838.428199:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787830838.428205:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000764e762e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+9:6512:x1874676443776128:12345-0@lo:502: 00000100:00100000:0.0:1787830838.428292:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000764e762e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+9:6512:x1874676443776128:12345-0@lo:502: Request processed in 87us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830838.428305:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787830838.428416:0:6512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c9c778a6 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:6512:1874676443776128:0@lo:502: 00000020:01000000:1.0:1787830838.428452:0:6512:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787830838.428464:0:6512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787830838.428467:0:6512:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787830838.428474:0:6512:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1787830838.428477:0:6512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787830838.428491:0:6512:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000e815bb3f) 00000020:00000080:1.0:1787830838.428508:0:6512:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1787830838.428513:0:6512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1787830838.428590:0:6512:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:1.0:1787830838.428596:0:6512:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x95459fb9d1d28425 00000020:00000080:1.0:1787830838.429061:0:6512:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1787830838.429067:0:6512:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787830838.429071:0:6512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787830838.429077:0:6512:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787830838.429081:0:6512:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787830838.429085:0:6512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787830838.429086:0:6512:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1787830838.429090:0:6512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787830838.429097:0:6512:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (0000000083c411b1) 00000020:00000080:1.0:1787830838.429107:0:6512:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1787830838.429111:0:6512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1787830838.429113:0:6512:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1787830838.429116:0:6512:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1787830838.429122:0:6512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787830838.429171:0:6512:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000ba8cc66a from lustre-MDT0000, refs=3 00000020:00000080:1.0:1787830838.429184:0:6512:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000087a0c7a) 00000020:00000080:1.0:1787830838.429191:0:6512:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1787830838.429260:0:6512:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1787830838.429266:0:6512:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x95459fb9d1d2843a 00000020:00000080:1.0:1787830838.429355:0:6512:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1787830838.429362:0:6512:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1787830838.429367:0:6512:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x95459fb9d1d28441 00080000:01000000:1.0:1787830838.429371:0:6512:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:1.0:1787830838.429374:0:6512:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x95459fb9d1d28448 00080000:10000000:1.0:1787830838.430415:0:6512:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:1.0:1787830838.432115:0:6512:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:2.0:1787830838.442301:0:6512:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:0.0:1787830838.533908:0:6512:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:0.0:1787830838.534279:0:6512:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:0.0:1787830838.536903:0:6512:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:0.0:1787830838.537271:0:6512:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1787830838.545131:0:6512:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000ff6da9fe) 00000020:00000080:0.0:1787830838.545157:0:6512:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1787830838.545237:0:6512:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:0.0:1787830838.545247:0:6512:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x95459fb9d1d28456 00000020:00000080:0.0:1787830838.546175:0:6512:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:0.0:1787830838.548059:0:6512:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:2.0:1787830838.559411:0:6512:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:3.0:1787830838.568358:0:6512:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:3.0:1787830838.573547:0:6512:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:3.0:1787830838.581398:0:6512:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:3.0:1787830838.585030:0:6512:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:3.0:1787830838.587129:0:6512:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x95459fb9d1d2845d 00000020:00000080:2.0:1787830838.588147:0:6512:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1787830838.588162:0:6512:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787830838.588169:0:6512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787830838.588172:0:6512:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1787830838.588175:0:6512:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787830838.588179:0:6512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787830838.588181:0:6512:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787830838.588184:0:6512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787830838.588185:0:6512:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787830838.588188:0:6512:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787830838.588190:0:6512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787830838.588192:0:6512:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787830838.588193:0:6512:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787830838.588199:0:6512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787830838.588200:0:6512:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1787830838.588203:0:6512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1787830838.588262:0:6512:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:2.0:1787830838.588332:0:6512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009bcaa052 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:6512:1874676443776256:0@lo:502: 00000100:00100000:2.0:1787830838.588433:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830838.588498:0:6512:0:(client.c:2715:ptlrpc_set_wait()) set 00000000789d41df going to sleep for 11 seconds 00000100:00100000:0.0:1787830838.589076:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443776256 00000100:00100000:0.0:1787830838.589084:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443776256 00000100:00100000:0.0:1787830838.589143:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787830838.589152:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004a3e794d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+9:6512:x1874676443776256:12345-0@lo:502: 00000100:00100000:0.0:1787830838.589297:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004a3e794d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+9:6512:x1874676443776256:12345-0@lo:502: Request processed in 145us (876us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830838.589305:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787830838.589391:0:6512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009bcaa052 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:6512:1874676443776256:0@lo:502: 00000020:01000000:2.0:1787830838.589436:0:6512:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787830838.589441:0:6512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787830838.589443:0:6512:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:2.0:1787830838.589447:0:6512:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:0.0:1787830838.589598:0:6466:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:0.0:1787830838.589620:0:6466:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787830838.589813:0:6466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: 00000000b3b4d6a6/0x95459fb9d1d28410 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d28417 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830838.589826:0:6466:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: 00000000b3b4d6a6/0x95459fb9d1d28410 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d28417 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787830838.589835:0:6466:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d2303f2e000 from 1 10000000:01000000:0.0:1787830838.589838:0:6466:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787830838.589877:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: 00000000efd67c6d/0x95459fb9d1d28464 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830838.589885:0:6466:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: 00000000efd67c6d/0x95459fb9d1d28464 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830838.589905:0:6466:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: 00000000efd67c6d/0x95459fb9d1d28464 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830838.589921:0:6466:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d076db49 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:6466:1874676443776384:0@lo:101: 00000100:00100000:0.0:1787830838.589956:0:6466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830838.590032:0:6466:0:(client.c:2715:ptlrpc_set_wait()) set 000000001fe9ea3f going to sleep for 11 seconds 00000100:00100000:0.0:1787830838.590052:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443776384 00000100:00100000:0.0:1787830838.590057:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443776384 00000100:00100000:0.0:1787830838.590082:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787830838.590089:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d7393bd6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+9:6466:x1874676443776384:12345-0@lo:101: 00010000:00010000:0.0:1787830838.590098:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787830838.590112:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b09a3b6e/0x95459fb9d1d2846b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d28464 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830838.590135:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b09a3b6e/0x95459fb9d1d2846b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d28464 expref: 10 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830838.590145:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b09a3b6e/0x95459fb9d1d2846b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d28464 expref: 10 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830838.590154:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b09a3b6e, rc 0) 00000100:00100000:0.0:1787830838.590185:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d7393bd6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+10:6466:x1874676443776384:12345-0@lo:101: Request processed in 97us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830838.590191:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787830838.590231:0:6466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d076db49 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:6466:1874676443776384:0@lo:101: 00010000:00010000:0.0:1787830838.590245:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: 00000000efd67c6d/0x95459fb9d1d28464 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2846b expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830838.590252:0:6466:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: 00000000efd67c6d/0x95459fb9d1d28464 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d2846b expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830838.591246:0:6466:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d076db49 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:6466:1874676443776512:0@lo:256: 00000100:00100000:0.0:1787830838.591292:0:6466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830838.591322:0:6466:0:(client.c:2715:ptlrpc_set_wait()) set 000000001fe9ea3f going to sleep for 11 seconds 00000100:00100000:3.0:1787830838.591327:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443776512 00000100:00100000:3.0:1787830838.591338:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443776512 00000100:00100000:3.0:1787830838.591372:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787830838.591388:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000026807dc1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+10:6466:x1874676443776512:12345-0@lo:256: 20000000:01000000:3.0:1787830838.591404:0:6484:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1787830838.591410:0:6484:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1787830838.591497:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000026807dc1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+10:6466:x1874676443776512:12345-0@lo:256: Request processed in 119us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830838.591504:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787830838.591510:0:6466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d076db49 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:6466:1874676443776512:0@lo:256: 10000000:01000000:0.0:1787830838.592216:0:6466:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787830838.592230:0:6466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: 00000000efd67c6d/0x95459fb9d1d28464 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2846b expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830838.592236:0:6466:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: 00000000efd67c6d/0x95459fb9d1d28464 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2846b expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787830838.592241:0:6466:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d2303f2e000 from 1 10000000:01000000:0.0:1787830838.592244:0:6466:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787830838.592261:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: 0000000004129782/0x95459fb9d1d28472 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830838.592265:0:6466:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: 0000000004129782/0x95459fb9d1d28472 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830838.592272:0:6466:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: 0000000004129782/0x95459fb9d1d28472 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830838.593725:0:6466:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d076db49 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:6466:1874676443776640:0@lo:101: 00000100:00100000:0.0:1787830838.593797:0:6466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830838.593834:0:6466:0:(client.c:2715:ptlrpc_set_wait()) set 000000001fe9ea3f going to sleep for 11 seconds 00000100:00100000:1.0:1787830838.593951:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443776640 00000100:00100000:1.0:1787830838.593960:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443776640 00000100:00100000:1.0:1787830838.594023:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787830838.594031:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002c46b1ce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+10:6466:x1874676443776640:12345-0@lo:101: 00010000:00010000:1.0:1787830838.594046:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787830838.594066:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009eba67ea/0x95459fb9d1d28479 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d28472 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830838.594092:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009eba67ea/0x95459fb9d1d28479 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d28472 expref: 11 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830838.594114:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009eba67ea/0x95459fb9d1d28479 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d28472 expref: 11 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830838.594123:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009eba67ea, rc 0) 00000100:00100000:1.0:1787830838.594163:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002c46b1ce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+11:6466:x1874676443776640:12345-0@lo:101: Request processed in 133us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830838.594169:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787830838.594250:0:6466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d076db49 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:6466:1874676443776640:0@lo:101: 00010000:00010000:0.0:1787830838.594263:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: 0000000004129782/0x95459fb9d1d28472 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d28479 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830838.594268:0:6466:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: 0000000004129782/0x95459fb9d1d28472 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d28479 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830838.594377:0:6466:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d076db49 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:6466:1874676443776768:0@lo:501: 00000100:00100000:0.0:1787830838.594398:0:6466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830838.594414:0:6466:0:(client.c:2715:ptlrpc_set_wait()) set 000000001fe9ea3f going to sleep for 11 seconds 00000100:00100000:3.0:1787830838.594486:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443776768 00000100:00100000:3.0:1787830838.594491:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443776768 00000100:00100000:3.0:1787830838.594521:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787830838.594527:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000ff2579e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+11:6466:x1874676443776768:12345-0@lo:501: 00000100:00100000:3.0:1787830838.594764:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000ff2579e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+11:6466:x1874676443776768:12345-0@lo:501: Request processed in 238us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830838.594764:0:6466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d076db49 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:6466:1874676443776768:0@lo:501: 00000100:00100000:3.0:1787830838.594772:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787830838.594791:0:6466:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d076db49 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:6466:1874676443776896:0@lo:503: 00000100:00100000:0.0:1787830838.594827:0:6466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830838.594851:0:6466:0:(client.c:2715:ptlrpc_set_wait()) set 000000001fe9ea3f going to sleep for 11 seconds 00000100:00100000:1.0:1787830838.594869:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443776896 00000100:00100000:1.0:1787830838.594873:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443776896 00000100:00100000:1.0:1787830838.594897:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787830838.594903:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ab5028ae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+11:6466:x1874676443776896:12345-0@lo:503: 00000040:00080000:1.0:1787830838.594935:0:6483:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787830838.594989:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ab5028ae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+11:6466:x1874676443776896:12345-0@lo:503: Request processed in 87us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830838.594997:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787830838.595021:0:6466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d076db49 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:6466:1874676443776896:0@lo:503: 00000040:00080000:2.0:1787830838.596576:0:6516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:0.0:1787830838.596715:0:6466:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1787830838.596745:0:6466:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787830838.596768:0:6466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: 0000000004129782/0x95459fb9d1d28472 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d28479 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830838.596779:0:6466:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: 0000000004129782/0x95459fb9d1d28472 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d28479 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787830838.596840:0:6466:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787830838.596852:0:6466:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d2303f2e000 10000000:01000000:0.0:1787830838.596855:0:6466:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d2303f2e000 10000000:01000000:0.0:1787830838.596859:0:6466:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787830838.596864:0:6466:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d2303f2e000 from 1 10000000:01000000:0.0:1787830838.596867:0:6466:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787830838.597291:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: 00000000f5f86de2/0x95459fb9d1d28480 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830838.597301:0:6466:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: 00000000f5f86de2/0x95459fb9d1d28480 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830838.597311:0:6466:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: 00000000f5f86de2/0x95459fb9d1d28480 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830838.597333:0:6466:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000074217877 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:6466:1874676443777024:0@lo:101: 00000100:00100000:0.0:1787830838.597401:0:6466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830838.597461:0:6466:0:(client.c:2715:ptlrpc_set_wait()) set 000000008ce877c6 going to sleep for 11 seconds 00000100:00100000:3.0:1787830838.597462:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443777024 00000100:00100000:3.0:1787830838.597469:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443777024 00000100:00100000:3.0:1787830838.597515:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787830838.597523:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000832ec338 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+11:6466:x1874676443777024:12345-0@lo:101: 00010000:00010000:3.0:1787830838.597535:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787830838.597551:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009b2f1a89/0x95459fb9d1d28487 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d28480 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830838.597573:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009b2f1a89/0x95459fb9d1d28487 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d28480 expref: 12 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830838.597584:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009b2f1a89/0x95459fb9d1d28487 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d28480 expref: 12 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830838.597605:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009b2f1a89, rc 0) 00000100:00100000:3.0:1787830838.597680:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000832ec338 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+12:6466:x1874676443777024:12345-0@lo:101: Request processed in 157us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830838.597891:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787830838.598133:0:6466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000074217877 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:6466:1874676443777024:0@lo:101: 00010000:00010000:2.0:1787830838.598149:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: 00000000f5f86de2/0x95459fb9d1d28480 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d28487 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830838.598160:0:6466:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: 00000000f5f86de2/0x95459fb9d1d28480 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d28487 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830838.598220:0:6466:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009bcaa052 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:6466:1874676443777152:0@lo:501: 00000100:00100000:2.0:1787830838.598251:0:6466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830838.598340:0:6466:0:(client.c:2715:ptlrpc_set_wait()) set 0000000067cf9a5f going to sleep for 11 seconds 00000100:00100000:1.0:1787830838.598385:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443777152 00000100:00100000:1.0:1787830838.598389:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443777152 00000100:00100000:1.0:1787830838.598414:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787830838.598421:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e12c70ca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+12:6466:x1874676443777152:12345-0@lo:501: 00000100:00100000:1.0:1787830838.598553:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e12c70ca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+12:6466:x1874676443777152:12345-0@lo:501: Request processed in 132us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830838.598560:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787830838.598603:0:6466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009bcaa052 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:6466:1874676443777152:0@lo:501: 00000100:00100000:2.0:1787830838.598647:0:6466:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009bcaa052 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:6466:1874676443777280:0@lo:503: 00000100:00100000:2.0:1787830838.598680:0:6466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830838.598707:0:6466:0:(client.c:2715:ptlrpc_set_wait()) set 0000000067cf9a5f going to sleep for 11 seconds 00000100:00100000:3.0:1787830838.598762:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443777280 00000100:00100000:3.0:1787830838.598767:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443777280 00000100:00100000:3.0:1787830838.598789:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787830838.598795:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000065fb890c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+12:6466:x1874676443777280:12345-0@lo:503: 00000100:00100000:3.0:1787830838.598884:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000065fb890c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+12:6466:x1874676443777280:12345-0@lo:503: Request processed in 89us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830838.598891:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787830838.599038:0:6466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009bcaa052 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:6466:1874676443777280:0@lo:503: 00000100:00100000:2.0:1787830838.599415:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009bcaa052 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:6517:1874676443777408:0@lo:502: 00000100:00100000:2.0:1787830838.599452:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830838.599480:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set 0000000018e5a04a going to sleep for 11 seconds 00000100:00100000:1.0:1787830838.599507:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443777408 00000100:00100000:1.0:1787830838.599513:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443777408 00000100:00100000:1.0:1787830838.599544:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787830838.599550:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a38e6e3e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+12:6517:x1874676443777408:12345-0@lo:502: 00000100:00100000:1.0:1787830838.599662:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a38e6e3e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+12:6517:x1874676443777408:12345-0@lo:502: Request processed in 112us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830838.599669:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787830838.599867:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009bcaa052 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:6517:1874676443777408:0@lo:502: 00000020:01000004:2.0:1787830838.599924:0:6517:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1787830838.599939:0:6517:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000bef2968e) 00000020:00000080:2.0:1787830838.599956:0:6517:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:2.0:1787830838.600056:0:6517:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000ba8cc66a from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787830838.600060:0:6517:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000ba8cc66a from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787830838.600063:0:6517:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000ba8cc66a 4 00010000:00080000:2.0:1787830838.600091:0:6517:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000098798312@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.131@tcp at head 00010000:00010000:2.0:1787830838.601779:0:6517:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:2.0:1787830838.602005:0:6517:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1787830838.602046:0:6517:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787830838.602061:0:6517:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x95459fb9d1d28495 00000100:00080000:2.0:1787830838.602071:0:6517:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787830838.602076:0:6517:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000098798312 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:2.0:1787830838.602113:0:6517:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000009bcaa052 x1874676443777536/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787830838.602199:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009bcaa052 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874676443777536:0@lo:38: 00000100:00100000:1.0:1787830838.602275:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787830838.602351:0:6517:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787830838.602450:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443777536 00000100:00100000:3.0:1787830838.602459:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443777536 00000100:00100000:3.0:1787830838.602500:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787830838.602507:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c9c778a6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3618:x1874676443777536:12345-0@lo:38: 00000100:00100000:3.0:1787830838.602663:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c9c778a6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3618:x1874676443777536:12345-0@lo:38: Request processed in 151us (385us total) trans 0 rc -11/-11 00000100:00100000:3.0:1787830838.602672:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787830838.602717:0:3618:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787830838.602725:0:3618:0:(import.c:65:import_set_state_nolock()) 0000000098798312 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787830838.602729:0:3618:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1787830838.602732:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009bcaa052 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874676443777536:0@lo:38: 00000100:00100000:0.0:1787830838.604142:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009174c7c3 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:6517:1874676443777664:0@lo:502: 00000100:00100000:0.0:1787830838.604216:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830838.604265:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set 0000000039600295 going to sleep for 11 seconds 00000100:00100000:3.0:1787830838.604283:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443777664 00000100:00100000:3.0:1787830838.604290:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443777664 00000100:00100000:3.0:1787830838.604347:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787830838.604355:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000179ca2c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+12:6517:x1874676443777664:12345-0@lo:502: 00000100:00100000:3.0:1787830838.604504:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000179ca2c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+12:6517:x1874676443777664:12345-0@lo:502: Request processed in 150us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830838.604520:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787830838.604528:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009174c7c3 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:6517:1874676443777664:0@lo:502: 00000040:00080000:0.0:1787830838.604553:0:6517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:1.0:1787830838.604771:0:6466:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:1.0:1787830838.604793:0:6466:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787830838.604814:0:6466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: 00000000f5f86de2/0x95459fb9d1d28480 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d28487 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830838.604826:0:6466:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: 00000000f5f86de2/0x95459fb9d1d28480 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d28487 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787830838.604875:0:6466:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787830838.604878:0:6466:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787830838.604879:0:6466:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787830838.604881:0:6466:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787830838.604882:0:6466:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787830838.604883:0:6466:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787830838.604885:0:6466:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787830838.604886:0:6466:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787830838.604888:0:6466:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787830838.604889:0:6466:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787830838.604891:0:6466:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787830838.604893:0:6466:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787830838.604897:0:6466:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:1.0:1787830838.604900:0:6466:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787830838.604906:0:6466:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787830838.604907:0:6466:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787830838.604908:0:6466:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787830838.604909:0:6466:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787830838.604910:0:6466:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787830838.604911:0:6466:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787830838.604912:0:6466:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787830838.604914:0:6466:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787830838.604915:0:6466:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787830838.604915:0:6466:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787830838.604916:0:6466:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787830838.604932:0:6466:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1787830838.604943:0:6466:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001faa995b pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:6466:1874676443777792:0@lo:253: 00000100:00100000:1.0:1787830838.604992:0:6466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830838.605017:0:6466:0:(client.c:2715:ptlrpc_set_wait()) set 0000000063189d35 going to sleep for 11 seconds 00000100:00100000:3.0:1787830838.605188:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443777792 00000100:00100000:3.0:1787830838.605200:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443777792 00000100:00100000:3.0:1787830838.605269:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787830838.605277:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fb610e44 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+12:6466:x1874676443777792:12345-0@lo:253: 20000000:01000000:3.0:1787830838.605299:0:6484:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1787830838.605314:0:6484:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1787830838.613462:0:6484:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787830838.613481:0:6484:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1787830838.613798:0:6506:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787830838.613805:0:6506:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787830838.613829:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000634d5a22/0x95459fb9d1d2849c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830838.613849:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000b09a3b6e/0x95459fb9d1d2846b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d28464 expref: 12 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830838.613858:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000634d5a22/0x95459fb9d1d2849c lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830838.613902:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000b09a3b6e/0x95459fb9d1d2846b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x95459fb9d1d28464 expref: 12 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830838.613927:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000b09a3b6e/0x95459fb9d1d2846b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x95459fb9d1d28464 expref: 12 pid: 6484 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830838.613944:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005798b581 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6506:1874676443777920:0@lo:104: 00000100:00100000:2.0:1787830838.614034:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830838.614095:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set 00000000789d41df going to sleep for 11 seconds 00000100:00100000:3.0:1787830838.614827:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443777920 00000100:00100000:3.0:1787830838.614836:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443777920 00000100:00100000:3.0:1787830838.614898:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787830838.614908:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000018418cd0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a45944b-32e3-4193-a2a5-46f84222bc14+3:6506:x1874676443777920:12345-0@lo:104: 00010000:00010000:3.0:1787830838.614923:0:6473:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: 00000000efd67c6d/0x95459fb9d1d28464 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d2846b expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830838.615033:0:6473:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787830838.615040:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000018418cd0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a45944b-32e3-4193-a2a5-46f84222bc14+3:6506:x1874676443777920:12345-0@lo:104: Request processed in 134us (1006us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830838.615047:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1787830838.615147:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787830838.615155:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: 00000000efd67c6d/0x95459fb9d1d28464 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d2846b expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830838.615165:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000efd67c6d already unused, calling callback (00000000bc230e97) 10000000:00010000:0.0:1787830838.615169:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: 00000000efd67c6d/0x95459fb9d1d28464 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x95459fb9d1d2846b expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830838.615187:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: 00000000efd67c6d/0x95459fb9d1d28464 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x95459fb9d1d2846b expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787830838.615195:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: 00000000efd67c6d/0x95459fb9d1d28464 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x95459fb9d1d2846b expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830838.615202:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005798b581 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6506:1874676443777920:0@lo:104: 10000000:01000000:0.0:1787830838.615202:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787830838.615232:0:6506:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000634d5a22/0x95459fb9d1d2849c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830838.615242:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: 00000000efd67c6d/0x95459fb9d1d28464 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d2846b expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830838.615250:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787830838.615280:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: 00000000efd67c6d/0x95459fb9d1d28464 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d2846b expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830838.615286:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: 00000000efd67c6d/0x95459fb9d1d28464 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d2846b expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830838.615303:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830838.615305:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830838.615306:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787830838.615335:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009174c7c3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a45944b-32e3-4193-a2a5-46f84222bc14:3620:1874676443778048:0@lo:103: 00000100:00100000:0.0:1787830838.615373:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fb610e44 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+12:6466:x1874676443777792:12345-0@lo:253: Request processed in 10096us (10379us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830838.615385:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787830838.615387:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830838.615446:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443778048 00000100:00100000:0.0:1787830838.615450:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443778048 00010000:00010000:0.0:1787830838.615470:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000b09a3b6e/0x95459fb9d1d2846b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d28464 expref: 12 pid: 6484 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830838.615501:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787830838.615508:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009dc45cc1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a45944b-32e3-4193-a2a5-46f84222bc14+12:3620:x1874676443778048:12345-0@lo:103: 00010000:00010000:0.0:1787830838.615526:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787830838.615532:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000b09a3b6e/0x95459fb9d1d2846b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d28464 expref: 12 pid: 6484 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830838.615543:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000b09a3b6e/0x95459fb9d1d2846b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x95459fb9d1d28464 expref: 12 pid: 6484 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830838.615552:0:6466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001faa995b pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:6466:1874676443777792:0@lo:253: 00010000:00010000:0.0:1787830838.615559:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b09a3b6e/0x95459fb9d1d2846b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x95459fb9d1d28464 expref: 12 pid: 6484 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787830838.615565:0:6466:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1787830838.615570:0:6466:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787830838.615572:0:6466:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787830838.615574:0:6466:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787830838.615576:0:6466:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787830838.615578:0:6466:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787830838.615579:0:6466:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787830838.615581:0:6466:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787830838.615582:0:6466:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787830838.615584:0:6466:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00010000:00010000:0.0:1787830838.615584:0:6475:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000634d5a22/0x95459fb9d1d2849c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787830838.615588:0:6466:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787830838.615590:0:6466:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787830838.615593:0:6466:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00010000:00010000:0.0:1787830838.615597:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000634d5a22/0x95459fb9d1d2849c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:02000000:1.0:1787830838.615607:0:6466:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:0.0:1787830838.615613:0:6475:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001809636s 00010000:00010000:0.0:1787830838.615618:0:6475:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000634d5a22/0x95459fb9d1d2849c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830838.615647:0:6475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000634d5a22/0x95459fb9d1d2849c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830838.615654:0:6475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000634d5a22/0x95459fb9d1d2849c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830838.615660:0:6475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000634d5a22/0x95459fb9d1d2849c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830838.615665:0:6475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000634d5a22 already unused, calling callback (00000000f4040125) 00010000:00010000:0.0:1787830838.615669:0:6475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000634d5a22/0x95459fb9d1d2849c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830838.615682:0:6475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000634d5a22/0x95459fb9d1d2849c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830838.615701:0:6475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000634d5a22/0x95459fb9d1d2849c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830838.615711:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787830838.615747:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009dc45cc1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a45944b-32e3-4193-a2a5-46f84222bc14+11:3620:x1874676443778048:12345-0@lo:103: Request processed in 240us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830838.615754:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787830838.615769:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009174c7c3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a45944b-32e3-4193-a2a5-46f84222bc14:3620:1874676443778048:0@lo:103: 00010000:00010000:3.0:1787830838.615804:0:6506:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000634d5a22/0x95459fb9d1d2849c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830838.615811:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000634d5a22/0x95459fb9d1d2849c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830838.615816:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000634d5a22/0x95459fb9d1d2849c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:0.0:1787830838.629717:0:6466:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:0.0:1787830838.629892:0:6466:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1787830838.630255:0:6466:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:0.0:1787830838.630492:0:6466:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1787830838.630818:0:6466:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:0.0:1787830838.631098:0:6466:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:1.0:1787830838.632531:0:6466:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:1.0:1787830838.632893:0:6466:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:0.0:1787830838.633620:0:6466:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:0.0:1787830838.633830:0:6466:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:0.0:1787830838.634802:0:6466:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:0.0:1787830838.635046:0:6466:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:2.0:1787830838.643871:0:6466:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:3.0:1787830838.658476:0:6466:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1787830838.658841:0:6522:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:2.0:1787830838.658846:0:6522:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:0.0:1787830838.659038:0:6523:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:00080000:0.0:1787830838.661543:0:6523:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:3.0:1787830838.664748:0:6466:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1787830838.665538:0:6466:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1787830838.668693:0:6466:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1787830838.668717:0:6466:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1787830838.669194:0:6466:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787830838.670621:0:6466:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1787830838.671580:0:6466:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1787830838.671895:0:6466:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1787830838.673374:0:6466:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1787830838.673687:0:6466:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00000040:00080000:0.0:1787830838.674018:0:6523:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1787830838.674088:0:6523:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1787830838.674092:0:6523:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00100000:10000000:2.0:1787830838.680526:0:6466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1787830838.680688:0:6466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1787830838.680820:0:6466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1787830838.681073:0:6466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1787830838.681188:0:6466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1787830838.681309:0:6466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1787830838.681434:0:6466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1787830838.681561:0:6466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1787830838.681818:0:6466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1787830838.682165:0:6466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1787830838.682295:0:6466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:2.0:1787830838.682430:0:6466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1787830838.682578:0:6466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1787830838.682810:0:6466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1787830838.683220:0:6466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1787830838.683352:0:6466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1787830838.683846:0:6466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1787830838.684034:0:6466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1787830838.684152:0:6466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:2.0:1787830838.684284:0:6466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:2.0:1787830838.684377:0:6466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1787830838.684729:0:6466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:2.0:1787830838.684837:0:6466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:2.0:1787830838.684953:0:6466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:2.0:1787830838.685106:0:6466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:2.0:1787830838.685267:0:6466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:2.0:1787830838.685366:0:6466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:2.0:1787830838.685774:0:6466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:2.0:1787830838.685864:0:6466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:2.0:1787830838.686027:0:6466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1787830838.686172:0:6466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1787830838.686263:0:6466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1787830838.686411:0:6466:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:0.0:1787830838.692129:0:6466:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1787830838.692174:0:6466:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffae38c1c7b988 00100000:10000000:0.0:1787830838.692184:0:6466:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1787830838.692785:0:6466:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787830838.692803:0:6466:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.131@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787830838.692821:0:6466:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=45 00000080:00000004:1.0:1787830838.692847:0:6466:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:1.0:1787830838.693601:0:6466:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787830838.693837:0:6466:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:0.0:1787830839.206874:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787830840.241714:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830841.260730:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787830842.278737:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787830843.275563:0:6767:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg331-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787830843.309762:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787830843.753081:0:478:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1787830843.753091:0:478:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787830843.753095:0:478:0:(import.c:65:import_set_state_nolock()) 0000000098798312 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787830843.753110:0:478:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000098798312 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:0.0:1787830843.753137:0:478:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000014591d5e x1874676443778304/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787830843.753181:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000014591d5e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874676443778304:0@lo:38: 00000100:00100000:0.0:1787830843.753269:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830843.753514:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ea853ee5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a45944b-32e3-4193-a2a5-46f84222bc14:3621:1874676443778176:0@lo:400: 00000100:00100000:2.0:1787830843.753550:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830843.753759:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443778304 00000100:00100000:2.0:1787830843.753767:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443778304 00000100:00100000:2.0:1787830843.753805:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787830843.753812:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000078082a11 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3618:x1874676443778304:12345-0@lo:38: 00010000:00080000:2.0:1787830843.753838:0:6492:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 134 last 0 00000020:00000080:2.0:1787830843.753879:0:6492:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x95459fb9d1d284a3 00000004:00100000:2.0:1787830843.753921:0:6492:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787830843.754092:0:6492:0:(import.c:65:import_set_state_nolock()) 00000000246e8cc9 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787830843.754157:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000078082a11 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874676443778304:12345-0@lo:38: Request processed in 344us (889us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830843.754165:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787830843.754227:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000014591d5e x1874676443778304/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787830853 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787830843.754243:0:3618:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1787830843.754251:0:3618:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1787830843.754256:0:3618:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787830843.754258:0:3618:0:(import.c:65:import_set_state_nolock()) 0000000098798312 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787830843.754266:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000014591d5e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874676443778304:0@lo:38: 00000100:00100000:0.0:1787830843.764204:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443778176 00000100:00100000:0.0:1787830843.764221:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443778176 00000100:00100000:0.0:1787830843.766515:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787830843.766532:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000070e501fc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+11:3621:x1874676443778176:12345-0@lo:400: 00000100:00100000:0.0:1787830843.766831:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000070e501fc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+11:3621:x1874676443778176:12345-0@lo:400: Request processed in 304us (13280us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830843.766840:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787830843.767053:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ea853ee5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a45944b-32e3-4193-a2a5-46f84222bc14:3621:1874676443778176:0@lo:400: 00010000:00010000:2.0:1787830844.326791:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787830844.425281:0:6820:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787830844.425425:0:6820:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787830845.356602:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787830846.374728:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787830847.012302:0:6921:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787830847.012483:0:6921:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787830847.398843:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787830848.230724:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787830848.230734:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d2303f2e000 from 3 10000000:01000000:0.0:1787830848.230740:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787830848.230792:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: 00000000efd67c6d/0x95459fb9d1d284aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830848.230806:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: 00000000efd67c6d/0x95459fb9d1d284aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830848.230818:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: 00000000efd67c6d/0x95459fb9d1d284aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830848.230864:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007c635cd2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443778432:0@lo:101: 00000100:00100000:0.0:1787830848.230964:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830848.231031:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set 0000000033744915 going to sleep for 11 seconds 00000100:00100000:3.0:1787830848.232295:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443778432 00000100:00100000:3.0:1787830848.232314:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443778432 00000100:00100000:3.0:1787830848.233116:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787830848.233128:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c3a4c14e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+11:6487:x1874676443778432:12345-0@lo:101: 00010000:00010000:3.0:1787830848.233149:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787830848.233171:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007b29eb53/0x95459fb9d1d284b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d284aa expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830848.233202:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007b29eb53/0x95459fb9d1d284b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d284aa expref: 12 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830848.233223:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007b29eb53/0x95459fb9d1d284b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d284aa expref: 12 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830848.233233:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007b29eb53, rc 0) 00000100:00100000:3.0:1787830848.233329:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c3a4c14e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+12:6487:x1874676443778432:12345-0@lo:101: Request processed in 204us (2366us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830848.233336:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787830848.233683:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007c635cd2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443778432:0@lo:101: 00010000:00010000:1.0:1787830848.233704:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: 00000000efd67c6d/0x95459fb9d1d284aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d284b1 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830848.233713:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: 00000000efd67c6d/0x95459fb9d1d284aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d284b1 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830848.233786:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a3bae1d3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443778560:0@lo:256: 00000100:00100000:1.0:1787830848.233824:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830848.233860:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fb760562 going to sleep for 11 seconds 00000100:00100000:0.0:1787830848.234089:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443778560 00000100:00100000:0.0:1787830848.234094:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443778560 00000100:00100000:0.0:1787830848.234134:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787830848.234139:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009b645d0d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+12:6487:x1874676443778560:12345-0@lo:256: 20000000:01000000:0.0:1787830848.234159:0:6485:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787830848.234179:0:6485:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787830848.234182:0:6485:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1787830848.234273:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009b645d0d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+12:6487:x1874676443778560:12345-0@lo:256: Request processed in 134us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830848.234288:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787830848.234518:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a3bae1d3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443778560:0@lo:256: 10000000:01000000:1.0:1787830848.234902:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787830848.234919:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: 00000000efd67c6d/0x95459fb9d1d284aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d284b1 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830848.234929:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: 00000000efd67c6d/0x95459fb9d1d284aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d284b1 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830848.424073:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787830849.255919:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007e8ad348 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a45944b-32e3-4193-a2a5-46f84222bc14:3622:1874676443778688:0@lo:400: 00000100:00100000:0.0:1787830849.255958:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ea853ee5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874676443778816:0@lo:400: 00000100:00100000:2.0:1787830849.256020:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830849.256020:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830849.256074:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443778816 00000100:00100000:3.0:1787830849.256083:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443778816 00000100:00100000:3.0:1787830849.256139:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787830849.256154:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000014591d5e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874676443778816:12345-0@lo:400: 00000100:00100000:3.0:1787830849.256427:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000014591d5e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874676443778816:12345-0@lo:400: Request processed in 274us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830849.256435:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787830849.256468:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000ea853ee5 x1874676443778816/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830865 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787830849.256475:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443778688 00000100:00100000:3.0:1787830849.256481:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443778688 00000100:00100000:0.0:1787830849.256487:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ea853ee5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874676443778816:0@lo:400: 00000100:00100000:3.0:1787830849.256521:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787830849.256530:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d5c76bbd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+12:3622:x1874676443778688:12345-0@lo:400: 00000100:00100000:3.0:1787830849.256571:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d5c76bbd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+12:3622:x1874676443778688:12345-0@lo:400: Request processed in 44us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830849.256577:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787830849.257219:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007e8ad348 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a45944b-32e3-4193-a2a5-46f84222bc14:3622:1874676443778688:0@lo:400: 00010000:00010000:3.0:1787830849.447188:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787830850.474477:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787830851.494964:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787830852.518886:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787830853.542823:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787830854.374771:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787830854.374798:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001faa995b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a45944b-32e3-4193-a2a5-46f84222bc14:3619:1874676443778944:0@lo:400: 00000100:00100000:1.0:1787830854.374890:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830854.374956:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009b1336ac pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3621:1874676443779072:0@lo:400: 00000100:00100000:2.0:1787830854.375241:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443778944 00000100:00100000:2.0:1787830854.375256:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443778944 00000100:00100000:2.0:1787830854.375306:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787830854.375315:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008e70eb73 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+12:3619:x1874676443778944:12345-0@lo:400: 00000100:00100000:2.0:1787830854.375374:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008e70eb73 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+12:3619:x1874676443778944:12345-0@lo:400: Request processed in 62us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830854.375381:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787830854.376255:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830854.376307:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443779072 00000100:00100000:2.0:1787830854.376313:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443779072 00000100:00100000:1.0:1787830854.376338:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001faa995b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a45944b-32e3-4193-a2a5-46f84222bc14:3619:1874676443778944:0@lo:400: 00000100:00100000:2.0:1787830854.376358:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787830854.376366:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007fe45484 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1874676443779072:12345-0@lo:400: 00000100:00100000:2.0:1787830854.376422:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007fe45484 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1874676443779072:12345-0@lo:400: Request processed in 59us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830854.376429:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787830854.377465:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000009b1336ac x1874676443779072/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830870 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787830854.377479:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009b1336ac pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3621:1874676443779072:0@lo:400: 00010000:00010000:3.0:1787830854.566831:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787830855.597346:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830856.614804:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787830856.994127:0:7419:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787830856.994132:0:7419:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:2.0:1787830856.994134:0:7419:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1787830856.994552:0:7419:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000008d3a5259 00000020:01000004:2.0:1787830856.994569:0:7419:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:2.0:1787830856.994580:0:7419:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1787830856.994594:0:7419:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (0000000092c8f9e5) 00000020:00000080:2.0:1787830856.994757:0:7419:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1787830857.045889:0:7419:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:3.0:1787830857.045985:0:7419:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:0.0:1787830857.073814:0:7419:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1787830857.074059:0:7419:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:0.0:1787830857.074070:0:7419:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787830857.074082:0:7419:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x95459fb9d1d284bf 00000020:01000004:0.0:1787830857.074089:0:7419:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:0.0:1787830857.074118:0:7419:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.131@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1787830857.074121:0:7419:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.131@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1787830857.074129:0:7419:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:0.0:1787830857.074157:0:7419:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:0.0:1787830857.074161:0:7419:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.131@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:2.0:1787830857.108029:0:7419:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.131@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787830857.108069:0:7419:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.131@tcp, index=0001, flags=0x20061 00000020:01000004:2.0:1787830857.108074:0:7419:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787830857.108076:0:7419:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787830857.108077:0:7419:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787830857.108078:0:7419:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787830857.108080:0:7419:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787830857.108081:0:7419:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787830857.108083:0:7419:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787830857.108084:0:7419:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787830857.108085:0:7419:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787830857.108090:0:7419:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787830857.108092:0:7419:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787830857.108148:0:7419:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:2.0:1787830857.108150:0:7419:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787830857.108151:0:7419:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787830857.108152:0:7419:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787830857.108153:0:7419:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787830857.108154:0:7419:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787830857.108155:0:7419:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787830857.108155:0:7419:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787830857.108156:0:7419:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787830857.108157:0:7419:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787830857.108158:0:7419:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787830857.108159:0:7419:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787830857.108186:0:7419:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1787830857.108203:0:7419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000010d5b07f pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:7419:1874676443779200:0@lo:253: 00000100:00100000:2.0:1787830857.108342:0:7419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830857.108446:0:7419:0:(client.c:2715:ptlrpc_set_wait()) set 000000009925ee9f going to sleep for 11 seconds 00000100:00100000:0.0:1787830857.108591:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443779200 00000100:00100000:0.0:1787830857.108599:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443779200 00000100:00100000:2.0:1787830857.108891:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787830857.108903:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000753f219b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+12:7419:x1874676443779200:12345-0@lo:253: 20000000:01000000:2.0:1787830857.108949:0:6484:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1787830857.108954:0:6484:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:2.0:1787830857.108959:0:6484:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:2.0:1787830857.108962:0:6484:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:2.0:1787830857.109001:0:6484:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:2.0:1787830857.109202:0:6484:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787830857.109411:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:2.0:1787830857.109426:0:6484:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1787830857.109442:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:2.0:1787830857.109458:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:2.0:1787830857.109473:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:2.0:1787830857.109530:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:2.0:1787830857.109538:0:6484:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:2.0:1787830857.109553:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:2.0:1787830857.109567:0:6484:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:2.0:1787830857.109586:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:2.0:1787830857.109591:0:6484:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:2.0:1787830857.109604:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:2.0:1787830857.109620:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:2.0:1787830857.109769:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:2.0:1787830857.109836:0:6484:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.131@tcp (null) (null) (null) 00000040:00080000:2.0:1787830857.109864:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:2.0:1787830857.109872:0:6484:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1787830857.109886:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:2.0:1787830857.109892:0:6484:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.203.131@tcp (null) (null) 00000040:00080000:2.0:1787830857.109905:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:2.0:1787830857.109911:0:6484:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1787830857.109923:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:2.0:1787830857.109939:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:2.0:1787830857.109950:0:6484:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:2.0:1787830857.110032:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:2.0:1787830857.110042:0:6484:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:2.0:1787830857.110056:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:2.0:1787830857.110073:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:2.0:1787830857.110089:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:2.0:1787830857.110095:0:6484:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:2.0:1787830857.110107:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:2.0:1787830857.110127:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:2.0:1787830857.110133:0:6484:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:2.0:1787830857.110152:0:6484:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1787830857.110158:0:6484:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:0.0:1787830857.113250:0:7425:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:2.0:1787830857.113540:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:2.0:1787830857.113570:0:6484:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.131@tcp for mdt 20000000:01000000:2.0:1787830857.113573:0:6484:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.131@tcp (null) (null) (null) 00000040:00080000:2.0:1787830857.113601:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:2.0:1787830857.113608:0:6484:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1787830857.113836:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:2.0:1787830857.113915:0:6484:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.203.131@tcp (null) (null) 00000040:00080000:2.0:1787830857.113943:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:2.0:1787830857.113952:0:6484:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:2.0:1787830857.113966:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:2.0:1787830857.114432:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:2.0:1787830857.114499:0:6484:0:(mgs_llog.c:3435:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:2.0:1787830857.114509:0:6484:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:0.0:1787830857.115328:0:7426:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:2.0:1787830857.115582:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:2.0:1787830857.115605:0:6484:0:(mgs_llog.c:3493:mgs_write_log_osp_to_mdt()) add nid 192.168.203.131@tcp for mdt 20000000:01000000:2.0:1787830857.115607:0:6484:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.131@tcp (null) (null) (null) 00000040:00080000:2.0:1787830857.115795:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:2.0:1787830857.115805:0:6484:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1787830857.115821:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:2.0:1787830857.115827:0:6484:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.203.131@tcp (null) (null) 00000040:00080000:2.0:1787830857.115839:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:2.0:1787830857.115923:0:6484:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:2.0:1787830857.115942:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:2.0:1787830857.115957:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:2.0:1787830857.115975:0:6484:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:2.0:1787830857.115978:0:6484:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1787830857.115981:0:6484:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1787830857.116101:0:6484:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1787830857.116104:0:6484:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787830857.116470:0:7427:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:0.0:1787830857.116492:0:7427:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:0.0:1787830857.116509:0:7427:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:2.0:1787830857.116819:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:2.0:1787830857.116840:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:2.0:1787830857.116949:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:2.0:1787830857.116961:0:6484:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1787830857.116962:0:6484:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787830857.118512:0:7428:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:0.0:1787830857.118706:0:7428:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:0.0:1787830857.118729:0:7428:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:2.0:1787830857.119111:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:2.0:1787830857.119138:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:2.0:1787830857.119155:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:2.0:1787830857.119163:0:6484:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1787830857.119166:0:6484:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787830857.119467:0:7429:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:0.0:1787830857.119487:0:7429:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:0.0:1787830857.119502:0:7429:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:2.0:1787830857.119973:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:2.0:1787830857.120072:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:2.0:1787830857.120094:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:2.0:1787830857.120109:0:6484:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1787830857.120111:0:6484:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1787830857.120116:0:6484:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1787830857.120122:0:6484:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1787830857.120489:0:7430:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:2.0:1787830857.120763:0:6484:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:2.0:1787830857.140482:0:6484:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1787830857.151560:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000d7a8e00e/0x95459fb9d1d284c6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830857.159086:0:6484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000007d0efe64/0x95459fb9d1d283fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d283f4 expref: 12 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830857.159118:0:6484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000303d313f/0x95459fb9d1d28417 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d28410 expref: 12 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830857.159125:0:6484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000009b2f1a89/0x95459fb9d1d28487 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d28480 expref: 12 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830857.159150:0:6484:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000d7a8e00e/0x95459fb9d1d284c6 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830857.159201:0:6484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000009b2f1a89/0x95459fb9d1d28487 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x95459fb9d1d28480 expref: 12 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830857.159218:0:6484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000009b2f1a89/0x95459fb9d1d28487 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x95459fb9d1d28480 expref: 12 pid: 6484 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830857.159233:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000496cc966 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6484:1874676443779328:0@lo:104: 00000100:00100000:3.0:1787830857.159298:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787830857.159371:0:6484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000303d313f/0x95459fb9d1d28417 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x95459fb9d1d28410 expref: 12 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830857.159378:0:6484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000303d313f/0x95459fb9d1d28417 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x95459fb9d1d28410 expref: 12 pid: 6483 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830857.159387:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d46ca520 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6484:1874676443779456:0@lo:104: 00000100:00100000:3.0:1787830857.159407:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787830857.159430:0:6484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000007d0efe64/0x95459fb9d1d283fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x95459fb9d1d283f4 expref: 12 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830857.159437:0:6484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000007d0efe64/0x95459fb9d1d283fb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x95459fb9d1d283f4 expref: 12 pid: 6484 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830857.159444:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009708cd7a pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6484:1874676443779584:0@lo:104: 00000100:00100000:3.0:1787830857.159462:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830857.159471:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set 000000007dfaf0e2 going to sleep for 11 seconds 00000100:00100000:1.0:1787830857.159743:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443779328 00000100:00100000:1.0:1787830857.159761:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443779328 00000100:00100000:1.0:1787830857.159814:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443779456 00000100:00100000:1.0:1787830857.159817:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443779456 00000100:00100000:1.0:1787830857.159828:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443779584 00000100:00100000:1.0:1787830857.159830:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443779584 00000100:00100000:1.0:1787830857.159854:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787830857.159862:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fb2cdc5c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a45944b-32e3-4193-a2a5-46f84222bc14+5:6484:x1874676443779328:12345-0@lo:104: 00010000:00010000:1.0:1787830857.159877:0:6473:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: 00000000f5f86de2/0x95459fb9d1d28480 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d28487 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830857.159944:0:6473:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787830857.159950:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fb2cdc5c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a45944b-32e3-4193-a2a5-46f84222bc14+5:6484:x1874676443779328:12345-0@lo:104: Request processed in 89us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830857.159958:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787830857.159971:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000496cc966 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6484:1874676443779328:0@lo:104: 00000100:00100000:1.0:1787830857.159978:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787830857.159988:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ad48feb5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a45944b-32e3-4193-a2a5-46f84222bc14+4:6484:x1874676443779456:12345-0@lo:104: 00010000:00010000:1.0:1787830857.159996:0:6473:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: 00000000b3b4d6a6/0x95459fb9d1d28410 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d28417 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830857.160345:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d46ca520 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6484:1874676443779456:0@lo:104: 00010000:00010000:1.0:1787830857.160358:0:6473:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787830857.160366:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ad48feb5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a45944b-32e3-4193-a2a5-46f84222bc14+4:6484:x1874676443779456:12345-0@lo:104: Request processed in 380us (957us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830857.160372:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787830857.160390:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1787830857.160392:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:1.0:1787830857.160398:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005114c1b2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a45944b-32e3-4193-a2a5-46f84222bc14+3:6484:x1874676443779584:12345-0@lo:104: 00010000:00010000:2.0:1787830857.160400:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: 00000000f5f86de2/0x95459fb9d1d28480 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d28487 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830857.160406:0:6473:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: 000000009f828d4a/0x95459fb9d1d283f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d283fb expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830857.160411:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f5f86de2 already unused, calling callback (00000000bc230e97) 10000000:00010000:2.0:1787830857.160418:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: 00000000f5f86de2/0x95459fb9d1d28480 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x95459fb9d1d28487 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830857.160427:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: 00000000f5f86de2/0x95459fb9d1d28480 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x95459fb9d1d28487 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787830857.160434:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: 00000000f5f86de2/0x95459fb9d1d28480 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x95459fb9d1d28487 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787830857.160440:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787830857.160454:0:6473:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787830857.160460:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005114c1b2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a45944b-32e3-4193-a2a5-46f84222bc14+3:6484:x1874676443779584:12345-0@lo:104: Request processed in 65us (997us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830857.160466:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1787830857.160482:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787830857.160485:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: 00000000f5f86de2/0x95459fb9d1d28480 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d28487 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830857.160494:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787830857.160513:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: 00000000f5f86de2/0x95459fb9d1d28480 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d28487 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830857.160520:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: 00000000f5f86de2/0x95459fb9d1d28480 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d28487 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830857.160535:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787830857.160538:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: 000000009f828d4a/0x95459fb9d1d283f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d283fb expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830857.160543:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000009f828d4a already unused, calling callback (00000000bc230e97) 10000000:00010000:2.0:1787830857.160545:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: 000000009f828d4a/0x95459fb9d1d283f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x95459fb9d1d283fb expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830857.160551:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: 000000009f828d4a/0x95459fb9d1d283f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x95459fb9d1d283fb expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787830857.160556:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: 000000009f828d4a/0x95459fb9d1d283f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x95459fb9d1d283fb expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787830857.160561:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787830857.160594:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: 000000009f828d4a/0x95459fb9d1d283f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d283fb expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830857.160601:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787830857.160616:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: 000000009f828d4a/0x95459fb9d1d283f4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d283fb expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830857.160653:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: 000000009f828d4a/0x95459fb9d1d283f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d283fb expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830857.160663:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787830857.160665:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787830857.160666:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787830857.160675:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787830857.160687:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009bcaa052 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a45944b-32e3-4193-a2a5-46f84222bc14:3620:1874676443779840:0@lo:103: 00000100:00100000:2.0:1787830857.160722:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830857.160766:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443779840 00000100:00100000:2.0:1787830857.160771:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443779840 00010000:00010000:2.0:1787830857.160791:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000007d0efe64/0x95459fb9d1d283fb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d283f4 expref: 13 pid: 6484 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830857.160816:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787830857.160824:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f45e5929 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2a45944b-32e3-4193-a2a5-46f84222bc14+13:3620:x1874676443779840:12345-0@lo:103: 00010000:00010000:2.0:1787830857.160836:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787830857.160841:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000007d0efe64/0x95459fb9d1d283fb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d283f4 expref: 13 pid: 6484 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830857.160862:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009708cd7a pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6484:1874676443779584:0@lo:104: 00010000:00010000:2.0:1787830857.160868:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000007d0efe64/0x95459fb9d1d283fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x95459fb9d1d283f4 expref: 13 pid: 6484 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830857.160884:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000007d0efe64/0x95459fb9d1d283fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x95459fb9d1d283f4 expref: 13 pid: 6484 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830857.160891:0:6484:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000d7a8e00e/0x95459fb9d1d284c6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830857.160897:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787830857.160929:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f45e5929 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2a45944b-32e3-4193-a2a5-46f84222bc14+12:3620:x1874676443779840:12345-0@lo:103: Request processed in 107us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830857.160942:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787830857.161086:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ca867705 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a45944b-32e3-4193-a2a5-46f84222bc14:3622:1874676443779712:0@lo:103: 00000100:00100000:1.0:1787830857.161114:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830857.161172:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443779712 00000100:00100000:2.0:1787830857.161177:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443779712 00010000:00010000:2.0:1787830857.161196:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000009b2f1a89/0x95459fb9d1d28487 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d28480 expref: 12 pid: 6484 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830857.161215:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1787830857.161218:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787830857.161223:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008e97441e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2a45944b-32e3-4193-a2a5-46f84222bc14+12:3622:x1874676443779712:12345-0@lo:103: 00010000:00010000:1.0:1787830857.161224:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: 00000000b3b4d6a6/0x95459fb9d1d28410 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d28417 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830857.161234:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000b3b4d6a6 already unused, calling callback (00000000bc230e97) 00010000:00010000:2.0:1787830857.161235:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 10000000:00010000:1.0:1787830857.161237:0:6479:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: 00000000b3b4d6a6/0x95459fb9d1d28410 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x95459fb9d1d28417 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830857.161241:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000009b2f1a89/0x95459fb9d1d28487 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d28480 expref: 12 pid: 6484 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830857.161247:0:6479:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: 00000000b3b4d6a6/0x95459fb9d1d28410 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x95459fb9d1d28417 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830857.161256:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000009b2f1a89/0x95459fb9d1d28487 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x95459fb9d1d28480 expref: 12 pid: 6484 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787830857.161274:0:6479:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: 00000000b3b4d6a6/0x95459fb9d1d28410 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x95459fb9d1d28417 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830857.161277:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000009b2f1a89/0x95459fb9d1d28487 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x95459fb9d1d28480 expref: 12 pid: 6484 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787830857.161286:0:6479:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787830857.161296:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787830857.161308:0:6479:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: 00000000b3b4d6a6/0x95459fb9d1d28410 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d28417 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830857.161316:0:6479:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787830857.161327:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: 00000000b3b4d6a6/0x95459fb9d1d28410 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d28417 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830857.161332:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: 00000000b3b4d6a6/0x95459fb9d1d28410 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d28417 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830857.161344:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830857.161345:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830857.161346:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787830857.161353:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787830857.161361:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001686cc8c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a45944b-32e3-4193-a2a5-46f84222bc14:3619:1874676443779968:0@lo:103: 00000100:00100000:1.0:1787830857.161384:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830857.161407:0:6475:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1787830857.161414:0:6475:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:1.0:1787830857.161475:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830857.161477:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787830857.161491:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443779968 00000100:00100000:1.0:1787830857.161494:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443779968 00010000:00010000:1.0:1787830857.161508:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000303d313f/0x95459fb9d1d28417 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d28410 expref: 12 pid: 6483 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830857.161521:0:6475:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1787830857.161537:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787830857.161542:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e921955e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a45944b-32e3-4193-a2a5-46f84222bc14+12:3619:x1874676443779968:12345-0@lo:103: 00010000:00010000:1.0:1787830857.161550:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787830857.161554:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000303d313f/0x95459fb9d1d28417 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d28410 expref: 12 pid: 6483 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830857.161563:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000303d313f/0x95459fb9d1d28417 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x95459fb9d1d28410 expref: 12 pid: 6483 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830857.161572:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000303d313f/0x95459fb9d1d28417 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x95459fb9d1d28410 expref: 12 pid: 6483 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830857.161584:0:6475:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000d7a8e00e/0x95459fb9d1d284c6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830857.161592:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d7a8e00e/0x95459fb9d1d284c6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830857.161603:0:6475:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d7a8e00e/0x95459fb9d1d284c6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830857.161609:0:6475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d7a8e00e/0x95459fb9d1d284c6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830857.161615:0:6475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000d7a8e00e/0x95459fb9d1d284c6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830857.161621:0:6475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000d7a8e00e/0x95459fb9d1d284c6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830857.161644:0:6475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d7a8e00e already unused, calling callback (00000000f4040125) 00010000:00010000:1.0:1787830857.161648:0:6475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000d7a8e00e/0x95459fb9d1d284c6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830857.161660:0:6475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000d7a8e00e/0x95459fb9d1d284c6 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830857.161923:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009bcaa052 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a45944b-32e3-4193-a2a5-46f84222bc14:3620:1874676443779840:0@lo:103: 00010000:00010000:1.0:1787830857.162041:0:6475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000d7a8e00e/0x95459fb9d1d284c6 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830857.162051:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787830857.162082:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e921955e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a45944b-32e3-4193-a2a5-46f84222bc14+11:3619:x1874676443779968:12345-0@lo:103: Request processed in 540us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830857.162088:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787830857.162112:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001686cc8c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a45944b-32e3-4193-a2a5-46f84222bc14:3619:1874676443779968:0@lo:103: 00010000:00010000:3.0:1787830857.162226:0:6484:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000d7a8e00e/0x95459fb9d1d284c6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830857.162233:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000d7a8e00e/0x95459fb9d1d284c6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830857.162238:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d7a8e00e/0x95459fb9d1d284c6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787830857.162255:0:6484:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1787830857.162942:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ca867705 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a45944b-32e3-4193-a2a5-46f84222bc14:3622:1874676443779712:0@lo:103: 00000100:00100000:2.0:1787830857.163654:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008e97441e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2a45944b-32e3-4193-a2a5-46f84222bc14+10:3622:x1874676443779712:12345-0@lo:103: Request processed in 2430us (2537us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830857.163667:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787830857.175489:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000753f219b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+9:7419:x1874676443779200:12345-0@lo:253: Request processed in 66580us (67139us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830857.175506:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787830857.177923:0:7419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000010d5b07f pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:7419:1874676443779200:0@lo:253: 10000000:01000000:2.0:1787830857.177948:0:7419:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1787830857.177951:0:7419:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787830857.177953:0:7419:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787830857.177955:0:7419:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787830857.177956:0:7419:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:2.0:1787830857.177957:0:7419:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787830857.177976:0:7419:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787830857.177978:0:7419:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787830857.177979:0:7419:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1787830857.177980:0:7419:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787830857.177982:0:7419:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787830857.178007:0:7419:0:(tgt_mount.c:101:server_register_mount()) register mount 000000008d3a5259 from lustre-MDT0001 10000000:01000000:2.0:1787830857.178039:0:7419:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:2.0:1787830857.178042:0:7419:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1787830857.178049:0:7419:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8d2312953370 local copy 10000000:01000000:2.0:1787830857.178053:0:7419:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787830857.178097:0:7419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: 00000000483ac386/0x95459fb9d1d284cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830857.178109:0:7419:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.131@tcp lock: 00000000483ac386/0x95459fb9d1d284cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830857.178118:0:7419:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: 00000000483ac386/0x95459fb9d1d284cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830857.178298:0:7419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000010d5b07f pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:7419:1874676443780096:0@lo:101: 00000100:00100000:2.0:1787830857.178355:0:7419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830857.178410:0:7419:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d51b0b2e going to sleep for 11 seconds 00000100:00100000:3.0:1787830857.178457:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443780096 00000100:00100000:3.0:1787830857.178463:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443780096 00000100:00100000:3.0:1787830857.179017:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787830857.179028:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004d05cbfe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+9:7419:x1874676443780096:12345-0@lo:101: 00010000:00010000:3.0:1787830857.179043:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787830857.179059:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000023de687f/0x95459fb9d1d284d4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d284cd expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830857.179100:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000023de687f/0x95459fb9d1d284d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d284cd expref: 10 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830857.179110:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000023de687f/0x95459fb9d1d284d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d284cd expref: 10 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830857.179120:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000023de687f, rc 0) 00000100:00100000:3.0:1787830857.179184:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004d05cbfe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+10:7419:x1874676443780096:12345-0@lo:101: Request processed in 158us (829us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830857.179191:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787830857.179659:0:7419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000010d5b07f pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:7419:1874676443780096:0@lo:101: 00010000:00010000:1.0:1787830857.179678:0:7419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: 00000000483ac386/0x95459fb9d1d284cd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x95459fb9d1d284d4 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830857.179689:0:7419:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: 00000000483ac386/0x95459fb9d1d284cd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x95459fb9d1d284d4 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830857.179858:0:7419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001686cc8c pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:7419:1874676443780224:0@lo:501: 00000100:00100000:1.0:1787830857.179895:0:7419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830857.180043:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443780224 00000100:00100000:3.0:1787830857.180050:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443780224 00000100:00100000:1.0:1787830857.180054:0:7419:0:(client.c:2715:ptlrpc_set_wait()) set 0000000041d20aa1 going to sleep for 11 seconds 00000100:00100000:1.0:1787830857.180090:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787830857.180101:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f17b1030 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+10:7419:x1874676443780224:12345-0@lo:501: 00000100:00100000:1.0:1787830857.180190:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f17b1030 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+10:7419:x1874676443780224:12345-0@lo:501: Request processed in 92us (295us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787830857.180198:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787830857.180219:0:7419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001686cc8c pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:7419:1874676443780224:0@lo:501: 10000000:01000000:2.0:1787830857.180240:0:7419:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.131@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787830857.180262:0:7419:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.131@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787830857.180268:0:7419:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: 00000000483ac386/0x95459fb9d1d284cd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x95459fb9d1d284d4 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830857.180277:0:7419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: 00000000483ac386/0x95459fb9d1d284cd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x95459fb9d1d284d4 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830857.180284:0:7419:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.131@tcp lock: 00000000483ac386/0x95459fb9d1d284cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x95459fb9d1d284d4 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830857.180312:0:7419:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787830857.180461:0:7419:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d232f730000 10000000:01000000:2.0:1787830857.180466:0:7419:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787830857.180470:0:7419:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8d2312953370 10000000:01000000:2.0:1787830857.180473:0:7419:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1787830857.180476:0:7419:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8d2312953370 from 1 10000000:01000000:2.0:1787830857.180479:0:7419:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1787830857.180501:0:7419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: 0000000050e3bbdb/0x95459fb9d1d284db lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830857.180508:0:7419:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: 0000000050e3bbdb/0x95459fb9d1d284db lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830857.180516:0:7419:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: 0000000050e3bbdb/0x95459fb9d1d284db lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830857.180528:0:7419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000c5547a3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:7419:1874676443780352:0@lo:101: 00000100:00100000:2.0:1787830857.180557:0:7419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830857.180579:0:7419:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d51b0b2e going to sleep for 11 seconds 00000100:00100000:3.0:1787830857.180647:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443780352 00000100:00100000:3.0:1787830857.180652:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443780352 00000100:00100000:3.0:1787830857.180680:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787830857.180686:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000db9beb84 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+10:7419:x1874676443780352:12345-0@lo:101: 00010000:00010000:3.0:1787830857.180694:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787830857.180706:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001c16cac6/0x95459fb9d1d284e2 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d284db expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830857.180725:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001c16cac6/0x95459fb9d1d284e2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d284db expref: 11 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830857.180735:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001c16cac6/0x95459fb9d1d284e2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d284db expref: 11 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830857.180742:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001c16cac6, rc 0) 00000100:00100000:3.0:1787830857.180782:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000db9beb84 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+11:7419:x1874676443780352:12345-0@lo:101: Request processed in 96us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830857.180795:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:0.0:1787830857.181001:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787830857.181007:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: 00000000483ac386/0x95459fb9d1d284cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x95459fb9d1d284d4 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830857.181016:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000483ac386 already unused, calling callback (00000000bc230e97) 10000000:00010000:0.0:1787830857.181019:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: 00000000483ac386/0x95459fb9d1d284cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x95459fb9d1d284d4 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830857.181027:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: 00000000483ac386/0x95459fb9d1d284cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x95459fb9d1d284d4 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787830857.181035:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: 00000000483ac386/0x95459fb9d1d284cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x95459fb9d1d284d4 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787830857.181047:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1787830857.181056:0:7419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000c5547a3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:7419:1874676443780352:0@lo:101: 00010000:00010000:0.0:1787830857.181069:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: 00000000483ac386/0x95459fb9d1d284cd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x95459fb9d1d284d4 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830857.181071:0:7419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: 0000000050e3bbdb/0x95459fb9d1d284db lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d284e2 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830857.181086:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787830857.181090:0:7419:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: 0000000050e3bbdb/0x95459fb9d1d284db lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d284e2 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830857.181109:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: 00000000483ac386/0x95459fb9d1d284cd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x95459fb9d1d284d4 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787830857.181111:0:7419:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1787830857.181120:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: 00000000483ac386/0x95459fb9d1d284cd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x95459fb9d1d284d4 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830857.181143:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830857.181145:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830857.181146:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787830857.181385:0:7419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: 0000000050e3bbdb/0x95459fb9d1d284db lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d284e2 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830857.181399:0:7419:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: 0000000050e3bbdb/0x95459fb9d1d284db lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d284e2 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787830857.181408:0:7419:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8d232f730000 10000000:01000000:2.0:1787830857.181426:0:7419:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1787830857.181430:0:7419:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8d232f730000 from 1 10000000:01000000:2.0:1787830857.181433:0:7419:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1787830857.181447:0:7419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: 0000000091c5273c/0x95459fb9d1d284e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830857.181606:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787830857.181618:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d076db49 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a45944b-32e3-4193-a2a5-46f84222bc14:3622:1874676443780480:0@lo:103: 00000100:00100000:3.0:1787830857.181672:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787830857.181750:0:7419:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: 0000000091c5273c/0x95459fb9d1d284e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830857.181759:0:7419:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: 0000000091c5273c/0x95459fb9d1d284e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830857.181772:0:7419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000c5547a3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:7419:1874676443780608:0@lo:101: 00000100:00100000:0.0:1787830857.181818:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443780480 00000100:00100000:0.0:1787830857.181824:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443780480 00000100:00100000:0.0:1787830857.181875:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787830857.181881:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009708cd7a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a45944b-32e3-4193-a2a5-46f84222bc14+11:3622:x1874676443780480:12345-0@lo:103: 00010000:00010000:0.0:1787830857.181892:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787830857.181905:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000023de687f/0x95459fb9d1d284d4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x95459fb9d1d284cd expref: 11 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830857.181918:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787830857.181926:0:7419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830857.181959:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009708cd7a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a45944b-32e3-4193-a2a5-46f84222bc14+10:3622:x1874676443780480:12345-0@lo:103: Request processed in 76us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830857.181965:0:7419:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d51b0b2e going to sleep for 11 seconds 00000100:00100000:1.0:1787830857.181967:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443780608 00000100:00100000:0.0:1787830857.181969:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787830857.181975:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443780608 00000100:00100000:0.0:1787830857.182005:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d076db49 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a45944b-32e3-4193-a2a5-46f84222bc14:3622:1874676443780480:0@lo:103: 00000100:00100000:1.0:1787830857.182020:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787830857.182030:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000042b84dba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+10:7419:x1874676443780608:12345-0@lo:101: 00010000:00010000:1.0:1787830857.182040:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787830857.182051:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b3b4d6a6/0x95459fb9d1d284f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d284e9 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830857.182069:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b3b4d6a6/0x95459fb9d1d284f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d284e9 expref: 11 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830857.182079:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b3b4d6a6/0x95459fb9d1d284f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d284e9 expref: 11 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830857.182085:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b3b4d6a6, rc 0) 00000100:00100000:1.0:1787830857.182119:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000042b84dba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+11:7419:x1874676443780608:12345-0@lo:101: Request processed in 92us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830857.182126:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787830857.182134:0:7419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000c5547a3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:7419:1874676443780608:0@lo:101: 00010000:00010000:2.0:1787830857.182147:0:7419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: 0000000091c5273c/0x95459fb9d1d284e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d284f0 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830857.182155:0:7419:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: 0000000091c5273c/0x95459fb9d1d284e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d284f0 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787830857.182167:0:7419:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1787830857.182180:0:7419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: 0000000091c5273c/0x95459fb9d1d284e9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d284f0 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830857.182194:0:7419:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: 0000000091c5273c/0x95459fb9d1d284e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d284f0 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787830857.182201:0:7419:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1787830857.182204:0:7419:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787830857.182208:0:7419:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8d232f730000 10000000:01000000:2.0:1787830857.182211:0:7419:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1787830857.182213:0:7419:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:2.0:1787830857.182215:0:7419:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1787830857.182228:0:7419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: 00000000634d5a22/0x95459fb9d1d284f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830857.182235:0:7419:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: 00000000634d5a22/0x95459fb9d1d284f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830857.182241:0:7419:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: 00000000634d5a22/0x95459fb9d1d284f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830857.182252:0:7419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000c5547a3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:7419:1874676443780736:0@lo:101: 00000100:00100000:2.0:1787830857.182276:0:7419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830857.182296:0:7419:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d51b0b2e going to sleep for 11 seconds 00000100:00100000:3.0:1787830857.182336:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443780736 00000100:00100000:3.0:1787830857.182340:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443780736 00000100:00100000:3.0:1787830857.182393:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787830857.182399:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f125b041 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+11:7419:x1874676443780736:12345-0@lo:101: 00010000:00010000:3.0:1787830857.182407:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787830857.182414:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002fa4d7b6/0x95459fb9d1d284fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d284f7 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830857.182427:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002fa4d7b6/0x95459fb9d1d284fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d284f7 expref: 12 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830857.182434:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002fa4d7b6/0x95459fb9d1d284fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d284f7 expref: 12 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830857.182441:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002fa4d7b6, rc 0) 00000100:00100000:3.0:1787830857.182483:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f125b041 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+12:7419:x1874676443780736:12345-0@lo:101: Request processed in 84us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830857.182489:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787830857.182516:0:7419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000c5547a3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:7419:1874676443780736:0@lo:101: 00010000:00010000:1.0:1787830857.182527:0:7419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: 00000000634d5a22/0x95459fb9d1d284f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d284fe expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830857.182534:0:7419:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: 00000000634d5a22/0x95459fb9d1d284f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d284fe expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830857.182610:0:7419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fb86a3f8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:7419:1874676443780864:0@lo:501: 00000100:00100000:1.0:1787830857.182663:0:7419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830857.182866:0:7419:0:(client.c:2715:ptlrpc_set_wait()) set 0000000041d20aa1 going to sleep for 11 seconds 00000100:00100000:2.0:1787830857.183396:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443780864 00000100:00100000:2.0:1787830857.183402:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443780864 00000100:00100000:2.0:1787830857.183430:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787830857.183436:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fa1c921b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+12:7419:x1874676443780864:12345-0@lo:501: 00000100:00100000:2.0:1787830857.183614:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fa1c921b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+12:7419:x1874676443780864:12345-0@lo:501: Request processed in 178us (950us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830857.183621:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787830857.183665:0:7419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fb86a3f8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:7419:1874676443780864:0@lo:501: 00000100:00100000:1.0:1787830857.183721:0:7419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fb86a3f8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:7419:1874676443780992:0@lo:503: 00000100:00100000:1.0:1787830857.183763:0:7419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830857.183866:0:7419:0:(client.c:2715:ptlrpc_set_wait()) set 0000000041d20aa1 going to sleep for 11 seconds 00000100:00100000:3.0:1787830857.183909:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443780992 00000100:00100000:3.0:1787830857.183914:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443780992 00000100:00100000:3.0:1787830857.183945:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787830857.183952:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f9bd1d0e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+12:7419:x1874676443780992:12345-0@lo:503: 00000100:00100000:3.0:1787830857.184047:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f9bd1d0e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+12:7419:x1874676443780992:12345-0@lo:503: Request processed in 96us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830857.184066:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787830857.184084:0:7419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fb86a3f8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:7419:1874676443780992:0@lo:503: 00000040:00080000:1.0:1787830857.184384:0:7419:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787830857.184455:0:7419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fb86a3f8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:7419:1874676443781120:0@lo:502: 00000100:00100000:1.0:1787830857.184490:0:7419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830857.184514:0:7419:0:(client.c:2715:ptlrpc_set_wait()) set 00000000dc5d84cb going to sleep for 11 seconds 00000100:00100000:0.0:1787830857.184600:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443781120 00000100:00100000:0.0:1787830857.184610:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443781120 00000100:00100000:0.0:1787830857.184675:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787830857.184681:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000bb4ac63 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+12:7419:x1874676443781120:12345-0@lo:502: 00000100:00100000:3.0:1787830857.184951:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000bb4ac63 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+12:7419:x1874676443781120:12345-0@lo:502: Request processed in 270us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830857.184959:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787830857.184991:0:7419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fb86a3f8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:7419:1874676443781120:0@lo:502: 00000040:00080000:1.0:1787830857.185191:0:7419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1787830857.185221:0:7419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:1.0:1787830857.185235:0:7419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:1.0:1787830857.185248:0:7419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:1.0:1787830857.185261:0:7419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:1.0:1787830857.185273:0:7419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:1.0:1787830857.185285:0:7419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:1.0:1787830857.185298:0:7419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:1.0:1787830857.185312:0:7419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:1.0:1787830857.185327:0:7419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:1.0:1787830857.185341:0:7419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:1.0:1787830857.185361:0:7419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:1.0:1787830857.185377:0:7419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:1.0:1787830857.185391:0:7419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:1.0:1787830857.185404:0:7419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:1.0:1787830857.185416:0:7419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:1.0:1787830857.185427:0:7419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:1.0:1787830857.185453:0:7419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:1.0:1787830857.185469:0:7419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:1.0:1787830857.185482:0:7419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:1.0:1787830857.185502:0:7419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:1.0:1787830857.185516:0:7419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:1.0:1787830857.185530:0:7419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:1.0:1787830857.185563:0:7419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fb86a3f8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:7419:1874676443781248:0@lo:502: 00000100:00100000:1.0:1787830857.185600:0:7419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830857.185660:0:7419:0:(client.c:2715:ptlrpc_set_wait()) set 0000000041d20aa1 going to sleep for 11 seconds 00000100:00100000:3.0:1787830857.185720:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443781248 00000100:00100000:3.0:1787830857.185725:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443781248 00000100:00100000:3.0:1787830857.185817:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787830857.185824:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000524864b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+12:7419:x1874676443781248:12345-0@lo:502: 00000100:00100000:3.0:1787830857.185931:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000524864b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+12:7419:x1874676443781248:12345-0@lo:502: Request processed in 107us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830857.185938:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787830857.186002:0:7419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fb86a3f8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:7419:1874676443781248:0@lo:502: 00000040:00080000:1.0:1787830857.186040:0:7419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:1.0:1787830857.186047:0:7419:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000020:01000000:1.0:1787830857.186555:0:7433:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787830857.186565:0:7433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787830857.186567:0:7433:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1787830857.186572:0:7433:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:1.0:1787830857.186575:0:7433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787830857.186596:0:7433:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (0000000005e8c5ae) 00000020:00000080:1.0:1787830857.186614:0:7433:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:1.0:1787830857.187374:0:7433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1787830857.187454:0:7433:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787830857.187460:0:7433:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x95459fb9d1d2850c 00000020:00000080:1.0:1787830857.187647:0:7433:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1787830857.187653:0:7433:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787830857.187657:0:7433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787830857.187659:0:7433:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1787830857.187661:0:7433:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787830857.187665:0:7433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787830857.187666:0:7433:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:1.0:1787830857.187668:0:7433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787830857.187674:0:7433:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (00000000cf37c255) 00000020:00000080:1.0:1787830857.187683:0:7433:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:1.0:1787830857.187686:0:7433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1787830857.187687:0:7433:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:1.0:1787830857.187693:0:7433:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:1.0:1787830857.187697:0:7433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787830857.187748:0:7433:0:(tgt_mount.c:153:server_get_mount()) get mount 000000008d3a5259 from lustre-MDT0001, refs=2 00000020:00000080:1.0:1787830857.187761:0:7433:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (00000000dfe53fcb) 00000020:00000080:1.0:1787830857.187787:0:7433:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:1.0:1787830857.187824:0:7433:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1787830857.187827:0:7433:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x95459fb9d1d28521 00000020:00000080:1.0:1787830857.187911:0:7433:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:1.0:1787830857.187916:0:7433:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1787830857.187920:0:7433:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x95459fb9d1d28528 00080000:01000000:1.0:1787830857.187923:0:7433:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:1.0:1787830857.187925:0:7433:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x95459fb9d1d2852f 00080000:10000000:1.0:1787830857.188424:0:7433:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:1.0:1787830857.188515:0:7433:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:2.0:1787830857.287500:0:7433:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:2.0:1787830857.287995:0:7433:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:2.0:1787830857.289972:0:7433:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1787830857.290248:0:7433:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1787830857.301223:0:7433:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:0.0:1787830857.301237:0:7433:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787830857.301243:0:7433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787830857.301245:0:7433:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:0.0:1787830857.301248:0:7433:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787830857.301253:0:7433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787830857.301255:0:7433:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:0.0:1787830857.301257:0:7433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787830857.301262:0:7433:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.131@tcp to nid 0x20000c0a8cb83 (192.168.203.131@tcp) 00000020:00000080:0.0:1787830857.301297:0:7433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787830857.301312:0:7433:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (00000000a6604a15) 00000020:00000080:0.0:1787830857.301331:0:7433:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:0.0:1787830857.301336:0:7433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787830857.301399:0:7433:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:0.0:1787830857.301405:0:7433:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:0.0:1787830857.301411:0:7433:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x95459fb9d1d2853d 00010000:00080000:0.0:1787830857.301442:0:7433:0:(ldlm_lib.c:102:import_set_conn()) imp 000000008f26d17f@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.131@tcp at head 00010000:00010000:0.0:1787830857.304589:0:7433:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:1.0:1787830857.306903:0:7433:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787830857.306918:0:7433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1787830857.306964:0:7433:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:1.0:1787830857.306985:0:7433:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x95459fb9d1d28544 00000100:00080000:1.0:1787830857.306997:0:7433:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787830857.307002:0:7433:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 000000008f26d17f using connection 192.168.203.131@tcp/0@lo 00000100:00100000:1.0:1787830857.307039:0:7433:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000fb86a3f8 x1874676443781376/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787830857.307068:0:7433:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:1.0:1787830857.307130:0:7433:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787830857.307136:0:7433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787830857.307137:0:7433:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:1.0:1787830857.307141:0:7433:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787830857.307144:0:7433:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1787830857.307146:0:7433:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787830857.307148:0:7433:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787830857.307149:0:7433:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787830857.307151:0:7433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787830857.307157:0:7433:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787830857.307161:0:7433:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787830857.307166:0:7433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787830857.307167:0:7433:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:1.0:1787830857.307171:0:7433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1787830857.307191:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d46ca520 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3622:1874676443781504:0@lo:400: 00000004:01000000:1.0:1787830857.307212:0:7433:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1787830857.307227:0:7433:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787830857.307230:0:7433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787830857.307232:0:7433:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:1.0:1787830857.307234:0:7433:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787830857.307238:0:7433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787830857.307239:0:7433:0:(obd_config.c:1563:class_process_config()) marker 19 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787830857.307242:0:7433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787830857.307244:0:7433:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787830857.307267:0:7433:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787830857.307271:0:7433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787830857.307273:0:7433:0:(obd_config.c:1563:class_process_config()) marker 19 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787830857.307276:0:7433:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000100:00100000:3.0:1787830857.307290:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830857.307386:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443781504 00000100:00100000:3.0:1787830857.307394:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443781504 00000100:00100000:3.0:1787830857.307444:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000020:01000000:2.0:1787830857.307449:0:7419:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 00000100:00100000:3.0:1787830857.307455:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000496cc966 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1874676443781504:12345-0@lo:400: 10000000:01000000:2.0:1787830857.307482:0:7419:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1787830857.307495:0:7419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: 00000000634d5a22/0x95459fb9d1d284f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d284fe expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830857.307507:0:7419:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: 00000000634d5a22/0x95459fb9d1d284f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d284fe expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787830857.307515:0:7419:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d232f730000 from 1 10000000:01000000:2.0:1787830857.307518:0:7419:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00000100:00100000:3.0:1787830857.307529:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000496cc966 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1874676443781504:12345-0@lo:400: Request processed in 76us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830857.307542:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1787830857.307544:0:7419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: 000000007d0efe64/0x95459fb9d1d2854b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830857.307552:0:7419:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: 000000007d0efe64/0x95459fb9d1d2854b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830857.307562:0:7419:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: 000000007d0efe64/0x95459fb9d1d2854b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830857.307578:0:7419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005798b581 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:7419:1874676443781632:0@lo:101: 00010000:00080000:3.0:1787830857.307582:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000d46ca520 x1874676443781504/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830873 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787830857.307597:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d46ca520 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3622:1874676443781504:0@lo:400: 00000100:00100000:2.0:1787830857.307616:0:7419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830857.307663:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443781632 00000100:00100000:3.0:1787830857.307666:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443781632 00000100:00100000:3.0:1787830857.307691:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787830857.307704:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ddf5711e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+12:7419:x1874676443781632:12345-0@lo:101: 00010000:00010000:3.0:1787830857.307713:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787830857.307726:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d7a8e00e/0x95459fb9d1d28552 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d2854b expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830857.307768:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d7a8e00e/0x95459fb9d1d28552 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d2854b expref: 13 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830857.307778:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d7a8e00e/0x95459fb9d1d28552 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d2854b expref: 13 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830857.307787:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d7a8e00e, rc 0) 00000100:00100000:3.0:1787830857.307811:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ddf5711e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+13:7419:x1874676443781632:12345-0@lo:101: Request processed in 109us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830857.307817:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787830857.308138:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fb86a3f8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1874676443781376:0@lo:38: 00000100:00100000:0.0:1787830857.308174:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830857.308352:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443781376 00000100:00100000:2.0:1787830857.308356:0:7419:0:(client.c:2715:ptlrpc_set_wait()) set 00000000020ddd27 going to sleep for 11 seconds 00000100:00100000:3.0:1787830857.308358:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443781376 00000100:00100000:2.0:1787830857.308374:0:7419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005798b581 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:7419:1874676443781632:0@lo:101: 00010000:00010000:2.0:1787830857.308388:0:7419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: 000000007d0efe64/0x95459fb9d1d2854b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d28552 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830857.308409:0:7419:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: 000000007d0efe64/0x95459fb9d1d2854b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d28552 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830857.308445:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787830857.308450:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d076db49 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3618:x1874676443781376:12345-0@lo:38: 00010000:00080000:3.0:1787830857.308532:0:6495:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 148 last 0 00000020:00000080:3.0:1787830857.308564:0:6495:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x95459fb9d1d28559 00000004:00100000:3.0:1787830857.308580:0:6495:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1787830857.308586:0:6495:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:2.0:1787830857.309167:0:7419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005798b581 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:7419:1874676443781760:0@lo:256: 00000100:00100000:2.0:1787830857.309206:0:7419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830857.309235:0:7419:0:(client.c:2715:ptlrpc_set_wait()) set 00000000020ddd27 going to sleep for 11 seconds 00000100:00100000:0.0:1787830857.309378:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443781760 00000100:00100000:0.0:1787830857.309384:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443781760 00000100:00100000:0.0:1787830857.309422:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787830857.309429:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d679d335 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+13:7419:x1874676443781760:12345-0@lo:256: 20000000:01000000:0.0:1787830857.310599:0:6483:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1787830857.310619:0:6483:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787830857.310644:0:6483:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1787830857.312927:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d679d335 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+13:7419:x1874676443781760:12345-0@lo:256: Request processed in 3493us (3714us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830857.312945:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787830857.313136:0:7419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005798b581 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:7419:1874676443781760:0@lo:256: 10000000:01000000:2.0:1787830857.314176:0:7419:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787830857.314201:0:7419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: 000000007d0efe64/0x95459fb9d1d2854b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d28552 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830857.314213:0:7419:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: 000000007d0efe64/0x95459fb9d1d2854b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d28552 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787830857.314219:0:7419:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d232f730000 from 1 10000000:01000000:2.0:1787830857.314222:0:7419:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787830857.314253:0:7419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: 000000002e8fc016/0x95459fb9d1d28560 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830857.314258:0:7419:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: 000000002e8fc016/0x95459fb9d1d28560 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830857.314264:0:7419:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: 000000002e8fc016/0x95459fb9d1d28560 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830857.314281:0:7419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005798b581 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:7419:1874676443781888:0@lo:101: 00000100:00100000:2.0:1787830857.314950:0:7419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830857.315006:0:7419:0:(client.c:2715:ptlrpc_set_wait()) set 00000000020ddd27 going to sleep for 11 seconds 00000100:00100000:0.0:1787830857.315150:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443781888 00000100:00100000:0.0:1787830857.315158:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443781888 00000100:00100000:0.0:1787830857.315207:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787830857.315216:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001f98c4a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+13:7419:x1874676443781888:12345-0@lo:101: 00010000:00010000:0.0:1787830857.315230:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787830857.315244:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009f828d4a/0x95459fb9d1d28567 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d28560 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830857.315270:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009f828d4a/0x95459fb9d1d28567 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d28560 expref: 14 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830857.315281:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009f828d4a/0x95459fb9d1d28567 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d28560 expref: 14 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830857.315302:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009f828d4a, rc 0) 00000100:00100000:0.0:1787830857.315351:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001f98c4a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+14:7419:x1874676443781888:12345-0@lo:101: Request processed in 136us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830857.315357:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787830857.315504:0:7419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005798b581 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:7419:1874676443781888:0@lo:101: 00010000:00010000:2.0:1787830857.315519:0:7419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: 000000002e8fc016/0x95459fb9d1d28560 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d28567 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830857.315528:0:7419:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: 000000002e8fc016/0x95459fb9d1d28560 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d28567 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830857.315614:0:7419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005798b581 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:7419:1874676443782016:0@lo:501: 00000100:00100000:2.0:1787830857.315862:0:7419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830857.315888:0:7419:0:(client.c:2715:ptlrpc_set_wait()) set 00000000020ddd27 going to sleep for 11 seconds 00000100:00100000:0.0:1787830857.315947:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443782016 00000100:00100000:0.0:1787830857.315952:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443782016 00000100:00100000:0.0:1787830857.316013:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787830857.316020:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009ca02736 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+14:7419:x1874676443782016:12345-0@lo:501: 00000100:00100000:0.0:1787830857.316122:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009ca02736 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+14:7419:x1874676443782016:12345-0@lo:501: Request processed in 103us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830857.316129:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787830857.316156:0:7419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005798b581 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:7419:1874676443782016:0@lo:501: 00000100:00100000:2.0:1787830857.316190:0:7419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005798b581 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:7419:1874676443782144:0@lo:503: 00000100:00100000:2.0:1787830857.316247:0:7419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787830857.317067:0:6495:0:(import.c:65:import_set_state_nolock()) 000000005255c4ae : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787830857.317126:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d076db49 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3618:x1874676443781376:12345-0@lo:38: Request processed in 8674us (8951us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830857.317135:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787830857.317176:0:3618:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787830857.317190:0:3618:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:3.0:1787830857.317199:0:3618:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1787830857.317204:0:3618:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787830857.317206:0:3618:0:(import.c:65:import_set_state_nolock()) 000000008f26d17f lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787830857.317219:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fb86a3f8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1874676443781376:0@lo:38: 00000100:00100000:2.0:1787830857.317486:0:7419:0:(client.c:2715:ptlrpc_set_wait()) set 00000000020ddd27 going to sleep for 11 seconds 00000100:00100000:1.0:1787830857.317582:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443782144 00000100:00100000:1.0:1787830857.317588:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443782144 00000100:00100000:1.0:1787830857.317618:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787830857.317646:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000050c4e9ac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+14:7419:x1874676443782144:12345-0@lo:503: 00000040:00080000:1.0:1787830857.317703:0:6485:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787830857.317745:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000050c4e9ac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+14:7419:x1874676443782144:12345-0@lo:503: Request processed in 122us (1500us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830857.317753:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787830857.317839:0:7419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005798b581 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:7419:1874676443782144:0@lo:503: 00000040:00080000:2.0:1787830857.318092:0:7419:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787830857.318152:0:7419:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:2.0:1787830857.318230:0:7419:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787830857.319117:0:7438:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:1.0:1787830857.319314:0:7419:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1787830857.319339:0:7419:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787830857.319361:0:7419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: 000000002e8fc016/0x95459fb9d1d28560 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d28567 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830857.319372:0:7419:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: 000000002e8fc016/0x95459fb9d1d28560 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d28567 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787830857.319425:0:7419:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787830857.319428:0:7419:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d232f730000 10000000:01000000:1.0:1787830857.319432:0:7419:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d232f730000 10000000:01000000:1.0:1787830857.319435:0:7419:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787830857.319441:0:7419:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d232f730000 from 1 10000000:01000000:1.0:1787830857.319443:0:7419:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787830857.319472:0:7419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: 00000000ec9580c9/0x95459fb9d1d2856e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830857.319480:0:7419:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: 00000000ec9580c9/0x95459fb9d1d2856e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830857.319488:0:7419:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: 00000000ec9580c9/0x95459fb9d1d2856e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830857.319506:0:7419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005d514eb7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:7419:1874676443782272:0@lo:101: 00000100:00100000:1.0:1787830857.319552:0:7419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830857.319582:0:7419:0:(client.c:2715:ptlrpc_set_wait()) set 000000009925ee9f going to sleep for 11 seconds 00000100:00100000:1.0:1787830857.319600:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443782272 00000100:00100000:1.0:1787830857.319605:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443782272 00000100:00100000:1.0:1787830857.319651:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787830857.319669:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cc9a5b31 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+14:7419:x1874676443782272:12345-0@lo:101: 00010000:00010000:1.0:1787830857.319682:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787830857.319693:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000778ffcc/0x95459fb9d1d28575 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d2856e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830857.319715:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000778ffcc/0x95459fb9d1d28575 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d2856e expref: 15 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830857.319735:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000778ffcc/0x95459fb9d1d28575 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d2856e expref: 15 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830857.319742:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000778ffcc, rc 0) 00000100:00100000:1.0:1787830857.319772:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cc9a5b31 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+15:7419:x1874676443782272:12345-0@lo:101: Request processed in 115us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830857.319778:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787830857.319813:0:7419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005d514eb7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:7419:1874676443782272:0@lo:101: 00010000:00010000:1.0:1787830857.319824:0:7419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: 00000000ec9580c9/0x95459fb9d1d2856e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d28575 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830857.319832:0:7419:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: 00000000ec9580c9/0x95459fb9d1d2856e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d28575 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830857.319903:0:7419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005d514eb7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:7419:1874676443782400:0@lo:501: 00000100:00100000:1.0:1787830857.319924:0:7419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830857.319940:0:7419:0:(client.c:2715:ptlrpc_set_wait()) set 000000009925ee9f going to sleep for 11 seconds 00000100:00100000:1.0:1787830857.319951:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443782400 00000100:00100000:1.0:1787830857.319954:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443782400 00000100:00100000:1.0:1787830857.319968:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787830857.319972:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000015ce3f49 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+15:7419:x1874676443782400:12345-0@lo:501: 00000100:00100000:1.0:1787830857.320049:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000015ce3f49 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+15:7419:x1874676443782400:12345-0@lo:501: Request processed in 76us (124us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830857.320055:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787830857.320081:0:7419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005d514eb7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:7419:1874676443782400:0@lo:501: 00000100:00100000:1.0:1787830857.320103:0:7419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005d514eb7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:7419:1874676443782528:0@lo:503: 00000100:00100000:1.0:1787830857.320140:0:7419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830857.320151:0:7419:0:(client.c:2715:ptlrpc_set_wait()) set 0000000072caa544 going to sleep for 11 seconds 00000100:00100000:1.0:1787830857.320162:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443782528 00000100:00100000:1.0:1787830857.320165:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443782528 00000100:00100000:1.0:1787830857.320180:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787830857.320184:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000047a9b49c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+15:7419:x1874676443782528:12345-0@lo:503: 00000100:00100000:1.0:1787830857.320245:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000047a9b49c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+15:7419:x1874676443782528:12345-0@lo:503: Request processed in 61us (105us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830857.320251:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787830857.320282:0:7419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005d514eb7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:7419:1874676443782528:0@lo:503: 00000040:00080000:1.0:1787830857.320498:0:7419:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787830857.320547:0:7419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005d514eb7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:7419:1874676443782656:0@lo:502: 00000100:00100000:1.0:1787830857.320578:0:7419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830857.320592:0:7419:0:(client.c:2715:ptlrpc_set_wait()) set 0000000072caa544 going to sleep for 11 seconds 00000100:00100000:1.0:1787830857.320606:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443782656 00000100:00100000:1.0:1787830857.320610:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443782656 00000100:00100000:1.0:1787830857.320649:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787830857.320654:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008785e4d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+15:7419:x1874676443782656:12345-0@lo:502: 00000100:00100000:1.0:1787830857.320722:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008785e4d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+15:7419:x1874676443782656:12345-0@lo:502: Request processed in 68us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830857.320728:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787830857.320763:0:7419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005d514eb7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:7419:1874676443782656:0@lo:502: 00000040:00080000:1.0:1787830857.320924:0:7419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1787830857.320947:0:7419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1787830857.320962:0:7419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1787830857.320976:0:7419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1787830857.320991:0:7419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1787830857.321018:0:7419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1787830857.321031:0:7419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1787830857.321043:0:7419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1787830857.321056:0:7419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1787830857.321070:0:7419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1787830857.321082:0:7419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1787830857.321096:0:7419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1787830857.321109:0:7419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1787830857.321123:0:7419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1787830857.321136:0:7419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1787830857.321149:0:7419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1787830857.321163:0:7419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1787830857.321174:0:7419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1787830857.321187:0:7419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1787830857.321210:0:7419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1787830857.321226:0:7419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1787830857.321239:0:7419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1787830857.321251:0:7419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1787830857.321264:0:7419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1787830857.321277:0:7419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:1.0:1787830857.321290:0:7419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:1.0:1787830857.321302:0:7419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:1.0:1787830857.321315:0:7419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:1.0:1787830857.321337:0:7419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005d514eb7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:7419:1874676443782784:0@lo:502: 00000100:00100000:1.0:1787830857.321376:0:7419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830857.321401:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443782784 00000100:00100000:1.0:1787830857.321404:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443782784 00000100:00100000:1.0:1787830857.321423:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787830857.321427:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cd1bd0a0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+15:7419:x1874676443782784:12345-0@lo:502: 00000100:00100000:1.0:1787830857.321484:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cd1bd0a0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+15:7419:x1874676443782784:12345-0@lo:502: Request processed in 56us (108us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830857.321497:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787830857.321528:0:7419:0:(client.c:2715:ptlrpc_set_wait()) set 0000000072caa544 going to sleep for 11 seconds 00000100:00100000:1.0:1787830857.321538:0:7419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005d514eb7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:7419:1874676443782784:0@lo:502: 00000040:00080000:1.0:1787830857.321568:0:7419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:1.0:1787830857.321574:0:7419:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:1.0:1787830857.321888:0:7439:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:1.0:1787830857.321901:0:7439:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (0000000018bb1375) 00000020:00000080:1.0:1787830857.321919:0:7439:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:1.0:1787830857.321992:0:7439:0:(tgt_mount.c:153:server_get_mount()) get mount 000000008d3a5259 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1787830857.321996:0:7439:0:(tgt_mount.c:187:server_put_mount()) put mount 000000008d3a5259 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1787830857.321998:0:7439:0:(obd_mount.c:710:lustre_put_lsi()) put 000000008d3a5259 3 00010000:00080000:1.0:1787830857.322026:0:7439:0:(ldlm_lib.c:102:import_set_conn()) imp 000000005f7f234c@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.131@tcp at head 00000100:00100000:2.0:1787830857.323449:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008718ef3d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443782912:0@lo:41: 00000100:00100000:2.0:1787830857.323506:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830857.323595:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443782912 00000100:00100000:0.0:1787830857.323609:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443782912 00000100:00100000:0.0:1787830857.323680:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787830857.323686:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005798b581 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3619:x1874676443782912:12345-0@lo:41: 00000004:00000024:0.0:1787830857.323717:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:0.0:1787830857.323756:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005798b581 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3619:x1874676443782912:12345-0@lo:41: Request processed in 71us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830857.323762:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787830857.323913:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008718ef3d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443782912:0@lo:41: 00010000:00010000:1.0:1787830857.324744:0:7439:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:1.0:1787830857.324929:0:7439:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:1.0:1787830857.324967:0:7439:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787830857.324977:0:7439:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x95459fb9d1d28583 00000100:00080000:1.0:1787830857.324984:0:7439:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787830857.324988:0:7439:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 000000005f7f234c using connection 192.168.203.131@tcp/0@lo 00000100:00100000:1.0:1787830857.325015:0:7439:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000005d514eb7 x1874676443783040/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787830857.325068:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005d514eb7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3618:1874676443783040:0@lo:38: 00000100:00100000:2.0:1787830857.325111:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787830857.326690:0:7439:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787830857.327747:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443783040 00000100:00100000:3.0:1787830857.327758:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443783040 00000100:00100000:3.0:1787830857.327798:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787830857.327805:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000c5547a3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3618:x1874676443783040:12345-0@lo:38: 00010000:00080000:3.0:1787830857.327856:0:6492:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 148 last 0 00000020:00000080:3.0:1787830857.327893:0:6492:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x95459fb9d1d2858a 00000004:00100000:3.0:1787830857.327911:0:6492:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787830857.327945:0:6492:0:(import.c:65:import_set_state_nolock()) 00000000342ee068 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787830857.328034:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000c5547a3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1874676443783040:12345-0@lo:38: Request processed in 228us (2921us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830857.328043:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787830857.328053:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000005d514eb7 x1874676443783040/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787830867 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787830857.328072:0:3618:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787830857.328081:0:3618:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1787830857.328089:0:3618:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1787830857.328094:0:3618:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787830857.328096:0:3618:0:(import.c:65:import_set_state_nolock()) 000000005f7f234c lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787830857.328102:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005d514eb7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3618:1874676443783040:0@lo:38: 40000000:00080000:3.0:1787830857.330457:0:7441:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00000040:00080000:1.0:1787830857.330458:0:7439:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:1.0:1787830857.330520:0:7419:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:1.0:1787830857.330548:0:7419:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787830857.330569:0:7419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: 00000000ec9580c9/0x95459fb9d1d2856e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d28575 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830857.330581:0:7419:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: 00000000ec9580c9/0x95459fb9d1d2856e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d28575 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787830857.330653:0:7419:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787830857.330656:0:7419:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787830857.330658:0:7419:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787830857.332072:0:7419:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787830857.332076:0:7419:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787830857.332078:0:7419:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787830857.332080:0:7419:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787830857.332081:0:7419:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787830857.332083:0:7419:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787830857.332085:0:7419:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787830857.332086:0:7419:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787830857.332091:0:7419:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:1.0:1787830857.332094:0:7419:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787830857.332095:0:7419:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787830857.332096:0:7419:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787830857.332098:0:7419:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787830857.332099:0:7419:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787830857.332100:0:7419:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787830857.332101:0:7419:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787830857.332101:0:7419:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787830857.332102:0:7419:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787830857.332103:0:7419:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787830857.332104:0:7419:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787830857.332133:0:7419:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1787830857.332151:0:7419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ee0e42b3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:7419:1874676443783168:0@lo:253: 00000100:00100000:1.0:1787830857.332224:0:7419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830857.332270:0:7419:0:(client.c:2715:ptlrpc_set_wait()) set 00000000dc5d84cb going to sleep for 11 seconds 00000100:00100000:2.0:1787830857.332365:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443783168 00000100:00100000:2.0:1787830857.332371:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443783168 00000100:00100000:2.0:1787830857.332417:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787830857.332426:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005cb2df96 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+15:7419:x1874676443783168:12345-0@lo:253: 20000000:01000000:2.0:1787830857.332454:0:6485:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1787830857.332466:0:6485:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:1.0:1787830857.334817:0:6469:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:2.0:1787830857.335001:0:6485:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787830857.335020:0:6485:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:3.0:1787830857.335137:0:6506:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787830857.335142:0:6506:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787830857.335162:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000868d9877/0x95459fb9d1d28591 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830857.335181:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000007b29eb53/0x95459fb9d1d284b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d284aa expref: 15 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830857.335189:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000d7a8e00e/0x95459fb9d1d28552 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d2854b expref: 15 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830857.335209:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000868d9877/0x95459fb9d1d28591 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830857.335248:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000d7a8e00e/0x95459fb9d1d28552 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x95459fb9d1d2854b expref: 15 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830857.335261:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000d7a8e00e/0x95459fb9d1d28552 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x95459fb9d1d2854b expref: 15 pid: 6484 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830857.335274:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d46ca520 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6506:1874676443783296:0@lo:104: 00000100:00100000:3.0:1787830857.335337:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787830857.335501:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000007b29eb53/0x95459fb9d1d284b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x95459fb9d1d284aa expref: 15 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830857.335509:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000007b29eb53/0x95459fb9d1d284b1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x95459fb9d1d284aa expref: 15 pid: 6484 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830857.335516:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c2f13d4c pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6506:1874676443783424:0@lo:104: 00000100:00100000:3.0:1787830857.335537:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830857.335723:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005cb2df96 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+15:7419:x1874676443783168:12345-0@lo:253: Request processed in 3298us (3498us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830857.335733:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787830857.335887:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set 000000006867a594 going to sleep for 11 seconds 00000100:00100000:0.0:1787830857.335975:0:7419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ee0e42b3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:7419:1874676443783168:0@lo:253: 00000100:00100000:2.0:1787830857.335982:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443783296 10000000:01000000:0.0:1787830857.335989:0:7419:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000100:00100000:2.0:1787830857.335990:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443783296 00000020:01000004:0.0:1787830857.335995:0:7419:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787830857.335997:0:7419:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1787830857.335998:0:7419:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787830857.336000:0:7419:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787830857.336001:0:7419:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787830857.336002:0:7419:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787830857.336004:0:7419:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787830857.336005:0:7419:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787830857.336006:0:7419:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787830857.336007:0:7419:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787830857.336008:0:7419:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787830857.336024:0:7419:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1787830857.336026:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443783424 00000100:00100000:2.0:1787830857.336030:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443783424 00000100:00100000:2.0:1787830857.336047:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787830857.336053:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000a75d294 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a45944b-32e3-4193-a2a5-46f84222bc14+4:6506:x1874676443783296:12345-0@lo:104: 00010000:00010000:2.0:1787830857.336066:0:6474:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: 000000007d0efe64/0x95459fb9d1d2854b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d28552 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830857.336120:0:6474:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787830857.336125:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000a75d294 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a45944b-32e3-4193-a2a5-46f84222bc14+4:6506:x1874676443783296:12345-0@lo:104: Request processed in 72us (788us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830857.336133:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787830857.336148:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d46ca520 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6506:1874676443783296:0@lo:104: 00000100:00100000:2.0:1787830857.336159:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787830857.336166:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ed063b87 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a45944b-32e3-4193-a2a5-46f84222bc14+3:6506:x1874676443783424:12345-0@lo:104: 00010000:00010000:2.0:1787830857.336174:0:6474:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: 00000000efd67c6d/0x95459fb9d1d284aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d284b1 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830857.336213:0:6474:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787830857.336218:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ed063b87 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a45944b-32e3-4193-a2a5-46f84222bc14+3:6506:x1874676443783424:12345-0@lo:104: Request processed in 53us (681us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830857.336224:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787830857.336245:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c2f13d4c pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6506:1874676443783424:0@lo:104: 00010000:00010000:3.0:1787830857.336262:0:6506:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000868d9877/0x95459fb9d1d28591 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830857.336275:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787830857.336281:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: 000000007d0efe64/0x95459fb9d1d2854b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d28552 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830857.336366:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000007d0efe64 already unused, calling callback (00000000bc230e97) 10000000:00010000:1.0:1787830857.336369:0:6479:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: 000000007d0efe64/0x95459fb9d1d2854b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x95459fb9d1d28552 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830857.336377:0:6479:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: 000000007d0efe64/0x95459fb9d1d2854b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x95459fb9d1d28552 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787830857.336384:0:6479:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: 000000007d0efe64/0x95459fb9d1d2854b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x95459fb9d1d28552 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787830857.336390:0:6479:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787830857.336421:0:6479:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: 000000007d0efe64/0x95459fb9d1d2854b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d28552 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830857.336428:0:6479:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787830857.336483:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:1.0:1787830857.336503:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: 000000007d0efe64/0x95459fb9d1d2854b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d28552 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830857.336510:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: 000000007d0efe64/0x95459fb9d1d2854b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d28552 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830857.336522:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787830857.336525:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: 00000000efd67c6d/0x95459fb9d1d284aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d284b1 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830857.336530:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000efd67c6d already unused, calling callback (00000000bc230e97) 10000000:00010000:1.0:1787830857.336532:0:6479:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: 00000000efd67c6d/0x95459fb9d1d284aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x95459fb9d1d284b1 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830857.336549:0:6479:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: 00000000efd67c6d/0x95459fb9d1d284aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x95459fb9d1d284b1 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787830857.336554:0:6479:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: 00000000efd67c6d/0x95459fb9d1d284aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x95459fb9d1d284b1 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787830857.336559:0:6479:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787830857.336583:0:6479:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: 00000000efd67c6d/0x95459fb9d1d284aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d284b1 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830857.336589:0:6479:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787830857.336606:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: 00000000efd67c6d/0x95459fb9d1d284aa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d284b1 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830857.336612:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: 00000000efd67c6d/0x95459fb9d1d284aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d284b1 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830857.336654:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830857.336655:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830857.336657:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830857.336672:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787830857.336682:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008e8b22f0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a45944b-32e3-4193-a2a5-46f84222bc14:3621:1874676443783680:0@lo:103: 00000100:00100000:1.0:1787830857.336710:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830857.336829:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443783680 00000100:00100000:3.0:1787830857.336852:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443783680 00000100:00100000:2.0:1787830857.336874:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d3968ab3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a45944b-32e3-4193-a2a5-46f84222bc14:3619:1874676443783552:0@lo:103: 00010000:00010000:3.0:1787830857.336876:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000007b29eb53/0x95459fb9d1d284b1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d284aa expref: 15 pid: 6484 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830857.336906:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830857.337118:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443783552 00000100:00100000:3.0:1787830857.337123:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443783552 00000100:00100000:1.0:1787830857.337129:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1787830857.337141:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000d7a8e00e/0x95459fb9d1d28552 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d2854b expref: 16 pid: 6484 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830857.337142:0:7432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ee0e42b3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2a45944b-32e3-4193-a2a5-46f84222bc14+16:3621:x1874676443783680:12345-0@lo:103: 00010000:00010000:1.0:1787830857.337158:0:7432:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787830857.337165:0:7432:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000007b29eb53/0x95459fb9d1d284b1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d284aa expref: 16 pid: 6484 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830857.337173:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787830857.337182:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a66bbdb1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2a45944b-32e3-4193-a2a5-46f84222bc14+16:3619:x1874676443783552:12345-0@lo:103: 00010000:00010000:3.0:1787830857.337193:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787830857.337195:0:7432:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000007b29eb53/0x95459fb9d1d284b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x95459fb9d1d284aa expref: 16 pid: 6484 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830857.337199:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000d7a8e00e/0x95459fb9d1d28552 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d2854b expref: 16 pid: 6484 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830857.337219:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000007b29eb53/0x95459fb9d1d284b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x95459fb9d1d284aa expref: 16 pid: 6484 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830857.337225:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000d7a8e00e/0x95459fb9d1d28552 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x95459fb9d1d2854b expref: 16 pid: 6484 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830857.337238:0:7432:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787830857.337243:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d7a8e00e/0x95459fb9d1d28552 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x95459fb9d1d2854b expref: 15 pid: 6484 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830857.337256:0:6476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000868d9877/0x95459fb9d1d28591 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830857.337264:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000868d9877/0x95459fb9d1d28591 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830857.337272:0:7432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ee0e42b3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2a45944b-32e3-4193-a2a5-46f84222bc14+14:3621:x1874676443783680:12345-0@lo:103: Request processed in 135us (561us total) trans 0 rc 0/0 20000000:01000000:3.0:1787830857.337278:0:6476:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002136501s 00000100:00100000:1.0:1787830857.337281:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1787830857.337285:0:6476:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000868d9877/0x95459fb9d1d28591 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830857.337293:0:6476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000868d9877/0x95459fb9d1d28591 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830857.337309:0:6476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000868d9877/0x95459fb9d1d28591 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830857.337315:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000868d9877/0x95459fb9d1d28591 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830857.337321:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000868d9877 already unused, calling callback (00000000f4040125) 00010000:00010000:3.0:1787830857.337325:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000868d9877/0x95459fb9d1d28591 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830857.337326:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008e8b22f0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a45944b-32e3-4193-a2a5-46f84222bc14:3621:1874676443783680:0@lo:103: 00010000:00010000:3.0:1787830857.337338:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000868d9877/0x95459fb9d1d28591 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830857.337352:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000868d9877/0x95459fb9d1d28591 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830857.337363:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787830857.337403:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a66bbdb1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2a45944b-32e3-4193-a2a5-46f84222bc14+13:3619:x1874676443783552:12345-0@lo:103: Request processed in 224us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830857.337409:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787830857.337445:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d3968ab3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a45944b-32e3-4193-a2a5-46f84222bc14:3619:1874676443783552:0@lo:103: 00010000:00010000:3.0:1787830857.339418:0:6506:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000868d9877/0x95459fb9d1d28591 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830857.339430:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000868d9877/0x95459fb9d1d28591 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830857.339435:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000868d9877/0x95459fb9d1d28591 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:1.0:1787830857.340386:0:7419:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:10000000:1.0:1787830857.340556:0:7419:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1787830857.341110:0:7419:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:2.0:1787830857.341286:0:7419:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1787830857.341489:0:7419:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:2.0:1787830857.341916:0:7419:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:2.0:1787830857.342492:0:7419:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:2.0:1787830857.342950:0:7419:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:2.0:1787830857.343148:0:7419:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:2.0:1787830857.343437:0:7419:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:2.0:1787830857.343932:0:7419:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:2.0:1787830857.344107:0:7419:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000040:01000000:1.0:1787830857.345605:0:7419:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:2.0:1787830857.345767:0:7444:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:2.0:1787830857.345771:0:7444:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:1.0:1787830857.345947:0:7445:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:1.0:1787830857.346000:0:7445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d3968ab3 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7445:1874676443783808:0@lo:700: 00000100:00100000:1.0:1787830857.346070:0:7445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830857.346110:0:7445:0:(client.c:2715:ptlrpc_set_wait()) set 000000000919f1f9 going to sleep for 11 seconds 00000040:01000000:2.0:1787830857.346157:0:7419:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:3.0:1787830857.346247:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443783808 00000100:00100000:3.0:1787830857.346257:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443783808 00000100:00100000:3.0:1787830857.346460:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787830857.346468:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008e8b22f0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7445:x1874676443783808:12345-0@lo:700: 00000100:00100000:3.0:1787830857.346728:0:7446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009708cd7a pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7446:1874676443783936:0@lo:1000: 00000100:00100000:3.0:1787830857.346767:0:7446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830857.346805:0:7446:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a836c956 going to sleep for 11 seconds 00000100:00100000:0.0:1787830857.346805:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443783936 00000100:00100000:0.0:1787830857.346811:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443783936 00000100:00100000:0.0:1787830857.346863:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787830857.346869:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c2f13d4c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7446:x1874676443783936:12345-0@lo:1000: 00000100:00100000:0.0:1787830857.347017:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c2f13d4c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7446:x1874676443783936:12345-0@lo:1000: Request processed in 149us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830857.347025:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000040:01000000:1.0:1787830857.347237:0:7419:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:1.0:1787830857.347351:0:7419:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1787830857.347931:0:7419:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1787830857.347942:0:7419:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:1.0:1787830857.348085:0:7419:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787830857.348460:0:7446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009708cd7a pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7446:1874676443783936:0@lo:1000: 00000040:01000000:3.0:1787830857.348500:0:7446:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:3.0:1787830857.348533:0:7446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009708cd7a pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7446:1874676443784064:0@lo:700: 00000100:00100000:3.0:1787830857.348586:0:7446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830857.348615:0:7446:0:(client.c:2715:ptlrpc_set_wait()) set 00000000101c6b8b going to sleep for 11 seconds 00000100:00100000:3.0:1787830857.349728:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443784064 00000100:00100000:3.0:1787830857.349738:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443784064 00000100:00100000:3.0:1787830857.349793:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787830857.349800:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d46ca520 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7446:x1874676443784064:12345-0@lo:700: 00000100:00100000:3.0:1787830857.349893:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d46ca520 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7446:x1874676443784064:12345-0@lo:700: Request processed in 93us (1307us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830857.349901:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787830857.349943:0:7446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009708cd7a pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7446:1874676443784064:0@lo:700: 00000100:00100000:3.0:1787830857.350000:0:7446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009708cd7a pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7446:1874676443784192:0@lo:900: 00000100:00100000:3.0:1787830857.350054:0:7446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830857.350085:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443784192 00000100:00100000:3.0:1787830857.350089:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443784192 00000100:00100000:3.0:1787830857.350116:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787830857.350121:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cedde159 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7446:x1874676443784192:12345-0@lo:900: 00000100:00100000:3.0:1787830857.350157:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cedde159 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7446:x1874676443784192:12345-0@lo:900: Request processed in 36us (103us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830857.350171:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787830857.350192:0:7446:0:(client.c:2715:ptlrpc_set_wait()) set 00000000101c6b8b going to sleep for 11 seconds 00010000:00080000:3.0:1787830857.350207:0:7446:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000009708cd7a x1874676443784192/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787830873 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787830857.350216:0:7446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009708cd7a pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7446:1874676443784192:0@lo:900: 00000100:00100000:3.0:1787830857.350281:0:7446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009708cd7a pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7446:1874676443784320:0@lo:1000: 40000000:02000000:2.0:1787830857.351423:0:6497:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00000040:00080000:1.0:1787830857.352235:0:7419:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:3.0:1787830857.352807:0:7446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830857.352909:0:7446:0:(client.c:2715:ptlrpc_set_wait()) set 0000000057a357c1 going to sleep for 11 seconds 00000040:00080000:1.0:1787830857.354725:0:7419:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1787830857.354800:0:7419:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:1.0:1787830857.355033:0:7419:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1787830857.355248:0:7419:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:1.0:1787830857.355967:0:7419:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:1.0:1787830857.356109:0:7419:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:1.0:1787830857.356270:0:7419:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00000100:00100000:0.0:1787830857.356366:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443784320 00000100:00100000:0.0:1787830857.356379:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443784320 00100000:10000000:1.0:1787830857.356417:0:7419:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00000100:00100000:0.0:1787830857.356493:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787830857.356503:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c0fc0a1b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7446:x1874676443784320:12345-0@lo:1000: 00100000:10000000:1.0:1787830857.356585:0:7419:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:1.0:1787830857.356825:0:7419:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:1.0:1787830857.356994:0:7419:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00000100:00100000:2.0:1787830857.357106:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008e8b22f0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7445:x1874676443783808:12345-0@lo:700: Request processed in 10638us (11035us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830857.357128:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00100000:10000000:1.0:1787830857.357151:0:7419:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:1.0:1787830857.357286:0:7419:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00000100:00100000:0.0:1787830857.357332:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c0fc0a1b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7446:x1874676443784320:12345-0@lo:1000: Request processed in 830us (4527us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830857.357342:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787830857.357439:0:7446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009708cd7a pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7446:1874676443784320:0@lo:1000: 00100000:10000000:1.0:1787830857.357443:0:7419:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00000004:00080000:3.0:1787830857.357508:0:7446:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000101c6b8b with version 0 00000020:00100000:3.0:1787830857.357540:0:7446:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1787830857.357548:0:7446:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000009708cd7a x1874676443784576/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00100000:10000000:1.0:1787830857.357598:0:7419:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00000100:00100000:3.0:1787830857.357654:0:7446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009708cd7a pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7446:1874676443784576:0@lo:1000: 00000100:00100000:3.0:1787830857.357761:0:7446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830857.357798:0:7446:0:(client.c:2715:ptlrpc_set_wait()) set 00000000dc05a6a4 going to sleep for 11 seconds 00000100:00100000:2.0:1787830857.357890:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443784576 00000100:00100000:2.0:1787830857.357896:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443784576 00000100:00100000:2.0:1787830857.357920:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787830857.357925:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000064d2e82f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7446:x1874676443784576:12345-0@lo:1000: 00100000:10000000:1.0:1787830857.358758:0:7419:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00010000:00080000:0.0:1787830857.359003:0:7445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000d3968ab3 x1874676443783808/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787830873 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00100000:10000000:1.0:1787830857.359006:0:7419:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00000100:00100000:0.0:1787830857.359021:0:7445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d3968ab3 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7445:1874676443783808:0@lo:700: 40000000:02000000:0.0:1787830857.359033:0:7445:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00100000:10000000:1.0:1787830857.359150:0:7419:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:1.0:1787830857.359285:0:7419:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:1.0:1787830857.359417:0:7419:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:1.0:1787830857.359750:0:7419:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:1.0:1787830857.359904:0:7419:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:1.0:1787830857.360128:0:7419:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1787830857.360301:0:7419:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:1.0:1787830857.360434:0:7419:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1787830857.360567:0:7419:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:1.0:1787830857.360727:0:7419:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1787830857.360895:0:7419:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:1.0:1787830857.361117:0:7419:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1787830857.361263:0:7419:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1787830857.361424:0:7419:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1787830857.361551:0:7419:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1787830857.361704:0:7419:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1787830857.362030:0:7419:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1787830857.362210:0:7419:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1787830857.362376:0:7419:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1787830857.362578:0:7419:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:2.0:1787830857.368071:0:6469:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000001:00080000:2.0:1787830857.368367:0:7419:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1787830857.368403:0:7419:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffae38c188b988 00100000:10000000:2.0:1787830857.368411:0:7419:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000004:00080000:0.0:1787830857.368897:0:7446:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:0.0:1787830857.368903:0:7446:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1787830857.368922:0:7446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009708cd7a pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7446:1874676443784576:0@lo:1000: 00000100:00100000:0.0:1787830857.369029:0:7446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c75c5971 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7446:1874676443784704:0@lo:1000: 00000100:00100000:0.0:1787830857.369076:0:7446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830857.369107:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:0.0:1787830857.369114:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:0.0:1787830857.369160:0:7446:0:(client.c:2715:ptlrpc_set_wait()) set 000000000e5f732b going to sleep for 11 seconds 00000100:00100000:3.0:1787830857.369250:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000064d2e82f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7446:x1874676443784576:12345-0@lo:1000: Request processed in 11323us (11488us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1787830857.369261:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787830857.369286:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443784704 00000100:00100000:3.0:1787830857.369356:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443784704 00000020:01000004:1.0:1787830857.369361:0:7419:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787830857.369391:0:7419:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.131@tcp: cl_mgc_mutex unlock 00000100:00100000:3.0:1787830857.369394:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787830857.369402:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002fd68536 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7446:x1874676443784704:12345-0@lo:1000: 00000020:01000004:1.0:1787830857.369416:0:7419:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1787830857.369437:0:7419:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000100:00100000:3.0:1787830857.369477:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002fd68536 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7446:x1874676443784704:12345-0@lo:1000: Request processed in 76us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830857.369495:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787830857.369530:0:7446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c75c5971 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7446:1874676443784704:0@lo:1000: 00000040:00080000:2.0:1787830857.370812:0:7446:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:2.0:1787830857.370866:0:7446:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 000000002d58bc87 with version 1 00000004:00080000:0.0:1787830857.370886:0:7436:0:(osp_trans.c:1336:osp_get_next_request()) ou 0000000058bbe739 version 1 rpc_version 1 00000020:00100000:0.0:1787830857.370914:0:7436:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787830857.370923:0:7436:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000007ced4f1f x1874676443784960/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787830857.370942:0:7436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007ced4f1f pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7436:1874676443784960:0@lo:1000: 00000100:00100000:0.0:1787830857.370995:0:7436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830857.371034:0:7436:0:(client.c:2715:ptlrpc_set_wait()) set 000000004c67b722 going to sleep for 11 seconds 00000020:00000004:0.0:1787830857.373728:0:7419:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000040:00080000:2.0:1787830857.373864:0:7446:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1787830857.373944:0:7446:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000020:00000004:0.0:1787830857.374083:0:7419:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00000100:00100000:2.0:1787830857.374181:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443784960 00000100:00100000:2.0:1787830857.374192:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443784960 00000100:00100000:2.0:1787830857.374255:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787830857.374266:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b066a5f7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:7436:x1874676443784960:12345-0@lo:1000: 00000001:00080000:2.0:1787830857.381081:0:6469:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000100:00100000:2.0:1787830857.381199:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b066a5f7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:7436:x1874676443784960:12345-0@lo:1000: Request processed in 6932us (10200us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1787830857.381215:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:0.0:1787830857.381575:0:7436:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:0.0:1787830857.381581:0:7436:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1787830857.381614:0:7436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007ced4f1f pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7436:1874676443784960:0@lo:1000: 00000040:00080000:2.0:1787830857.387921:0:7445:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787830857.398903:0:7445:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1787830857.398985:0:7445:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1787830857.398991:0:7445:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00010000:00010000:0.0:1787830857.640324:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787830858.664134:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830859.686777:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787830860.101742:0:7692:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg331-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787830860.711906:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787830860.742249:0:7744:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787830860.742570:0:7744:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787830861.735260:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787830862.567165:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787830862.567192:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007ced4f1f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443785088:0@lo:41: 00000100:00100000:0.0:1787830862.567277:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830862.567340:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443785088 00000100:00100000:2.0:1787830862.567400:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443785088 00000100:00100000:2.0:1787830862.567475:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787830862.567484:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008a542e85 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443785088:12345-0@lo:41: 00000004:00000024:2.0:1787830862.567526:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:2.0:1787830862.567584:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008a542e85 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443785088:12345-0@lo:41: Request processed in 101us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830862.567591:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787830862.567664:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007ced4f1f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443785088:0@lo:41: 00000100:00100000:1.0:1787830862.569253:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a3bae1d3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3620:1874676443785344:0@lo:400: 00000100:00100000:1.0:1787830862.569318:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830862.569400:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000286164e2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a45944b-32e3-4193-a2a5-46f84222bc14:3619:1874676443785216:0@lo:400: 00000100:00100000:2.0:1787830862.569438:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830862.569476:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787830862.569483:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009b1336ac pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3622:1874676443785472:0@lo:400: 00000100:00100000:2.0:1787830862.569504:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830862.569662:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443785344 00000100:00100000:2.0:1787830862.569668:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443785344 00000100:00100000:2.0:1787830862.569714:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443785472 00000100:00100000:2.0:1787830862.569718:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443785472 00000100:00100000:1.0:1787830862.569735:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787830862.569746:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001686cc8c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1874676443785344:12345-0@lo:400: 00000100:00100000:1.0:1787830862.569790:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001686cc8c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1874676443785344:12345-0@lo:400: Request processed in 48us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830862.569826:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787830862.569835:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000010d5b07f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1874676443785472:12345-0@lo:400: 00000100:00100000:2.0:1787830862.569874:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000010d5b07f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1874676443785472:12345-0@lo:400: Request processed in 42us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830862.569880:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1787830862.569916:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000009b1336ac x1874676443785472/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830878 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787830862.569927:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009b1336ac pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3622:1874676443785472:0@lo:400: 00000100:00100000:2.0:1787830862.570236:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443785216 00000100:00100000:2.0:1787830862.570241:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443785216 00000100:00100000:2.0:1787830862.570273:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787830862.570289:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000079ee9b99 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+13:3619:x1874676443785216:12345-0@lo:400: 00000100:00100000:2.0:1787830862.570330:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000079ee9b99 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+13:3619:x1874676443785216:12345-0@lo:400: Request processed in 44us (892us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830862.570337:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787830862.570374:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000286164e2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a45944b-32e3-4193-a2a5-46f84222bc14:3619:1874676443785216:0@lo:400: 00010000:00080000:2.0:1787830862.570495:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000a3bae1d3 x1874676443785344/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830878 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787830862.570504:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a3bae1d3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3620:1874676443785344:0@lo:400: 00000100:00100000:1.0:1787830862.572414:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1787830862.759518:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787830863.211501:0:7845:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787830863.211947:0:7845:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787830863.783852:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787830864.044616:0:7893:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd18d470a0 20000000:00000080:3.0:1787830864.046445:0:7893:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d232f6e4c00 uarg=0000000000000000 20000000:01000000:3.0:1787830864.046504:0:7893:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1787830864.046512:0:7893:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1787830864.046518:0:7893:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1787830864.046612:0:7893:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:3.0:1787830864.046750:0:7893:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:3.0:1787830864.049784:0:7893:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787830864.050107:0:7893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1787830864.050146:0:7893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:3.0:1787830864.050163:0:7893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:3.0:1787830864.050180:0:7893:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787830864.050200:0:7893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000868d9877/0x95459fb9d1d28598 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830864.050222:0:7893:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000009eba67ea/0x95459fb9d1d28479 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d28472 expref: 12 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830864.050230:0:7893:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000009f828d4a/0x95459fb9d1d28567 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d28560 expref: 12 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830864.050237:0:7893:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000868d9877/0x95459fb9d1d28598 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830864.050280:0:7893:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000009f828d4a/0x95459fb9d1d28567 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x95459fb9d1d28560 expref: 12 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830864.050304:0:7893:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000009f828d4a/0x95459fb9d1d28567 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x95459fb9d1d28560 expref: 12 pid: 6485 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830864.050321:0:7893:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b26a36c6 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7893:1874676443785600:0@lo:104: 00000100:00100000:3.0:1787830864.050410:0:7893:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787830864.050529:0:7893:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000009eba67ea/0x95459fb9d1d28479 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x95459fb9d1d28472 expref: 12 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830864.050537:0:7893:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000009eba67ea/0x95459fb9d1d28479 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x95459fb9d1d28472 expref: 12 pid: 6483 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830864.050546:0:7893:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007984eaab pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7893:1874676443785728:0@lo:104: 00000100:00100000:3.0:1787830864.050565:0:7893:0:(client.c:2715:ptlrpc_set_wait()) set 0000000081831115 going to sleep for 11 seconds 00000100:00100000:0.0:1787830864.052991:0:6473:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787830864.053038:0:6473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830864.053113:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443785600 00000100:00100000:0.0:1787830864.053122:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443785600 00000100:00100000:2.0:1787830864.053179:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443785728 00000100:00100000:2.0:1787830864.053182:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443785728 00000100:00100000:2.0:1787830864.053201:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787830864.053207:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c470334d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a45944b-32e3-4193-a2a5-46f84222bc14+4:7893:x1874676443785600:12345-0@lo:104: 00010000:00010000:2.0:1787830864.053221:0:6474:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: 000000002e8fc016/0x95459fb9d1d28560 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d28567 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830864.053296:0:6474:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787830864.053301:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c470334d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a45944b-32e3-4193-a2a5-46f84222bc14+4:7893:x1874676443785600:12345-0@lo:104: Request processed in 94us (2892us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830864.053308:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787830864.053323:0:7893:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b26a36c6 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7893:1874676443785600:0@lo:104: 00000100:00100000:2.0:1787830864.053353:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787830864.053359:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008718ef3d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a45944b-32e3-4193-a2a5-46f84222bc14+3:7893:x1874676443785728:12345-0@lo:104: 00010000:00010000:2.0:1787830864.053365:0:6474:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: 0000000004129782/0x95459fb9d1d28472 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d28479 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830864.053408:0:6474:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787830864.053412:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008718ef3d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a45944b-32e3-4193-a2a5-46f84222bc14+3:7893:x1874676443785728:12345-0@lo:104: Request processed in 55us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830864.053431:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:2.0:1787830864.053458:0:7431:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787830864.053464:0:7431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: 000000002e8fc016/0x95459fb9d1d28560 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d28567 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830864.053471:0:7431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000002e8fc016 already unused, calling callback (00000000bc230e97) 10000000:00010000:2.0:1787830864.053474:0:7431:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: 000000002e8fc016/0x95459fb9d1d28560 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x95459fb9d1d28567 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830864.053483:0:7431:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: 000000002e8fc016/0x95459fb9d1d28560 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x95459fb9d1d28567 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787830864.053489:0:7431:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: 000000002e8fc016/0x95459fb9d1d28560 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x95459fb9d1d28567 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787830864.053500:0:7431:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787830864.053566:0:7431:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: 000000002e8fc016/0x95459fb9d1d28560 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d28567 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830864.053573:0:7431:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787830864.053588:0:7431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: 000000002e8fc016/0x95459fb9d1d28560 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d28567 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830864.053594:0:7431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: 000000002e8fc016/0x95459fb9d1d28560 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d28567 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830864.053603:0:7431:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787830864.053605:0:7431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: 0000000004129782/0x95459fb9d1d28472 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d28479 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830864.053620:0:7431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000004129782 already unused, calling callback (00000000bc230e97) 00010000:00010000:1.0:1787830864.053683:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:2.0:1787830864.053742:0:7431:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: 0000000004129782/0x95459fb9d1d28472 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x95459fb9d1d28479 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830864.053752:0:7431:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: 0000000004129782/0x95459fb9d1d28472 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x95459fb9d1d28479 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787830864.053757:0:7431:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: 0000000004129782/0x95459fb9d1d28472 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x95459fb9d1d28479 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787830864.053761:0:7431:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787830864.053773:0:7431:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: 0000000004129782/0x95459fb9d1d28472 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d28479 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830864.053777:0:7431:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787830864.053833:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ca867705 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a45944b-32e3-4193-a2a5-46f84222bc14:3619:1874676443785984:0@lo:103: 00000100:00100000:1.0:1787830864.053881:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830864.053964:0:7893:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007984eaab pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7893:1874676443785728:0@lo:104: 00010000:00010000:3.0:1787830864.053989:0:7893:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000868d9877/0x95459fb9d1d28598 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830864.054023:0:7431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: 0000000004129782/0x95459fb9d1d28472 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d28479 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830864.054033:0:7431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: 0000000004129782/0x95459fb9d1d28472 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d28479 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830864.054050:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787830864.054051:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787830864.054053:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787830864.054070:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000018418cd0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a45944b-32e3-4193-a2a5-46f84222bc14:3622:1874676443785856:0@lo:103: 00000100:00100000:2.0:1787830864.054093:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830864.054131:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443785856 00000100:00100000:2.0:1787830864.054131:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443785984 00000100:00100000:3.0:1787830864.054135:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443785856 00000100:00100000:2.0:1787830864.054135:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443785984 00010000:00010000:3.0:1787830864.054152:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000009f828d4a/0x95459fb9d1d28567 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d28560 expref: 14 pid: 6485 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830864.054152:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000009eba67ea/0x95459fb9d1d28479 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d28472 expref: 14 pid: 6483 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830864.054181:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787830864.054185:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787830864.054187:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009bcaa052 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2a45944b-32e3-4193-a2a5-46f84222bc14+14:3622:x1874676443785856:12345-0@lo:103: 00000100:00100000:2.0:1787830864.054190:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fb86a3f8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2a45944b-32e3-4193-a2a5-46f84222bc14+14:3619:x1874676443785984:12345-0@lo:103: 00010000:00010000:3.0:1787830864.054199:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787830864.054199:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787830864.054203:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000009f828d4a/0x95459fb9d1d28567 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d28560 expref: 14 pid: 6485 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830864.054203:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000009eba67ea/0x95459fb9d1d28479 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d28472 expref: 14 pid: 6483 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830864.054212:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000009eba67ea/0x95459fb9d1d28479 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x95459fb9d1d28472 expref: 14 pid: 6483 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830864.054296:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000009f828d4a/0x95459fb9d1d28567 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x95459fb9d1d28560 expref: 14 pid: 6485 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830864.054310:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000009eba67ea/0x95459fb9d1d28479 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x95459fb9d1d28472 expref: 14 pid: 6483 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830864.054311:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000009f828d4a/0x95459fb9d1d28567 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x95459fb9d1d28560 expref: 14 pid: 6485 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830864.054324:0:6477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000868d9877/0x95459fb9d1d28598 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830864.054331:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000868d9877/0x95459fb9d1d28598 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830864.054338:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787830864.054343:0:6477:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000868d9877/0x95459fb9d1d28598 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830864.054350:0:6477:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000868d9877/0x95459fb9d1d28598 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830864.054356:0:6477:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000868d9877/0x95459fb9d1d28598 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830864.054362:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000868d9877/0x95459fb9d1d28598 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830864.054377:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000868d9877 already unused, calling callback (00000000f4040125) 00010000:00010000:2.0:1787830864.054381:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000868d9877/0x95459fb9d1d28598 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830864.054388:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000868d9877/0x95459fb9d1d28598 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830864.054446:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009bcaa052 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2a45944b-32e3-4193-a2a5-46f84222bc14+12:3622:x1874676443785856:12345-0@lo:103: Request processed in 259us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830864.054453:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787830864.054498:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000018418cd0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a45944b-32e3-4193-a2a5-46f84222bc14:3622:1874676443785856:0@lo:103: 00010000:00010000:1.0:1787830864.056245:0:7893:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000868d9877/0x95459fb9d1d28598 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830864.056263:0:7893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000868d9877/0x95459fb9d1d28598 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830864.056568:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000868d9877/0x95459fb9d1d28598 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830864.056579:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000868d9877/0x95459fb9d1d28598 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830864.056599:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787830864.056735:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fb86a3f8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2a45944b-32e3-4193-a2a5-46f84222bc14+11:3619:x1874676443785984:12345-0@lo:103: Request processed in 2540us (2849us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830864.056747:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787830864.056756:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ca867705 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a45944b-32e3-4193-a2a5-46f84222bc14:3619:1874676443785984:0@lo:103: 00010000:00010000:0.0:1787830864.811461:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830865.831217:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787830866.854730:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787830867.047690:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787830867.047699:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d232f730000 from 4 10000000:01000000:2.0:1787830867.047704:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787830867.047759:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: 000000002e8fc016/0x95459fb9d1d2859f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830867.047783:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: 000000002e8fc016/0x95459fb9d1d2859f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830867.047794:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: 000000002e8fc016/0x95459fb9d1d2859f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830867.047839:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000018418cd0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443786112:0@lo:101: 00000100:00100000:2.0:1787830867.047926:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830867.048000:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set 0000000081d606f2 going to sleep for 11 seconds 00000100:00100000:3.0:1787830867.048094:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443786112 00000100:00100000:3.0:1787830867.048103:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443786112 00000100:00100000:3.0:1787830867.048168:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787830867.048178:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003e3fac7c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+11:6487:x1874676443786112:12345-0@lo:101: 00010000:00010000:3.0:1787830867.048193:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787830867.048209:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d7a8e00e/0x95459fb9d1d285a6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d2859f expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830867.048247:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d7a8e00e/0x95459fb9d1d285a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d2859f expref: 12 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830867.048257:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d7a8e00e/0x95459fb9d1d285a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d2859f expref: 12 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830867.048266:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d7a8e00e, rc 0) 00000100:00100000:3.0:1787830867.048315:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003e3fac7c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+12:6487:x1874676443786112:12345-0@lo:101: Request processed in 138us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830867.048332:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787830867.048594:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000018418cd0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443786112:0@lo:101: 00010000:00010000:0.0:1787830867.048610:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: 000000002e8fc016/0x95459fb9d1d2859f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d285a6 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830867.048620:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: 000000002e8fc016/0x95459fb9d1d2859f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d285a6 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830867.048690:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000074217877 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443786240:0@lo:256: 00000100:00100000:0.0:1787830867.048728:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830867.048807:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set 000000003343c438 going to sleep for 11 seconds 00000100:00100000:2.0:1787830867.056352:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443786240 00000100:00100000:2.0:1787830867.056374:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443786240 00000100:00100000:2.0:1787830867.056840:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787830867.056851:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000081e1ac0d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+12:6487:x1874676443786240:12345-0@lo:256: 20000000:01000000:2.0:1787830867.056882:0:6484:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787830867.056902:0:6484:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787830867.056905:0:6484:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1787830867.057236:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000081e1ac0d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+12:6487:x1874676443786240:12345-0@lo:256: Request processed in 386us (8507us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830867.057244:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787830867.061185:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000074217877 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443786240:0@lo:256: 10000000:01000000:1.0:1787830867.061274:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787830867.061286:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: 000000002e8fc016/0x95459fb9d1d2859f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d285a6 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830867.061299:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: 000000002e8fc016/0x95459fb9d1d2859f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d285a6 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787830867.061311:0:6487:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787830867.061313:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d232f730000 from 1 10000000:01000000:1.0:1787830867.061317:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787830867.061356:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: 00000000b20c1294/0x95459fb9d1d285ad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830867.061363:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: 00000000b20c1294/0x95459fb9d1d285ad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830867.061372:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: 00000000b20c1294/0x95459fb9d1d285ad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830867.061391:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008e97441e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443786368:0@lo:101: 00000100:00100000:1.0:1787830867.061475:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830867.061535:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set 0000000035389ce8 going to sleep for 11 seconds 00000100:00100000:2.0:1787830867.061854:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443786368 00000100:00100000:2.0:1787830867.061862:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443786368 00000100:00100000:2.0:1787830867.061925:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787830867.061934:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006d8ef699 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+12:6487:x1874676443786368:12345-0@lo:101: 00010000:00010000:2.0:1787830867.061948:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787830867.061963:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c3b486bf/0x95459fb9d1d285b4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d285ad expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830867.061985:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c3b486bf/0x95459fb9d1d285b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d285ad expref: 13 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830867.061995:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c3b486bf/0x95459fb9d1d285b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d285ad expref: 13 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830867.062004:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c3b486bf, rc 0) 00000100:00100000:2.0:1787830867.062058:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006d8ef699 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+13:6487:x1874676443786368:12345-0@lo:101: Request processed in 126us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830867.062066:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787830867.062144:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008e97441e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443786368:0@lo:101: 00010000:00010000:0.0:1787830867.062156:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: 00000000b20c1294/0x95459fb9d1d285ad lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d285b4 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830867.062174:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: 00000000b20c1294/0x95459fb9d1d285ad lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d285b4 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830867.062249:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009174c7c3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443786496:0@lo:501: 00000100:00100000:0.0:1787830867.062275:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830867.062299:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set 0000000059e66cac going to sleep for 11 seconds 00000100:00100000:1.0:1787830867.062376:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443786496 00000100:00100000:1.0:1787830867.062381:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443786496 00000100:00100000:1.0:1787830867.062418:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787830867.062424:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c06e2521 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+13:6487:x1874676443786496:12345-0@lo:501: 00000100:00100000:1.0:1787830867.062555:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c06e2521 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+13:6487:x1874676443786496:12345-0@lo:501: Request processed in 132us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830867.062562:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787830867.062602:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009174c7c3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443786496:0@lo:501: 00000100:00100000:1.0:1787830867.062660:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ee0e42b3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443786624:0@lo:503: 00000100:00100000:1.0:1787830867.062701:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830867.062719:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set 0000000030e06b83 going to sleep for 11 seconds 00000100:00100000:1.0:1787830867.062729:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443786624 00000100:00100000:1.0:1787830867.062732:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443786624 00000100:00100000:1.0:1787830867.062746:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787830867.062751:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003fd5ccfd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+13:6487:x1874676443786624:12345-0@lo:503: 00000100:00100000:1.0:1787830867.062835:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003fd5ccfd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+13:6487:x1874676443786624:12345-0@lo:503: Request processed in 83us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830867.062841:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787830867.062877:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ee0e42b3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443786624:0@lo:503: 00000100:00100000:1.0:1787830867.063435:0:8031:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ee0e42b3 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:8031:1874676443786752:0@lo:502: 00000100:00100000:1.0:1787830867.063473:0:8031:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830867.063495:0:8031:0:(client.c:2715:ptlrpc_set_wait()) set 000000000e5f732b going to sleep for 11 seconds 00000100:00100000:0.0:1787830867.063574:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443786752 00000100:00100000:0.0:1787830867.063578:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443786752 00000100:00100000:0.0:1787830867.063619:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787830867.063647:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c29ed0a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+13:8031:x1874676443786752:12345-0@lo:502: 00000100:00100000:0.0:1787830867.063738:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c29ed0a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+13:8031:x1874676443786752:12345-0@lo:502: Request processed in 93us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830867.063745:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787830867.064115:0:8031:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ee0e42b3 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:8031:1874676443786752:0@lo:502: 00000020:01000000:1.0:1787830867.064139:0:8031:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787830867.064149:0:8031:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787830867.064155:0:8031:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787830867.064163:0:8031:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d232f730000 00000020:00000080:1.0:1787830867.064165:0:8031:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787830867.064206:0:8031:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2314ed52c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:8031:1874676443786880:0@lo:502: 00000100:00100000:1.0:1787830867.064248:0:8031:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830867.064273:0:8031:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2310a40c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787830867.064309:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443786880 00000100:00100000:0.0:1787830867.064313:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443786880 00000100:00100000:0.0:1787830867.064340:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787830867.064346:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d231859c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+13:8031:x1874676443786880:12345-0@lo:502: 00000100:00100000:0.0:1787830867.064416:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d231859c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+13:8031:x1874676443786880:12345-0@lo:502: Request processed in 69us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830867.064422:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787830867.064536:0:8031:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2314ed52c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:8031:1874676443786880:0@lo:502: 00000020:01000000:2.0:1787830867.064556:0:8031:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787830867.064561:0:8031:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787830867.064562:0:8031:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1787830867.064569:0:8031:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1787830867.064884:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1787830867.064907:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787830867.064916:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d2301668800/0x95459fb9d1d285ad lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d285b4 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830867.064929:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8d2301668800/0x95459fb9d1d285ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d285b4 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787830867.064945:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787830867.064948:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d2303f2e000 from 21 10000000:01000000:0.0:1787830867.064951:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787830867.064976:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d2300030a00/0x95459fb9d1d285bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830867.064983:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8d2300030a00/0x95459fb9d1d285bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830867.064993:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8d2300030a00/0x95459fb9d1d285bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830867.065004:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2314e70b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443787008:0@lo:101: 00000100:00100000:0.0:1787830867.065031:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830867.065051:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d23082b6600 going to sleep for 11 seconds 00000100:00100000:1.0:1787830867.065103:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443787008 00000100:00100000:1.0:1787830867.065107:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443787008 00000100:00100000:1.0:1787830867.065135:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787830867.065141:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d231859c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+13:6487:x1874676443787008:12345-0@lo:101: 00010000:00010000:1.0:1787830867.065149:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787830867.065161:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2301669200/0x95459fb9d1d285c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d285bb expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830867.065181:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2301669200/0x95459fb9d1d285c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d285bb expref: 14 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830867.065191:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2301669200/0x95459fb9d1d285c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d285bb expref: 14 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830867.065199:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2301669200, rc 0) 00000100:00100000:1.0:1787830867.065239:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d231859c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+14:6487:x1874676443787008:12345-0@lo:101: Request processed in 98us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830867.065244:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787830867.065270:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2314e70b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443787008:0@lo:101: 00010000:00010000:1.0:1787830867.065280:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8d2300030a00/0x95459fb9d1d285bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d285c2 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830867.065288:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8d2300030a00/0x95459fb9d1d285bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d285c2 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830867.065338:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2314ed52c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443787136:0@lo:501: 00000100:00100000:1.0:1787830867.065358:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830867.065376:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2310a40600 going to sleep for 11 seconds 00000100:00100000:1.0:1787830867.065385:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443787136 00000100:00100000:1.0:1787830867.065387:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443787136 00000100:00100000:1.0:1787830867.065611:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787830867.065618:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d231859dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+14:6487:x1874676443787136:12345-0@lo:501: 00000100:00100000:1.0:1787830867.065749:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d231859dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+14:6487:x1874676443787136:12345-0@lo:501: Request processed in 131us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830867.065755:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787830867.065794:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2314ed52c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443787136:0@lo:501: 00000100:00100000:1.0:1787830867.065822:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2314ed52c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443787264:0@lo:503: 00000100:00100000:1.0:1787830867.065858:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830867.065875:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2310a40600 going to sleep for 11 seconds 00000100:00100000:1.0:1787830867.065886:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443787264 00000100:00100000:1.0:1787830867.065889:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443787264 00000100:00100000:1.0:1787830867.065906:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787830867.065911:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d231859e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+14:6487:x1874676443787264:12345-0@lo:503: 00000100:00100000:1.0:1787830867.065987:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d231859e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+14:6487:x1874676443787264:12345-0@lo:503: Request processed in 75us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830867.065994:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787830867.066029:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2314ed52c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443787264:0@lo:503: 00000100:00100000:0.0:1787830867.069141:0:8032:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2314e71e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:8032:1874676443787392:0@lo:502: 00000100:00100000:0.0:1787830867.069259:0:8032:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830867.069311:0:8032:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d23082b69c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787830867.069386:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443787392 00000100:00100000:1.0:1787830867.069456:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443787392 00000100:00100000:1.0:1787830867.069522:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787830867.069532:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d231859d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+14:8032:x1874676443787392:12345-0@lo:502: 00000100:00100000:1.0:1787830867.070045:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d231859d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+14:8032:x1874676443787392:12345-0@lo:502: Request processed in 513us (785us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830867.070054:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787830867.072382:0:8032:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2314e71e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:8032:1874676443787392:0@lo:502: 00000100:00100000:0.0:1787830867.072866:0:8032:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2314e70000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:8032:1874676443787520:0@lo:502: 00000100:00100000:0.0:1787830867.072953:0:8032:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830867.073001:0:8032:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d23082b6d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787830867.073559:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443787520 00000100:00100000:2.0:1787830867.073568:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443787520 00000100:00100000:2.0:1787830867.073657:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787830867.073669:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2310886050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+14:8032:x1874676443787520:12345-0@lo:502: 00000100:00100000:2.0:1787830867.073861:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2310886050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+14:8032:x1874676443787520:12345-0@lo:502: Request processed in 194us (907us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830867.073870:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787830867.073972:0:8032:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2314e70000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:8032:1874676443787520:0@lo:502: 00000040:00080000:1.0:1787830867.074005:0:8032:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:2.0:1787830867.074244:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:2.0:1787830867.074271:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787830867.074283:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d2300030a00/0x95459fb9d1d285bb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d285c2 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830867.074294:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8d2300030a00/0x95459fb9d1d285bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d285c2 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787830867.074304:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787830867.074307:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d2303f2e000 from 4 10000000:01000000:2.0:1787830867.074311:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787830867.074344:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233837b600/0x95459fb9d1d285c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830867.074360:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8d233837b600/0x95459fb9d1d285c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830867.074371:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8d233837b600/0x95459fb9d1d285c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830867.074388:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2309cfa1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443787648:0@lo:101: 00000100:00100000:2.0:1787830867.074429:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830867.074506:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d232f727540 going to sleep for 11 seconds 00000100:00100000:1.0:1787830867.075334:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443787648 00000100:00100000:1.0:1787830867.075343:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443787648 00000100:00100000:1.0:1787830867.075432:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787830867.075442:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2310884850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+14:6487:x1874676443787648:12345-0@lo:101: 00010000:00010000:1.0:1787830867.075454:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787830867.075471:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2301669a00/0x95459fb9d1d285d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d285c9 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830867.075499:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2301669a00/0x95459fb9d1d285d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d285c9 expref: 15 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830867.075511:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2301669a00/0x95459fb9d1d285d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d285c9 expref: 15 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830867.075520:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2301669a00, rc 0) 00000100:00100000:1.0:1787830867.075576:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2310884850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+15:6487:x1874676443787648:12345-0@lo:101: Request processed in 136us (1147us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830867.075584:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787830867.075798:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2309cfa1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443787648:0@lo:101: 00010000:00010000:2.0:1787830867.075817:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8d233837b600/0x95459fb9d1d285c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d285d0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830867.075828:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8d233837b600/0x95459fb9d1d285c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d285d0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830867.075894:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2309cfa1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443787776:0@lo:256: 00000100:00100000:2.0:1787830867.075937:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830867.076009:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d232f727540 going to sleep for 11 seconds 00000100:00100000:1.0:1787830867.076045:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443787776 00000100:00100000:1.0:1787830867.076050:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443787776 00000100:00100000:1.0:1787830867.076199:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787830867.076217:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2310887c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+15:6487:x1874676443787776:12345-0@lo:256: 20000000:01000000:1.0:1787830867.076235:0:6485:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787830867.076255:0:6485:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787830867.076259:0:6485:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1787830867.076352:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2310887c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+15:6487:x1874676443787776:12345-0@lo:256: Request processed in 136us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830867.076360:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787830867.076422:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2309cfa1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443787776:0@lo:256: 10000000:01000000:2.0:1787830867.076470:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787830867.076478:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233837b600/0x95459fb9d1d285c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d285d0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830867.076487:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8d233837b600/0x95459fb9d1d285c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d285d0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787830867.076508:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1787830867.076511:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:2.0:1787830867.076514:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787830867.076534:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233837bc00/0x95459fb9d1d285d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830867.076542:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8d233837bc00/0x95459fb9d1d285d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830867.076550:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8d233837bc00/0x95459fb9d1d285d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830867.076563:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2309cfa1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443787904:0@lo:101: 00000100:00100000:2.0:1787830867.076590:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830867.076739:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d232f727540 going to sleep for 11 seconds 00000100:00100000:0.0:1787830867.076783:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443787904 00000100:00100000:0.0:1787830867.076789:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443787904 00000100:00100000:0.0:1787830867.076815:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787830867.076823:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2310887450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+15:6487:x1874676443787904:12345-0@lo:101: 00010000:00010000:0.0:1787830867.076831:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787830867.076843:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2300030000/0x95459fb9d1d285de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d285d7 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830867.076871:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2300030000/0x95459fb9d1d285de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d285d7 expref: 16 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830867.076882:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2300030000/0x95459fb9d1d285de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d285d7 expref: 16 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830867.076890:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2300030000, rc 0) 00000100:00100000:0.0:1787830867.076925:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2310887450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+16:6487:x1874676443787904:12345-0@lo:101: Request processed in 104us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830867.076932:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787830867.077036:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2309cfa1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443787904:0@lo:101: 00010000:00010000:2.0:1787830867.077241:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8d233837bc00/0x95459fb9d1d285d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d285de expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830867.077252:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8d233837bc00/0x95459fb9d1d285d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d285de expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830867.077321:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2309cfa1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443788032:0@lo:501: 00000100:00100000:2.0:1787830867.077352:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830867.077412:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d232f727540 going to sleep for 11 seconds 00000100:00100000:0.0:1787830867.077446:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443788032 00000100:00100000:0.0:1787830867.077451:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443788032 00000100:00100000:0.0:1787830867.077518:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787830867.077526:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2310884450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+16:6487:x1874676443788032:12345-0@lo:501: 00000100:00100000:0.0:1787830867.078069:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2310884450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+16:6487:x1874676443788032:12345-0@lo:501: Request processed in 542us (713us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830867.078079:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787830867.078253:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2309cfa1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443788032:0@lo:501: 00000100:00100000:2.0:1787830867.078295:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2309cfa1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443788160:0@lo:503: 00000100:00100000:2.0:1787830867.078351:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830867.078422:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d232f727540 going to sleep for 11 seconds 00000100:00100000:0.0:1787830867.078459:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443788160 00000100:00100000:0.0:1787830867.078465:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443788160 00000100:00100000:0.0:1787830867.078498:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787830867.078507:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d230888b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+16:6487:x1874676443788160:12345-0@lo:503: 00000100:00100000:0.0:1787830867.078609:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d230888b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+16:6487:x1874676443788160:12345-0@lo:503: Request processed in 102us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830867.078616:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787830867.078803:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2309cfa1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443788160:0@lo:503: 00000100:00100000:0.0:1787830867.079260:0:8033:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2314e70000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:8033:1874676443788288:0@lo:502: 00000100:00100000:0.0:1787830867.079306:0:8033:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830867.079347:0:8033:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d23082b6cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787830867.079390:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443788288 00000100:00100000:2.0:1787830867.079395:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443788288 00000100:00100000:2.0:1787830867.079455:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787830867.079463:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d230888bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+16:8033:x1874676443788288:12345-0@lo:502: 00000100:00100000:2.0:1787830867.079560:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d230888bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+16:8033:x1874676443788288:12345-0@lo:502: Request processed in 98us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830867.079567:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787830867.079661:0:8033:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2314e70000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:8033:1874676443788288:0@lo:502: 00000020:01000000:1.0:1787830867.079689:0:8033:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787830867.079703:0:8033:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787830867.079706:0:8033:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1787830867.079711:0:8033:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787830867.079715:0:8033:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.131@tcp to nid 0x20000c0a8cb83 (192.168.203.131@tcp) 00000020:00000080:1.0:1787830867.079742:0:8033:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787830867.079907:0:8033:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff8d232f77cd28) 00000020:00000080:1.0:1787830867.079933:0:8033:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:1.0:1787830867.079942:0:8033:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787830867.080035:0:8033:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1787830867.080043:0:8033:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:1.0:1787830867.080051:0:8033:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x95459fb9d1d285ec 00010000:00080000:1.0:1787830867.080232:0:8033:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d233bc5c000@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.131@tcp at head 00010000:00010000:0.0:1787830867.082516:0:8033:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:0.0:1787830867.083570:0:8033:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787830867.083587:0:8033:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1787830867.085295:0:8033:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:0.0:1787830867.085337:0:8033:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x95459fb9d1d285f3 00000100:00080000:0.0:1787830867.085352:0:8033:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787830867.085360:0:8033:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8d233bc5c000 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:0.0:1787830867.085425:0:8033:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2314e71e00 x1874676443788416/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787830867.085499:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2314e71e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1874676443788416:0@lo:38: 00000100:00100000:2.0:1787830867.085607:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830867.085828:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443788416 00000100:00100000:1.0:1787830867.085837:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443788416 00000100:00100000:1.0:1787830867.085882:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787830867.085891:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2309cfa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3618:x1874676443788416:12345-0@lo:38: 00010000:00080000:1.0:1787830867.085922:0:7448:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 158 last 0 00000020:00000080:1.0:1787830867.085967:0:7448:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x95459fb9d1d285fa 00000004:00100000:1.0:1787830867.085985:0:7448:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1787830867.085990:0:7448:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:0.0:1787830867.086144:0:8033:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000040:01000000:0.0:1787830867.086233:0:8033:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:2.0:1787830867.086646:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2314ed52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3620:1874676443788544:0@lo:400: 00000100:00100000:2.0:1787830867.086698:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830867.086880:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2314ed61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443788672:0@lo:400: 00000100:00100000:1.0:1787830867.086935:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830867.086958:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787830867.086965:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2314ed4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3621:1874676443788800:0@lo:400: 00000100:00100000:1.0:1787830867.086986:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830867.087014:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443788672 00000100:00100000:1.0:1787830867.087019:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443788672 00000100:00100000:1.0:1787830867.087055:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787830867.087062:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2314ed6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443788672:12345-0@lo:400: 00000100:00100000:1.0:1787830867.087132:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2314ed6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443788672:12345-0@lo:400: Request processed in 70us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830867.087140:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787830867.087164:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443788544 00000100:00100000:1.0:1787830867.087167:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443788544 00000100:00100000:1.0:1787830867.087192:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443788800 00000100:00100000:1.0:1787830867.087196:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443788800 00000100:00100000:1.0:1787830867.087210:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787830867.087216:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2309cfa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1874676443788544:12345-0@lo:400: 00000100:00100000:1.0:1787830867.087426:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2309cfa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1874676443788544:12345-0@lo:400: Request processed in 208us (726us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830867.087433:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787830867.087446:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787830867.087452:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2314ed43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1874676443788800:12345-0@lo:400: 00000100:00100000:1.0:1787830867.087480:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2314ed43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1874676443788800:12345-0@lo:400: Request processed in 29us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830867.087486:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1787830867.087535:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d2314ed4b40 x1874676443788800/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830883 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787830867.087559:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2314ed4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3621:1874676443788800:0@lo:400: 00000100:00100000:1.0:1787830867.087573:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2314ed61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443788672:0@lo:400: 00010000:00080000:2.0:1787830867.098696:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d2314ed52c0 x1874676443788544/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830883 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787830867.098721:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2314ed52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3620:1874676443788544:0@lo:400: 00000100:00080000:1.0:1787830867.100894:0:7448:0:(import.c:65:import_set_state_nolock()) ffff8d233bc5e000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787830867.101017:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2309cfa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3618:x1874676443788416:12345-0@lo:38: Request processed in 15124us (15407us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830867.101030:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787830867.101140:0:3618:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787830867.101151:0:3618:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1787830867.101161:0:3618:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1787830867.101168:0:3618:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1787830867.101172:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8d233bc5c000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787830867.101197:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2314e71e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1874676443788416:0@lo:38: 00000100:00100000:2.0:1787830867.101422:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2314ed61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443788928:0@lo:41: 00000100:00100000:2.0:1787830867.101479:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830867.101573:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443788928 00000100:00100000:1.0:1787830867.101580:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443788928 00000100:00100000:1.0:1787830867.101654:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787830867.101665:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2309cf83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3619:x1874676443788928:12345-0@lo:41: 00000004:00000024:1.0:1787830867.101695:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1787830867.101742:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2309cf83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3619:x1874676443788928:12345-0@lo:41: Request processed in 79us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830867.101749:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787830867.101932:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2314ed61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443788928:0@lo:41: 00000100:00100000:2.0:1787830867.102184:0:8036:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2309cf8780 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:8036:1874676443789056:0@lo:1000: 00000100:00100000:2.0:1787830867.102216:0:8036:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830867.102245:0:8036:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d232f7270c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787830867.102339:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443789056 00000100:00100000:1.0:1787830867.102344:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443789056 00000100:00100000:1.0:1787830867.102376:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787830867.102383:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2309cf8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:8036:x1874676443789056:12345-0@lo:1000: 00000100:00100000:1.0:1787830867.102443:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2309cf8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:8036:x1874676443789056:12345-0@lo:1000: Request processed in 61us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830867.102450:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787830867.102506:0:8036:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2309cf8780 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:8036:1874676443789056:0@lo:1000: 00000040:01000000:2.0:1787830867.102531:0:8036:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1787830867.102556:0:8036:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2309cf8780 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:8036:1874676443789184:0@lo:1000: 00000100:00100000:2.0:1787830867.102583:0:8036:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830867.102605:0:8036:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d232f7270c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787830867.102719:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443789184 00000100:00100000:1.0:1787830867.102724:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443789184 00000100:00100000:1.0:1787830867.102754:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787830867.102760:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2309d08780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:8036:x1874676443789184:12345-0@lo:1000: 00000100:00100000:1.0:1787830867.102870:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2309d08780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:8036:x1874676443789184:12345-0@lo:1000: Request processed in 110us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830867.102885:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787830867.102962:0:8036:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2309cf8780 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:8036:1874676443789184:0@lo:1000: 00000100:00100000:2.0:1787830867.103009:0:8036:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2309d09e00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:8036:1874676443789312:0@lo:700: 00000100:00100000:2.0:1787830867.103036:0:8036:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830867.103195:0:8036:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d232f727c00 going to sleep for 11 seconds 00000020:01000000:0.0:1787830867.103322:0:8033:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787830867.103331:0:8033:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787830867.103333:0:8033:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:0.0:1787830867.103337:0:8033:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787830867.103341:0:8033:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787830867.103343:0:8033:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787830867.103347:0:8033:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787830867.103349:0:8033:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1787830867.103374:0:8033:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2314e70b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:8033:1874676443789440:0@lo:502: 00000100:00100000:0.0:1787830867.103417:0:8033:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830867.103442:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443789440 00000100:00100000:0.0:1787830867.103446:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443789440 00000100:00100000:0.0:1787830867.103570:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787830867.103579:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2308888450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+16:8033:x1874676443789440:12345-0@lo:502: 00000100:00100000:0.0:1787830867.103696:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2308888450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+16:8033:x1874676443789440:12345-0@lo:502: Request processed in 117us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830867.103703:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787830867.103805:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443789312 00000100:00100000:1.0:1787830867.103810:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443789312 00000100:00100000:1.0:1787830867.103836:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787830867.103842:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2309d08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:8036:x1874676443789312:12345-0@lo:700: 00000100:00100000:1.0:1787830867.103884:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2309d08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:8036:x1874676443789312:12345-0@lo:700: Request processed in 43us (848us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830867.103890:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787830867.103970:0:8036:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2309d09e00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:8036:1874676443789312:0@lo:700: 00000100:00100000:2.0:1787830867.104143:0:8036:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2309d09e00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:8036:1874676443789568:0@lo:1000: 00000100:00100000:2.0:1787830867.104170:0:8036:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830867.104195:0:8036:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d232f727b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787830867.104428:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443789568 00000100:00100000:1.0:1787830867.104432:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443789568 00000100:00100000:1.0:1787830867.104464:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787830867.104470:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2309d092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:8036:x1874676443789568:12345-0@lo:1000: 00000100:00100000:1.0:1787830867.104539:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2309d092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:8036:x1874676443789568:12345-0@lo:1000: Request processed in 69us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830867.104546:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787830867.104609:0:8036:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2309d09e00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:8036:1874676443789568:0@lo:1000: 00000004:00080000:2.0:1787830867.104680:0:8036:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8d232f727c00 with version 0 00000020:00100000:2.0:1787830867.104696:0:8036:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1787830867.104704:0:8036:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8d2309d09e00 x1874676443789824/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787830867.104717:0:8036:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2309d09e00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:8036:1874676443789824:0@lo:1000: 00000100:00100000:2.0:1787830867.104749:0:8036:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830867.104767:0:8036:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d232f727600 going to sleep for 11 seconds 00000100:00100000:1.0:1787830867.104831:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443789824 00000100:00100000:1.0:1787830867.104835:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443789824 00000100:00100000:1.0:1787830867.104864:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787830867.104870:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2309d0b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:8036:x1874676443789824:12345-0@lo:1000: 00000100:00100000:0.0:1787830867.107732:0:8033:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d23082b6180 going to sleep for 11 seconds 00000100:00100000:0.0:1787830867.107794:0:8033:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2314e70b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:8033:1874676443789440:0@lo:502: 00000020:01000000:0.0:1787830867.107843:0:8033:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787830867.107853:0:8033:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787830867.107856:0:8033:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787830867.107862:0:8033:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:1.0:1787830867.108206:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:1.0:1787830867.108236:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787830867.108249:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233837bc00/0x95459fb9d1d285d7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d285de expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830867.108262:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8d233837bc00/0x95459fb9d1d285d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d285de expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787830867.108285:0:6487:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787830867.108289:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d2303f2e000 from 1 10000000:01000000:1.0:1787830867.108292:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787830867.108333:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d2301669600/0x95459fb9d1d28601 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830867.108341:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8d2301669600/0x95459fb9d1d28601 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830867.108350:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8d2301669600/0x95459fb9d1d28601 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830867.108373:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2314ed4b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443789952:0@lo:101: 00000100:00100000:1.0:1787830867.108472:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830867.108509:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d23100036c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787830867.108533:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443789952 00000100:00100000:1.0:1787830867.108540:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443789952 00000100:00100000:1.0:1787830867.108587:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787830867.108596:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2308888850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+16:6487:x1874676443789952:12345-0@lo:101: 00010000:00010000:1.0:1787830867.108609:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787830867.108658:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d233be95400/0x95459fb9d1d28608 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d28601 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830867.108685:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d233be95400/0x95459fb9d1d28608 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d28601 expref: 17 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830867.108695:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d233be95400/0x95459fb9d1d28608 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d28601 expref: 17 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830867.108713:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233be95400, rc 0) 00000100:00100000:1.0:1787830867.108756:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2308888850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+17:6487:x1874676443789952:12345-0@lo:101: Request processed in 160us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830867.108763:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787830867.108822:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2314ed4b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443789952:0@lo:101: 00010000:00010000:1.0:1787830867.108836:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8d2301669600/0x95459fb9d1d28601 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d28608 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830867.108845:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8d2301669600/0x95459fb9d1d28601 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d28608 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830867.108909:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2314ed4b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443790080:0@lo:501: 00000100:00100000:1.0:1787830867.108935:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830867.108952:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d23100036c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787830867.109508:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443790080 00000100:00100000:0.0:1787830867.109513:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443790080 00000100:00100000:0.0:1787830867.109553:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787830867.109562:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2308889c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+17:6487:x1874676443790080:12345-0@lo:501: 00000100:00100000:0.0:1787830867.109737:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2308889c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+17:6487:x1874676443790080:12345-0@lo:501: Request processed in 175us (800us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830867.109745:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787830867.109791:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2314ed4b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443790080:0@lo:501: 00000100:00100000:0.0:1787830867.109827:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2314e70b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443790208:0@lo:503: 00000100:00100000:0.0:1787830867.109869:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830867.109888:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d23082b6d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787830867.109949:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443790208 00000100:00100000:2.0:1787830867.109954:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443790208 00000100:00100000:2.0:1787830867.109990:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787830867.109997:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d230888a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+17:6487:x1874676443790208:12345-0@lo:503: 00000100:00100000:2.0:1787830867.110097:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d230888a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+17:6487:x1874676443790208:12345-0@lo:503: Request processed in 100us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830867.110104:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787830867.110180:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2314e70b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443790208:0@lo:503: 00000100:00100000:2.0:1787830867.110859:0:8038:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2309d0bc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:8038:1874676443790336:0@lo:502: 00000100:00100000:2.0:1787830867.110906:0:8038:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830867.110969:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443790336 00000100:00100000:1.0:1787830867.110974:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443790336 00000100:00100000:2.0:1787830867.110980:0:8038:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d23046d2b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787830867.111008:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787830867.111017:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2308889450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+17:8038:x1874676443790336:12345-0@lo:502: 00000100:00100000:1.0:1787830867.111134:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2308889450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+17:8038:x1874676443790336:12345-0@lo:502: Request processed in 118us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830867.111141:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000001:00080000:0.0:1787830867.111172:0:7421:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:0.0:1787830867.111183:0:7421:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1787830867.111219:0:8038:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2309d0bc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:8038:1874676443790336:0@lo:502: 00000020:01000000:2.0:1787830867.111247:0:8038:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787830867.111260:0:8038:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787830867.111262:0:8038:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787830867.111268:0:8038:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d2303f2e000 00000020:00000080:2.0:1787830867.111270:0:8038:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787830867.111291:0:8038:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2309d0bc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:8038:1874676443790464:0@lo:502: 00000100:00100000:2.0:1787830867.111324:0:8038:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830867.111350:0:8038:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2303250240 going to sleep for 11 seconds 00000100:00100000:1.0:1787830867.111463:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2309d0b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:8036:x1874676443789824:12345-0@lo:1000: Request processed in 6592us (6712us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1787830867.111472:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787830867.111695:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443790464 00000100:00100000:0.0:1787830867.111700:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443790464 00000100:00100000:0.0:1787830867.111764:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787830867.111771:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2308888c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+17:8038:x1874676443790464:12345-0@lo:502: 00000100:00100000:0.0:1787830867.111866:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2308888c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+17:8038:x1874676443790464:12345-0@lo:502: Request processed in 95us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830867.111873:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000004:00080000:2.0:1787830867.111965:0:8036:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:2.0:1787830867.111970:0:8036:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1787830867.111985:0:8036:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2309d09e00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:8036:1874676443789824:0@lo:1000: 00000100:00100000:2.0:1787830867.112057:0:8036:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2309d09e00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:8036:1874676443790592:0@lo:1000: 00000100:00100000:2.0:1787830867.112090:0:8036:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830867.112116:0:8036:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2303250600 going to sleep for 11 seconds 00000100:00100000:2.0:1787830867.112134:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443790592 00000100:00100000:2.0:1787830867.112139:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443790592 00000100:00100000:2.0:1787830867.112166:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787830867.112173:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2309cf8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:8036:x1874676443790592:12345-0@lo:1000: 00000100:00100000:2.0:1787830867.112231:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2309cf8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:8036:x1874676443790592:12345-0@lo:1000: Request processed in 59us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830867.112238:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787830867.112267:0:8036:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2309d09e00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:8036:1874676443790592:0@lo:1000: 00000040:00080000:2.0:1787830867.112286:0:8036:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:2.0:1787830867.112313:0:8036:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8d23032503c0 with version 1 00000004:00080000:3.0:1787830867.113941:0:8034:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8d23082b6840 version 1 rpc_version 1 00000020:00100000:3.0:1787830867.113978:0:8034:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1787830867.113991:0:8034:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8d232f795680 x1874676443790848/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787830867.114016:0:8034:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d232f795680 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8034:1874676443790848:0@lo:1000: 00000100:00100000:3.0:1787830867.114100:0:8034:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830867.114670:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443790848 00000100:00100000:1.0:1787830867.114680:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443790848 00000100:00100000:3.0:1787830867.114684:0:8034:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2305268c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787830867.114746:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787830867.114755:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d232f794f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:8034:x1874676443790848:12345-0@lo:1000: 00000040:00080000:2.0:1787830867.114941:0:8036:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1787830867.115025:0:8036:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1787830867.115031:0:8036:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000100:00100000:0.0:1787830867.115687:0:8038:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2309d0bc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:8038:1874676443790464:0@lo:502: 00000020:01000000:0.0:1787830867.115734:0:8038:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787830867.115743:0:8038:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787830867.115746:0:8038:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1787830867.115759:0:8038:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1787830867.116255:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1787830867.116292:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787830867.116305:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d2301669600/0x95459fb9d1d28601 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d28608 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830867.116318:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8d2301669600/0x95459fb9d1d28601 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d28608 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787830867.116330:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1787830867.116333:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8d2312953370 from 1 10000000:01000000:2.0:1787830867.116336:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787830867.116373:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233837b800/0x95459fb9d1d2860f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830867.116382:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8d233837b800/0x95459fb9d1d2860f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830867.116400:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8d233837b800/0x95459fb9d1d2860f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830867.116422:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2309d0bc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443790976:0@lo:101: 00000100:00100000:2.0:1787830867.116492:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830867.116689:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2303250c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787830867.118294:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443790976 00000100:00100000:3.0:1787830867.118308:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443790976 00000100:00100000:3.0:1787830867.118370:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787830867.118381:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d230888ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+17:6487:x1874676443790976:12345-0@lo:101: 00010000:00010000:3.0:1787830867.118398:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787830867.118417:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2307c76600/0x95459fb9d1d28616 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d2860f expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830867.118454:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2307c76600/0x95459fb9d1d28616 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d2860f expref: 18 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830867.118465:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2307c76600/0x95459fb9d1d28616 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d2860f expref: 18 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830867.118475:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2307c76600, rc 0) 00000100:00100000:3.0:1787830867.118550:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d230888ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+18:6487:x1874676443790976:12345-0@lo:101: Request processed in 172us (2058us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830867.118557:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787830867.119399:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2309d0bc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443790976:0@lo:101: 00010000:00010000:2.0:1787830867.119423:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8d233837b800/0x95459fb9d1d2860f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d28616 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830867.119436:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8d233837b800/0x95459fb9d1d2860f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d28616 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830867.119528:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2309d0bc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443791104:0@lo:501: 00000100:00100000:2.0:1787830867.119574:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830867.119616:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2303250c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787830867.119616:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443791104 00000100:00100000:1.0:1787830867.119644:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443791104 00000100:00100000:1.0:1787830867.119677:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787830867.119683:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d230888b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+18:6487:x1874676443791104:12345-0@lo:501: 00000100:00100000:1.0:1787830867.119767:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d230888b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+18:6487:x1874676443791104:12345-0@lo:501: Request processed in 84us (194us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787830867.119787:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787830867.122561:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2309d0bc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443791104:0@lo:501: 10000000:01000000:0.0:1787830867.122647:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787830867.122659:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233837b800/0x95459fb9d1d2860f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d28616 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830867.122673:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8d233837b800/0x95459fb9d1d2860f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d28616 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787830867.130862:0:7421:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:1.0:1787830867.131905:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d232f794f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:8034:x1874676443790848:12345-0@lo:1000: Request processed in 17143us (17797us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1787830867.131919:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000004:00080000:3.0:1787830867.132054:0:8034:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:3.0:1787830867.132060:0:8034:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1787830867.132090:0:8034:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d232f795680 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8034:1874676443790848:0@lo:1000: 00000100:00100000:1.0:1787830867.687377:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787830867.689075:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2314e70b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443791232:0@lo:41: 00000100:00100000:1.0:1787830867.689171:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830867.689408:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443791232 00000100:00100000:2.0:1787830867.689417:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443791232 00000100:00100000:2.0:1787830867.689518:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787830867.689529:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2314ed4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443791232:12345-0@lo:41: 00000004:00000024:2.0:1787830867.689571:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:2.0:1787830867.689669:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2314ed4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443791232:12345-0@lo:41: Request processed in 141us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830867.689677:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787830867.689848:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2314e70b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443791232:0@lo:41: 00010000:00010000:1.0:1787830867.880813:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787830868.902925:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787830869.927233:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830870.962450:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830871.976646:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787830872.294931:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787830872.294954:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2314ed4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676443791360:0@lo:41: 00000100:00100000:1.0:1787830872.295026:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830872.295084:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443791360 00000100:00100000:1.0:1787830872.295091:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443791360 00000100:00100000:1.0:1787830872.295130:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787830872.295138:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2314ed5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1874676443791360:12345-0@lo:41: 00000004:00000024:1.0:1787830872.295178:0:7448:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1787830872.295231:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2314ed5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1874676443791360:12345-0@lo:41: Request processed in 93us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830872.295238:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787830872.295294:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2314ed4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676443791360:0@lo:41: 00000100:00100000:2.0:1787830872.295505:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2309d09e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874676443791616:0@lo:400: 00000100:00100000:2.0:1787830872.295570:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830872.295596:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787830872.295602:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2318d57840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443791744:0@lo:400: 00000100:00100000:2.0:1787830872.295652:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830872.295681:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443791616 00000100:00100000:2.0:1787830872.295685:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443791616 00000100:00100000:2.0:1787830872.295716:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787830872.295722:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233be743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874676443791616:12345-0@lo:400: 00000100:00100000:2.0:1787830872.295778:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233be743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874676443791616:12345-0@lo:400: Request processed in 56us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830872.295785:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787830872.295804:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443791744 00000100:00100000:2.0:1787830872.295807:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443791744 00000100:00100000:2.0:1787830872.295829:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787830872.295835:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233be77840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443791744:12345-0@lo:400: 00000100:00100000:2.0:1787830872.295865:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233be77840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443791744:12345-0@lo:400: Request processed in 31us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830872.295872:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787830872.295898:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2318d57840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443791744:0@lo:400: 00010000:00080000:2.0:1787830872.295910:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d2309d09e00 x1874676443791616/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830888 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787830872.295919:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2309d09e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874676443791616:0@lo:400: 00000100:00100000:0.0:1787830872.296091:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2318d543c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3621:1874676443791872:0@lo:400: 00000100:00100000:0.0:1787830872.296122:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830872.296152:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787830872.296158:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2309d0bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a45944b-32e3-4193-a2a5-46f84222bc14:3621:1874676443791488:0@lo:400: 00000100:00100000:0.0:1787830872.296197:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830872.296487:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443791872 00000100:00100000:2.0:1787830872.296491:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443791872 00000100:00100000:2.0:1787830872.296524:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787830872.296543:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2314e703c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1874676443791872:12345-0@lo:400: 00000100:00100000:2.0:1787830872.296594:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2314e703c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1874676443791872:12345-0@lo:400: Request processed in 51us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830872.296600:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787830872.296620:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443791488 00000100:00100000:2.0:1787830872.296648:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443791488 00000100:00100000:2.0:1787830872.296673:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787830872.296679:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2308889850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+18:3621:x1874676443791488:12345-0@lo:400: 00000100:00100000:2.0:1787830872.296708:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2308889850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+18:3621:x1874676443791488:12345-0@lo:400: Request processed in 29us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830872.296714:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787830872.296762:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2309d0bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a45944b-32e3-4193-a2a5-46f84222bc14:3621:1874676443791488:0@lo:400: 00010000:00080000:2.0:1787830872.296773:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d2318d543c0 x1874676443791872/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830888 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787830872.296783:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2318d543c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3621:1874676443791872:0@lo:400: 00000100:00100000:2.0:1787830872.808511:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787830872.808541:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233be76580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443792000:0@lo:41: 00000100:00100000:2.0:1787830872.808695:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830872.808808:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443792000 00000100:00100000:2.0:1787830872.808814:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443792000 00000100:00100000:2.0:1787830872.808854:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787830872.808862:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233be76d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443792000:12345-0@lo:41: 00000004:00000024:2.0:1787830872.808982:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:2.0:1787830872.809084:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233be76d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443792000:12345-0@lo:41: Request processed in 222us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830872.809092:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787830872.809243:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233be76580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443792000:0@lo:41: 00000020:01000004:3.0:1787830872.956116:0:8399:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787830872.956121:0:8399:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1787830872.956122:0:8399:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1787830872.956267:0:8399:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8d232f6b0800 00000020:01000004:3.0:1787830872.956281:0:8399:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1787830872.956293:0:8399:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1787830872.956307:0:8399:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8d23129519b8) 00000020:00000080:3.0:1787830872.956322:0:8399:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1787830872.984913:0:8399:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1787830872.984979:0:8399:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:2.0:1787830872.997073:0:8399:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1787830872.997365:0:8399:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1787830872.997378:0:8399:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787830872.997389:0:8399:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x95459fb9d1d28624 00000020:01000004:2.0:1787830872.997396:0:8399:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1787830872.997418:0:8399:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.131@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787830872.997422:0:8399:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.131@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787830872.997427:0:8399:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1787830872.997432:0:8399:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1787830872.997443:0:8399:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8d230333cd28) 00000020:00000080:2.0:1787830872.997453:0:8399:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00010000:00010000:2.0:1787830873.000302:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787830873.001004:0:8399:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787830873.001173:0:8399:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1787830873.001298:0:8399:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1787830873.002099:0:8399:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1787830873.002107:0:8399:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1787830873.006876:0:8399:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1787830873.007723:0:8399:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1787830873.011948:0:8399:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787830873.012271:0:8399:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1787830873.012278:0:8399:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1787830873.014151:0:8399:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1787830873.014162:0:8399:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1787830873.032064:0:8399:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787830873.032383:0:8399:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1787830873.032390:0:8399:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1787830873.033457:0:8399:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1787830873.033466:0:8399:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1787830873.036782:0:8399:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1787830873.036797:0:8399:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1787830873.041035:0:8399:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787830873.041236:0:8399:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1787830873.041242:0:8399:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1787830873.043113:0:8399:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1787830873.043123:0:8399:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1787830873.098382:0:8399:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787830873.098612:0:8399:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1787830873.098619:0:8399:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1787830873.100357:0:8399:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1787830873.100370:0:8399:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1787830873.101043:0:8399:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1787830873.101073:0:8399:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:2.0:1787830873.101082:0:8399:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.131@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1787830873.136418:0:8399:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.131@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787830873.136455:0:8399:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.131@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1787830873.136459:0:8399:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787830873.136461:0:8399:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787830873.136462:0:8399:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787830873.136464:0:8399:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787830873.136465:0:8399:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787830873.136470:0:8399:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787830873.136471:0:8399:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787830873.136473:0:8399:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787830873.136474:0:8399:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787830873.136476:0:8399:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787830873.136477:0:8399:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787830873.136481:0:8399:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1787830873.136483:0:8399:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787830873.136484:0:8399:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787830873.136485:0:8399:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787830873.136486:0:8399:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787830873.136487:0:8399:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787830873.136488:0:8399:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787830873.136489:0:8399:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787830873.136490:0:8399:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787830873.136491:0:8399:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787830873.136492:0:8399:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787830873.136493:0:8399:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787830873.136521:0:8399:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787830873.136539:0:8399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233be752c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:8399:1874676443792128:0@lo:253: 00000100:00100000:2.0:1787830873.136606:0:8399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830873.136669:0:8399:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d231852fc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787830873.136779:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443792128 00000100:00100000:3.0:1787830873.136786:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443792128 00000100:00100000:3.0:1787830873.136835:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787830873.136844:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a686850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+18:8399:x1874676443792128:12345-0@lo:253: 20000000:01000000:3.0:1787830873.136884:0:6484:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1787830873.136889:0:6484:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:3.0:1787830873.136894:0:6484:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:3.0:1787830873.136897:0:6484:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:3.0:1787830873.137085:0:6484:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787830873.137212:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:3.0:1787830873.137226:0:6484:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:3.0:1787830873.137243:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:3.0:1787830873.137248:0:6484:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:3.0:1787830873.137262:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:3.0:1787830873.137277:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:3.0:1787830873.137360:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:3.0:1787830873.137374:0:6484:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.131@tcp 20000000:01000000:3.0:1787830873.137376:0:6484:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.131@tcp (null) (null) (null) 00000040:00080000:3.0:1787830873.137390:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:3.0:1787830873.137396:0:6484:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1787830873.137409:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:3.0:1787830873.137414:0:6484:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.203.131@tcp (null) (null) 00000040:00080000:3.0:1787830873.137426:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:3.0:1787830873.137432:0:6484:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1787830873.137444:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:3.0:1787830873.137458:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:3.0:1787830873.137541:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:3.0:1787830873.137554:0:6484:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.131@tcp 20000000:01000000:3.0:1787830873.137556:0:6484:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.131@tcp (null) (null) (null) 00000040:00080000:3.0:1787830873.137570:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:3.0:1787830873.137576:0:6484:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1787830873.137598:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:3.0:1787830873.137605:0:6484:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.203.131@tcp (null) (null) 00000040:00080000:3.0:1787830873.137618:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:3.0:1787830873.137651:0:6484:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1787830873.137670:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:3.0:1787830873.137687:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:3.0:1787830873.138073:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:3.0:1787830873.138087:0:6484:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.131@tcp 20000000:01000000:3.0:1787830873.138089:0:6484:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.131@tcp (null) (null) (null) 00000040:00080000:3.0:1787830873.138105:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:3.0:1787830873.138111:0:6484:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1787830873.138124:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:3.0:1787830873.138130:0:6484:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.203.131@tcp (null) (null) 00000040:00080000:3.0:1787830873.138144:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:3.0:1787830873.138150:0:6484:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1787830873.138164:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:3.0:1787830873.138181:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:3.0:1787830873.138195:0:6484:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1787830873.138197:0:6484:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1787830873.138201:0:6484:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1787830873.138242:0:6484:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1787830873.138245:0:6484:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787830873.139359:0:8418:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 18 1->4: lustre sys.timeout 20000000:01000000:0.0:1787830873.139408:0:8418:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 18 2->4: lustre sys.timeout 00000040:00080000:0.0:1787830873.139428:0:8418:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:3.0:1787830873.139923:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:3.0:1787830873.139945:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:3.0:1787830873.139961:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:3.0:1787830873.139971:0:6484:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1787830873.139973:0:6484:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787830873.140337:0:8419:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 19 1->4: lustre sys.timeout 20000000:01000000:3.0:1787830873.140355:0:8419:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 19 2->4: lustre sys.timeout 00000040:00080000:3.0:1787830873.140371:0:8419:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:3.0:1787830873.144080:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:3.0:1787830873.144116:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:3.0:1787830873.144149:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 20000000:01000000:3.0:1787830873.144161:0:6484:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1787830873.144164:0:6484:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1787830873.144979:0:8420:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:0.0:1787830873.145178:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:0.0:1787830873.145271:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:0.0:1787830873.145288:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:0.0:1787830873.145298:0:6484:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1787830873.145300:0:6484:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787830873.145776:0:8421:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 20 1->4: lustre sys.timeout 20000000:01000000:3.0:1787830873.145797:0:8421:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 20 2->4: lustre sys.timeout 00000040:00080000:3.0:1787830873.145813:0:8421:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:0.0:1787830873.146022:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:0.0:1787830873.146052:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:0.0:1787830873.146065:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 10000000:01000000:0.0:1787830873.146080:0:6484:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1787830873.146100:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d2300031e00/0x95459fb9d1d28632 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830873.146119:0:6484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2307c76800/0x95459fb9d1d284fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d284f7 expref: 18 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830873.146127:0:6484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2301668e00/0x95459fb9d1d28575 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d2856e expref: 18 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830873.146133:0:6484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2301669200/0x95459fb9d1d285c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d285bb expref: 18 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830873.146139:0:6484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2300030000/0x95459fb9d1d285de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d285d7 expref: 18 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830873.146146:0:6484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2307c76600/0x95459fb9d1d28616 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d2860f expref: 18 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830873.146153:0:6484:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d2300031e00/0x95459fb9d1d28632 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830873.146268:0:6484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2307c76600/0x95459fb9d1d28616 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x95459fb9d1d2860f expref: 18 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830873.146284:0:6484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d2307c76600/0x95459fb9d1d28616 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x95459fb9d1d2860f expref: 18 pid: 6484 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830873.146298:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2314e71680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6484:1874676443792256:0@lo:104: 00000100:00100000:0.0:1787830873.146363:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787830873.146579:0:6484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2300030000/0x95459fb9d1d285de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x95459fb9d1d285d7 expref: 18 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830873.146589:0:6484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d2300030000/0x95459fb9d1d285de lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x95459fb9d1d285d7 expref: 18 pid: 6483 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830873.146598:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2314e72940 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6484:1874676443792384:0@lo:104: 00000100:00100000:0.0:1787830873.146621:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787830873.146864:0:6484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2301669200/0x95459fb9d1d285c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x95459fb9d1d285bb expref: 18 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830873.146872:0:6484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d2301669200/0x95459fb9d1d285c2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x95459fb9d1d285bb expref: 18 pid: 6485 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830873.146882:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2314e71e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6484:1874676443792512:0@lo:104: 00000100:00100000:0.0:1787830873.146906:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830873.147012:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443792256 00000100:00100000:1.0:1787830873.147020:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443792256 00000100:00100000:1.0:1787830873.147054:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443792384 00000100:00100000:1.0:1787830873.147057:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443792384 00000100:00100000:1.0:1787830873.147072:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787830873.147082:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2314e72580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a45944b-32e3-4193-a2a5-46f84222bc14+4:6484:x1874676443792256:12345-0@lo:104: 00010000:00010000:1.0:1787830873.147095:0:6474:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff8d233837b800/0x95459fb9d1d2860f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d28616 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830873.147192:0:6474:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787830873.147198:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2314e72580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a45944b-32e3-4193-a2a5-46f84222bc14+4:6484:x1874676443792256:12345-0@lo:104: Request processed in 119us (836us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830873.147206:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787830873.147223:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787830873.147228:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2314e70b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a45944b-32e3-4193-a2a5-46f84222bc14+3:6484:x1874676443792384:12345-0@lo:104: 00010000:00010000:1.0:1787830873.147236:0:6474:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff8d233837bc00/0x95459fb9d1d285d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d285de expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830873.147347:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787830873.147355:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8d233837b800/0x95459fb9d1d2860f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d28616 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830873.147363:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233837b800 already unused, calling callback (ffffffffc14f9c20) 10000000:00010000:3.0:1787830873.147367:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8d233837b800/0x95459fb9d1d2860f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x95459fb9d1d28616 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830873.147375:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8d233837b800/0x95459fb9d1d2860f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x95459fb9d1d28616 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787830873.147383:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8d233837b800/0x95459fb9d1d2860f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x95459fb9d1d28616 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787830873.147402:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787830873.147433:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8d233837b800/0x95459fb9d1d2860f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d28616 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830873.147439:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787830873.147456:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8d233837b800/0x95459fb9d1d2860f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d28616 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830873.147463:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8d233837b800/0x95459fb9d1d2860f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d28616 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830873.147487:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787830873.147490:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8d233837bc00/0x95459fb9d1d285d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d285de expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830873.147495:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233837bc00 already unused, calling callback (ffffffffc14f9c20) 10000000:00010000:3.0:1787830873.147498:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8d233837bc00/0x95459fb9d1d285d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x95459fb9d1d285de expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830873.147504:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8d233837bc00/0x95459fb9d1d285d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x95459fb9d1d285de expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787830873.147511:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8d233837bc00/0x95459fb9d1d285d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x95459fb9d1d285de expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787830873.147516:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787830873.147529:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8d233837bc00/0x95459fb9d1d285d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d285de expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830873.147535:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787830873.147541:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8d233837bc00/0x95459fb9d1d285d7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d285de expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830873.147547:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8d233837bc00/0x95459fb9d1d285d7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d285de expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830873.147556:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787830873.147558:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787830873.147559:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830873.147651:0:6484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2301668e00/0x95459fb9d1d28575 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x95459fb9d1d2856e expref: 18 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830873.147661:0:6484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d2301668e00/0x95459fb9d1d28575 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x95459fb9d1d2856e expref: 18 pid: 6485 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830873.147671:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2201deda40 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6484:1874676443792896:0@lo:104: 00000100:00100000:0.0:1787830873.147696:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787830873.147716:0:6484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2307c76800/0x95459fb9d1d284fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x95459fb9d1d284f7 expref: 18 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830873.147724:0:6484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d2307c76800/0x95459fb9d1d284fe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x95459fb9d1d284f7 expref: 18 pid: 6483 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830873.147742:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2201dee940 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6484:1874676443793024:0@lo:104: 00000100:00100000:0.0:1787830873.147771:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830873.147781:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d232f7e7540 going to sleep for 11 seconds 00000100:00100000:0.0:1787830873.147799:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2314e71680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6484:1874676443792256:0@lo:104: 00000100:00100000:0.0:1787830873.147805:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2314e72940 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6484:1874676443792384:0@lo:104: 00010000:00010000:1.0:1787830873.149044:0:6474:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:1.0:1787830873.149057:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2314e70b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a45944b-32e3-4193-a2a5-46f84222bc14+3:6484:x1874676443792384:12345-0@lo:104: Request processed in 1825us (2432us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830873.149067:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787830873.149092:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443792512 00000100:00100000:1.0:1787830873.149098:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443792512 00000100:00100000:1.0:1787830873.149120:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443792896 00000100:00100000:1.0:1787830873.149122:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443792896 00000100:00100000:1.0:1787830873.149130:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443793024 00000100:00100000:1.0:1787830873.149132:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443793024 00000100:00100000:1.0:1787830873.149157:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787830873.149163:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2314e70000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a45944b-32e3-4193-a2a5-46f84222bc14+5:6484:x1874676443792512:12345-0@lo:104: 00010000:00010000:1.0:1787830873.149174:0:6474:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff8d2300030a00/0x95459fb9d1d285bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d285c2 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830873.149392:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2314e71e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6484:1874676443792512:0@lo:104: 00000100:00100000:2.0:1787830873.149480:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d232f797c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a45944b-32e3-4193-a2a5-46f84222bc14:3619:1874676443792640:0@lo:103: 00000100:00100000:2.0:1787830873.149519:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830873.149558:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787830873.149565:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d232f794000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a45944b-32e3-4193-a2a5-46f84222bc14:3619:1874676443792768:0@lo:103: 00000100:00100000:2.0:1787830873.149587:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830873.149619:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443792640 00000100:00100000:2.0:1787830873.149640:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443792640 00010000:00010000:2.0:1787830873.150615:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2307c76600/0x95459fb9d1d28616 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d2860f expref: 19 pid: 6484 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830873.150795:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443792768 00000100:00100000:2.0:1787830873.150800:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443792768 00010000:00010000:2.0:1787830873.150816:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2300030000/0x95459fb9d1d285de lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d285d7 expref: 20 pid: 6483 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830873.150849:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787830873.150857:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233be74f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2a45944b-32e3-4193-a2a5-46f84222bc14+20:3619:x1874676443792640:12345-0@lo:103: 00010000:00010000:2.0:1787830873.150872:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787830873.150879:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2307c76600/0x95459fb9d1d28616 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d2860f expref: 20 pid: 6484 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830873.150892:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2307c76600/0x95459fb9d1d28616 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x95459fb9d1d2860f expref: 20 pid: 6484 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830873.150910:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2307c76600/0x95459fb9d1d28616 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x95459fb9d1d2860f expref: 20 pid: 6484 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830873.150925:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787830873.150974:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233be74f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2a45944b-32e3-4193-a2a5-46f84222bc14+19:3619:x1874676443792640:12345-0@lo:103: Request processed in 119us (1455us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830873.150981:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787830873.150999:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787830873.151005:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233be770c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2a45944b-32e3-4193-a2a5-46f84222bc14+18:3619:x1874676443792768:12345-0@lo:103: 00010000:00010000:2.0:1787830873.151011:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787830873.151015:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2300030000/0x95459fb9d1d285de lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d285d7 expref: 18 pid: 6483 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830873.151023:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2300030000/0x95459fb9d1d285de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x95459fb9d1d285d7 expref: 18 pid: 6483 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830873.151032:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2300030000/0x95459fb9d1d285de lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x95459fb9d1d285d7 expref: 18 pid: 6483 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830873.151049:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787830873.151071:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233be770c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2a45944b-32e3-4193-a2a5-46f84222bc14+17:3619:x1874676443792768:12345-0@lo:103: Request processed in 67us (1484us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830873.151077:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787830873.151120:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d232f794000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a45944b-32e3-4193-a2a5-46f84222bc14:3619:1874676443792768:0@lo:103: 00000100:00100000:2.0:1787830873.151129:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d232f797c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a45944b-32e3-4193-a2a5-46f84222bc14:3619:1874676443792640:0@lo:103: 00010000:00010000:3.0:1787830873.151257:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787830873.151270:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8d2300030a00/0x95459fb9d1d285bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d285c2 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830873.151278:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2300030a00 already unused, calling callback (ffffffffc14f9c20) 10000000:00010000:3.0:1787830873.151282:0:6479:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8d2300030a00/0x95459fb9d1d285bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x95459fb9d1d285c2 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830873.151291:0:6479:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8d2300030a00/0x95459fb9d1d285bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x95459fb9d1d285c2 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787830873.151298:0:6479:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8d2300030a00/0x95459fb9d1d285bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x95459fb9d1d285c2 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787830873.151304:0:6479:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787830873.151341:0:6479:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8d2300030a00/0x95459fb9d1d285bb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d285c2 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830873.151347:0:6479:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787830873.151369:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8d2300030a00/0x95459fb9d1d285bb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d285c2 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830873.151376:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8d2300030a00/0x95459fb9d1d285bb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d285c2 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830873.151387:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787830873.151390:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787830873.151392:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787830873.151405:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d232f795e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a45944b-32e3-4193-a2a5-46f84222bc14:3621:1874676443793152:0@lo:103: 00000100:00100000:3.0:1787830873.151439:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830873.151664:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443793152 00000100:00100000:2.0:1787830873.151668:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443793152 00010000:00010000:2.0:1787830873.151687:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2301669200/0x95459fb9d1d285c2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d285bb expref: 17 pid: 6485 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830873.151711:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787830873.151718:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d232f795a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2a45944b-32e3-4193-a2a5-46f84222bc14+17:3621:x1874676443793152:12345-0@lo:103: 00010000:00010000:2.0:1787830873.151725:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787830873.151729:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2301669200/0x95459fb9d1d285c2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d285bb expref: 17 pid: 6485 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830873.151749:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2301669200/0x95459fb9d1d285c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x95459fb9d1d285bb expref: 17 pid: 6485 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830873.151758:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2301669200/0x95459fb9d1d285c2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x95459fb9d1d285bb expref: 17 pid: 6485 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830873.151766:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787830873.151792:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d232f795a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2a45944b-32e3-4193-a2a5-46f84222bc14+16:3621:x1874676443793152:12345-0@lo:103: Request processed in 75us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830873.151797:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787830873.151825:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d232f795e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a45944b-32e3-4193-a2a5-46f84222bc14:3621:1874676443793152:0@lo:103: 00010000:00010000:1.0:1787830873.151955:0:6474:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:1.0:1787830873.151963:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2314e70000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a45944b-32e3-4193-a2a5-46f84222bc14+5:6484:x1874676443792512:12345-0@lo:104: Request processed in 2800us (5056us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830873.151971:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787830873.151988:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787830873.151995:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2201dec780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a45944b-32e3-4193-a2a5-46f84222bc14+4:6484:x1874676443792896:12345-0@lo:104: 00010000:00010000:1.0:1787830873.152004:0:6474:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff8d2301668600/0x95459fb9d1d2856e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d28575 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830873.152086:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2201deda40 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6484:1874676443792896:0@lo:104: 00010000:00010000:2.0:1787830873.152241:0:7431:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787830873.152247:0:7431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8d2301668600/0x95459fb9d1d2856e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d28575 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830873.152255:0:7431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2301668600 already unused, calling callback (ffffffffc14f9c20) 10000000:00010000:2.0:1787830873.152258:0:7431:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8d2301668600/0x95459fb9d1d2856e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x95459fb9d1d28575 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830873.152266:0:7431:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8d2301668600/0x95459fb9d1d2856e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x95459fb9d1d28575 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787830873.152272:0:7431:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8d2301668600/0x95459fb9d1d2856e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x95459fb9d1d28575 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787830873.152278:0:7431:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787830873.152336:0:7431:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8d2301668600/0x95459fb9d1d2856e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d28575 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830873.152342:0:7431:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787830873.152361:0:7431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8d2301668600/0x95459fb9d1d2856e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d28575 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830873.152367:0:7431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8d2301668600/0x95459fb9d1d2856e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d28575 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830873.152378:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787830873.152379:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787830873.152381:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787830873.152413:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787830873.152421:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233be761c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a45944b-32e3-4193-a2a5-46f84222bc14:3621:1874676443793280:0@lo:103: 00000100:00100000:3.0:1787830873.152448:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830873.152512:0:7432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443793280 00000100:00100000:2.0:1787830873.152517:0:7432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443793280 00010000:00010000:2.0:1787830873.152539:0:7432:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2301668e00/0x95459fb9d1d28575 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d2856e expref: 16 pid: 6485 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830873.152566:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787830873.152574:0:7432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d232f794780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2a45944b-32e3-4193-a2a5-46f84222bc14+16:3621:x1874676443793280:12345-0@lo:103: 00010000:00010000:2.0:1787830873.152593:0:7432:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787830873.152597:0:7432:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2301668e00/0x95459fb9d1d28575 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d2856e expref: 16 pid: 6485 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830873.152607:0:7432:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2301668e00/0x95459fb9d1d28575 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x95459fb9d1d2856e expref: 16 pid: 6485 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830873.152619:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2301668e00/0x95459fb9d1d28575 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x95459fb9d1d2856e expref: 16 pid: 6485 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830873.152653:0:7432:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787830873.152684:0:7432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d232f794780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2a45944b-32e3-4193-a2a5-46f84222bc14+15:3621:x1874676443793280:12345-0@lo:103: Request processed in 111us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830873.152690:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787830873.152714:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233be761c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a45944b-32e3-4193-a2a5-46f84222bc14:3621:1874676443793280:0@lo:103: 00010000:00010000:1.0:1787830873.154673:0:6474:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:1.0:1787830873.154686:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2201dec780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a45944b-32e3-4193-a2a5-46f84222bc14+4:6484:x1874676443792896:12345-0@lo:104: Request processed in 2689us (6986us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830873.154695:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787830873.154784:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787830873.154794:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2201decb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a45944b-32e3-4193-a2a5-46f84222bc14+3:6484:x1874676443793024:12345-0@lo:104: 00010000:00010000:1.0:1787830873.154808:0:6474:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff8d233837ac00/0x95459fb9d1d284f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d284fe expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830873.154875:0:6474:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787830873.154879:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2201decb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a45944b-32e3-4193-a2a5-46f84222bc14+3:6484:x1874676443793024:12345-0@lo:104: Request processed in 90us (7109us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830873.154883:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1787830873.154903:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787830873.154916:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8d233837ac00/0x95459fb9d1d284f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d284fe expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830873.154921:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233837ac00 already unused, calling callback (ffffffffc14f9c20) 10000000:00010000:1.0:1787830873.154924:0:6479:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8d233837ac00/0x95459fb9d1d284f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x95459fb9d1d284fe expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830873.154930:0:6479:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8d233837ac00/0x95459fb9d1d284f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x95459fb9d1d284fe expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787830873.154935:0:6479:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8d233837ac00/0x95459fb9d1d284f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x95459fb9d1d284fe expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787830873.154938:0:6479:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787830873.155051:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787830873.155256:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2201dee940 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6484:1874676443793024:0@lo:104: 00010000:00010000:2.0:1787830873.155291:0:6484:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d2300031e00/0x95459fb9d1d28632 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830873.157363:0:6479:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8d233837ac00/0x95459fb9d1d284f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d284fe expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830873.157377:0:6479:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787830873.157413:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8d233837ac00/0x95459fb9d1d284f7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d284fe expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830873.157421:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8d233837ac00/0x95459fb9d1d284f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d284fe expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830873.157439:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830873.157441:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830873.157442:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787830873.157453:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787830873.157469:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2314ed70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a45944b-32e3-4193-a2a5-46f84222bc14:3620:1874676443793408:0@lo:103: 00000100:00100000:1.0:1787830873.157527:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830873.157577:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443793408 00000100:00100000:1.0:1787830873.157595:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443793408 00010000:00010000:1.0:1787830873.157641:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2307c76800/0x95459fb9d1d284fe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d284f7 expref: 15 pid: 6483 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830873.157669:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787830873.157677:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2321e77450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2a45944b-32e3-4193-a2a5-46f84222bc14+15:3620:x1874676443793408:12345-0@lo:103: 00010000:00010000:1.0:1787830873.157690:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787830873.157695:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2307c76800/0x95459fb9d1d284fe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d284f7 expref: 15 pid: 6483 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830873.157706:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2307c76800/0x95459fb9d1d284fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x95459fb9d1d284f7 expref: 15 pid: 6483 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830873.157720:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2307c76800/0x95459fb9d1d284fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x95459fb9d1d284f7 expref: 15 pid: 6483 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830873.157744:0:6476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d2300031e00/0x95459fb9d1d28632 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830873.157754:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2300031e00/0x95459fb9d1d28632 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830873.157769:0:6476:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d2300031e00/0x95459fb9d1d28632 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830873.157776:0:6476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d2300031e00/0x95459fb9d1d28632 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830873.157783:0:6476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d2300031e00/0x95459fb9d1d28632 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830873.157790:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d2300031e00/0x95459fb9d1d28632 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830873.157801:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2300031e00 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:1.0:1787830873.157806:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d2300031e00/0x95459fb9d1d28632 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830873.157814:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d2300031e00/0x95459fb9d1d28632 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830873.157827:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d2300031e00/0x95459fb9d1d28632 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830873.157836:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787830873.157866:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2321e77450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2a45944b-32e3-4193-a2a5-46f84222bc14+14:3620:x1874676443793408:12345-0@lo:103: Request processed in 189us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830873.157872:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787830873.157936:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2314ed70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a45944b-32e3-4193-a2a5-46f84222bc14:3620:1874676443793408:0@lo:103: 00010000:00010000:1.0:1787830873.157953:0:6484:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d2300031e00/0x95459fb9d1d28632 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830873.157961:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d2300031e00/0x95459fb9d1d28632 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830873.157967:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2300031e00/0x95459fb9d1d28632 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787830873.157980:0:6484:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1787830873.160104:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a686850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+13:8399:x1874676443792128:12345-0@lo:253: Request processed in 23253us (23490us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830873.160118:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787830873.160206:0:8399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233be752c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:8399:1874676443792128:0@lo:253: 10000000:01000000:3.0:1787830873.160223:0:8399:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1787830873.160226:0:8399:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787830873.160227:0:8399:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787830873.160229:0:8399:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787830873.160230:0:8399:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:3.0:1787830873.160232:0:8399:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787830873.160233:0:8399:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787830873.160234:0:8399:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787830873.160236:0:8399:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1787830873.160237:0:8399:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787830873.160238:0:8399:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787830873.160257:0:8399:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d232f6b0800 from lustre-OST0000 10000000:01000000:3.0:1787830873.160285:0:8399:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1787830873.160287:0:8399:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1787830873.160293:0:8399:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8d2312953370 local copy 10000000:01000000:3.0:1787830873.160297:0:8399:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787830873.160328:0:8399:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d2307c77000/0x95459fb9d1d28639 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830873.160338:0:8399:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.131@tcp lock: ffff8d2307c77000/0x95459fb9d1d28639 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830873.160348:0:8399:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8d2307c77000/0x95459fb9d1d28639 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830873.160363:0:8399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d232f796940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:8399:1874676443793536:0@lo:101: 00000100:00100000:3.0:1787830873.160408:0:8399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830873.160450:0:8399:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2335786480 going to sleep for 11 seconds 00000100:00100000:1.0:1787830873.160573:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443793536 00000100:00100000:1.0:1787830873.160579:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443793536 00000100:00100000:1.0:1787830873.160618:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787830873.160648:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a687050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+13:8399:x1874676443793536:12345-0@lo:101: 00010000:00010000:1.0:1787830873.160667:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787830873.160682:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d233be94c00/0x95459fb9d1d28640 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d28639 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830873.160706:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d233be94c00/0x95459fb9d1d28640 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d28639 expref: 14 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830873.160718:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d233be94c00/0x95459fb9d1d28640 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d28639 expref: 14 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830873.160727:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233be94c00, rc 0) 00000100:00100000:1.0:1787830873.160770:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a687050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+14:8399:x1874676443793536:12345-0@lo:101: Request processed in 145us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830873.160776:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787830873.160907:0:8399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d232f796940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:8399:1874676443793536:0@lo:101: 00010000:00010000:3.0:1787830873.160920:0:8399:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8d2307c77000/0x95459fb9d1d28639 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x95459fb9d1d28640 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830873.160929:0:8399:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8d2307c77000/0x95459fb9d1d28639 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x95459fb9d1d28640 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830873.161006:0:8399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d232f796940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:8399:1874676443793664:0@lo:501: 00000100:00100000:3.0:1787830873.161028:0:8399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830873.161055:0:8399:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2335786480 going to sleep for 11 seconds 00000100:00100000:2.0:1787830873.161094:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443793664 00000100:00100000:2.0:1787830873.161098:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443793664 00000100:00100000:2.0:1787830873.161131:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787830873.161137:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a686450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+14:8399:x1874676443793664:12345-0@lo:501: 00000100:00100000:2.0:1787830873.161202:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a686450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+14:8399:x1874676443793664:12345-0@lo:501: Request processed in 65us (172us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787830873.161208:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787830873.161303:0:8399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d232f796940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:8399:1874676443793664:0@lo:501: 10000000:01000000:3.0:1787830873.161314:0:8399:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.131@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1787830873.161328:0:8399:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.131@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1787830873.161332:0:8399:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d2307c77000/0x95459fb9d1d28639 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x95459fb9d1d28640 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830873.161340:0:8399:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d2307c77000/0x95459fb9d1d28639 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x95459fb9d1d28640 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830873.161348:0:8399:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.131@tcp lock: ffff8d2307c77000/0x95459fb9d1d28639 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x95459fb9d1d28640 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830873.161368:0:8399:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787830873.161396:0:8399:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d232f6b0800 10000000:01000000:3.0:1787830873.161402:0:8399:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787830873.161406:0:8399:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1787830873.161412:0:8399:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787830873.161416:0:8399:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1787830873.161425:0:8399:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1787830873.161440:0:8399:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d2307c76200/0x95459fb9d1d28647 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830873.161447:0:8399:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8d2307c76200/0x95459fb9d1d28647 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830873.161455:0:8399:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8d2307c76200/0x95459fb9d1d28647 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830873.161466:0:8399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d232f796940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:8399:1874676443793792:0@lo:101: 00000100:00100000:3.0:1787830873.161490:0:8399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830873.161503:0:8399:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2335786d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787830873.161664:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443793792 00000100:00100000:2.0:1787830873.161668:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443793792 00000100:00100000:2.0:1787830873.161692:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787830873.161698:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a687850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+14:8399:x1874676443793792:12345-0@lo:101: 00010000:00010000:2.0:1787830873.161705:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787830873.161715:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d233837ae00/0x95459fb9d1d2864e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d28647 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830873.161730:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d233837ae00/0x95459fb9d1d2864e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d28647 expref: 15 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830873.161749:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d233837ae00/0x95459fb9d1d2864e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d28647 expref: 15 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830873.161757:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233837ae00, rc 0) 00000100:00100000:2.0:1787830873.161782:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a687850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+15:8399:x1874676443793792:12345-0@lo:101: Request processed in 84us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830873.161788:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00010000:00010000:2.0:1787830873.161806:0:7431:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787830873.161813:0:7431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8d2307c77000/0x95459fb9d1d28639 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x95459fb9d1d28640 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830873.161820:0:7431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2307c77000 already unused, calling callback (ffffffffc14f9c20) 10000000:00010000:2.0:1787830873.161824:0:7431:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8d2307c77000/0x95459fb9d1d28639 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x95459fb9d1d28640 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830873.161838:0:7431:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8d2307c77000/0x95459fb9d1d28639 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x95459fb9d1d28640 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787830873.161845:0:7431:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8d2307c77000/0x95459fb9d1d28639 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x95459fb9d1d28640 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787830873.161851:0:7431:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787830873.161870:0:7431:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8d2307c77000/0x95459fb9d1d28639 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x95459fb9d1d28640 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830873.161876:0:7431:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787830873.161894:0:7431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8d2307c77000/0x95459fb9d1d28639 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x95459fb9d1d28640 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830873.161901:0:7431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8d2307c77000/0x95459fb9d1d28639 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x95459fb9d1d28640 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830873.161912:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787830873.161914:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787830873.161916:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787830873.161923:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787830873.161934:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233be761c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a45944b-32e3-4193-a2a5-46f84222bc14:3619:1874676443793920:0@lo:103: 00000100:00100000:2.0:1787830873.161962:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830873.161987:0:7432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443793920 00000100:00100000:2.0:1787830873.161991:0:7432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443793920 00000100:00100000:2.0:1787830873.162022:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787830873.162029:0:7432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233be77c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2a45944b-32e3-4193-a2a5-46f84222bc14+15:3619:x1874676443793920:12345-0@lo:103: 00010000:00010000:2.0:1787830873.162038:0:7432:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787830873.162049:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d233be94c00/0x95459fb9d1d28640 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x95459fb9d1d28639 expref: 15 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830873.162066:0:7432:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787830873.162094:0:7432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233be77c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2a45944b-32e3-4193-a2a5-46f84222bc14+14:3619:x1874676443793920:12345-0@lo:103: Request processed in 65us (131us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830873.162101:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787830873.162126:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233be761c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a45944b-32e3-4193-a2a5-46f84222bc14:3619:1874676443793920:0@lo:103: 00000100:00100000:3.0:1787830873.162212:0:8399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d232f796940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:8399:1874676443793792:0@lo:101: 00010000:00010000:3.0:1787830873.162222:0:8399:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8d2307c76200/0x95459fb9d1d28647 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2864e expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830873.162230:0:8399:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8d2307c76200/0x95459fb9d1d28647 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d2864e expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830873.162280:0:8399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d232f796940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:8399:1874676443794048:0@lo:501: 00000100:00100000:3.0:1787830873.162302:0:8399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830873.162328:0:8399:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2335786d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787830873.162496:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443794048 00000100:00100000:1.0:1787830873.162500:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443794048 00000100:00100000:1.0:1787830873.162530:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787830873.162536:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a687c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+14:8399:x1874676443794048:12345-0@lo:501: 00000100:00100000:1.0:1787830873.162642:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a687c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+14:8399:x1874676443794048:12345-0@lo:501: Request processed in 87us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830873.162649:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787830873.162766:0:8399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d232f796940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:8399:1874676443794048:0@lo:501: 00000100:00100000:3.0:1787830873.162789:0:8399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d232f796940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:8399:1874676443794176:0@lo:503: 00000100:00100000:3.0:1787830873.162822:0:8399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830873.162846:0:8399:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2335786d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787830873.162881:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443794176 00000100:00100000:1.0:1787830873.162885:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443794176 00000100:00100000:1.0:1787830873.162910:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787830873.162916:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a684450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+14:8399:x1874676443794176:12345-0@lo:503: 00000100:00100000:1.0:1787830873.162989:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a684450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+14:8399:x1874676443794176:12345-0@lo:503: Request processed in 73us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830873.162996:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787830873.163078:0:8399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d232f796940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:8399:1874676443794176:0@lo:503: 00000040:00080000:3.0:1787830873.163354:0:8399:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787830873.163463:0:8399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d232f796940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:8399:1874676443794304:0@lo:502: 00000100:00100000:3.0:1787830873.163493:0:8399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830873.163542:0:8399:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2335786d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787830873.163810:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443794304 00000100:00100000:2.0:1787830873.163815:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443794304 00000100:00100000:2.0:1787830873.163883:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787830873.163891:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a684850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+14:8399:x1874676443794304:12345-0@lo:502: 00000100:00100000:2.0:1787830873.163983:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a684850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+14:8399:x1874676443794304:12345-0@lo:502: Request processed in 93us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830873.163990:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787830873.164046:0:8399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d232f796940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:8399:1874676443794304:0@lo:502: 00000040:00080000:3.0:1787830873.164223:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1787830873.164244:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1787830873.164255:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1787830873.164266:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1787830873.164276:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1787830873.164286:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1787830873.164302:0:8399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d232f796940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:8399:1874676443794432:0@lo:502: 00000100:00100000:3.0:1787830873.164331:0:8399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830873.164524:0:8399:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2335786d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787830873.164594:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443794432 00000100:00100000:1.0:1787830873.164598:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443794432 00000100:00100000:1.0:1787830873.164620:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787830873.164655:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a685c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+14:8399:x1874676443794432:12345-0@lo:502: 00000100:00100000:1.0:1787830873.164730:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a685c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+14:8399:x1874676443794432:12345-0@lo:502: Request processed in 76us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830873.164746:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787830873.165016:0:8399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d232f796940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:8399:1874676443794432:0@lo:502: 00000040:00080000:3.0:1787830873.165053:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1787830873.165061:0:8399:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:2.0:1787830873.165886:0:8422:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787830873.165895:0:8422:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:2.0:1787830873.165902:0:8422:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787830873.165905:0:8422:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1787830873.165910:0:8422:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787830873.165932:0:8422:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8d2201e18000) 00000020:00000080:2.0:1787830873.165955:0:8422:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:2.0:1787830873.165961:0:8422:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787830873.166036:0:8422:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d232f6b0800 from lustre-OST0000, refs=2 00080000:01000000:2.0:1787830873.166044:0:8422:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787830873.166050:0:8422:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x95459fb9d1d2865c 00010000:00010000:3.0:1787830873.175171:0:8422:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:3.0:1787830873.175529:0:8422:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:3.0:1787830873.179463:0:8422:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1787830873.179931:0:8422:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1787830873.185276:0:8422:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:3.0:1787830873.185600:0:8422:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:3.0:1787830873.196373:0:8422:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:1.0:1787830873.199539:0:8422:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1787830873.199552:0:8422:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787830873.199559:0:8422:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787830873.199562:0:8422:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1787830873.199566:0:8422:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787830873.199570:0:8422:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787830873.199572:0:8422:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787830873.199575:0:8422:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787830873.199576:0:8422:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787830873.199600:0:8422:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787830873.199603:0:8422:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787830873.199747:0:8422:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787830873.199753:0:8422:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1787830873.200979:0:8399:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:3.0:1787830873.201013:0:8399:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1787830873.201037:0:8399:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d2307c76200/0x95459fb9d1d28647 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2864e expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830873.201057:0:8399:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8d2307c76200/0x95459fb9d1d28647 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2864e expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787830873.201066:0:8399:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d232f6b0800 from 1 10000000:01000000:3.0:1787830873.201069:0:8399:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787830873.201106:0:8399:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d2307c76c00/0x95459fb9d1d28663 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830873.201115:0:8399:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8d2307c76c00/0x95459fb9d1d28663 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830873.201128:0:8399:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8d2307c76c00/0x95459fb9d1d28663 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830873.201150:0:8399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d232f796940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:8399:1874676443794560:0@lo:101: 00000100:00100000:3.0:1787830873.201275:0:8399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830873.201335:0:8399:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d23382389c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787830873.201428:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443794560 00000100:00100000:1.0:1787830873.201435:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443794560 00000100:00100000:1.0:1787830873.201489:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787830873.201498:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a686050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+14:8399:x1874676443794560:12345-0@lo:101: 00010000:00010000:1.0:1787830873.201512:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787830873.201527:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d233be94400/0x95459fb9d1d2866a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d28663 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830873.201555:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d233be94400/0x95459fb9d1d2866a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d28663 expref: 15 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830873.201577:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d233be94400/0x95459fb9d1d2866a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d28663 expref: 15 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830873.201586:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233be94400, rc 0) 00000100:00100000:1.0:1787830873.201656:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a686050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+15:8399:x1874676443794560:12345-0@lo:101: Request processed in 158us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830873.201664:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787830873.201686:0:8399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d232f796940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:8399:1874676443794560:0@lo:101: 00010000:00010000:3.0:1787830873.201709:0:8399:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8d2307c76c00/0x95459fb9d1d28663 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2866a expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830873.201719:0:8399:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8d2307c76c00/0x95459fb9d1d28663 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d2866a expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830873.201816:0:8399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d232f796940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:8399:1874676443794688:0@lo:501: 00000100:00100000:3.0:1787830873.201841:0:8399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830873.201867:0:8399:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d23382389c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787830873.201975:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443794688 00000100:00100000:1.0:1787830873.201979:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443794688 00000100:00100000:1.0:1787830873.202004:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787830873.202010:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a685450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+15:8399:x1874676443794688:12345-0@lo:501: 00000100:00100000:1.0:1787830873.202116:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a685450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+15:8399:x1874676443794688:12345-0@lo:501: Request processed in 105us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830873.202122:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787830873.202309:0:8399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d232f796940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:8399:1874676443794688:0@lo:501: 00000100:00100000:3.0:1787830873.202412:0:8399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d232f796940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:8399:1874676443794816:0@lo:503: 00000100:00100000:3.0:1787830873.202456:0:8399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830873.202468:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443794816 00000100:00100000:3.0:1787830873.202469:0:8399:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d23382389c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787830873.202473:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443794816 00000100:00100000:2.0:1787830873.202505:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787830873.202512:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a684c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+15:8399:x1874676443794816:12345-0@lo:503: 00000100:00100000:2.0:1787830873.202603:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a684c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+15:8399:x1874676443794816:12345-0@lo:503: Request processed in 91us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830873.202616:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787830873.202795:0:8399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d232f796940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:8399:1874676443794816:0@lo:503: 00000040:00080000:1.0:1787830873.203147:0:8399:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787830873.204020:0:8399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2314ed70c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:8399:1874676443794944:0@lo:502: 00000100:00100000:1.0:1787830873.204078:0:8399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830873.204985:0:8399:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2310003240 going to sleep for 11 seconds 00000100:00100000:2.0:1787830873.206531:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443794944 00000100:00100000:2.0:1787830873.206540:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443794944 00000100:00100000:2.0:1787830873.206588:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787830873.206598:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a686c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+15:8399:x1874676443794944:12345-0@lo:502: 00000100:00100000:2.0:1787830873.206902:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a686c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+15:8399:x1874676443794944:12345-0@lo:502: Request processed in 306us (2824us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830873.206910:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787830873.206958:0:8399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2314ed70c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:8399:1874676443794944:0@lo:502: 00000040:00080000:1.0:1787830873.207752:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1787830873.207788:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1787830873.207821:0:8399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2314ed70c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:8399:1874676443795072:0@lo:502: 00000100:00100000:1.0:1787830873.207988:0:8399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830873.208026:0:8399:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2310003240 going to sleep for 11 seconds 00000100:00100000:3.0:1787830873.208246:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443795072 00000100:00100000:3.0:1787830873.208252:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443795072 00000100:00100000:3.0:1787830873.208298:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787830873.208307:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a687450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+15:8399:x1874676443795072:12345-0@lo:502: 00000100:00100000:3.0:1787830873.208419:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a687450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+15:8399:x1874676443795072:12345-0@lo:502: Request processed in 112us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830873.208426:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787830873.208524:0:8399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2314ed70c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:8399:1874676443795072:0@lo:502: 00000040:00080000:0.0:1787830873.208575:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1787830873.208585:0:8399:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1787830873.209571:0:8426:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787830873.209581:0:8426:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787830873.209583:0:8426:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787830873.209589:0:8426:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d232f6b0800 00000020:00000080:0.0:1787830873.209592:0:8426:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787830873.209602:0:8426:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787830873.210044:0:8426:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787830873.210046:0:8426:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1787830873.210050:0:8426:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1787830873.211575:0:8399:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1787830873.211618:0:8399:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787830873.211654:0:8399:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d2307c76c00/0x95459fb9d1d28663 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2866a expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830873.211668:0:8399:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8d2307c76c00/0x95459fb9d1d28663 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2866a expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787830873.211723:0:8399:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787830873.211726:0:8399:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d232f6b0800 10000000:01000000:3.0:1787830873.211729:0:8399:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d232f6b0800 10000000:01000000:3.0:1787830873.211742:0:8399:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787830873.211748:0:8399:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d232f6b0800 from 1 10000000:01000000:3.0:1787830873.211750:0:8399:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787830873.211789:0:8399:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d2307c76400/0x95459fb9d1d28671 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830873.211798:0:8399:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8d2307c76400/0x95459fb9d1d28671 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830873.211817:0:8399:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8d2307c76400/0x95459fb9d1d28671 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830873.211840:0:8399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d232f794b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:8399:1874676443795200:0@lo:101: 00000100:00100000:3.0:1787830873.211905:0:8399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830873.212007:0:8399:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2338238600 going to sleep for 11 seconds 00000100:00100000:2.0:1787830873.212754:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443795200 00000100:00100000:2.0:1787830873.212763:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443795200 00000100:00100000:2.0:1787830873.212812:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787830873.212821:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a685850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+15:8399:x1874676443795200:12345-0@lo:101: 00010000:00010000:2.0:1787830873.212836:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787830873.212852:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d233837be00/0x95459fb9d1d28678 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d28671 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830873.212879:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d233837be00/0x95459fb9d1d28678 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d28671 expref: 16 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830873.212890:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d233837be00/0x95459fb9d1d28678 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d28671 expref: 16 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830873.212899:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233837be00, rc 0) 00000100:00100000:2.0:1787830873.213339:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a685850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+16:8399:x1874676443795200:12345-0@lo:101: Request processed in 518us (1432us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830873.213347:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787830873.214246:0:8399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d232f794b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:8399:1874676443795200:0@lo:101: 00010000:00010000:1.0:1787830873.214274:0:8399:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8d2307c76400/0x95459fb9d1d28671 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d28678 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830873.214285:0:8399:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8d2307c76400/0x95459fb9d1d28671 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d28678 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830873.214664:0:8399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2314ed7840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:8399:1874676443795328:0@lo:501: 00000100:00100000:1.0:1787830873.214713:0:8399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830873.214758:0:8399:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2310003300 going to sleep for 11 seconds 00000100:00100000:3.0:1787830873.214774:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443795328 00000100:00100000:3.0:1787830873.214779:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443795328 00000100:00100000:3.0:1787830873.214822:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787830873.214829:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a685050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+16:8399:x1874676443795328:12345-0@lo:501: 00000100:00100000:3.0:1787830873.214957:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a685050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+16:8399:x1874676443795328:12345-0@lo:501: Request processed in 129us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830873.214965:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787830873.214980:0:8399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2314ed7840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:8399:1874676443795328:0@lo:501: 00000100:00100000:1.0:1787830873.215010:0:8399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2314ed7840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:8399:1874676443795456:0@lo:503: 00000100:00100000:1.0:1787830873.215049:0:8399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830873.215074:0:8399:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2310003300 going to sleep for 11 seconds 00000100:00100000:0.0:1787830873.215077:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443795456 00000100:00100000:0.0:1787830873.215081:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443795456 00000100:00100000:0.0:1787830873.215114:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787830873.215122:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a684050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+16:8399:x1874676443795456:12345-0@lo:503: 00000100:00100000:0.0:1787830873.215203:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a684050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+16:8399:x1874676443795456:12345-0@lo:503: Request processed in 82us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830873.215209:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787830873.215266:0:8399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2314ed7840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:8399:1874676443795456:0@lo:503: 00000040:00080000:1.0:1787830873.215825:0:8399:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787830873.216012:0:8399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2314ed7840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:8399:1874676443795584:0@lo:502: 00000100:00100000:1.0:1787830873.216057:0:8399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830873.216084:0:8399:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2310003300 going to sleep for 11 seconds 00000100:00100000:3.0:1787830873.216131:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443795584 00000100:00100000:3.0:1787830873.216136:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443795584 00000100:00100000:3.0:1787830873.216169:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787830873.216177:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a681050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+16:8399:x1874676443795584:12345-0@lo:502: 00000100:00100000:3.0:1787830873.216806:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a681050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+16:8399:x1874676443795584:12345-0@lo:502: Request processed in 628us (747us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830873.216813:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787830873.219061:0:8399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2314ed7840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:8399:1874676443795584:0@lo:502: 00000040:00080000:0.0:1787830873.220277:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1787830873.220317:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1787830873.220334:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1787830873.220360:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1787830873.220375:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1787830873.220394:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1787830873.220407:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1787830873.220420:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1787830873.220563:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1787830873.220586:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1787830873.220601:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1787830873.220614:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1787830873.220764:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1787830873.220782:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1787830873.220795:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1787830873.220807:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1787830873.220821:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1787830873.220835:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1787830873.220849:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1787830873.220862:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1787830873.220874:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1787830873.220884:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1787830873.220895:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1787830873.220906:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1787830873.220917:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:0.0:1787830873.220928:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:0.0:1787830873.220939:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:0.0:1787830873.220952:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:0.0:1787830873.220980:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:0.0:1787830873.220998:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:0.0:1787830873.221012:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:0.0:1787830873.221024:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:0.0:1787830873.221037:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:0.0:1787830873.221139:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:0.0:1787830873.221159:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:0.0:1787830873.221174:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:0.0:1787830873.221264:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:0.0:1787830873.221307:0:8399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2201def480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:8399:1874676443795712:0@lo:502: 00000100:00100000:0.0:1787830873.221383:0:8399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830873.221471:0:8399:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d232f7e7c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787830873.221513:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443795712 00000100:00100000:2.0:1787830873.221520:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443795712 00000100:00100000:2.0:1787830873.221607:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787830873.221616:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a680050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+16:8399:x1874676443795712:12345-0@lo:502: 00000100:00100000:2.0:1787830873.221756:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a680050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+16:8399:x1874676443795712:12345-0@lo:502: Request processed in 141us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830873.221763:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787830873.221857:0:8399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2201def480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:8399:1874676443795712:0@lo:502: 00000040:00080000:0.0:1787830873.221897:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:0.0:1787830873.221905:0:8399:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:0.0:1787830873.222521:0:8427:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1787830873.222537:0:8427:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8d232f4c99b8) 00000020:00000080:0.0:1787830873.222559:0:8427:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:1.0:1787830873.234794:0:8427:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d232f6b0800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787830873.234804:0:8427:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d232f6b0800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787830873.234807:0:8427:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d232f6b0800 3 00010000:00080000:1.0:1787830873.234845:0:8427:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d2334551800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.131@tcp at head 00010000:00010000:1.0:1787830873.237021:0:8427:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:1.0:1787830873.237281:0:8427:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1787830873.237330:0:8427:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787830873.237343:0:8427:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x95459fb9d1d28686 00000100:00080000:1.0:1787830873.237361:0:8427:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787830873.237367:0:8427:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8d2334551800 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:1.0:1787830873.237408:0:8427:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2314ed4b40 x1874676443795840/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787830873.237493:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2314ed4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3618:1874676443795840:0@lo:38: 00000100:00100000:2.0:1787830873.237574:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787830873.237683:0:8427:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787830873.237783:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2314ed52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676443796096:0@lo:400: 00000100:00100000:1.0:1787830873.237827:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830873.237852:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787830873.237858:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2314ed61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3622:1874676443795968:0@lo:400: 00000100:00100000:1.0:1787830873.237891:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830873.237929:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2314ed70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1874676443796352:0@lo:400: 00000100:00100000:1.0:1787830873.237958:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830873.237977:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787830873.237982:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2314ed7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3620:1874676443796224:0@lo:400: 00000100:00100000:1.0:1787830873.238003:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830873.238206:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443795840 00000100:00100000:3.0:1787830873.238214:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443795840 00000100:00100000:3.0:1787830873.238237:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443795968 00000100:00100000:3.0:1787830873.238240:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443795968 00000100:00100000:3.0:1787830873.238260:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443796224 00000100:00100000:3.0:1787830873.238262:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443796224 00000100:00100000:3.0:1787830873.238276:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787830873.238292:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220258c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1874676443795968:12345-0@lo:400: 00000100:00100000:3.0:1787830873.238346:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220258c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1874676443795968:12345-0@lo:400: Request processed in 56us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830873.238353:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787830873.238369:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787830873.238375:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220258e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1874676443796224:12345-0@lo:400: 00000100:00100000:3.0:1787830873.238406:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220258e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1874676443796224:12345-0@lo:400: Request processed in 31us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830873.238411:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787830873.238423:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787830873.238427:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233be761c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3618:x1874676443795840:12345-0@lo:38: 00010000:00080000:3.0:1787830873.238459:0:6490:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 164 last 0 00000020:00000080:3.0:1787830873.238488:0:6490:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x95459fb9d1d2868d 00000004:00100000:3.0:1787830873.238503:0:6490:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787830873.238544:0:6490:0:(import.c:65:import_set_state_nolock()) ffff8d232f728800 : changing import state from RECOVER to FULL 00010000:00080000:1.0:1787830873.238646:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d2314ed61c0 x1874676443795968/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830889 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787830873.238660:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2314ed61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3622:1874676443795968:0@lo:400: 00010000:00080000:1.0:1787830873.238692:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d2314ed7840 x1874676443796224/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830889 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787830873.238700:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2314ed7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3620:1874676443796224:0@lo:400: 00000100:00100000:2.0:1787830873.240861:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443796096 00000100:00100000:2.0:1787830873.240873:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443796096 00000100:00100000:2.0:1787830873.240921:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443796352 00000100:00100000:2.0:1787830873.240924:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443796352 00000100:00100000:2.0:1787830873.240940:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787830873.240948:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2309cf9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676443796096:12345-0@lo:400: 00000100:00100000:2.0:1787830873.241050:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2309cf9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676443796096:12345-0@lo:400: Request processed in 102us (3222us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830873.241057:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787830873.241075:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787830873.241081:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220258f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1874676443796352:12345-0@lo:400: 00000100:00100000:2.0:1787830873.241129:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220258f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1874676443796352:12345-0@lo:400: Request processed in 49us (3174us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830873.241136:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787830873.241186:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2314ed70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1874676443796352:0@lo:400: 00000100:00100000:1.0:1787830873.241288:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2314ed52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676443796096:0@lo:400: 00000100:00100000:3.0:1787830873.241354:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233be761c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1874676443795840:12345-0@lo:38: Request processed in 2923us (3778us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830873.241362:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787830873.241425:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d2314ed4b40 x1874676443795840/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787830883 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787830873.241435:0:3618:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787830873.241444:0:3618:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1787830873.241460:0:3618:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787830873.241466:0:3618:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787830873.241470:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8d2334551800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787830873.241477:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2314ed4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3618:1874676443795840:0@lo:38: 00000020:01000004:0.0:1787830873.245335:0:8427:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1787830873.245356:0:8427:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff8d232f4c8000) 00000020:00000080:0.0:1787830873.245380:0:8427:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:0.0:1787830873.245851:0:8427:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d232f6b0800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787830873.245856:0:8427:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d232f6b0800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787830873.245858:0:8427:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d232f6b0800 3 00010000:00080000:0.0:1787830873.245901:0:8427:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d232f69b800@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.131@tcp at head 00010000:00010000:0.0:1787830873.247986:0:8427:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000020:00000080:0.0:1787830873.248200:0:8427:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:0.0:1787830873.248242:0:8427:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787830873.248257:0:8427:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x95459fb9d1d2869b 00000100:00080000:0.0:1787830873.248268:0:8427:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787830873.248274:0:8427:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8d232f69b800 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:0.0:1787830873.248313:0:8427:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2201def480 x1874676443796480/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787830873.248337:0:8427:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1787830873.249180:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2201def480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3618:1874676443796480:0@lo:38: 00000100:00100000:3.0:1787830873.249251:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830873.257088:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443796480 00000100:00100000:0.0:1787830873.257109:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443796480 00000100:00100000:0.0:1787830873.257175:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787830873.257292:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d232f797480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3618:x1874676443796480:12345-0@lo:38: 00010000:00080000:0.0:1787830873.257326:0:6491:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 164 last 0 00000020:00000080:0.0:1787830873.257362:0:6491:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x95459fb9d1d286a2 00000004:00100000:0.0:1787830873.257381:0:6491:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000040:00080000:1.0:1787830873.257432:0:8427:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:1.0:1787830873.257486:0:8399:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:1.0:1787830873.257518:0:8399:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787830873.257540:0:8399:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d2307c76400/0x95459fb9d1d28671 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d28678 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830873.257550:0:8399:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8d2307c76400/0x95459fb9d1d28671 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d28678 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787830873.257595:0:8399:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787830873.257598:0:8399:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787830873.257599:0:8399:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787830873.257600:0:8399:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787830873.257601:0:8399:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787830873.257602:0:8399:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787830873.257604:0:8399:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787830873.257606:0:8399:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787830873.257607:0:8399:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787830873.257609:0:8399:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787830873.257610:0:8399:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787830873.257614:0:8399:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:1.0:1787830873.257617:0:8399:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787830873.257618:0:8399:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787830873.257620:0:8399:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787830873.257621:0:8399:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787830873.257638:0:8399:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787830873.257640:0:8399:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787830873.257641:0:8399:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787830873.257642:0:8399:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787830873.257643:0:8399:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787830873.257644:0:8399:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787830873.257645:0:8399:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787830873.257668:0:8399:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1787830873.257685:0:8399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220258ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:8399:1874676443796608:0@lo:253: 00000100:00100000:1.0:1787830873.257762:0:8399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787830873.257785:0:6491:0:(import.c:65:import_set_state_nolock()) ffff8d232f4b9800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787830873.257806:0:8399:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2310003b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787830873.257919:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d232f797480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1874676443796480:12345-0@lo:38: Request processed in 628us (8667us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830873.257928:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1787830873.258054:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d2201def480 x1874676443796480/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787830883 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787830873.258065:0:3618:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787830873.258072:0:3618:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1787830873.258080:0:3618:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787830873.258085:0:3618:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1787830873.258087:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8d232f69b800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787830873.258093:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2201def480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3618:1874676443796480:0@lo:38: 00000100:00100000:3.0:1787830873.261281:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443796608 00000100:00100000:3.0:1787830873.261294:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443796608 00000100:00100000:3.0:1787830873.261359:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787830873.261368:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a682850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+16:8399:x1874676443796608:12345-0@lo:253: 20000000:01000000:3.0:1787830873.261401:0:6485:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1787830873.261414:0:6485:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1787830873.266872:0:6485:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787830873.266895:0:6485:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1787830873.266998:0:6506:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787830873.267004:0:6506:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787830873.267025:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d2300031a00/0x95459fb9d1d286a9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830873.267045:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2307c77600/0x95459fb9d1d285a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d2859f expref: 16 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830873.267053:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2301669a00/0x95459fb9d1d285d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d285c9 expref: 16 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830873.267075:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d2300031a00/0x95459fb9d1d286a9 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830873.267113:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2301669a00/0x95459fb9d1d285d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x95459fb9d1d285c9 expref: 16 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830873.267127:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d2301669a00/0x95459fb9d1d285d0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x95459fb9d1d285c9 expref: 16 pid: 6485 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830873.267142:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2201def480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6506:1874676443796736:0@lo:104: 00000100:00100000:0.0:1787830873.267203:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787830873.267261:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2307c77600/0x95459fb9d1d285a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x95459fb9d1d2859f expref: 16 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830873.267270:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d2307c77600/0x95459fb9d1d285a6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x95459fb9d1d2859f expref: 16 pid: 6485 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830873.267279:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2201dec3c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6506:1874676443796864:0@lo:104: 00000100:00100000:0.0:1787830873.267296:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d232f7e70c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787830873.267430:0:6473:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787830873.267451:0:6473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830873.267480:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443796736 00000100:00100000:2.0:1787830873.267486:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443796736 00000100:00100000:2.0:1787830873.267517:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443796864 00000100:00100000:2.0:1787830873.267520:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443796864 00000100:00100000:2.0:1787830873.267535:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787830873.267543:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233bc4d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a45944b-32e3-4193-a2a5-46f84222bc14+4:6506:x1874676443796736:12345-0@lo:104: 00010000:00010000:2.0:1787830873.267555:0:6473:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff8d233837b600/0x95459fb9d1d285c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d285d0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830873.267641:0:6473:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787830873.267648:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233bc4d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a45944b-32e3-4193-a2a5-46f84222bc14+4:6506:x1874676443796736:12345-0@lo:104: Request processed in 106us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830873.267655:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787830873.267684:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787830873.267692:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233be74000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a45944b-32e3-4193-a2a5-46f84222bc14+3:6506:x1874676443796864:12345-0@lo:104: 00010000:00010000:1.0:1787830873.267700:0:6474:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff8d233837a800/0x95459fb9d1d2859f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d285a6 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830873.267764:0:6474:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787830873.267770:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233be74000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a45944b-32e3-4193-a2a5-46f84222bc14+3:6506:x1874676443796864:12345-0@lo:104: Request processed in 79us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830873.267776:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:2.0:1787830873.267797:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787830873.267803:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8d233837b600/0x95459fb9d1d285c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d285d0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830873.267811:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233837b600 already unused, calling callback (ffffffffc14f9c20) 10000000:00010000:2.0:1787830873.267815:0:6479:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8d233837b600/0x95459fb9d1d285c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x95459fb9d1d285d0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830873.267825:0:6479:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8d233837b600/0x95459fb9d1d285c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x95459fb9d1d285d0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830873.267847:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2201def480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6506:1874676443796736:0@lo:104: 10000000:00010000:2.0:1787830873.267852:0:6479:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8d233837b600/0x95459fb9d1d285c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x95459fb9d1d285d0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830873.267855:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2201dec3c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6506:1874676443796864:0@lo:104: 10000000:01000000:2.0:1787830873.267859:0:6479:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787830873.267878:0:6506:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d2300031a00/0x95459fb9d1d286a9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830873.267892:0:6479:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8d233837b600/0x95459fb9d1d285c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d285d0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830873.267898:0:6479:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787830873.267924:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8d233837b600/0x95459fb9d1d285c9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d285d0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830873.267933:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8d233837b600/0x95459fb9d1d285c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d285d0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830873.267954:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787830873.267958:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8d233837a800/0x95459fb9d1d2859f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d285a6 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830873.267963:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233837a800 already unused, calling callback (ffffffffc14f9c20) 00000100:00100000:0.0:1787830873.267964:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233be75e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a45944b-32e3-4193-a2a5-46f84222bc14:3621:1874676443796992:0@lo:103: 10000000:00010000:2.0:1787830873.267966:0:6479:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8d233837a800/0x95459fb9d1d2859f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x95459fb9d1d285a6 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830873.267972:0:6479:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8d233837a800/0x95459fb9d1d2859f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x95459fb9d1d285a6 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787830873.267978:0:6479:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8d233837a800/0x95459fb9d1d2859f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x95459fb9d1d285a6 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787830873.267983:0:6479:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:0.0:1787830873.267990:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787830873.268014:0:6479:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8d233837a800/0x95459fb9d1d2859f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d285a6 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830873.268021:0:6479:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787830873.268028:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8d233837a800/0x95459fb9d1d2859f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d285a6 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830873.268034:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8d233837a800/0x95459fb9d1d2859f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d285a6 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830873.268038:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:2.0:1787830873.268047:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787830873.268049:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787830873.268050:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787830873.268051:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233be75a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a45944b-32e3-4193-a2a5-46f84222bc14:3621:1874676443797120:0@lo:103: 00000100:00100000:0.0:1787830873.268073:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830873.268140:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443796992 00000100:00100000:1.0:1787830873.268144:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443796992 00010000:00010000:1.0:1787830873.268166:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2301669a00/0x95459fb9d1d285d0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d285c9 expref: 17 pid: 6485 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830873.268258:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787830873.268307:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a682850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+17:8399:x1874676443796608:12345-0@lo:253: Request processed in 6939us (10544us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830873.268315:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787830873.268430:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443797120 00000100:00100000:1.0:1787830873.268434:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443797120 00010000:00010000:1.0:1787830873.268446:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2307c77600/0x95459fb9d1d285a6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d2859f expref: 17 pid: 6485 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830873.272046:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787830873.272072:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2201dec3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2a45944b-32e3-4193-a2a5-46f84222bc14+17:3621:x1874676443796992:12345-0@lo:103: 00010000:00010000:2.0:1787830873.272096:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787830873.272105:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2301669a00/0x95459fb9d1d285d0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d285c9 expref: 17 pid: 6485 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830873.272122:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2301669a00/0x95459fb9d1d285d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x95459fb9d1d285c9 expref: 17 pid: 6485 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830873.272143:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2301669a00/0x95459fb9d1d285d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x95459fb9d1d285c9 expref: 17 pid: 6485 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830873.272162:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787830873.272249:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2201dec3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2a45944b-32e3-4193-a2a5-46f84222bc14+16:3621:x1874676443796992:12345-0@lo:103: Request processed in 189us (4257us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830873.272257:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787830873.272282:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787830873.272289:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2201def480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2a45944b-32e3-4193-a2a5-46f84222bc14+15:3621:x1874676443797120:12345-0@lo:103: 00010000:00010000:2.0:1787830873.272310:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787830873.272316:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2307c77600/0x95459fb9d1d285a6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d2859f expref: 15 pid: 6485 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830873.272324:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2307c77600/0x95459fb9d1d285a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x95459fb9d1d2859f expref: 15 pid: 6485 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830873.272334:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2307c77600/0x95459fb9d1d285a6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x95459fb9d1d2859f expref: 15 pid: 6485 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830873.272345:0:6477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d2300031a00/0x95459fb9d1d286a9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830873.272353:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2300031a00/0x95459fb9d1d286a9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787830873.272368:0:6477:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005365558s 00010000:00010000:2.0:1787830873.272373:0:6477:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d2300031a00/0x95459fb9d1d286a9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830873.272380:0:6477:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d2300031a00/0x95459fb9d1d286a9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830873.272579:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233be75e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a45944b-32e3-4193-a2a5-46f84222bc14:3621:1874676443796992:0@lo:103: 00010000:00010000:2.0:1787830873.273302:0:6477:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d2300031a00/0x95459fb9d1d286a9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830873.273315:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d2300031a00/0x95459fb9d1d286a9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830873.273321:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2300031a00 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:2.0:1787830873.273326:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d2300031a00/0x95459fb9d1d286a9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830873.273344:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d2300031a00/0x95459fb9d1d286a9 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830873.273370:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d2300031a00/0x95459fb9d1d286a9 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830873.273383:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787830873.273442:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2201def480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2a45944b-32e3-4193-a2a5-46f84222bc14+14:3621:x1874676443797120:12345-0@lo:103: Request processed in 1153us (5367us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830873.273450:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787830873.273488:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233be75a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a45944b-32e3-4193-a2a5-46f84222bc14:3621:1874676443797120:0@lo:103: 00010000:00010000:3.0:1787830873.273727:0:6506:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d2300031a00/0x95459fb9d1d286a9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830873.273745:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d2300031a00/0x95459fb9d1d286a9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830873.273752:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2300031a00/0x95459fb9d1d286a9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830873.273760:0:8399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220258ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:8399:1874676443796608:0@lo:253: 10000000:01000000:2.0:1787830873.273770:0:8399:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787830873.273773:0:8399:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787830873.273774:0:8399:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787830873.273775:0:8399:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787830873.273777:0:8399:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787830873.273778:0:8399:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787830873.273780:0:8399:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787830873.273781:0:8399:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787830873.273783:0:8399:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787830873.273784:0:8399:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787830873.273786:0:8399:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787830873.273787:0:8399:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787830873.273799:0:8399:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1787830873.280249:0:8399:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:2.0:1787830873.280508:0:8399:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1787830873.283092:0:8399:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:3.0:1787830873.283677:0:8399:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1787830873.283925:0:8399:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:3.0:1787830873.284156:0:8399:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:3.0:1787830873.285601:0:8399:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1787830873.304062:0:8399:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1787830873.304070:0:8399:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1787830873.304104:0:8399:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787830873.304143:0:8399:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.131@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787830873.304167:0:8399:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1787830873.304183:0:8399:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:3.0:1787830873.304896:0:8399:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787830873.305069:0:8399:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:3.0:1787830874.067796:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787830874.347203:0:8483:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787830874.347519:0:8483:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787830875.110982:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830876.134878:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787830876.519014:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787830876.519023:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d232f730000 from 30 10000000:01000000:2.0:1787830876.519028:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787830876.519086:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233837a800/0x95459fb9d1d286b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830876.519098:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8d233837a800/0x95459fb9d1d286b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830876.519110:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8d233837a800/0x95459fb9d1d286b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830876.519134:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233be75a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443797248:0@lo:101: 00000100:00100000:2.0:1787830876.519204:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830876.519272:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d23082b69c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787830876.519283:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443797248 00000100:00100000:0.0:1787830876.519293:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443797248 00000100:00100000:0.0:1787830876.519344:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787830876.519353:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a683050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+14:6487:x1874676443797248:12345-0@lo:101: 00010000:00010000:0.0:1787830876.519368:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787830876.519383:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2300030a00/0x95459fb9d1d286b7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d286b0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830876.519411:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2300030a00/0x95459fb9d1d286b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d286b0 expref: 15 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830876.519423:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2300030a00/0x95459fb9d1d286b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d286b0 expref: 15 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830876.519450:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2300030a00, rc 0) 00000100:00100000:0.0:1787830876.519503:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a683050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+15:6487:x1874676443797248:12345-0@lo:101: Request processed in 151us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830876.519510:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787830876.519706:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233be75a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443797248:0@lo:101: 00010000:00010000:2.0:1787830876.519732:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8d233837a800/0x95459fb9d1d286b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d286b7 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830876.519742:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8d233837a800/0x95459fb9d1d286b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d286b7 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830876.519801:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233be75a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443797376:0@lo:501: 00000100:00100000:2.0:1787830876.519830:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830876.519855:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d23082b69c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787830876.519916:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443797376 00000100:00100000:0.0:1787830876.519920:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443797376 00000100:00100000:0.0:1787830876.519997:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787830876.520004:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a682450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+15:6487:x1874676443797376:12345-0@lo:501: 00000100:00100000:0.0:1787830876.520123:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a682450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+15:6487:x1874676443797376:12345-0@lo:501: Request processed in 119us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830876.520129:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787830876.520178:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233be75a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443797376:0@lo:501: 00000100:00100000:2.0:1787830876.520206:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233be75a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443797504:0@lo:503: 00000100:00100000:2.0:1787830876.520245:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830876.520379:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d23082b69c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787830876.520422:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443797504 00000100:00100000:0.0:1787830876.520432:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443797504 00000100:00100000:0.0:1787830876.520522:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787830876.520529:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a683850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+15:6487:x1874676443797504:12345-0@lo:503: 00000100:00100000:0.0:1787830876.520610:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a683850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+15:6487:x1874676443797504:12345-0@lo:503: Request processed in 81us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830876.520617:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787830876.520750:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233be75a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443797504:0@lo:503: 00000100:00100000:2.0:1787830876.521598:0:8610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233be75a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:8610:1874676443797632:0@lo:502: 00000100:00100000:2.0:1787830876.521696:0:8610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830876.521746:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443797632 00000100:00100000:0.0:1787830876.521752:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443797632 00000100:00100000:2.0:1787830876.521758:0:8610:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d23082b6540 going to sleep for 11 seconds 00000100:00100000:0.0:1787830876.521787:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787830876.521796:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a683c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+15:8610:x1874676443797632:12345-0@lo:502: 00000100:00100000:0.0:1787830876.521908:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a683c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+15:8610:x1874676443797632:12345-0@lo:502: Request processed in 112us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830876.521914:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787830876.522108:0:8610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233be75a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:8610:1874676443797632:0@lo:502: 00000100:00100000:2.0:1787830876.522152:0:8610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233be75a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:8610:1874676443797760:0@lo:502: 00000100:00100000:2.0:1787830876.522184:0:8610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830876.522208:0:8610:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d23082b6540 going to sleep for 11 seconds 00000100:00100000:3.0:1787830876.522471:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443797760 00000100:00100000:3.0:1787830876.522483:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443797760 00000100:00100000:3.0:1787830876.522526:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787830876.522535:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a680450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+15:8610:x1874676443797760:12345-0@lo:502: 00000100:00100000:3.0:1787830876.522674:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a680450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+15:8610:x1874676443797760:12345-0@lo:502: Request processed in 140us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830876.522681:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787830876.522988:0:8610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233be75a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:8610:1874676443797760:0@lo:502: 00000040:00080000:0.0:1787830876.523017:0:8610:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1787830876.523123:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1787830876.523149:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787830876.523221:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233837a800/0x95459fb9d1d286b0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d286b7 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830876.523232:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8d233837a800/0x95459fb9d1d286b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d286b7 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787830876.523242:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787830876.523244:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d232f730000 from 5 10000000:01000000:3.0:1787830876.523247:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787830876.523276:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d2307c76a00/0x95459fb9d1d286be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830876.523284:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8d2307c76a00/0x95459fb9d1d286be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830876.523294:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8d2307c76a00/0x95459fb9d1d286be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830876.523307:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d232f796580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443797888:0@lo:101: 00000100:00100000:3.0:1787830876.523421:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830876.523506:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2334484540 going to sleep for 11 seconds 00000100:00100000:0.0:1787830876.523844:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443797888 00000100:00100000:0.0:1787830876.523850:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443797888 00000100:00100000:0.0:1787830876.523925:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787830876.523933:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a680850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+15:6487:x1874676443797888:12345-0@lo:101: 00010000:00010000:0.0:1787830876.523944:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787830876.523959:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2300030000/0x95459fb9d1d286c5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d286be expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830876.523994:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2300030000/0x95459fb9d1d286c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d286be expref: 16 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830876.524006:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2300030000/0x95459fb9d1d286c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d286be expref: 16 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830876.524027:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2300030000, rc 0) 00000100:00100000:0.0:1787830876.524073:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a680850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+16:6487:x1874676443797888:12345-0@lo:101: Request processed in 141us (652us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830876.524080:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787830876.524153:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d232f796580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443797888:0@lo:101: 00010000:00010000:2.0:1787830876.524177:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8d2307c76a00/0x95459fb9d1d286be lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d286c5 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830876.524187:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8d2307c76a00/0x95459fb9d1d286be lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d286c5 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830876.524239:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233be74780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443798016:0@lo:256: 00000100:00100000:2.0:1787830876.524273:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830876.524535:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d23082b6540 going to sleep for 11 seconds 00000100:00100000:3.0:1787830876.524565:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443798016 00000100:00100000:3.0:1787830876.524575:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443798016 00000100:00100000:3.0:1787830876.524599:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787830876.524606:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a681c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+16:6487:x1874676443798016:12345-0@lo:256: 20000000:01000000:3.0:1787830876.524621:0:6483:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787830876.524669:0:6483:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787830876.524672:0:6483:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1787830876.524881:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a681c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+16:6487:x1874676443798016:12345-0@lo:256: Request processed in 275us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830876.524889:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787830876.525232:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233be74780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443798016:0@lo:256: 10000000:01000000:2.0:1787830876.525278:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787830876.525286:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d2307c76a00/0x95459fb9d1d286be lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d286c5 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830876.525294:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8d2307c76a00/0x95459fb9d1d286be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d286c5 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787830876.525302:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1787830876.525304:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:2.0:1787830876.525307:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1787830876.525407:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233837b600/0x95459fb9d1d286cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830876.525416:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8d233837b600/0x95459fb9d1d286cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830876.525424:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8d233837b600/0x95459fb9d1d286cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830876.525439:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233be74780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443798144:0@lo:101: 00000100:00100000:2.0:1787830876.525470:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830876.525539:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d23082b6540 going to sleep for 11 seconds 00000100:00100000:3.0:1787830876.525582:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443798144 00000100:00100000:3.0:1787830876.525587:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443798144 00000100:00100000:3.0:1787830876.525837:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787830876.525848:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a682050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+16:6487:x1874676443798144:12345-0@lo:101: 00010000:00010000:3.0:1787830876.525858:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787830876.525872:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2307c76000/0x95459fb9d1d286d3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d286cc expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830876.525894:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2307c76000/0x95459fb9d1d286d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d286cc expref: 17 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830876.525905:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2307c76000/0x95459fb9d1d286d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d286cc expref: 17 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830876.525915:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2307c76000, rc 0) 00000100:00100000:3.0:1787830876.526000:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a682050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+17:6487:x1874676443798144:12345-0@lo:101: Request processed in 153us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830876.526006:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787830876.526146:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233be74780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443798144:0@lo:101: 00010000:00010000:2.0:1787830876.526226:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8d233837b600/0x95459fb9d1d286cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d286d3 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830876.526236:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8d233837b600/0x95459fb9d1d286cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d286d3 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830876.526294:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233be74780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443798272:0@lo:501: 00000100:00100000:2.0:1787830876.526320:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830876.526454:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d23082b6540 going to sleep for 11 seconds 00000100:00100000:3.0:1787830876.528833:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443798272 00000100:00100000:3.0:1787830876.528846:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443798272 00000100:00100000:3.0:1787830876.528912:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787830876.528923:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a681450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+17:6487:x1874676443798272:12345-0@lo:501: 00000100:00100000:3.0:1787830876.529245:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a681450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+17:6487:x1874676443798272:12345-0@lo:501: Request processed in 324us (2922us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830876.529253:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787830876.529394:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233be74780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443798272:0@lo:501: 00000100:00100000:2.0:1787830876.529444:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233be74780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443798400:0@lo:503: 00000100:00100000:2.0:1787830876.529494:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830876.529528:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d23082b6540 going to sleep for 11 seconds 00000100:00100000:3.0:1787830876.529659:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443798400 00000100:00100000:3.0:1787830876.529664:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443798400 00000100:00100000:3.0:1787830876.529687:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787830876.529697:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a680c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+17:6487:x1874676443798400:12345-0@lo:503: 00000100:00100000:3.0:1787830876.529940:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a680c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+17:6487:x1874676443798400:12345-0@lo:503: Request processed in 246us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830876.529947:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787830876.530130:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233be74780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443798400:0@lo:503: 00000100:00100000:2.0:1787830876.531858:0:8612:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233be74780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:8612:1874676443798528:0@lo:502: 00000100:00100000:2.0:1787830876.531936:0:8612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830876.532094:0:8612:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d23082b6b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787830876.532243:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443798528 00000100:00100000:3.0:1787830876.532250:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443798528 00000100:00100000:3.0:1787830876.532297:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787830876.532307:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a682c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+17:8612:x1874676443798528:12345-0@lo:502: 00000100:00100000:3.0:1787830876.532510:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a682c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+17:8612:x1874676443798528:12345-0@lo:502: Request processed in 204us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830876.532518:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787830876.532817:0:8612:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233be74780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:8612:1874676443798528:0@lo:502: 00000020:01000000:2.0:1787830876.532851:0:8612:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787830876.532859:0:8612:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1787830876.532865:0:8612:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787830876.532867:0:8612:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1787830876.532873:0:8612:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787830876.532877:0:8612:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.131@tcp to nid 0x20000c0a8cb83 (192.168.203.131@tcp) 00000020:01000000:2.0:1787830876.532898:0:8612:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1787830876.532901:0:8612:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787830876.532917:0:8612:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff8d2201e1b370) 00000020:00000080:2.0:1787830876.532939:0:8612:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:2.0:1787830876.532945:0:8612:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787830876.533584:0:8612:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:2.0:1787830876.533592:0:8612:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:2.0:1787830876.533601:0:8612:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x95459fb9d1d286e1 00010000:00080000:2.0:1787830876.535070:0:8612:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d233be47000@lustre-OST0000-osc-MDT0001: add connection 192.168.203.131@tcp at head 00010000:00010000:2.0:1787830876.536496:0:8612:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:2.0:1787830876.576112:0:8612:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1787830876.576137:0:8612:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:2.0:1787830876.576393:0:8612:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787830876.576613:0:8612:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787830876.576747:0:8612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1787830876.576836:0:8612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1787830876.581297:0:8617:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787830876.581305:0:8617:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1787830876.581508:0:8612:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787830876.581521:0:8612:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787830876.581564:0:8612:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1787830876.581592:0:8612:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x95459fb9d1d286e8 00000100:00080000:2.0:1787830876.581606:0:8612:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787830876.581620:0:8612:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8d233be47000 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:2.0:1787830876.581696:0:8612:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d233be76940 x1874676443798656/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787830876.581733:0:8612:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1787830876.581795:0:8612:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787830876.581799:0:8612:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787830876.581801:0:8612:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1787830876.581803:0:8612:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787830876.581807:0:8612:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787830876.581808:0:8612:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787830876.581811:0:8612:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787830876.581813:0:8612:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1787830876.581843:0:8612:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233be74b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:8612:1874676443798784:0@lo:502: 00000100:00100000:2.0:1787830876.581928:0:8612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830876.583089:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233be76940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1874676443798656:0@lo:8: 00000100:00100000:3.0:1787830876.583274:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830876.584071:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220258cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874676443798912:0@lo:400: 00000100:00100000:3.0:1787830876.584116:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830876.584148:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443798912 00000100:00100000:3.0:1787830876.584260:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443798912 00000100:00100000:3.0:1787830876.584313:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787830876.584322:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d232f796580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874676443798912:12345-0@lo:400: 00000100:00100000:3.0:1787830876.584381:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d232f796580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874676443798912:12345-0@lo:400: Request processed in 59us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830876.584389:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787830876.584492:0:8612:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d23082b69c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787830876.584513:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443798784 00000100:00100000:2.0:1787830876.584517:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443798784 00000100:00100000:2.0:1787830876.584548:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787830876.584555:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a683450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+17:8612:x1874676443798784:12345-0@lo:502: 00000100:00100000:2.0:1787830876.584688:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a683450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+17:8612:x1874676443798784:12345-0@lo:502: Request processed in 134us (2760us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830876.584696:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787830876.584747:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220258f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1874676443799040:0@lo:400: 00000100:00100000:2.0:1787830876.584777:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830876.584797:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220258de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3620:1874676443799552:0@lo:400: 00000100:00100000:2.0:1787830876.584819:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830876.584849:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220258e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3621:1874676443799168:0@lo:400: 00000100:00100000:2.0:1787830876.584883:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830876.584903:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787830876.584909:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220258fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443799296:0@lo:400: 00000100:00100000:2.0:1787830876.584930:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830876.584959:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443799040 00000100:00100000:2.0:1787830876.584962:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443799040 00000100:00100000:0.0:1787830876.586338:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443798656 00000100:00100000:0.0:1787830876.586349:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443798656 00000100:00100000:0.0:1787830876.586380:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787830876.586387:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d232f796d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3618:x1874676443798656:12345-0@lo:8: 00010000:00080000:0.0:1787830876.586416:0:8406:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 167 last 0 00000020:00000080:0.0:1787830876.586447:0:8406:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x95459fb9d1d286ef 00002000:00100000:0.0:1787830876.586487:0:8406:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff8d233bda6800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211393d ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:0.0:1787830876.586491:0:8406:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:0.0:1787830876.586496:0:8406:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1787830876.586557:0:8406:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1787830876.586790:0:8406:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:0.0:1787830876.586818:0:8406:0:(import.c:65:import_set_state_nolock()) ffff8d233bda7800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787830876.586892:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d232f796d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3618:x1874676443798656:12345-0@lo:8: Request processed in 503us (3738us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830876.586899:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787830876.587130:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d233be76940 x1874676443798656/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787830886 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787830876.587130:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443799296 00000100:00100000:2.0:1787830876.587134:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443799296 00000100:00100000:3.0:1787830876.587142:0:3618:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00100000:2.0:1787830876.587153:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787830876.587160:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233be77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1874676443799040:12345-0@lo:400: 00000100:00080000:3.0:1787830876.587165:0:3618:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:3.0:1787830876.587173:0:3618:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787830876.587179:0:3618:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1787830876.587181:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8d233be47000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787830876.587201:0:3618:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787830876.587207:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233be76940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1874676443798656:0@lo:8: 00010000:00080000:3.0:1787830876.587249:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d220258cf00 x1874676443798912/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830892 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787830876.587260:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220258cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874676443798912:0@lo:400: 00000100:00100000:3.0:1787830876.587270:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220258c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3619:1874676443799424:0@lo:400: 00000100:00100000:2.0:1787830876.587276:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233be77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1874676443799040:12345-0@lo:400: Request processed in 117us (2499us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830876.587282:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787830876.587299:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787830876.587305:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830876.587305:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233be75e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1874676443799296:12345-0@lo:400: 00000100:00100000:2.0:1787830876.587335:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233be75e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1874676443799296:12345-0@lo:400: Request processed in 31us (2405us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830876.587341:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787830876.587344:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443799552 00000100:00100000:3.0:1787830876.587347:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443799552 00000100:00100000:2.0:1787830876.587359:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443799168 00000100:00100000:2.0:1787830876.587362:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443799168 00000100:00100000:2.0:1787830876.587376:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443799424 00000100:00100000:2.0:1787830876.587378:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443799424 00000100:00100000:3.0:1787830876.587380:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787830876.587385:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233be75a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1874676443799552:12345-0@lo:400: 00000100:00100000:2.0:1787830876.587389:0:6491:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1787830876.587395:0:6491:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1787830876.587411:0:6490:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1787830876.587415:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233be75a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1874676443799552:12345-0@lo:400: Request processed in 30us (2596us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830876.587418:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787830876.587421:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787830876.587423:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233be75680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1874676443799168:12345-0@lo:400: 00000100:00100000:3.0:1787830876.587431:0:6492:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1787830876.587443:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787830876.587448:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d232f797840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874676443799424:12345-0@lo:400: 00000100:00100000:2.0:1787830876.587450:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233be75680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1874676443799168:12345-0@lo:400: Request processed in 27us (2567us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830876.587460:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787830876.587475:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d232f797840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874676443799424:12345-0@lo:400: Request processed in 27us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830876.587481:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1787830876.587505:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d220258c000 x1874676443799424/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830892 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787830876.587513:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220258c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3619:1874676443799424:0@lo:400: 00000100:00100000:3.0:1787830876.587552:0:8618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d232f7943c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8618:1874676443799680:0@lo:700: 00000100:00100000:2.0:1787830876.587565:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220258f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1874676443799040:0@lo:400: 00000100:00100000:3.0:1787830876.587577:0:8618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1787830876.587577:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d220258de00 x1874676443799552/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830892 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787830876.587586:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220258de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3620:1874676443799552:0@lo:400: 00000100:00100000:3.0:1787830876.587600:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443799680 00000100:00100000:3.0:1787830876.587603:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443799680 00000100:00100000:2.0:1787830876.587612:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220258fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443799296:0@lo:400: 00000100:00100000:3.0:1787830876.587652:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787830876.587660:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d232f794b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8618:x1874676443799680:12345-0@lo:700: 00000100:00100000:3.0:1787830876.587684:0:8414:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d232f796940 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8414:1874676443799808:0@lo:700: 00000100:00100000:3.0:1787830876.587719:0:8414:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830876.587736:0:8414:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2310a409c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787830876.587744:0:8618:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2310a40900 going to sleep for 11 seconds 00010000:00080000:2.0:1787830876.587880:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d220258e1c0 x1874676443799168/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830892 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787830876.587893:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220258e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3621:1874676443799168:0@lo:400: 00000100:00080000:2.0:1787830876.587916:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787830876.587920:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787830876.587923:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787830876.588008:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443799808 00000100:00100000:2.0:1787830876.588012:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443799808 00000100:00100000:2.0:1787830876.588036:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787830876.588047:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d232f795a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8414:x1874676443799808:12345-0@lo:700: 00000100:00100000:2.0:1787830876.588159:0:8612:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233be74b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:8612:1874676443798784:0@lo:502: 00000020:01000000:2.0:1787830876.588194:0:8612:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787830876.588202:0:8612:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787830876.588204:0:8612:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787830876.588209:0:8612:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000020:01000000:2.0:1787830876.588318:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:2.0:1787830876.588337:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1787830876.588347:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233837b600/0x95459fb9d1d286cc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d286d3 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830876.588368:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8d233837b600/0x95459fb9d1d286cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d286d3 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787830876.588378:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787830876.588381:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d2303f2e000 from 30 10000000:01000000:2.0:1787830876.588384:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787830876.588409:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233837b000/0x95459fb9d1d286f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830876.588417:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8d233837b000/0x95459fb9d1d286f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830876.588426:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8d233837b000/0x95459fb9d1d286f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787830876.588434:0:8617:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:2.0:1787830876.588437:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233be74b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443799936:0@lo:101: 00000100:00100000:2.0:1787830876.588468:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1787830876.588493:0:8617:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 167588867466ns, next at 0ns, rc = 0 00080000:00080000:1.0:1787830876.588500:0:8617:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1787830876.589266:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d23082b69c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787830876.589306:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443799936 00000100:00100000:2.0:1787830876.589313:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443799936 00000100:00100000:2.0:1787830876.589349:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787830876.589356:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a681850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+17:6487:x1874676443799936:12345-0@lo:101: 00010000:00010000:2.0:1787830876.589373:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787830876.589388:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d233837a000/0x95459fb9d1d286fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d286f6 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830876.589414:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d233837a000/0x95459fb9d1d286fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d286f6 expref: 18 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830876.589437:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d233837a000/0x95459fb9d1d286fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d286f6 expref: 18 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830876.589446:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233837a000, rc 0) 00000100:00100000:2.0:1787830876.589560:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a681850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+18:6487:x1874676443799936:12345-0@lo:101: Request processed in 203us (1090us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830876.589567:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787830876.589614:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233be74b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443799936:0@lo:101: 00010000:00010000:2.0:1787830876.589894:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8d233837b000/0x95459fb9d1d286f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d286fd expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830876.589904:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8d233837b000/0x95459fb9d1d286f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d286fd expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830876.589968:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233be74b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443800064:0@lo:501: 00000100:00100000:2.0:1787830876.589997:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830876.590019:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d23082b69c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787830876.590278:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443800064 00000100:00100000:0.0:1787830876.590283:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443800064 00000100:00100000:0.0:1787830876.590321:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787830876.590328:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d231859cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+18:6487:x1874676443800064:12345-0@lo:501: 00000100:00100000:0.0:1787830876.590439:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d231859cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+18:6487:x1874676443800064:12345-0@lo:501: Request processed in 111us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830876.590455:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787830876.590488:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233be74b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443800064:0@lo:501: 00000004:00080000:3.0:1787830876.592102:0:7421:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:0.0:1787830876.593611:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2201dee580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443800192:0@lo:503: 00000100:00100000:0.0:1787830876.593726:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830876.593768:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d230659dd80 going to sleep for 11 seconds 00000100:00100000:3.0:1787830876.594093:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443800192 00000100:00100000:3.0:1787830876.594100:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443800192 00000100:00100000:3.0:1787830876.594228:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787830876.594238:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d231859ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+18:6487:x1874676443800192:12345-0@lo:503: 00000100:00100000:3.0:1787830876.594363:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d231859ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+18:6487:x1874676443800192:12345-0@lo:503: Request processed in 126us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830876.594371:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787830876.596648:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2201dee580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443800192:0@lo:503: 40000000:02000000:3.0:1787830876.597473:0:6497:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000100:00100000:2.0:1787830876.601933:0:8621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233be752c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:8621:1874676443800320:0@lo:502: 00000100:00100000:2.0:1787830876.602032:0:8621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830876.602081:0:8621:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2321cf3600 going to sleep for 11 seconds 00000100:00100000:0.0:1787830876.602267:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443800320 00000100:00100000:0.0:1787830876.602275:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443800320 00000100:00100000:0.0:1787830876.602332:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787830876.602343:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d231859f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+18:8621:x1874676443800320:12345-0@lo:502: 00000100:00100000:0.0:1787830876.602479:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d231859f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+18:8621:x1874676443800320:12345-0@lo:502: Request processed in 138us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830876.602487:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787830876.603726:0:8621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233be752c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:8621:1874676443800320:0@lo:502: 00000100:00100000:2.0:1787830876.603813:0:8621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233be752c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:8621:1874676443800448:0@lo:502: 00000100:00100000:2.0:1787830876.603873:0:8621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830876.603913:0:8621:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2321cf3600 going to sleep for 11 seconds 00000100:00100000:0.0:1787830876.604066:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443800448 00000100:00100000:0.0:1787830876.604073:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443800448 00000100:00100000:0.0:1787830876.604129:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787830876.604139:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d231859d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+18:8621:x1874676443800448:12345-0@lo:502: 00000100:00100000:0.0:1787830876.604259:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d231859d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+18:8621:x1874676443800448:12345-0@lo:502: Request processed in 121us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830876.604268:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787830876.604285:0:8621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233be752c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:8621:1874676443800448:0@lo:502: 00000040:00080000:1.0:1787830876.604315:0:8621:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1787830876.605083:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1787830876.605110:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787830876.605121:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233837b000/0x95459fb9d1d286f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d286fd expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830876.605133:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8d233837b000/0x95459fb9d1d286f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d286fd expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787830876.605161:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787830876.605164:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d2303f2e000 from 5 10000000:01000000:0.0:1787830876.605166:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787830876.605198:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d2300031e00/0x95459fb9d1d28704 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830876.605207:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8d2300031e00/0x95459fb9d1d28704 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830876.605216:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8d2300031e00/0x95459fb9d1d28704 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830876.605233:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2201dee580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443800576:0@lo:101: 00000100:00100000:0.0:1787830876.605275:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830876.605318:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d230659d480 going to sleep for 11 seconds 00000100:00100000:1.0:1787830876.605463:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443800576 00000100:00100000:1.0:1787830876.605470:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443800576 00000100:00100000:1.0:1787830876.605516:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787830876.605525:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d231859d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+18:6487:x1874676443800576:12345-0@lo:101: 00010000:00010000:1.0:1787830876.605548:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787830876.605571:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d233be95200/0x95459fb9d1d2870b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d28704 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830876.605599:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d233be95200/0x95459fb9d1d2870b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d28704 expref: 19 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830876.605612:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d233be95200/0x95459fb9d1d2870b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d28704 expref: 19 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830876.605643:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233be95200, rc 0) 00000100:00100000:1.0:1787830876.605684:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d231859d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+19:6487:x1874676443800576:12345-0@lo:101: Request processed in 160us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830876.605691:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787830876.606111:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2201dee580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443800576:0@lo:101: 00010000:00010000:0.0:1787830876.606129:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8d2300031e00/0x95459fb9d1d28704 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2870b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830876.606140:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8d2300031e00/0x95459fb9d1d28704 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d2870b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830876.606274:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2201dee580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443800704:0@lo:256: 00000100:00100000:0.0:1787830876.606312:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830876.606338:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d230659d480 going to sleep for 11 seconds 00000100:00100000:0.0:1787830876.606354:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443800704 00000100:00100000:0.0:1787830876.606358:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443800704 00000100:00100000:0.0:1787830876.606387:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787830876.606402:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d231859c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+19:6487:x1874676443800704:12345-0@lo:256: 20000000:01000000:0.0:1787830876.606429:0:6484:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787830876.606443:0:6484:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787830876.606446:0:6484:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1787830876.606520:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d231859c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+19:6487:x1874676443800704:12345-0@lo:256: Request processed in 118us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830876.606527:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787830876.606559:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2201dee580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443800704:0@lo:256: 10000000:01000000:0.0:1787830876.606602:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787830876.606608:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d2300031e00/0x95459fb9d1d28704 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2870b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830876.606617:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8d2300031e00/0x95459fb9d1d28704 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2870b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787830876.606643:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1787830876.606646:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:0.0:1787830876.606648:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787830876.606666:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d2300031a00/0x95459fb9d1d28712 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830876.606673:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8d2300031a00/0x95459fb9d1d28712 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830876.606680:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8d2300031a00/0x95459fb9d1d28712 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830876.606692:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2201dee580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443800832:0@lo:101: 00000100:00100000:0.0:1787830876.606737:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830876.606757:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2303250480 going to sleep for 11 seconds 00000100:00100000:0.0:1787830876.606769:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443800832 00000100:00100000:0.0:1787830876.606772:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443800832 00000100:00100000:0.0:1787830876.606795:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787830876.606801:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d231859e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+19:6487:x1874676443800832:12345-0@lo:101: 00010000:00010000:0.0:1787830876.606808:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787830876.606818:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2300030200/0x95459fb9d1d28719 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d28712 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830876.606835:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2300030200/0x95459fb9d1d28719 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d28712 expref: 20 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830876.606843:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2300030200/0x95459fb9d1d28719 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d28712 expref: 20 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830876.606851:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2300030200, rc 0) 00000100:00100000:0.0:1787830876.606878:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d231859e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+20:6487:x1874676443800832:12345-0@lo:101: Request processed in 77us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830876.606883:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787830876.606912:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2201dee580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443800832:0@lo:101: 00010000:00010000:0.0:1787830876.606922:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8d2300031a00/0x95459fb9d1d28712 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d28719 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830876.606929:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8d2300031a00/0x95459fb9d1d28712 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d28719 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830876.606986:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2201dee580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443800960:0@lo:501: 00000100:00100000:0.0:1787830876.607010:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830876.607023:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2303250480 going to sleep for 11 seconds 00000100:00100000:0.0:1787830876.607041:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443800960 00000100:00100000:0.0:1787830876.607045:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443800960 00000100:00100000:0.0:1787830876.607067:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1787830876.607073:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d231859f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+20:6487:x1874676443800960:12345-0@lo:501: 00000100:00100000:0.0:1787830876.613687:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d231859f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+20:6487:x1874676443800960:12345-0@lo:501: Request processed in 6602us (6664us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830876.613704:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1787830876.613799:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2201dee580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443800960:0@lo:501: 00000100:00100000:0.0:1787830876.613857:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2201dee580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443801088:0@lo:503: 00000100:00100000:0.0:1787830876.613909:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830876.613942:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2303250480 going to sleep for 11 seconds 00000100:00100000:0.0:1787830876.613960:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443801088 00000100:00100000:0.0:1787830876.613966:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443801088 00000100:00100000:0.0:1787830876.614008:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787830876.614017:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d231859e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+20:6487:x1874676443801088:12345-0@lo:503: 00000100:00100000:0.0:1787830876.614120:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d231859e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+20:6487:x1874676443801088:12345-0@lo:503: Request processed in 104us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830876.614127:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787830876.614169:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2201dee580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443801088:0@lo:503: 00000100:00100000:0.0:1787830876.614390:0:8623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2201dee580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:8623:1874676443801216:0@lo:502: 00000100:00100000:0.0:1787830876.614423:0:8623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830876.614442:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443801216 00000100:00100000:0.0:1787830876.614445:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443801216 00000100:00100000:0.0:1787830876.614468:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1787830876.614474:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d231859f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+20:8623:x1874676443801216:12345-0@lo:502: 00000100:00100000:0.0:1787830876.614544:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d231859f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+20:8623:x1874676443801216:12345-0@lo:502: Request processed in 69us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830876.614556:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1787830876.614583:0:8623:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2303250600 going to sleep for 11 seconds 00000100:00100000:0.0:1787830876.614594:0:8623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2201dee580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:8623:1874676443801216:0@lo:502: 00000020:01000000:0.0:1787830876.614615:0:8623:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787830876.614642:0:8623:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1787830876.614649:0:8623:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787830876.614652:0:8623:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1787830876.614657:0:8623:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787830876.614661:0:8623:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.131@tcp to nid 0x20000c0a8cb83 (192.168.203.131@tcp) 00000020:01000000:0.0:1787830876.614682:0:8623:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1787830876.614684:0:8623:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787830876.614718:0:8623:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8d233f430000) 00000020:00000080:0.0:1787830876.614743:0:8623:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:0.0:1787830876.614749:0:8623:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787830876.614817:0:8623:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1787830876.614822:0:8623:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:0.0:1787830876.614829:0:8623:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x95459fb9d1d28727 00010000:00080000:0.0:1787830876.614869:0:8623:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d233f43d000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.131@tcp at head 00010000:00010000:0.0:1787830876.615084:0:8623:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 00000100:00100000:3.0:1787830876.615838:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d232f795a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8414:x1874676443799808:12345-0@lo:700: Request processed in 27792us (28125us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830876.615848:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787830876.615896:0:8414:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d232f796940 x1874676443799808/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787830892 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787830876.615908:0:8414:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d232f796940 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8414:1874676443799808:0@lo:700: 40000000:02000000:3.0:1787830876.615918:0:8414:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000040:01000000:2.0:1787830876.633382:0:8623:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1787830876.633413:0:8623:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1787830876.633618:0:8623:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787830876.633846:0:8623:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787830876.633933:0:8623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1787830876.634027:0:8623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1787830876.634556:0:8625:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787830876.634561:0:8625:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1787830876.635271:0:8623:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787830876.635283:0:8623:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787830876.635318:0:8623:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1787830876.635343:0:8623:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x95459fb9d1d2872e 00000100:00080000:0.0:1787830876.635354:0:8623:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787830876.635360:0:8623:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d233f43d000 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:0.0:1787830876.635398:0:8623:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2201dee580 x1874676443801344/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787830876.635450:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2201dee580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1874676443801344:0@lo:8: 00000100:00100000:3.0:1787830876.635523:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830876.636024:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443801344 00000100:00100000:2.0:1787830876.636033:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443801344 00000100:00100000:2.0:1787830876.636076:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787830876.636083:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d232f796940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3618:x1874676443801344:12345-0@lo:8: 00010000:00080000:2.0:1787830876.636110:0:8408:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 167 last 0 00000020:00000080:2.0:1787830876.636137:0:8408:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x95459fb9d1d28735 00002000:00100000:2.0:1787830876.636152:0:8408:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8d233f421800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211393d ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1787830876.636167:0:8408:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1787830876.636170:0:8408:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787830876.636247:0:8408:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787830876.636270:0:8408:0:(import.c:65:import_set_state_nolock()) ffff8d233f424000 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1787830876.636433:0:8623:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1787830876.636525:0:8623:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787830876.636530:0:8623:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787830876.636532:0:8623:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1787830876.636536:0:8623:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787830876.636540:0:8623:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787830876.636541:0:8623:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787830876.636544:0:8623:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787830876.636546:0:8623:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1787830876.636570:0:8623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2201deed00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:8623:1874676443801472:0@lo:502: 00000100:00100000:0.0:1787830876.636617:0:8623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830876.636666:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443801472 00000100:00100000:0.0:1787830876.636670:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443801472 00000100:00100000:0.0:1787830876.636702:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1787830876.636718:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d231859fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+20:8623:x1874676443801472:12345-0@lo:502: 00000100:00100000:0.0:1787830876.636815:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d231859fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+20:8623:x1874676443801472:12345-0@lo:502: Request processed in 106us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830876.636823:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1787830876.636871:0:8623:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d230659d480 going to sleep for 11 seconds 00000100:00100000:0.0:1787830876.636892:0:8623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2201deed00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:8623:1874676443801472:0@lo:502: 00000020:01000000:0.0:1787830876.636920:0:8623:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787830876.636925:0:8623:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787830876.636926:0:8623:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787830876.636930:0:8623:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:0.0:1787830876.636980:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:0.0:1787830876.636998:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787830876.637009:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d2300031a00/0x95459fb9d1d28712 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d28719 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830876.637020:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8d2300031a00/0x95459fb9d1d28712 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d28719 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787830876.637037:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1787830876.637040:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8d2312953370 from 1 10000000:01000000:0.0:1787830876.637043:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787830876.637067:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d2300030400/0x95459fb9d1d2873c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830876.637075:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8d2300030400/0x95459fb9d1d2873c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830876.637085:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8d2300030400/0x95459fb9d1d2873c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830876.637097:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2201deed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443801600:0@lo:101: 00000100:00100000:0.0:1787830876.637124:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830876.637138:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d232f686f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787830876.637166:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443801600 00000100:00100000:0.0:1787830876.637170:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443801600 00000100:00100000:0.0:1787830876.637191:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1787830876.637198:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d231859c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+20:6487:x1874676443801600:12345-0@lo:101: 00010000:00010000:0.0:1787830876.637206:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787830876.637233:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d233bf10c00/0x95459fb9d1d28743 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d2873c expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830876.637259:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d233bf10c00/0x95459fb9d1d28743 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d2873c expref: 21 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830876.637271:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d233bf10c00/0x95459fb9d1d28743 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d2873c expref: 21 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830876.637292:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233bf10c00, rc 0) 00000100:00100000:0.0:1787830876.637322:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d231859c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+21:6487:x1874676443801600:12345-0@lo:101: Request processed in 125us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830876.637328:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1787830876.637359:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2201deed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443801600:0@lo:101: 00010000:00010000:0.0:1787830876.637372:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8d2300030400/0x95459fb9d1d2873c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d28743 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830876.637381:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8d2300030400/0x95459fb9d1d2873c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d28743 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830876.637426:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2201deed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443801728:0@lo:501: 00000100:00100000:0.0:1787830876.637450:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830876.637463:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d232f686f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787830876.637476:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443801728 00000100:00100000:0.0:1787830876.637479:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443801728 00000100:00100000:0.0:1787830876.637500:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1787830876.637506:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d231859c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+21:6487:x1874676443801728:12345-0@lo:501: 00000100:00100000:0.0:1787830876.637572:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d231859c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+21:6487:x1874676443801728:12345-0@lo:501: Request processed in 66us (121us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787830876.637579:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1787830876.637606:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2201deed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443801728:0@lo:501: 10000000:01000000:0.0:1787830876.637650:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787830876.637655:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d2300030400/0x95459fb9d1d2873c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d28743 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830876.637672:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8d2300030400/0x95459fb9d1d2873c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d28743 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:3.0:1787830876.642362:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2201dee580 x1874676443801344/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787830886 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787830876.642362:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d232f796940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3618:x1874676443801344:12345-0@lo:8: Request processed in 6266us (6827us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830876.642382:0:3618:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00100000:2.0:1787830876.642385:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1787830876.642394:0:3618:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1787830876.642404:0:3618:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787830876.642410:0:3618:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1787830876.642414:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8d233f43d000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787830876.642427:0:3618:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787830876.642434:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2201dee580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1874676443801344:0@lo:8: 00000004:00080000:2.0:1787830876.642473:0:8625:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1787830876.642543:0:8625:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 167642917552ns, next at 0ns, rc = 0 00080000:00080000:2.0:1787830876.642550:0:8625:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000001:00100000:2.0:1787830876.644241:0:8401:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:3.0:1787830876.647438:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d232f794b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8618:x1874676443799680:12345-0@lo:700: Request processed in 59770us (59850us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830876.647453:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787830876.647511:0:8618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d232f7943c0 x1874676443799680/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787830892 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787830876.647527:0:8618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d232f7943c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8618:1874676443799680:0@lo:700: 00000004:00080000:1.0:1787830876.648511:0:6469:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:3.0:1787830876.652380:0:8626:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:3.0:1787830876.652417:0:8626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d232f794780 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8626:1874676443801984:0@lo:7: 00000100:00100000:3.0:1787830876.652493:0:8626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830876.652541:0:8626:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2310a40900 going to sleep for 11 seconds 00000100:00100000:1.0:1787830876.652612:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443801984 00000100:00100000:1.0:1787830876.652620:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443801984 00000100:00100000:1.0:1787830876.652702:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787830876.652722:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d232f795e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8626:x1874676443801984:12345-0@lo:7: 00000100:00100000:2.0:1787830876.652908:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d232f7943c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443801856:0@lo:13: 00000100:00100000:2.0:1787830876.652943:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830876.653953:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443801856 00000100:00100000:2.0:1787830876.653967:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443801856 00000100:00100000:2.0:1787830876.654084:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787830876.654093:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233be74f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3621:x1874676443801856:12345-0@lo:13: 00002000:00000024:2.0:1787830876.654117:0:8409:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923894272 avail 3692371968 00000100:00100000:2.0:1787830876.654182:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233be74f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3621:x1874676443801856:12345-0@lo:13: Request processed in 90us (1237us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830876.654190:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787830876.654310:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d232f7943c0 x1874676443801856/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787830892 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787830876.654331:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d232f7943c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443801856:0@lo:13: 00000100:00080000:3.0:1787830876.655000:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:0.0:1787830876.656380:0:8407:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:0.0:1787830876.656386:0:8407:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:0.0:1787830876.656472:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d232f795e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8626:x1874676443801984:12345-0@lo:7: Request processed in 3752us (3977us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830876.656481:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787830876.656743:0:8626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d232f794780 x1874676443801984/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787830892 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787830876.656758:0:8626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d232f794780 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8626:1874676443801984:0@lo:7: 00000004:00080000:2.0:1787830876.656774:0:8626:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:2.0:1787830876.656815:0:8626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233be770c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8626:1874676443802112:0@lo:5: 00000100:00100000:2.0:1787830876.656867:0:8626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830876.656909:0:8626:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2321cf3600 going to sleep for 11 seconds 00000100:00100000:0.0:1787830876.657949:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443802112 00000100:00100000:0.0:1787830876.657960:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443802112 00000100:00100000:0.0:1787830876.658008:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787830876.658017:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233be76580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8626:x1874676443802112:12345-0@lo:5: 00002000:00080000:0.0:1787830876.658048:0:8408:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1787830876.658053:0:8408:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000004:00080000:1.0:1787830876.668876:0:8618:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:1.0:1787830876.668927:0:8618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220258c780 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8618:1874676443802368:0@lo:7: 00000100:00100000:2.0:1787830876.669091:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220258da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676443802240:0@lo:13: 00000100:00100000:2.0:1787830876.669149:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830876.669245:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443802240 00000100:00100000:2.0:1787830876.669252:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443802240 00000100:00100000:2.0:1787830876.669297:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787830876.669307:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233be752c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676443802240:12345-0@lo:13: 00002000:00000024:2.0:1787830876.669329:0:8409:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923894272 avail 3692371968 00000100:00100000:2.0:1787830876.669375:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233be752c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676443802240:12345-0@lo:13: Request processed in 70us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830876.669396:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787830876.669438:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d220258da40 x1874676443802240/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787830892 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787830876.669458:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220258da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676443802240:0@lo:13: 00000100:00100000:1.0:1787830876.669965:0:8618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830876.670684:0:8618:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d233bcbc780 going to sleep for 11 seconds 00000100:00100000:1.0:1787830876.674895:0:8407:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1787830876.674913:0:8407:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000001:00080000:1.0:1787830876.676910:0:8401:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:1.0:1787830876.676926:0:8401:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1787830876.677124:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233be76580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8626:x1874676443802112:12345-0@lo:5: Request processed in 19102us (20251us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1787830876.677137:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787830876.677225:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443802368 00000100:00100000:0.0:1787830876.677233:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443802368 00000100:00100000:0.0:1787830876.677282:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787830876.677292:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220258e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8618:x1874676443802368:12345-0@lo:7: 00010000:00080000:1.0:1787830876.678103:0:8626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d233be770c0 x1874676443802112/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787830892 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787830876.678115:0:8626:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1787830876.678129:0:8626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233be770c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8626:1874676443802112:0@lo:5: 00000004:00080000:1.0:1787830876.678145:0:8626:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:1.0:1787830876.678194:0:8626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220258cb40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8626:1874676443802496:0@lo:700: 00000100:00100000:1.0:1787830876.678251:0:8626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830876.678284:0:8626:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d233bcbc240 going to sleep for 11 seconds 00000100:00100000:3.0:1787830876.678523:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443802496 00000100:00100000:3.0:1787830876.678529:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443802496 00000100:00100000:3.0:1787830876.678568:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787830876.678577:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220258f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8626:x1874676443802496:12345-0@lo:700: 00002000:00080000:0.0:1787830876.687477:0:8408:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:0.0:1787830876.687488:0:8408:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:0.0:1787830876.687930:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220258e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8618:x1874676443802368:12345-0@lo:7: Request processed in 10635us (17960us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830876.687943:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1787830876.688074:0:8618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d220258c780 x1874676443802368/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787830892 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787830876.688092:0:8618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220258c780 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8618:1874676443802368:0@lo:7: 00000004:00080000:1.0:1787830876.688108:0:8618:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:1.0:1787830876.688169:0:8618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220258c780 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8618:1874676443802624:0@lo:5: 00000100:00100000:1.0:1787830876.688212:0:8618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830876.688250:0:8618:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d233bcbc780 going to sleep for 11 seconds 00000100:00100000:3.0:1787830876.688371:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443802624 00000100:00100000:3.0:1787830876.688378:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443802624 00000100:00100000:3.0:1787830876.688425:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787830876.688435:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220258da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8618:x1874676443802624:12345-0@lo:5: 00002000:00080000:3.0:1787830876.688461:0:8406:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:3.0:1787830876.688510:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220258da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8618:x1874676443802624:12345-0@lo:5: Request processed in 77us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830876.688516:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1787830876.688613:0:8618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d220258c780 x1874676443802624/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787830892 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787830876.688665:0:8618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220258c780 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8618:1874676443802624:0@lo:5: 00000004:00080000:0.0:1787830876.688674:0:8618:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:0.0:1787830876.688700:0:8618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2201deed00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8618:1874676443802752:0@lo:5: 00000100:00100000:0.0:1787830876.688737:0:8618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830876.688754:0:8618:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d232f6869c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787830876.688814:0:8631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443802752 00000100:00100000:3.0:1787830876.688818:0:8631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443802752 00000100:00100000:3.0:1787830876.688846:0:8631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787830876.688852:0:8631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2201ded680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:8618:x1874676443802752:12345-0@lo:5: 00002000:00080000:3.0:1787830876.688876:0:8631:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:3.0:1787830876.691086:0:8631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2201ded680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:8618:x1874676443802752:12345-0@lo:5: Request processed in 2228us (2342us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1787830876.691101:0:8631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1787830876.692030:0:8618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2201deed00 x1874676443802752/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787830892 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787830876.692050:0:8618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2201deed00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8618:1874676443802752:0@lo:5: 00000004:00080000:0.0:1787830876.692068:0:8618:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:0.0:1787830876.692121:0:8618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2201ded2c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8618:1874676443802880:0@lo:900: 00000100:00100000:0.0:1787830876.692168:0:8618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830876.692200:0:8618:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d232f6869c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787830876.692248:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443802880 00000100:00100000:3.0:1787830876.692255:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443802880 00000100:00100000:3.0:1787830876.692311:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787830876.692330:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2201decf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8618:x1874676443802880:12345-0@lo:900: 00000100:00100000:3.0:1787830876.692382:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2201decf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8618:x1874676443802880:12345-0@lo:900: Request processed in 53us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830876.692389:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787830876.692699:0:8618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2201ded2c0 x1874676443802880/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787830892 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787830876.692717:0:8618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2201ded2c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8618:1874676443802880:0@lo:900: 00000001:00080000:1.0:1787830876.705868:0:8401:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000100:00100000:0.0:1787830876.706041:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220258f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8626:x1874676443802496:12345-0@lo:700: Request processed in 27461us (27785us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830876.706054:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787830876.706227:0:8626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d220258cb40 x1874676443802496/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787830892 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787830876.706242:0:8626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220258cb40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8626:1874676443802496:0@lo:700: 00000004:02000040:2.0:1787830876.715345:0:8626:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:3.0:1787830876.719123:0:8626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d232f797c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8626:1874676443803008:0@lo:5: 00000100:00100000:3.0:1787830876.719215:0:8626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830876.719273:0:8626:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2310a403c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787830876.719322:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443803008 00000100:00100000:2.0:1787830876.719330:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443803008 00000100:00100000:2.0:1787830876.719380:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787830876.719388:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d232f794000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8626:x1874676443803008:12345-0@lo:5: 00002000:00080000:0.0:1787830876.727187:0:8406:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:0.0:1787830876.727220:0:8406:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:0.0:1787830876.729858:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d232f794000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8626:x1874676443803008:12345-0@lo:5: Request processed in 10459us (10633us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1787830876.729872:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1787830876.730020:0:8626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d232f797c00 x1874676443803008/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787830892 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787830876.730041:0:8626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d232f797c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8626:1874676443803008:0@lo:5: 00000004:00080000:3.0:1787830876.730061:0:8626:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00010000:00010000:3.0:1787830877.159992:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787830877.414836:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220258cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443803136:0@lo:41: 00000100:00100000:0.0:1787830877.414955:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830877.417605:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443803136 00000100:00100000:0.0:1787830877.417653:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443803136 00000100:00100000:0.0:1787830877.417744:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787830877.417757:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2201ded2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676443803136:12345-0@lo:41: 00000004:00000024:0.0:1787830877.417801:0:7448:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1787830877.417915:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2201ded2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676443803136:12345-0@lo:41: Request processed in 162us (2960us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830877.417924:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787830877.417987:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220258cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443803136:0@lo:41: 00000100:00100000:2.0:1787830877.935512:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787830877.935546:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233be74b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443803264:0@lo:41: 00000100:00100000:2.0:1787830877.935665:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830877.936128:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443803264 00000100:00100000:2.0:1787830877.936138:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443803264 00000100:00100000:2.0:1787830877.936194:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787830877.936204:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233be76940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443803264:12345-0@lo:41: 00000004:00000024:2.0:1787830877.936244:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:2.0:1787830877.936298:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233be76940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443803264:12345-0@lo:41: Request processed in 96us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830877.936306:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787830877.936422:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233be74b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443803264:0@lo:41: 00010000:00010000:2.0:1787830878.182921:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787830878.936176:0:8782:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg331-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787830879.211012:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787830879.929263:0:8834:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787830879.929589:0:8834:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787830880.243156:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787830880.906339:0:8401:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00010000:00010000:2.0:1787830881.254877:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787830882.022903:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233be74b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443803392:0@lo:13: 00000100:00100000:2.0:1787830882.022999:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830882.023099:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443803392 00000100:00100000:2.0:1787830882.023108:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443803392 00000100:00100000:2.0:1787830882.023173:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787830882.023184:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233be74780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443803392:12345-0@lo:13: 00002000:00000024:2.0:1787830882.023216:0:8409:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1787830882.023244:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787830882.023269:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233be74780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443803392:12345-0@lo:13: Request processed in 87us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830882.023276:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787830882.023287:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d233be74b40 x1874676443803392/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787830898 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787830882.023299:0:3621:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1787830882.023327:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233be74b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443803392:0@lo:13: 00000100:00100000:2.0:1787830882.023392:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d232f7961c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676443803520:0@lo:13: 00000100:00100000:2.0:1787830882.023425:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830882.023511:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443803520 00000100:00100000:3.0:1787830882.023515:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443803520 00000100:00100000:3.0:1787830882.023749:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787830882.023758:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233be770c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1874676443803520:12345-0@lo:13: 00002000:00000024:3.0:1787830882.023770:0:8409:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787830882.023812:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233be770c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1874676443803520:12345-0@lo:13: Request processed in 57us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830882.023818:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1787830882.023873:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787830882.024041:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d232f7961c0 x1874676443803520/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787830898 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787830882.024051:0:3622:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:3.0:1787830882.024068:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d232f7961c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676443803520:0@lo:13: 00000100:00100000:0.0:1787830882.024342:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2201deed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a45944b-32e3-4193-a2a5-46f84222bc14:3619:1874676443803648:0@lo:400: 00000100:00100000:0.0:1787830882.024382:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830882.024410:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2201def0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443804160:0@lo:400: 00000100:00100000:0.0:1787830882.024435:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830882.024457:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787830882.024463:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2201defc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874676443803776:0@lo:400: 00000100:00100000:0.0:1787830882.024488:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830882.024517:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2201dee580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3619:1874676443804288:0@lo:400: 00000100:00100000:0.0:1787830882.024542:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830882.024575:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443803648 00000100:00100000:0.0:1787830882.024579:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443803648 00000100:00100000:0.0:1787830882.024613:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1787830882.024919:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d231859dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+21:3619:x1874676443803648:12345-0@lo:400: 00000100:00100000:0.0:1787830882.025021:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d231859dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+21:3619:x1874676443803648:12345-0@lo:400: Request processed in 399us (637us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830882.025028:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1787830882.025065:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443804160 00000100:00100000:0.0:1787830882.025070:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443804160 00000100:00100000:0.0:1787830882.025108:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787830882.025114:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2201dec780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676443804160:12345-0@lo:400: 00000100:00100000:0.0:1787830882.025150:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2201dec780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676443804160:12345-0@lo:400: Request processed in 36us (714us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830882.025156:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787830882.025174:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443803776 00000100:00100000:0.0:1787830882.025178:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443803776 00000100:00100000:0.0:1787830882.025204:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443804288 00000100:00100000:0.0:1787830882.025207:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443804288 00000100:00100000:0.0:1787830882.025234:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787830882.025239:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2201decb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874676443803776:12345-0@lo:400: 00000100:00100000:0.0:1787830882.025269:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2201decb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874676443803776:12345-0@lo:400: Request processed in 29us (780us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830882.025275:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787830882.025287:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787830882.025293:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2201dee940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874676443804288:12345-0@lo:400: 00000100:00100000:0.0:1787830882.025317:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2201dee940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874676443804288:12345-0@lo:400: Request processed in 25us (774us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830882.025329:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:0.0:1787830882.025358:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787830882.025370:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2201dede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3622:1874676443804032:0@lo:400: 00000100:00100000:0.0:1787830882.025401:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830882.025423:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787830882.025430:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2201dec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676443803904:0@lo:400: 00000100:00100000:0.0:1787830882.025471:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830882.025506:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2201def840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3622:1874676443804416:0@lo:400: 00000100:00100000:0.0:1787830882.025560:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830882.025587:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443803904 00000100:00100000:0.0:1787830882.025591:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443803904 00000100:00100000:0.0:1787830882.025616:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787830882.025644:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d232f6c92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676443803904:12345-0@lo:400: 00000100:00100000:0.0:1787830882.025694:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d232f6c92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676443803904:12345-0@lo:400: Request processed in 72us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830882.025700:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787830882.025719:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443804032 00000100:00100000:0.0:1787830882.025723:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443804032 00000100:00100000:0.0:1787830882.025741:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443804416 00000100:00100000:0.0:1787830882.025744:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443804416 00000100:00100000:0.0:1787830882.025765:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787830882.025771:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2201deda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1874676443804032:12345-0@lo:400: 00000100:00100000:0.0:1787830882.025800:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2201deda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1874676443804032:12345-0@lo:400: Request processed in 30us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830882.025807:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787830882.025820:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787830882.025825:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d232f6c8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1874676443804416:12345-0@lo:400: 00000100:00100000:0.0:1787830882.025861:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d232f6c8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1874676443804416:12345-0@lo:400: Request processed in 35us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830882.025868:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1787830882.025884:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787830882.025920:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2201dec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676443803904:0@lo:400: 00010000:00080000:0.0:1787830882.025933:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2201def840 x1874676443804416/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830898 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787830882.025943:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2201def840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3622:1874676443804416:0@lo:400: 00010000:00080000:0.0:1787830882.025953:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2201dede00 x1874676443804032/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830898 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787830882.025961:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2201dede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3622:1874676443804032:0@lo:400: 00000100:00100000:2.0:1787830882.026507:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2201deed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a45944b-32e3-4193-a2a5-46f84222bc14:3619:1874676443803648:0@lo:400: 00000100:00100000:2.0:1787830882.026523:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2201def0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443804160:0@lo:400: 00010000:00080000:2.0:1787830882.026557:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2201defc00 x1874676443803776/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830898 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787830882.026567:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2201defc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874676443803776:0@lo:400: 00010000:00080000:2.0:1787830882.026581:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2201dee580 x1874676443804288/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830898 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787830882.026588:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2201dee580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3619:1874676443804288:0@lo:400: 00010000:00010000:0.0:1787830882.283967:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787830882.542158:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220258fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676443804544:0@lo:41: 00000100:00100000:0.0:1787830882.542263:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830882.542461:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443804544 00000100:00100000:1.0:1787830882.542470:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443804544 00000100:00100000:1.0:1787830882.542536:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787830882.542547:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d232f6cb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1874676443804544:12345-0@lo:41: 00000004:00000024:1.0:1787830882.542586:0:7448:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1787830882.542664:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d232f6cb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1874676443804544:12345-0@lo:41: Request processed in 119us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830882.542697:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787830882.542753:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220258fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676443804544:0@lo:41: 00000020:00000004:1.0:1787830882.986312:0:8936:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787830882.986568:0:8936:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1787830883.052286:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2314e72d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443804672:0@lo:41: 00000100:00100000:2.0:1787830883.052379:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830883.055696:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443804672 00000100:00100000:1.0:1787830883.055716:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443804672 00000100:00100000:1.0:1787830883.055802:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787830883.055814:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2314e72580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443804672:12345-0@lo:41: 00000004:00000024:1.0:1787830883.055856:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1787830883.055954:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2314e72580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443804672:12345-0@lo:41: Request processed in 143us (3575us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830883.055962:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787830883.056032:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2314e72d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443804672:0@lo:41: 00010000:00010000:1.0:1787830883.309689:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787830883.942307:0:8984:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787830883.942321:0:8984:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:2.0:1787830884.326847:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830885.351087:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830886.374968:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787830887.143412:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787830887.143448:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d232f7952c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443804800:0@lo:13: 00000100:00100000:3.0:1787830887.143565:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830887.144563:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2314e70b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a45944b-32e3-4193-a2a5-46f84222bc14:3621:1874676443804928:0@lo:400: 00000100:00100000:2.0:1787830887.144618:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830887.144755:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2314e71e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443805184:0@lo:400: 00000100:00100000:3.0:1787830887.144789:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830887.145757:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2309d0bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3619:1874676443805696:0@lo:400: 00000100:00100000:3.0:1787830887.145802:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830887.145839:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787830887.146017:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2314e72940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874676443805312:0@lo:400: 00000100:00100000:3.0:1787830887.146044:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830887.146075:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2309d09e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443805824:0@lo:400: 00000100:00100000:3.0:1787830887.146102:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830887.146377:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443805696 00000100:00100000:1.0:1787830887.146385:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443805696 00000100:00100000:1.0:1787830887.146451:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443805312 00000100:00100000:1.0:1787830887.146455:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443805312 00000100:00100000:1.0:1787830887.146482:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787830887.146493:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d232f7961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874676443805696:12345-0@lo:400: 00000100:00100000:1.0:1787830887.146551:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d232f7961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874676443805696:12345-0@lo:400: Request processed in 61us (749us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830887.146558:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787830887.146577:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787830887.146583:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d232f7970c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874676443805312:12345-0@lo:400: 00000100:00100000:1.0:1787830887.146612:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d232f7970c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874676443805312:12345-0@lo:400: Request processed in 29us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830887.146777:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2314e71680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443805440:0@lo:400: 00000100:00100000:2.0:1787830887.146811:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830887.146838:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220258cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443805952:0@lo:13: 00010000:00080000:3.0:1787830887.147041:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2309d0bc00 x1874676443805696/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830903 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787830887.147057:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2309d0bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3619:1874676443805696:0@lo:400: 00010000:00080000:3.0:1787830887.147082:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2314e72940 x1874676443805312/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830903 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787830887.147097:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2314e72940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874676443805312:0@lo:400: 00000100:00100000:1.0:1787830887.147186:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:1.0:1787830887.147212:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787830887.147275:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830887.147305:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787830887.147313:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2314e70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3621:1874676443805056:0@lo:400: 00000100:00100000:2.0:1787830887.147356:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830887.147378:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2314e72d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3621:1874676443805568:0@lo:400: 00000100:00100000:2.0:1787830887.147402:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830887.147439:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443805056 00000100:00100000:2.0:1787830887.147444:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443805056 00000100:00100000:2.0:1787830887.147467:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443805568 00000100:00100000:2.0:1787830887.147469:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443805568 00000100:00100000:2.0:1787830887.147496:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787830887.147502:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2336bfd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1874676443805056:12345-0@lo:400: 00000100:00100000:2.0:1787830887.147543:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2336bfd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1874676443805056:12345-0@lo:400: Request processed in 41us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830887.147549:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787830887.147563:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787830887.147568:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2336bfd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1874676443805568:12345-0@lo:400: 00000100:00100000:2.0:1787830887.147594:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2336bfd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1874676443805568:12345-0@lo:400: Request processed in 26us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830887.147600:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787830887.147619:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443804928 00000100:00100000:3.0:1787830887.147734:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443804800 00000100:00100000:3.0:1787830887.147739:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443804800 00000100:00100000:3.0:1787830887.147763:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443805952 00000100:00100000:3.0:1787830887.147765:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443805952 00000100:00100000:3.0:1787830887.147779:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787830887.147785:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d232f795680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676443804800:12345-0@lo:13: 00002000:00000024:3.0:1787830887.147809:0:8410:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787830887.148270:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d232f795680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676443804800:12345-0@lo:13: Request processed in 484us (4704us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830887.148289:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787830887.148306:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787830887.148314:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2318d57840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443805952:12345-0@lo:13: 00002000:00000024:3.0:1787830887.148325:0:8410:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787830887.148356:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2318d57840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443805952:12345-0@lo:13: Request processed in 44us (1082us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830887.148363:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787830887.148381:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443805184 00000100:00100000:3.0:1787830887.148386:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443805184 00000100:00100000:3.0:1787830887.148419:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443805440 00000100:00100000:3.0:1787830887.148422:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443805440 00000100:00100000:3.0:1787830887.148436:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787830887.148442:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d232f797c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443805184:12345-0@lo:400: 00000100:00100000:3.0:1787830887.148478:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d232f797c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443805184:12345-0@lo:400: Request processed in 36us (3687us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830887.148486:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787830887.148498:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787830887.148503:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2318d543c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1874676443805440:12345-0@lo:400: 00000100:00100000:3.0:1787830887.148533:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2318d543c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1874676443805440:12345-0@lo:400: Request processed in 30us (1721us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830887.148539:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787830887.148562:0:8631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443805824 00000100:00100000:3.0:1787830887.148566:0:8631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443805824 00000100:00100000:3.0:1787830887.148594:0:8631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787830887.148600:0:8631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d232f794780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443805824:12345-0@lo:400: 00000100:00100000:2.0:1787830887.148992:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443804928 00000100:00100000:2.0:1787830887.149038:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1787830887.149046:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d231859e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+21:3621:x1874676443804928:12345-0@lo:400: 00000100:00100000:2.0:1787830887.149096:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d231859e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+21:3621:x1874676443804928:12345-0@lo:400: Request processed in 51us (4477us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830887.149102:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00080000:2.0:1787830887.149839:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787830887.149912:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787830887.149954:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2314e70000 x1874676443805056/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830903 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787830887.149970:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2314e70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3621:1874676443805056:0@lo:400: 00010000:00080000:2.0:1787830887.149985:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2314e72d00 x1874676443805568/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830903 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787830887.149995:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2314e72d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3621:1874676443805568:0@lo:400: 00010000:00080000:2.0:1787830887.150007:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d220258cf00 x1874676443805952/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787830903 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787830887.150023:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220258cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443805952:0@lo:13: 00000100:00100000:2.0:1787830887.150033:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2314e70b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a45944b-32e3-4193-a2a5-46f84222bc14:3621:1874676443804928:0@lo:400: 00000100:00100000:2.0:1787830887.150045:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2314e71680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443805440:0@lo:400: 00000100:00100000:3.0:1787830887.151793:0:8631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d232f794780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443805824:12345-0@lo:400: Request processed in 3184us (5680us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830887.151816:0:8631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787830887.152309:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2309d09e00 x1874676443805824/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787830903 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787830887.152326:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2309d09e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443805824:0@lo:400: 00000100:00100000:3.0:1787830887.152340:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2314e71e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443805184:0@lo:400: 00010000:00080000:3.0:1787830887.152352:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d232f7952c0 x1874676443804800/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787830903 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787830887.152370:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d232f7952c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443804800:0@lo:13: 00010000:00010000:2.0:1787830887.401236:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787830887.655491:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787830887.655527:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220258d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443806080:0@lo:41: 00000100:00100000:0.0:1787830887.655648:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830887.655831:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443806080 00000100:00100000:1.0:1787830887.655840:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443806080 00000100:00100000:1.0:1787830887.655914:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787830887.655924:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d232f6cbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1874676443806080:12345-0@lo:41: 00000004:00000024:1.0:1787830887.655963:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1787830887.656024:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d232f6cbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1874676443806080:12345-0@lo:41: Request processed in 101us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830887.656032:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787830887.656087:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220258d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443806080:0@lo:41: 00000100:00100000:1.0:1787830888.166774:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787830888.166812:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220258ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1874676443806208:0@lo:41: 00000100:00100000:1.0:1787830888.166912:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830888.167000:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443806208 00000100:00100000:1.0:1787830888.167008:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443806208 00000100:00100000:1.0:1787830888.167064:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787830888.167085:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220258c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1874676443806208:12345-0@lo:41: 00000004:00000024:1.0:1787830888.167127:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1787830888.167182:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220258c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1874676443806208:12345-0@lo:41: Request processed in 99us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830888.167191:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787830888.167248:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220258ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1874676443806208:0@lo:41: 00010000:00010000:0.0:1787830888.426820:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830889.448014:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787830890.471007:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787830891.152231:0:9482:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787830891.152236:0:9482:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:1.0:1787830891.152238:0:9482:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1787830891.152444:0:9482:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8d2334556800 00000020:01000004:1.0:1787830891.152471:0:9482:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1787830891.152488:0:9482:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1787830891.152502:0:9482:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8d232f7799b8) 00000020:00000080:1.0:1787830891.152520:0:9482:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1787830891.171170:0:9482:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:0.0:1787830891.171236:0:9482:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:0.0:1787830891.181888:0:9482:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1787830891.182159:0:9482:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1787830891.182175:0:9482:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787830891.182188:0:9482:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x95459fb9d1d28751 00000020:01000004:0.0:1787830891.182197:0:9482:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:0.0:1787830891.182229:0:9482:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.131@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1787830891.182233:0:9482:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.131@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1787830891.182241:0:9482:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1787830891.182284:0:9482:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:0.0:1787830891.182289:0:9482:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.131@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1787830891.195853:0:9482:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.131@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787830891.195898:0:9482:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.131@tcp, index=0001, flags=0x20062 00000020:01000004:0.0:1787830891.195902:0:9482:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787830891.195904:0:9482:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787830891.195906:0:9482:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787830891.195908:0:9482:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787830891.195909:0:9482:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787830891.195910:0:9482:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787830891.195912:0:9482:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787830891.195913:0:9482:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787830891.195915:0:9482:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787830891.195917:0:9482:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787830891.195919:0:9482:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787830891.195923:0:9482:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:0.0:1787830891.195925:0:9482:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787830891.195927:0:9482:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787830891.195928:0:9482:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787830891.195929:0:9482:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787830891.195930:0:9482:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787830891.195931:0:9482:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787830891.195933:0:9482:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787830891.195934:0:9482:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787830891.195935:0:9482:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787830891.195936:0:9482:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787830891.195936:0:9482:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787830891.195964:0:9482:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1787830891.195986:0:9482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d232f6c8780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:9482:1874676443806336:0@lo:253: 00000100:00100000:0.0:1787830891.196079:0:9482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830891.196149:0:9482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d233bf5af00 going to sleep for 11 seconds 00000100:00100000:2.0:1787830891.196168:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443806336 00000100:00100000:2.0:1787830891.196185:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443806336 00000100:00100000:2.0:1787830891.196256:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1787830891.196270:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d231859d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+21:9482:x1874676443806336:12345-0@lo:253: 20000000:01000000:2.0:1787830891.196307:0:6483:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1787830891.196312:0:6483:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:2.0:1787830891.196325:0:6483:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:2.0:1787830891.196328:0:6483:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:2.0:1787830891.196550:0:6483:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787830891.196730:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:2.0:1787830891.196744:0:6483:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:2.0:1787830891.196756:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:2.0:1787830891.196760:0:6483:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:2.0:1787830891.196770:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:2.0:1787830891.196783:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:2.0:1787830891.196884:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:2.0:1787830891.196899:0:6483:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.131@tcp 20000000:01000000:2.0:1787830891.196902:0:6483:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.131@tcp (null) (null) (null) 00000040:00080000:2.0:1787830891.196924:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:2.0:1787830891.196931:0:6483:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1787830891.196946:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:2.0:1787830891.196951:0:6483:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.203.131@tcp (null) (null) 00000040:00080000:2.0:1787830891.196963:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:2.0:1787830891.196970:0:6483:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1787830891.196984:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:2.0:1787830891.197000:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:2.0:1787830891.197077:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:2.0:1787830891.197088:0:6483:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.131@tcp 20000000:01000000:2.0:1787830891.197090:0:6483:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.131@tcp (null) (null) (null) 00000040:00080000:2.0:1787830891.197103:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:2.0:1787830891.197109:0:6483:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1787830891.197121:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:2.0:1787830891.197127:0:6483:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.203.131@tcp (null) (null) 00000040:00080000:2.0:1787830891.197140:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:2.0:1787830891.197146:0:6483:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1787830891.197158:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:2.0:1787830891.197179:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:2.0:1787830891.197530:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:2.0:1787830891.197542:0:6483:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.131@tcp 20000000:01000000:2.0:1787830891.197543:0:6483:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.131@tcp (null) (null) (null) 00000040:00080000:2.0:1787830891.197557:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:2.0:1787830891.197562:0:6483:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1787830891.197575:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:2.0:1787830891.197580:0:6483:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.203.131@tcp (null) (null) 00000040:00080000:2.0:1787830891.197594:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:2.0:1787830891.197599:0:6483:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1787830891.197901:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:2.0:1787830891.197921:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:2.0:1787830891.197935:0:6483:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1787830891.197938:0:6483:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1787830891.197942:0:6483:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1787830891.197992:0:6483:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1787830891.197995:0:6483:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787830891.198335:0:9488:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 25 1->4: lustre sys.timeout 20000000:01000000:2.0:1787830891.198357:0:9488:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 25 2->4: lustre sys.timeout 00000040:00080000:2.0:1787830891.198374:0:9488:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:0.0:1787830891.198551:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:0.0:1787830891.198573:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:0.0:1787830891.198599:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 20000000:01000000:0.0:1787830891.198667:0:6483:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1787830891.198670:0:6483:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787830891.198849:0:9489:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 26 1->4: lustre sys.timeout 20000000:01000000:0.0:1787830891.198862:0:9489:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 26 2->4: lustre sys.timeout 00000040:00080000:0.0:1787830891.198881:0:9489:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:2.0:1787830891.198979:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:2.0:1787830891.199010:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:2.0:1787830891.199027:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 20000000:01000000:2.0:1787830891.199037:0:6483:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1787830891.199039:0:6483:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787830891.199217:0:9490:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 27 1->4: lustre sys.timeout 20000000:01000000:2.0:1787830891.199243:0:9490:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 27 2->4: lustre sys.timeout 00000040:00080000:2.0:1787830891.199255:0:9490:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:0.0:1787830891.199365:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:0.0:1787830891.199387:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:0.0:1787830891.199404:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 20000000:01000000:0.0:1787830891.199414:0:6483:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1787830891.199416:0:6483:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787830891.199578:0:9491:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 28 1->4: lustre sys.timeout 20000000:01000000:0.0:1787830891.199596:0:9491:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 28 2->4: lustre sys.timeout 00000040:00080000:0.0:1787830891.199670:0:9491:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:2.0:1787830891.199763:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:2.0:1787830891.199785:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:2.0:1787830891.199801:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 20000000:01000000:2.0:1787830891.199810:0:6483:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1787830891.199812:0:6483:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:2.0:1787830891.200177:0:9492:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:0.0:1787830891.200257:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:0.0:1787830891.200269:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:0.0:1787830891.200277:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 10000000:01000000:0.0:1787830891.200287:0:6483:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1787830891.200304:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d233bf10e00/0x95459fb9d1d28758 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830891.200317:0:6483:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d233837ae00/0x95459fb9d1d2864e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d28647 expref: 21 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830891.200326:0:6483:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d233837be00/0x95459fb9d1d28678 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d28671 expref: 21 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830891.200333:0:6483:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2300030a00/0x95459fb9d1d286b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d286b0 expref: 21 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830891.200340:0:6483:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2307c76000/0x95459fb9d1d286d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d286cc expref: 21 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830891.200367:0:6483:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d233837a000/0x95459fb9d1d286fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d286f6 expref: 21 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830891.200379:0:6483:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2300030200/0x95459fb9d1d28719 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d28712 expref: 21 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830891.200384:0:6483:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d233bf10c00/0x95459fb9d1d28743 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d2873c expref: 21 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830891.200391:0:6483:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d233bf10e00/0x95459fb9d1d28758 lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830891.200430:0:6483:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d233bf10c00/0x95459fb9d1d28743 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x95459fb9d1d2873c expref: 21 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830891.200447:0:6483:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d233bf10c00/0x95459fb9d1d28743 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x95459fb9d1d2873c expref: 21 pid: 6484 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830891.200463:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d232f6ca940 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6483:1874676443806464:0@lo:104: 00000100:00100000:0.0:1787830891.200552:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830891.200618:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443806464 00010000:00010000:0.0:1787830891.200622:0:6483:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2300030200/0x95459fb9d1d28719 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x95459fb9d1d28712 expref: 21 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830891.200649:0:6483:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d2300030200/0x95459fb9d1d28719 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x95459fb9d1d28712 expref: 21 pid: 6485 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830891.200657:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443806464 00000100:00100000:0.0:1787830891.200659:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d232f6cb480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6483:1874676443806592:0@lo:104: 00000100:00100000:0.0:1787830891.200688:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830891.200720:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787830891.200732:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d232f6c8b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a45944b-32e3-4193-a2a5-46f84222bc14+3:6483:x1874676443806464:12345-0@lo:104: 00010000:00010000:1.0:1787830891.200745:0:6474:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff8d2300030400/0x95459fb9d1d2873c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d28743 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830891.200753:0:6473:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:2.0:1787830891.200760:0:6473:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:0.0:1787830891.200780:0:6483:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d233837a000/0x95459fb9d1d286fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x95459fb9d1d286f6 expref: 21 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830891.200796:0:6483:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d233837a000/0x95459fb9d1d286fd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x95459fb9d1d286f6 expref: 21 pid: 6485 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830891.200801:0:6474:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787830891.200806:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d232f6cb840 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6483:1874676443806720:0@lo:104: 00000100:00100000:1.0:1787830891.200807:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d232f6c8b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a45944b-32e3-4193-a2a5-46f84222bc14+3:6483:x1874676443806464:12345-0@lo:104: Request processed in 78us (255us total) trans 0 rc 0/0 00010000:00010000:2.0:1787830891.200810:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1787830891.200817:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:2.0:1787830891.200819:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8d2300030400/0x95459fb9d1d2873c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d28743 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830891.200831:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2300030400 already unused, calling callback (ffffffffc14f9c20) 10000000:00010000:2.0:1787830891.200837:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8d2300030400/0x95459fb9d1d2873c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x95459fb9d1d28743 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830891.200838:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443806592 00000100:00100000:1.0:1787830891.200845:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443806592 00000100:00100000:0.0:1787830891.200848:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787830891.200855:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8d2300030400/0x95459fb9d1d2873c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x95459fb9d1d28743 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830891.200864:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443806720 10000000:00010000:2.0:1787830891.200865:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8d2300030400/0x95459fb9d1d2873c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x95459fb9d1d28743 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830891.200869:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443806720 00010000:00010000:0.0:1787830891.200872:0:6483:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2307c76000/0x95459fb9d1d286d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x95459fb9d1d286cc expref: 21 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787830891.200876:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1787830891.200888:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00010000:00010000:0.0:1787830891.200889:0:6483:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d2307c76000/0x95459fb9d1d286d3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x95459fb9d1d286cc expref: 21 pid: 6483 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830891.200895:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d232f6c83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a45944b-32e3-4193-a2a5-46f84222bc14+4:6483:x1874676443806592:12345-0@lo:104: 00000100:00100000:0.0:1787830891.200898:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d232f6cad00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6483:1874676443806848:0@lo:104: 00010000:00010000:1.0:1787830891.200903:0:6474:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff8d2300031a00/0x95459fb9d1d28712 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d28719 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830891.200927:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787830891.200931:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8d2300030400/0x95459fb9d1d2873c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d28743 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830891.200939:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787830891.200943:0:6474:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:0.0:1787830891.200946:0:6483:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2300030a00/0x95459fb9d1d286b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x95459fb9d1d286b0 expref: 21 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830891.200949:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d232f6c83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a45944b-32e3-4193-a2a5-46f84222bc14+4:6483:x1874676443806592:12345-0@lo:104: Request processed in 56us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830891.200956:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:0.0:1787830891.200956:0:6483:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d2300030a00/0x95459fb9d1d286b7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x95459fb9d1d286b0 expref: 21 pid: 6484 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830891.200971:0:7431:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1787830891.200972:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d232f6c9e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6483:1874676443807104:0@lo:104: 00000100:00100000:1.0:1787830891.200973:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443806848 00010000:00010000:2.0:1787830891.200986:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8d2300030400/0x95459fb9d1d2873c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d28743 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830891.200986:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443806848 00010000:00010000:3.0:1787830891.200991:0:7431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8d2300031a00/0x95459fb9d1d28712 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d28719 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830891.201017:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787830891.201017:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787830891.201025:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8d2300030400/0x95459fb9d1d2873c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d28743 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830891.201032:0:7431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2300031a00 already unused, calling callback (ffffffffc14f9c20) 00000100:00100000:1.0:1787830891.201032:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d232f6ca580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a45944b-32e3-4193-a2a5-46f84222bc14+4:6483:x1874676443806720:12345-0@lo:104: 00010000:00010000:0.0:1787830891.201040:0:6483:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d233837be00/0x95459fb9d1d28678 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x95459fb9d1d28671 expref: 21 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787830891.201045:0:7431:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8d2300031a00/0x95459fb9d1d28712 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x95459fb9d1d28719 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830891.201047:0:6474:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff8d233837b000/0x95459fb9d1d286f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d286fd expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830891.201056:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830891.201056:0:6483:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d233837be00/0x95459fb9d1d28678 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x95459fb9d1d28671 expref: 21 pid: 6484 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830891.201061:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787830891.201065:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787830891.201079:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787830891.201088:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d232f6ca1c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6483:1874676443807232:0@lo:104: 00010000:00010000:3.0:1787830891.201090:0:7431:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8d2300031a00/0x95459fb9d1d28712 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x95459fb9d1d28719 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787830891.201102:0:7431:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8d2300031a00/0x95459fb9d1d28712 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x95459fb9d1d28719 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830891.201104:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2336bff0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a45944b-32e3-4193-a2a5-46f84222bc14:3619:1874676443806976:0@lo:103: 00010000:00010000:1.0:1787830891.201110:0:6474:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787830891.201117:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d232f6ca580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a45944b-32e3-4193-a2a5-46f84222bc14+4:6483:x1874676443806720:12345-0@lo:104: Request processed in 89us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830891.201132:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 10000000:01000000:3.0:1787830891.201142:0:7431:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1787830891.201146:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830891.201149:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443807104 00000100:00100000:1.0:1787830891.201154:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443807104 00000100:00100000:0.0:1787830891.201164:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830891.201185:0:6474:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787830891.201191:0:7432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443806976 00000100:00100000:2.0:1787830891.201195:0:7432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443806976 00000100:00100000:1.0:1787830891.201196:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443807232 00010000:00010000:3.0:1787830891.201199:0:7431:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8d2300031a00/0x95459fb9d1d28712 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d28719 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830891.201202:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443807232 00010000:00010000:0.0:1787830891.201209:0:6483:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d233837ae00/0x95459fb9d1d2864e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x95459fb9d1d28647 expref: 22 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830891.201215:0:7432:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d233bf10c00/0x95459fb9d1d28743 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d2873c expref: 22 pid: 6484 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830891.201222:0:7431:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787830891.201225:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00010000:00010000:0.0:1787830891.201236:0:6483:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d233837ae00/0x95459fb9d1d2864e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x95459fb9d1d28647 expref: 22 pid: 6485 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830891.201244:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d232f6c9680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a45944b-32e3-4193-a2a5-46f84222bc14+5:6483:x1874676443806848:12345-0@lo:104: 00000100:00100000:0.0:1787830891.201251:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2201dee1c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6483:1874676443807488:0@lo:104: 00000100:00100000:2.0:1787830891.201255:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00010000:00010000:1.0:1787830891.201256:0:6474:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff8d233837b600/0x95459fb9d1d286cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d286d3 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830891.201265:0:7432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2336bfe1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2a45944b-32e3-4193-a2a5-46f84222bc14+22:3619:x1874676443806976:12345-0@lo:103: 00010000:00010000:3.0:1787830891.201269:0:7431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8d2300031a00/0x95459fb9d1d28712 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d28719 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830891.201274:0:7432:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787830891.201280:0:7432:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d233bf10c00/0x95459fb9d1d28743 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d2873c expref: 22 pid: 6484 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830891.201287:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787830891.201295:0:6474:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787830891.201306:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d233a626540 going to sleep for 11 seconds 00000100:00100000:1.0:1787830891.201316:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d232f6c9680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a45944b-32e3-4193-a2a5-46f84222bc14+5:6483:x1874676443806848:12345-0@lo:104: Request processed in 76us (381us total) trans 0 rc 0/0 00010000:00010000:3.0:1787830891.201319:0:7431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8d2300031a00/0x95459fb9d1d28712 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d28719 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830891.201324:0:7432:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d233bf10c00/0x95459fb9d1d28743 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x95459fb9d1d2873c expref: 22 pid: 6484 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830891.201329:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787830891.201333:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d232f6ca940 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6483:1874676443806464:0@lo:104: 00000100:00100000:1.0:1787830891.201345:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443807488 00000100:00100000:1.0:1787830891.201351:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443807488 00000100:00100000:0.0:1787830891.201359:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d232f6cb480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6483:1874676443806592:0@lo:104: 00000100:00100000:0.0:1787830891.201375:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d232f6cb840 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6483:1874676443806720:0@lo:104: 00000100:00100000:1.0:1787830891.201376:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00010000:00010000:2.0:1787830891.201379:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d233bf10c00/0x95459fb9d1d28743 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x95459fb9d1d2873c expref: 22 pid: 6484 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830891.201386:0:7431:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:1.0:1787830891.201387:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d232f6c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a45944b-32e3-4193-a2a5-46f84222bc14+5:6483:x1874676443807104:12345-0@lo:104: 00000100:00100000:0.0:1787830891.201388:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d232f6cad00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6483:1874676443806848:0@lo:104: 00010000:00010000:2.0:1787830891.201398:0:7432:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787830891.201399:0:7431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8d233837b000/0x95459fb9d1d286f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d286fd expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830891.201403:0:6474:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff8d233837a800/0x95459fb9d1d286b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d286b7 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830891.201410:0:7431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233837b000 already unused, calling callback (ffffffffc14f9c20) 10000000:00010000:3.0:1787830891.201419:0:7431:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8d233837b000/0x95459fb9d1d286f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x95459fb9d1d286fd expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830891.201437:0:7432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2336bfe1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2a45944b-32e3-4193-a2a5-46f84222bc14+21:3619:x1874676443806976:12345-0@lo:103: Request processed in 171us (288us total) trans 0 rc 0/0 00010000:00010000:3.0:1787830891.201449:0:7431:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8d233837b000/0x95459fb9d1d286f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x95459fb9d1d286fd expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830891.201456:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:1.0:1787830891.201472:0:6474:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 10000000:00010000:3.0:1787830891.201477:0:7431:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8d233837b000/0x95459fb9d1d286f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x95459fb9d1d286fd expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830891.201486:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d232f6c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a45944b-32e3-4193-a2a5-46f84222bc14+5:6483:x1874676443807104:12345-0@lo:104: Request processed in 97us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830891.201486:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d232f6c9e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6483:1874676443807104:0@lo:104: 00000100:00100000:2.0:1787830891.201488:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787830891.201506:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d232f7943c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a45944b-32e3-4193-a2a5-46f84222bc14:3622:1874676443807360:0@lo:103: 10000000:01000000:3.0:1787830891.201510:0:7431:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1787830891.201518:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787830891.201536:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787830891.201553:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22025ce050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a45944b-32e3-4193-a2a5-46f84222bc14+4:6483:x1874676443807232:12345-0@lo:104: 00000100:00100000:2.0:1787830891.201554:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787830891.201562:0:7431:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8d233837b000/0x95459fb9d1d286f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d286fd expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830891.201566:0:6474:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff8d2307c76400/0x95459fb9d1d28671 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d28678 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830891.201579:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443807360 00000100:00100000:0.0:1787830891.201586:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443807360 00010000:00010000:3.0:1787830891.201596:0:7431:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787830891.201622:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2336bff0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a45944b-32e3-4193-a2a5-46f84222bc14:3619:1874676443806976:0@lo:103: 00000100:00100000:2.0:1787830891.201680:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2314e71e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a45944b-32e3-4193-a2a5-46f84222bc14:3622:1874676443807616:0@lo:103: 00010000:00010000:1.0:1787830891.201680:0:6474:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787830891.201689:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22025ce050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a45944b-32e3-4193-a2a5-46f84222bc14+4:6483:x1874676443807232:12345-0@lo:104: Request processed in 147us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830891.201700:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:0.0:1787830891.201717:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2300030200/0x95459fb9d1d28719 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d28712 expref: 21 pid: 6485 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830891.201727:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830891.201752:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443807616 00000100:00100000:0.0:1787830891.201757:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443807616 00010000:00010000:0.0:1787830891.201776:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d233837a000/0x95459fb9d1d286fd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d286f6 expref: 22 pid: 6485 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830891.201781:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787830891.201792:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2201dee580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a45944b-32e3-4193-a2a5-46f84222bc14+3:6483:x1874676443807488:12345-0@lo:104: 00010000:00010000:1.0:1787830891.201800:0:6474:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff8d2307c76200/0x95459fb9d1d28647 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d2864e expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830891.201807:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787830891.201815:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787830891.201816:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2336bffc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2a45944b-32e3-4193-a2a5-46f84222bc14+22:3622:x1874676443807360:12345-0@lo:103: 00010000:00010000:0.0:1787830891.201828:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1787830891.201833:0:7432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2336bff0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2a45944b-32e3-4193-a2a5-46f84222bc14+22:3622:x1874676443807616:12345-0@lo:103: 00010000:00010000:1.0:1787830891.201842:0:6474:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00010000:00010000:0.0:1787830891.201843:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2300030200/0x95459fb9d1d28719 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d28712 expref: 22 pid: 6485 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830891.201847:0:7432:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787830891.201848:0:7431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8d233837b000/0x95459fb9d1d286f6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d286fd expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830891.201849:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2201dee580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a45944b-32e3-4193-a2a5-46f84222bc14+3:6483:x1874676443807488:12345-0@lo:104: Request processed in 61us (568us total) trans 0 rc 0/0 00010000:00010000:0.0:1787830891.201857:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2300030200/0x95459fb9d1d28719 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x95459fb9d1d28712 expref: 22 pid: 6485 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830891.201863:0:7432:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d233837a000/0x95459fb9d1d286fd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d286f6 expref: 22 pid: 6485 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830891.201879:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:3.0:1787830891.201902:0:7431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8d233837b000/0x95459fb9d1d286f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d286fd expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830891.201903:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2300030200/0x95459fb9d1d28719 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x95459fb9d1d28712 expref: 22 pid: 6485 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830891.201904:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1787830891.201910:0:7432:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d233837a000/0x95459fb9d1d286fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x95459fb9d1d286f6 expref: 22 pid: 6485 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830891.201913:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8d233837b600/0x95459fb9d1d286cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d286d3 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830891.201952:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787830891.201955:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233837b600 already unused, calling callback (ffffffffc14f9c20) 00010000:00010000:2.0:1787830891.201962:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d233837a000/0x95459fb9d1d286fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x95459fb9d1d286f6 expref: 21 pid: 6485 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787830891.201965:0:6479:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8d233837b600/0x95459fb9d1d286cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x95459fb9d1d286d3 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830891.201966:0:7431:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787830891.201973:0:7432:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787830891.201976:0:6479:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8d233837b600/0x95459fb9d1d286cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x95459fb9d1d286d3 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830891.201982:0:7431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8d233837a800/0x95459fb9d1d286b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d286b7 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787830891.201987:0:6479:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8d233837b600/0x95459fb9d1d286cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x95459fb9d1d286d3 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830891.201994:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2336bffc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2a45944b-32e3-4193-a2a5-46f84222bc14+20:3622:x1874676443807360:12345-0@lo:103: Request processed in 178us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830891.202014:0:7432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2336bff0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2a45944b-32e3-4193-a2a5-46f84222bc14+20:3622:x1874676443807616:12345-0@lo:103: Request processed in 182us (282us total) trans 0 rc 0/0 10000000:01000000:1.0:1787830891.202015:0:6479:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787830891.202018:0:7431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233837a800 already unused, calling callback (ffffffffc14f9c20) 00000100:00100000:0.0:1787830891.202020:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 10000000:00010000:3.0:1787830891.202030:0:7431:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8d233837a800/0x95459fb9d1d286b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x95459fb9d1d286b7 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830891.202036:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:1.0:1787830891.202041:0:6479:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8d233837b600/0x95459fb9d1d286cc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d286d3 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830891.202061:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2314e71e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a45944b-32e3-4193-a2a5-46f84222bc14:3622:1874676443807616:0@lo:103: 00010000:00010000:3.0:1787830891.202063:0:7431:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8d233837a800/0x95459fb9d1d286b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x95459fb9d1d286b7 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830891.202064:0:6479:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1787830891.202076:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d232f7943c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a45944b-32e3-4193-a2a5-46f84222bc14:3622:1874676443807360:0@lo:103: 10000000:00010000:3.0:1787830891.202083:0:7431:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8d233837a800/0x95459fb9d1d286b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x95459fb9d1d286b7 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830891.202084:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8d233837b600/0x95459fb9d1d286cc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d286d3 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830891.202120:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8d233837b600/0x95459fb9d1d286cc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d286d3 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787830891.202121:0:7431:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787830891.202144:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787830891.202148:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8d2307c76400/0x95459fb9d1d28671 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d28678 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830891.202155:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2307c76400 already unused, calling callback (ffffffffc14f9c20) 10000000:00010000:1.0:1787830891.202159:0:6479:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8d2307c76400/0x95459fb9d1d28671 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x95459fb9d1d28678 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830891.202166:0:7431:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8d233837a800/0x95459fb9d1d286b0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d286b7 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830891.202168:0:6479:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8d2307c76400/0x95459fb9d1d28671 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x95459fb9d1d28678 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830891.202202:0:7431:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787830891.202211:0:7431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8d233837a800/0x95459fb9d1d286b0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d286b7 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787830891.202217:0:6479:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8d2307c76400/0x95459fb9d1d28671 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x95459fb9d1d28678 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830891.202222:0:7431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8d233837a800/0x95459fb9d1d286b0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d286b7 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787830891.202233:0:6479:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787830891.202250:0:7431:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787830891.202255:0:7431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8d2307c76200/0x95459fb9d1d28647 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d2864e expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830891.202263:0:7431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2307c76200 already unused, calling callback (ffffffffc14f9c20) 00010000:00010000:1.0:1787830891.202265:0:6479:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8d2307c76400/0x95459fb9d1d28671 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d28678 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787830891.202268:0:7431:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8d2307c76200/0x95459fb9d1d28647 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x95459fb9d1d2864e expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830891.202288:0:6479:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787830891.202301:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8d2307c76400/0x95459fb9d1d28671 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d28678 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830891.202305:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:3.0:1787830891.202308:0:7431:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8d2307c76200/0x95459fb9d1d28647 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x95459fb9d1d2864e expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830891.202311:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8d2307c76400/0x95459fb9d1d28671 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d28678 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830891.202313:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220258fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a45944b-32e3-4193-a2a5-46f84222bc14:3622:1874676443808000:0@lo:103: 10000000:00010000:3.0:1787830891.202344:0:7431:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8d2307c76200/0x95459fb9d1d28647 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x95459fb9d1d2864e expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830891.202349:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830891.202354:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787830891.202358:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787830891.202360:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787830891.202367:0:7431:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1787830891.202390:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443808000 00000100:00100000:1.0:1787830891.202396:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443808000 00010000:00010000:3.0:1787830891.202407:0:7431:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8d2307c76200/0x95459fb9d1d28647 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d2864e expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830891.202416:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d233837be00/0x95459fb9d1d28678 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d28671 expref: 19 pid: 6484 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830891.202418:0:7431:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787830891.202438:0:7431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8d2307c76200/0x95459fb9d1d28647 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d2864e expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830891.202449:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2314e70b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a45944b-32e3-4193-a2a5-46f84222bc14:3622:1874676443808128:0@lo:103: 00000100:00100000:1.0:1787830891.202451:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00010000:00010000:3.0:1787830891.202452:0:7431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8d2307c76200/0x95459fb9d1d28647 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d2864e expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830891.202462:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2321e75850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a45944b-32e3-4193-a2a5-46f84222bc14+19:3622:x1874676443808000:12345-0@lo:103: 00000100:00100000:0.0:1787830891.202472:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787830891.202477:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787830891.202483:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d233837be00/0x95459fb9d1d28678 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d28671 expref: 19 pid: 6484 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830891.202497:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830891.202497:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d233837be00/0x95459fb9d1d28678 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x95459fb9d1d28671 expref: 19 pid: 6484 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830891.202501:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443808128 00010000:00010000:3.0:1787830891.202504:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787830891.202508:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443808128 00010000:00010000:3.0:1787830891.202515:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830891.202529:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787830891.202536:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d233837ae00/0x95459fb9d1d2864e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d28647 expref: 20 pid: 6485 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830891.202564:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2321e75850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a45944b-32e3-4193-a2a5-46f84222bc14+20:3622:x1874676443808000:12345-0@lo:103: Request processed in 105us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830891.202570:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787830891.202578:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787830891.202578:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220258fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a45944b-32e3-4193-a2a5-46f84222bc14:3622:1874676443808000:0@lo:103: 00000100:00100000:2.0:1787830891.202584:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2201defc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2a45944b-32e3-4193-a2a5-46f84222bc14+20:3622:x1874676443808128:12345-0@lo:103: 00010000:00010000:2.0:1787830891.202593:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787830891.202597:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d233837ae00/0x95459fb9d1d2864e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d28647 expref: 19 pid: 6485 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830891.202604:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d233837ae00/0x95459fb9d1d2864e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x95459fb9d1d28647 expref: 19 pid: 6485 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830891.202674:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787830891.202682:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2314e71680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a45944b-32e3-4193-a2a5-46f84222bc14:3620:1874676443807872:0@lo:103: 00000100:00100000:3.0:1787830891.202705:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220258de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a45944b-32e3-4193-a2a5-46f84222bc14:3619:1874676443807744:0@lo:103: 00010000:00010000:0.0:1787830891.202705:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d233837be00/0x95459fb9d1d28678 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x95459fb9d1d28671 expref: 19 pid: 6484 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830891.202718:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830891.202733:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d232f6ca1c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6483:1874676443807232:0@lo:104: 00000100:00100000:0.0:1787830891.202746:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2201dee1c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6483:1874676443807488:0@lo:104: 00000100:00100000:1.0:1787830891.202766:0:7432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443807872 00000100:00100000:1.0:1787830891.202769:0:7432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443807872 00010000:00010000:1.0:1787830891.202783:0:7432:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2300030a00/0x95459fb9d1d286b7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d286b0 expref: 19 pid: 6484 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830891.202798:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830891.202807:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787830891.202816:0:7432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220258e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2a45944b-32e3-4193-a2a5-46f84222bc14+19:3620:x1874676443807872:12345-0@lo:103: 00010000:00010000:1.0:1787830891.202825:0:7432:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787830891.202831:0:7432:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2300030a00/0x95459fb9d1d286b7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d286b0 expref: 19 pid: 6484 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830891.202876:0:6483:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d233bf10e00/0x95459fb9d1d28758 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830891.202877:0:7432:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2300030a00/0x95459fb9d1d286b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x95459fb9d1d286b0 expref: 19 pid: 6484 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830891.202894:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d233837ae00/0x95459fb9d1d2864e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x95459fb9d1d28647 expref: 19 pid: 6485 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830891.202897:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2300030a00/0x95459fb9d1d286b7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x95459fb9d1d286b0 expref: 19 pid: 6484 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830891.202913:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787830891.202916:0:7432:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787830891.202958:0:7432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220258e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2a45944b-32e3-4193-a2a5-46f84222bc14+17:3620:x1874676443807872:12345-0@lo:103: Request processed in 145us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830891.202969:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787830891.202970:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2201defc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2a45944b-32e3-4193-a2a5-46f84222bc14+17:3622:x1874676443808128:12345-0@lo:103: Request processed in 387us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830891.202975:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2314e71680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a45944b-32e3-4193-a2a5-46f84222bc14:3620:1874676443807872:0@lo:103: 00000100:00100000:1.0:1787830891.202981:0:7432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443807744 00000100:00100000:2.0:1787830891.202983:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787830891.202991:0:7432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443807744 00000100:00100000:0.0:1787830891.203000:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2314e70b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a45944b-32e3-4193-a2a5-46f84222bc14:3622:1874676443808128:0@lo:103: 00010000:00010000:1.0:1787830891.203006:0:7432:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2307c76000/0x95459fb9d1d286d3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d286cc expref: 16 pid: 6483 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830891.203028:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787830891.203035:0:7432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2314e72d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2a45944b-32e3-4193-a2a5-46f84222bc14+16:3619:x1874676443807744:12345-0@lo:103: 00010000:00010000:1.0:1787830891.203042:0:7432:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787830891.203046:0:7432:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2307c76000/0x95459fb9d1d286d3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d286cc expref: 16 pid: 6483 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830891.203056:0:7432:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2307c76000/0x95459fb9d1d286d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x95459fb9d1d286cc expref: 16 pid: 6483 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830891.203066:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2307c76000/0x95459fb9d1d286d3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x95459fb9d1d286cc expref: 16 pid: 6483 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830891.203077:0:7432:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d233bf10e00/0x95459fb9d1d28758 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830891.203085:0:7432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d233bf10e00/0x95459fb9d1d28758 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830891.203097:0:7432:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d233bf10e00/0x95459fb9d1d28758 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830891.203104:0:7432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d233bf10e00/0x95459fb9d1d28758 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830891.203111:0:7432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d233bf10e00/0x95459fb9d1d28758 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830891.203129:0:7432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d233bf10e00/0x95459fb9d1d28758 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830891.203140:0:7432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233bf10e00 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:1.0:1787830891.203144:0:7432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d233bf10e00/0x95459fb9d1d28758 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830891.203153:0:7432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d233bf10e00/0x95459fb9d1d28758 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830891.203169:0:7432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d233bf10e00/0x95459fb9d1d28758 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830891.203179:0:7432:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787830891.203189:0:6483:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d233bf10e00/0x95459fb9d1d28758 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830891.203197:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d233bf10e00/0x95459fb9d1d28758 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830891.203201:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d233bf10e00/0x95459fb9d1d28758 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830891.203211:0:7432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2314e72d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2a45944b-32e3-4193-a2a5-46f84222bc14+15:3619:x1874676443807744:12345-0@lo:103: Request processed in 176us (418us total) trans 0 rc 0/0 20000000:01000000:0.0:1787830891.203213:0:6483:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1787830891.203218:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787830891.203268:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220258de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a45944b-32e3-4193-a2a5-46f84222bc14:3619:1874676443807744:0@lo:103: 00000100:00100000:0.0:1787830891.204432:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d231859d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+14:9482:x1874676443806336:12345-0@lo:253: Request processed in 8163us (8350us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830891.204447:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1787830891.204454:0:9482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d232f6c8780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:9482:1874676443806336:0@lo:253: 10000000:01000000:2.0:1787830891.204468:0:9482:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1787830891.204472:0:9482:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787830891.204475:0:9482:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787830891.204477:0:9482:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787830891.204478:0:9482:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:2.0:1787830891.204481:0:9482:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787830891.204483:0:9482:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787830891.204484:0:9482:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787830891.204486:0:9482:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1787830891.204488:0:9482:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787830891.204490:0:9482:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787830891.204515:0:9482:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d2334556800 from lustre-OST0001 10000000:01000000:2.0:1787830891.204542:0:9482:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1787830891.204546:0:9482:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1787830891.204555:0:9482:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8d2312953370 local copy 10000000:01000000:2.0:1787830891.204559:0:9482:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787830891.204585:0:9482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233837a600/0x95459fb9d1d2875f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830891.204592:0:9482:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.131@tcp lock: ffff8d233837a600/0x95459fb9d1d2875f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830891.204598:0:9482:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8d233837a600/0x95459fb9d1d2875f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830891.204688:0:9482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2336bfc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:9482:1874676443808256:0@lo:101: 00000100:00100000:2.0:1787830891.204728:0:9482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830891.204761:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443808256 00000100:00100000:2.0:1787830891.204765:0:9482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d220257dd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787830891.204767:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443808256 00000100:00100000:0.0:1787830891.204805:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1787830891.204813:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2310886050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+14:9482:x1874676443808256:12345-0@lo:101: 00010000:00010000:0.0:1787830891.204825:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787830891.204837:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d233bf11e00/0x95459fb9d1d28766 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d2875f expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830891.204857:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d233bf11e00/0x95459fb9d1d28766 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d2875f expref: 15 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830891.204879:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d233bf11e00/0x95459fb9d1d28766 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d2875f expref: 15 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830891.204887:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233bf11e00, rc 0) 00000100:00100000:0.0:1787830891.204919:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2310886050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+15:9482:x1874676443808256:12345-0@lo:101: Request processed in 107us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830891.204925:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1787830891.204947:0:9482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2336bfc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:9482:1874676443808256:0@lo:101: 00010000:00010000:2.0:1787830891.204960:0:9482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8d233837a600/0x95459fb9d1d2875f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x95459fb9d1d28766 expref: -99 pid: 9482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830891.204968:0:9482:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8d233837a600/0x95459fb9d1d2875f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x95459fb9d1d28766 expref: -99 pid: 9482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830891.205046:0:9482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2336bfc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:9482:1874676443808384:0@lo:501: 00000100:00100000:2.0:1787830891.205071:0:9482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830891.205086:0:9482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d220257dd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787830891.205104:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443808384 00000100:00100000:0.0:1787830891.205110:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443808384 00000100:00100000:0.0:1787830891.205138:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1787830891.205145:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2310884850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+15:9482:x1874676443808384:12345-0@lo:501: 00000100:00100000:0.0:1787830891.205211:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2310884850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+15:9482:x1874676443808384:12345-0@lo:501: Request processed in 66us (138us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787830891.205219:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1787830891.205227:0:9482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2336bfc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:9482:1874676443808384:0@lo:501: 10000000:01000000:2.0:1787830891.205243:0:9482:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.131@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787830891.205259:0:9482:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.131@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787830891.205264:0:9482:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233837a600/0x95459fb9d1d2875f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x95459fb9d1d28766 expref: -99 pid: 9482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830891.205272:0:9482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233837a600/0x95459fb9d1d2875f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x95459fb9d1d28766 expref: -99 pid: 9482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830891.205279:0:9482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.131@tcp lock: ffff8d233837a600/0x95459fb9d1d2875f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x95459fb9d1d28766 expref: -99 pid: 9482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830891.205298:0:9482:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787830891.205320:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:2.0:1787830891.205326:0:9482:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d2334556800 00010000:00010000:1.0:1787830891.205329:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8d233837a600/0x95459fb9d1d2875f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x95459fb9d1d28766 expref: -99 pid: 9482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787830891.205333:0:9482:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787830891.205341:0:9482:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 00010000:00010000:1.0:1787830891.205344:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233837a600 already unused, calling callback (ffffffffc14f9c20) 10000000:01000000:2.0:1787830891.205346:0:9482:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:00010000:1.0:1787830891.205351:0:6479:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8d233837a600/0x95459fb9d1d2875f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x95459fb9d1d28766 expref: -99 pid: 9482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787830891.205353:0:9482:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1787830891.205358:0:9482:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1787830891.205367:0:6479:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8d233837a600/0x95459fb9d1d2875f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x95459fb9d1d28766 expref: -99 pid: 9482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830891.205374:0:9482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233837b200/0x95459fb9d1d2876d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830891.205383:0:9482:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8d233837b200/0x95459fb9d1d2876d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787830891.205389:0:6479:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8d233837a600/0x95459fb9d1d2875f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x9400000000 nid: local remote: 0x95459fb9d1d28766 expref: -99 pid: 9482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830891.205392:0:9482:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8d233837b200/0x95459fb9d1d2876d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787830891.205407:0:6479:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1787830891.205417:0:9482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2336bfc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:9482:1874676443808512:0@lo:101: 00010000:00010000:1.0:1787830891.205442:0:6479:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8d233837a600/0x95459fb9d1d2875f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x95459fb9d1d28766 expref: -99 pid: 9482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830891.205449:0:9482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787830891.205455:0:6479:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787830891.205469:0:9482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d220257d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787830891.205483:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443808512 00010000:00010000:1.0:1787830891.205486:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8d233837a600/0x95459fb9d1d2875f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x95459fb9d1d28766 expref: -99 pid: 9482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830891.205489:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443808512 00010000:00010000:1.0:1787830891.205506:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8d233837a600/0x95459fb9d1d2875f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x95459fb9d1d28766 expref: -99 pid: 9482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830891.205521:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220258d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a45944b-32e3-4193-a2a5-46f84222bc14:3619:1874676443808640:0@lo:103: 00000100:00100000:0.0:1787830891.205521:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00010000:00010000:1.0:1787830891.205525:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830891.205534:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830891.205539:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787830891.205543:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2310887c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+15:9482:x1874676443808512:12345-0@lo:101: 00010000:00010000:0.0:1787830891.205552:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787830891.205563:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d233bf11600/0x95459fb9d1d28774 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d2876d expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830891.205581:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d233bf11600/0x95459fb9d1d28774 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d2876d expref: 16 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830891.205590:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d233bf11600/0x95459fb9d1d28774 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d2876d expref: 16 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830891.205599:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787830891.205660:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233bf11600, rc 0) 00000100:00100000:2.0:1787830891.205675:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443808640 00000100:00100000:2.0:1787830891.205683:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443808640 00000100:00100000:0.0:1787830891.205728:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2310887c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+17:9482:x1874676443808512:12345-0@lo:101: Request processed in 188us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830891.205739:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1787830891.205744:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787830891.205755:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2314e70000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2a45944b-32e3-4193-a2a5-46f84222bc14+16:3619:x1874676443808640:12345-0@lo:103: 00010000:00010000:2.0:1787830891.205765:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787830891.205778:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d233bf11e00/0x95459fb9d1d28766 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x95459fb9d1d2875f expref: 16 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830891.205789:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787830891.205827:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2314e70000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2a45944b-32e3-4193-a2a5-46f84222bc14+15:3619:x1874676443808640:12345-0@lo:103: Request processed in 76us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830891.205835:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787830891.205875:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220258d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a45944b-32e3-4193-a2a5-46f84222bc14:3619:1874676443808640:0@lo:103: 00000100:00100000:2.0:1787830891.205891:0:9482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2336bfc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:9482:1874676443808512:0@lo:101: 00010000:00010000:2.0:1787830891.205906:0:9482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8d233837b200/0x95459fb9d1d2876d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d28774 expref: -99 pid: 9482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830891.205914:0:9482:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8d233837b200/0x95459fb9d1d2876d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d28774 expref: -99 pid: 9482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830891.205965:0:9482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2336bfc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:9482:1874676443808768:0@lo:501: 00000100:00100000:2.0:1787830891.205992:0:9482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830891.206016:0:9482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d220257d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787830891.206066:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443808768 00000100:00100000:0.0:1787830891.206069:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443808768 00000100:00100000:0.0:1787830891.206125:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1787830891.206141:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2310887450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+15:9482:x1874676443808768:12345-0@lo:501: 00000100:00100000:0.0:1787830891.206232:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2310887450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+15:9482:x1874676443808768:12345-0@lo:501: Request processed in 100us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830891.206238:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1787830891.206242:0:9482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2336bfc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:9482:1874676443808768:0@lo:501: 00000100:00100000:2.0:1787830891.206266:0:9482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2336bfc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:9482:1874676443808896:0@lo:503: 00000100:00100000:2.0:1787830891.206312:0:9482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830891.206328:0:9482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d220257d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787830891.206339:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443808896 00000100:00100000:0.0:1787830891.206343:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443808896 00000100:00100000:0.0:1787830891.206363:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1787830891.206370:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2310884450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+15:9482:x1874676443808896:12345-0@lo:503: 00000100:00100000:0.0:1787830891.206437:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2310884450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+15:9482:x1874676443808896:12345-0@lo:503: Request processed in 67us (123us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830891.206444:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1787830891.206457:0:9482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2336bfc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:9482:1874676443808896:0@lo:503: 00000040:00080000:2.0:1787830891.206894:0:9482:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787830891.206962:0:9482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2336bfc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:9482:1874676443809024:0@lo:502: 00000100:00100000:2.0:1787830891.207007:0:9482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830891.207038:0:9482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d220257d900 going to sleep for 11 seconds 00000100:00100000:0.0:1787830891.207065:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443809024 00000100:00100000:0.0:1787830891.207070:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443809024 00000100:00100000:0.0:1787830891.207096:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1787830891.207103:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d230888b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+15:9482:x1874676443809024:12345-0@lo:502: 00000100:00100000:0.0:1787830891.207188:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d230888b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+15:9482:x1874676443809024:12345-0@lo:502: Request processed in 85us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830891.207196:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1787830891.207203:0:9482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2336bfc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:9482:1874676443809024:0@lo:502: 00000040:00080000:2.0:1787830891.207440:0:9482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1787830891.207466:0:9482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1787830891.207483:0:9482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1787830891.207496:0:9482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1787830891.207510:0:9482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1787830891.207523:0:9482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1787830891.207543:0:9482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2336bfc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:9482:1874676443809152:0@lo:502: 00000100:00100000:2.0:1787830891.207580:0:9482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830891.207598:0:9482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d220257d900 going to sleep for 11 seconds 00000100:00100000:0.0:1787830891.207677:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443809152 00000100:00100000:0.0:1787830891.207681:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443809152 00000100:00100000:0.0:1787830891.207709:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1787830891.207718:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d230888bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+15:9482:x1874676443809152:12345-0@lo:502: 00000100:00100000:0.0:1787830891.207789:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d230888bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+15:9482:x1874676443809152:12345-0@lo:502: Request processed in 72us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830891.207797:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1787830891.207802:0:9482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2336bfc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:9482:1874676443809152:0@lo:502: 00000040:00080000:2.0:1787830891.207843:0:9482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1787830891.207850:0:9482:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000020:01000000:0.0:1787830891.208200:0:9494:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787830891.208210:0:9494:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:0.0:1787830891.208218:0:9494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787830891.208220:0:9494:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1787830891.208227:0:9494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787830891.208245:0:9494:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8d233f433370) 00000020:00000080:0.0:1787830891.208272:0:9494:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:0.0:1787830891.208279:0:9494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787830891.208357:0:9494:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d2334556800 from lustre-OST0001, refs=2 00080000:01000000:0.0:1787830891.208366:0:9494:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787830891.208374:0:9494:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x95459fb9d1d28782 00010000:00010000:0.0:1787830891.211744:0:9494:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:0.0:1787830891.212086:0:9494:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:0.0:1787830891.213360:0:9494:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1787830891.213597:0:9494:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:0.0:1787830891.215600:0:9494:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:0.0:1787830891.215798:0:9494:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:0.0:1787830891.218558:0:9494:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:3.0:1787830891.219510:0:9494:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1787830891.219529:0:9494:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787830891.219537:0:9494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787830891.219539:0:9494:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1787830891.219543:0:9494:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787830891.219548:0:9494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787830891.219550:0:9494:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787830891.219553:0:9494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787830891.219556:0:9494:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787830891.219577:0:9494:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787830891.219581:0:9494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787830891.219583:0:9494:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787830891.219587:0:9494:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1787830891.219699:0:9482:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:0.0:1787830891.219736:0:9482:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1787830891.219757:0:9482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233837b200/0x95459fb9d1d2876d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d28774 expref: -99 pid: 9482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830891.219775:0:9482:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8d233837b200/0x95459fb9d1d2876d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d28774 expref: -99 pid: 9482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787830891.219782:0:9482:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d2334556800 from 1 10000000:01000000:0.0:1787830891.219785:0:9482:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787830891.219821:0:9482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233bf10e00/0x95459fb9d1d28789 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830891.219827:0:9482:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8d233bf10e00/0x95459fb9d1d28789 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830891.219836:0:9482:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8d233bf10e00/0x95459fb9d1d28789 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830891.219858:0:9482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2201dee1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:9482:1874676443809280:0@lo:101: 00000100:00100000:0.0:1787830891.219940:0:9482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830891.219995:0:9482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d22034db900 going to sleep for 11 seconds 00000100:00100000:1.0:1787830891.220013:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443809280 00000100:00100000:1.0:1787830891.220023:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443809280 00000100:00100000:1.0:1787830891.220082:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1787830891.220094:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2308888450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+15:9482:x1874676443809280:12345-0@lo:101: 00010000:00010000:1.0:1787830891.220108:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787830891.220136:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d233be94c00/0x95459fb9d1d28790 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d28789 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830891.220165:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d233be94c00/0x95459fb9d1d28790 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d28789 expref: 16 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830891.220177:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d233be94c00/0x95459fb9d1d28790 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d28789 expref: 16 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830891.220185:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233be94c00, rc 0) 00000100:00100000:1.0:1787830891.220233:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2308888450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+16:9482:x1874676443809280:12345-0@lo:101: Request processed in 142us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830891.220241:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1787830891.220265:0:9482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2201dee1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:9482:1874676443809280:0@lo:101: 00010000:00010000:0.0:1787830891.220279:0:9482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8d233bf10e00/0x95459fb9d1d28789 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d28790 expref: -99 pid: 9482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830891.220287:0:9482:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8d233bf10e00/0x95459fb9d1d28789 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d28790 expref: -99 pid: 9482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830891.220385:0:9482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2201dee1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:9482:1874676443809408:0@lo:501: 00000100:00100000:0.0:1787830891.220430:0:9482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830891.220453:0:9482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d22034db900 going to sleep for 11 seconds 00000100:00100000:1.0:1787830891.220782:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443809408 00000100:00100000:1.0:1787830891.220787:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443809408 00000100:00100000:1.0:1787830891.220822:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1787830891.220831:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2308888850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+16:9482:x1874676443809408:12345-0@lo:501: 00000100:00100000:1.0:1787830891.220949:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2308888850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+16:9482:x1874676443809408:12345-0@lo:501: Request processed in 118us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830891.220956:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1787830891.221010:0:9482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2201dee1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:9482:1874676443809408:0@lo:501: 00000100:00100000:0.0:1787830891.221046:0:9482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2201dee1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:9482:1874676443809536:0@lo:503: 00000100:00100000:0.0:1787830891.221094:0:9482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830891.221118:0:9482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d22034db900 going to sleep for 11 seconds 00000100:00100000:1.0:1787830891.221130:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443809536 00000100:00100000:1.0:1787830891.221135:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443809536 00000100:00100000:1.0:1787830891.221161:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1787830891.221169:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2308889c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+16:9482:x1874676443809536:12345-0@lo:503: 00000100:00100000:1.0:1787830891.221262:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2308889c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+16:9482:x1874676443809536:12345-0@lo:503: Request processed in 94us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830891.221266:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1787830891.221289:0:9482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2201dee1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:9482:1874676443809536:0@lo:503: 00000040:00080000:0.0:1787830891.221516:0:9482:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787830891.221580:0:9482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2201dee1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:9482:1874676443809664:0@lo:502: 00000100:00100000:0.0:1787830891.221641:0:9482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830891.221676:0:9482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d22034db900 going to sleep for 11 seconds 00000100:00100000:1.0:1787830891.221699:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443809664 00000100:00100000:1.0:1787830891.221703:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443809664 00000100:00100000:1.0:1787830891.221732:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1787830891.221739:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d230888a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+16:9482:x1874676443809664:12345-0@lo:502: 00000100:00100000:1.0:1787830891.221806:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d230888a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+16:9482:x1874676443809664:12345-0@lo:502: Request processed in 69us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830891.221811:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1787830891.221831:0:9482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2201dee1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:9482:1874676443809664:0@lo:502: 00000040:00080000:0.0:1787830891.222043:0:9482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1787830891.222068:0:9482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1787830891.222092:0:9482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2201dee1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:9482:1874676443809792:0@lo:502: 00000100:00100000:0.0:1787830891.222129:0:9482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830891.222149:0:9482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d22034db900 going to sleep for 11 seconds 00000100:00100000:1.0:1787830891.222171:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443809792 00000100:00100000:1.0:1787830891.222175:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443809792 00000100:00100000:1.0:1787830891.222195:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1787830891.222203:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2308889450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+16:9482:x1874676443809792:12345-0@lo:502: 00000100:00100000:1.0:1787830891.222274:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2308889450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+16:9482:x1874676443809792:12345-0@lo:502: Request processed in 73us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830891.222290:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1787830891.222291:0:9482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2201dee1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:9482:1874676443809792:0@lo:502: 00000040:00080000:0.0:1787830891.222335:0:9482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1787830891.222344:0:9482:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1787830891.222840:0:9498:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787830891.222850:0:9498:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787830891.222852:0:9498:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787830891.222857:0:9498:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d2334556800 00000020:00000080:1.0:1787830891.222860:0:9498:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787830891.222870:0:9498:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787830891.222872:0:9498:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787830891.222873:0:9498:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1787830891.222875:0:9498:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1787830891.222949:0:9482:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1787830891.222978:0:9482:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787830891.222996:0:9482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233bf10e00/0x95459fb9d1d28789 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d28790 expref: -99 pid: 9482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830891.223007:0:9482:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8d233bf10e00/0x95459fb9d1d28789 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d28790 expref: -99 pid: 9482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787830891.223060:0:9482:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787830891.223063:0:9482:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d2334556800 10000000:01000000:3.0:1787830891.223067:0:9482:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d2334556800 10000000:01000000:3.0:1787830891.223071:0:9482:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787830891.223075:0:9482:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d2334556800 from 1 10000000:01000000:3.0:1787830891.223078:0:9482:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787830891.223100:0:9482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d2307c76200/0x95459fb9d1d28797 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830891.223107:0:9482:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8d2307c76200/0x95459fb9d1d28797 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830891.223116:0:9482:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8d2307c76200/0x95459fb9d1d28797 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830891.223135:0:9482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2314e72940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:9482:1874676443809920:0@lo:101: 00000100:00100000:3.0:1787830891.223171:0:9482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830891.223207:0:9482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2201e97300 going to sleep for 11 seconds 00000100:00100000:1.0:1787830891.223207:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443809920 00000100:00100000:1.0:1787830891.223214:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443809920 00000100:00100000:1.0:1787830891.223254:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1787830891.223262:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2308888c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+16:9482:x1874676443809920:12345-0@lo:101: 00010000:00010000:1.0:1787830891.223272:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787830891.223286:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d233be94a00/0x95459fb9d1d2879e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d28797 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830891.223306:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d233be94a00/0x95459fb9d1d2879e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d28797 expref: 17 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830891.223315:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d233be94a00/0x95459fb9d1d2879e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d28797 expref: 17 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830891.223332:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233be94a00, rc 0) 00000100:00100000:1.0:1787830891.223379:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2308888c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+17:9482:x1874676443809920:12345-0@lo:101: Request processed in 118us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830891.223385:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1787830891.223473:0:9482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2314e72940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:9482:1874676443809920:0@lo:101: 00010000:00010000:3.0:1787830891.223489:0:9482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8d2307c76200/0x95459fb9d1d28797 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2879e expref: -99 pid: 9482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830891.223499:0:9482:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8d2307c76200/0x95459fb9d1d28797 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d2879e expref: -99 pid: 9482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830891.223580:0:9482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2314e72940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:9482:1874676443810048:0@lo:501: 00000100:00100000:3.0:1787830891.223708:0:9482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830891.223773:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443810048 00000100:00100000:1.0:1787830891.223782:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443810048 00000100:00100000:1.0:1787830891.223832:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1787830891.223851:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d230888ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+17:9482:x1874676443810048:12345-0@lo:501: 00000100:00100000:3.0:1787830891.223868:0:9482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2201e97300 going to sleep for 11 seconds 00000100:00100000:1.0:1787830891.223958:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d230888ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+17:9482:x1874676443810048:12345-0@lo:501: Request processed in 115us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830891.223969:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1787830891.224012:0:9482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2314e72940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:9482:1874676443810048:0@lo:501: 00000100:00100000:3.0:1787830891.224082:0:9482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2314e72940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:9482:1874676443810176:0@lo:503: 00000100:00100000:3.0:1787830891.224162:0:9482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830891.224192:0:9482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2201e97300 going to sleep for 11 seconds 00000100:00100000:1.0:1787830891.224215:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443810176 00000100:00100000:1.0:1787830891.224221:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443810176 00000100:00100000:1.0:1787830891.224255:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1787830891.224263:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d230888b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+17:9482:x1874676443810176:12345-0@lo:503: 00000100:00100000:1.0:1787830891.224368:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d230888b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+17:9482:x1874676443810176:12345-0@lo:503: Request processed in 106us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830891.224375:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1787830891.224427:0:9482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2314e72940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:9482:1874676443810176:0@lo:503: 00000040:00080000:3.0:1787830891.224716:0:9482:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787830891.224789:0:9482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2314e72940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:9482:1874676443810304:0@lo:502: 00000100:00100000:3.0:1787830891.224831:0:9482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830891.224864:0:9482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2201e97300 going to sleep for 11 seconds 00000100:00100000:1.0:1787830891.224922:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443810304 00000100:00100000:1.0:1787830891.224927:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443810304 00000100:00100000:1.0:1787830891.224959:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1787830891.224967:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2308889850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+17:9482:x1874676443810304:12345-0@lo:502: 00000100:00100000:1.0:1787830891.225064:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2308889850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+17:9482:x1874676443810304:12345-0@lo:502: Request processed in 99us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830891.225069:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1787830891.225112:0:9482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2314e72940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:9482:1874676443810304:0@lo:502: 00000040:00080000:3.0:1787830891.225372:0:9482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1787830891.225407:0:9482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1787830891.225425:0:9482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1787830891.225441:0:9482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1787830891.225458:0:9482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1787830891.225473:0:9482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1787830891.225490:0:9482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1787830891.225505:0:9482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1787830891.225520:0:9482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1787830891.225535:0:9482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1787830891.225550:0:9482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1787830891.225566:0:9482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1787830891.225581:0:9482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1787830891.225597:0:9482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1787830891.225673:0:9482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1787830891.225701:0:9482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1787830891.225734:0:9482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1787830891.225750:0:9482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1787830891.225764:0:9482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1787830891.225779:0:9482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1787830891.225794:0:9482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1787830891.225810:0:9482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1787830891.225825:0:9482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1787830891.225840:0:9482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1787830891.225865:0:9482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:3.0:1787830891.225883:0:9482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:3.0:1787830891.225898:0:9482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:3.0:1787830891.225912:0:9482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:3.0:1787830891.225927:0:9482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:3.0:1787830891.225942:0:9482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:3.0:1787830891.225957:0:9482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:3.0:1787830891.225972:0:9482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:3.0:1787830891.226000:0:9482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:3.0:1787830891.226017:0:9482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:3.0:1787830891.226042:0:9482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:3.0:1787830891.226057:0:9482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:3.0:1787830891.226073:0:9482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:3.0:1787830891.226096:0:9482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:3.0:1787830891.226116:0:9482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:3.0:1787830891.226132:0:9482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:3.0:1787830891.226147:0:9482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:3.0:1787830891.226162:0:9482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:3.0:1787830891.226177:0:9482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:3.0:1787830891.226192:0:9482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:3.0:1787830891.226207:0:9482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:3.0:1787830891.226221:0:9482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:3.0:1787830891.226248:0:9482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2314e72940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:9482:1874676443810432:0@lo:502: 00000100:00100000:3.0:1787830891.226301:0:9482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830891.226341:0:9482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2201e97300 going to sleep for 11 seconds 00000100:00100000:1.0:1787830891.226409:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443810432 00000100:00100000:1.0:1787830891.226415:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443810432 00000100:00100000:1.0:1787830891.226468:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1787830891.226479:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a686850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+17:9482:x1874676443810432:12345-0@lo:502: 00000100:00100000:1.0:1787830891.226671:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a686850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+17:9482:x1874676443810432:12345-0@lo:502: Request processed in 193us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830891.226679:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1787830891.226783:0:9482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2314e72940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:9482:1874676443810432:0@lo:502: 00000040:00080000:3.0:1787830891.226832:0:9482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:3.0:1787830891.226840:0:9482:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:3.0:1787830891.227257:0:9499:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1787830891.227273:0:9499:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8d2312950000) 00000020:00000080:3.0:1787830891.227296:0:9499:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:3.0:1787830891.227385:0:9499:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d2334556800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787830891.227390:0:9499:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d2334556800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787830891.227392:0:9499:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d2334556800 3 00010000:00080000:3.0:1787830891.227423:0:9499:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d233bda1800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.131@tcp at head 00010000:00010000:3.0:1787830891.229491:0:9499:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:3.0:1787830891.229749:0:9499:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1787830891.229791:0:9499:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787830891.229802:0:9499:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x95459fb9d1d287ac 00000100:00080000:3.0:1787830891.229811:0:9499:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787830891.229823:0:9499:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8d233bda1800 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:3.0:1787830891.229856:0:9499:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2314e72940 x1874676443810560/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787830891.229884:0:9499:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787830891.229947:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2314e72940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3618:1874676443810560:0@lo:38: 00000100:00100000:3.0:1787830891.230000:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220258cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3620:1874676443810688:0@lo:400: 00000100:00100000:0.0:1787830891.230050:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830891.230101:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830891.230108:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220258de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443811072:0@lo:400: 00000100:00100000:3.0:1787830891.230153:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220258fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3620:1874676443811200:0@lo:400: 00000100:00100000:1.0:1787830891.230169:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830891.230173:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443810560 00000100:00100000:0.0:1787830891.230183:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443810560 00000100:00100000:3.0:1787830891.230199:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830891.230201:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220258d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443811584:0@lo:400: 00000100:00100000:1.0:1787830891.230243:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830891.230247:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443810688 00000100:00100000:0.0:1787830891.230253:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443810688 00000100:00100000:3.0:1787830891.230274:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443811200 00000100:00100000:3.0:1787830891.230282:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443811200 00000100:00100000:1.0:1787830891.230303:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220258c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443810816:0@lo:400: 00000100:00100000:0.0:1787830891.230304:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787830891.230318:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2314e70b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1874676443810688:12345-0@lo:400: 00000100:00100000:3.0:1787830891.230340:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787830891.230350:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2201dee1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3618:x1874676443810560:12345-0@lo:38: 00000100:00100000:1.0:1787830891.230361:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1787830891.230381:0:6492:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 182 last 0 00000100:00100000:1.0:1787830891.230405:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220258f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3621:1874676443811328:0@lo:400: 00000100:00100000:0.0:1787830891.230432:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2314e70b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1874676443810688:12345-0@lo:400: Request processed in 115us (336us total) trans 0 rc 0/0 00000020:00000080:3.0:1787830891.230436:0:6492:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x95459fb9d1d287b3 00000100:00100000:0.0:1787830891.230444:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000004:00100000:3.0:1787830891.230457:0:6492:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:1.0:1787830891.230458:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830891.230471:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443811328 00000100:00100000:0.0:1787830891.230478:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443811328 00000100:00100000:1.0:1787830891.230490:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787830891.230499:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220258d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3621:1874676443810944:0@lo:400: 00000100:00100000:0.0:1787830891.230532:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787830891.230538:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830891.230544:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2314e71680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1874676443811200:12345-0@lo:400: 00000100:00100000:1.0:1787830891.230556:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220258cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443811456:0@lo:400: 00000100:00100000:0.0:1787830891.230589:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2314e71680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1874676443811200:12345-0@lo:400: Request processed in 49us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830891.230597:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787830891.230602:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830891.230652:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443810944 00000100:00100000:0.0:1787830891.230656:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443810944 00000100:00100000:0.0:1787830891.230678:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787830891.230680:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443811072 00000100:00100000:1.0:1787830891.230686:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443811072 00000100:00100000:0.0:1787830891.230686:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d232f6c9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1874676443811328:12345-0@lo:400: 00000100:00100000:0.0:1787830891.230727:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d232f6c9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1874676443811328:12345-0@lo:400: Request processed in 42us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830891.230734:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787830891.230735:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443810816 00000100:00100000:1.0:1787830891.230740:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443810816 00000100:00100000:0.0:1787830891.230751:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787830891.230760:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d232f6cad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1874676443810944:12345-0@lo:400: 00000100:00100000:1.0:1787830891.230771:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787830891.230781:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220258ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676443811072:12345-0@lo:400: 00000100:00100000:0.0:1787830891.230794:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d232f6cad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1874676443810944:12345-0@lo:400: Request processed in 35us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830891.230801:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787830891.230830:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220258ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676443811072:12345-0@lo:400: Request processed in 50us (665us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830891.230837:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787830891.230852:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787830891.230860:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d232f6ca1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443810816:12345-0@lo:400: 00000100:00100000:1.0:1787830891.230887:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d232f6ca1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443810816:12345-0@lo:400: Request processed in 29us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830891.230904:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787830891.230926:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443811584 00000100:00100000:1.0:1787830891.230929:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443811584 00000100:00100000:1.0:1787830891.230961:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443811456 00000100:00100000:1.0:1787830891.230964:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443811456 00010000:00080000:0.0:1787830891.230968:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d220258fc00 x1874676443811200/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830907 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787830891.230984:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220258fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3620:1874676443811200:0@lo:400: 00000100:00100000:1.0:1787830891.230990:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787830891.231000:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d232f6c8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676443811584:12345-0@lo:400: 00010000:00080000:0.0:1787830891.231003:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d220258cb40 x1874676443810688/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830907 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787830891.231021:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220258cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3620:1874676443810688:0@lo:400: 00000100:00100000:1.0:1787830891.231042:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d232f6c8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676443811584:12345-0@lo:400: Request processed in 42us (800us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830891.231050:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787830891.231065:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787830891.231073:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d232f6cb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443811456:12345-0@lo:400: 00000100:00100000:1.0:1787830891.231101:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d232f6cb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443811456:12345-0@lo:400: Request processed in 30us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830891.231109:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1787830891.231152:0:6492:0:(import.c:65:import_set_state_nolock()) ffff8d2203604800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787830891.231186:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220258de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443811072:0@lo:400: 00000020:01000004:0.0:1787830891.231197:0:9499:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00010000:00080000:1.0:1787830891.231206:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d220258d680 x1874676443811584/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787830907 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787830891.231219:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220258d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443811584:0@lo:400: 00000020:00000080:0.0:1787830891.231219:0:9499:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff8d233f434d28) 00000100:00100000:3.0:1787830891.231253:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2201dee1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1874676443810560:12345-0@lo:38: Request processed in 900us (1202us total) trans 0 rc 0/0 00000020:00000080:0.0:1787830891.231253:0:9499:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000100:00100000:3.0:1787830891.231272:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1787830891.231276:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d220258d2c0 x1874676443810944/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830907 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787830891.231289:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220258d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3621:1874676443810944:0@lo:400: 00010000:00080000:0.0:1787830891.231293:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2314e72940 x1874676443810560/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787830901 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787830891.231304:0:3618:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00010000:00080000:1.0:1787830891.231308:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d220258cf00 x1874676443811456/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787830907 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787830891.231313:0:3618:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00100000:1.0:1787830891.231321:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220258cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443811456:0@lo:400: 00000100:00080000:0.0:1787830891.231324:0:3618:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787830891.231330:0:3618:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787830891.231336:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8d233bda1800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787830891.231345:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2314e72940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3618:1874676443810560:0@lo:38: 00000100:00100000:1.0:1787830891.231353:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220258c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443810816:0@lo:400: 00010000:00080000:1.0:1787830891.231368:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d220258f0c0 x1874676443811328/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830907 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787830891.231378:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220258f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3621:1874676443811328:0@lo:400: 00000100:00100000:0.0:1787830891.231431:0:9500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2201def0c0 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9500:1874676443811712:0@lo:901: 00000100:00100000:0.0:1787830891.231477:0:9500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830891.231505:0:9500:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d22034db900 going to sleep for 11 seconds 00000100:00100000:3.0:1787830891.231530:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443811712 00000100:00100000:3.0:1787830891.231537:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443811712 00000100:00100000:3.0:1787830891.231578:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787830891.231589:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2201deed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9500:x1874676443811712:12345-0@lo:901: 00000020:01000004:0.0:1787830891.231690:0:9499:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d2334556800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787830891.231696:0:9499:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d2334556800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787830891.231699:0:9499:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d2334556800 3 00010000:00080000:0.0:1787830891.231746:0:9499:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d2203513800@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.131@tcp at head 00000100:00100000:3.0:1787830891.231754:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2201deed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9500:x1874676443811712:12345-0@lo:901: Request processed in 167us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830891.231765:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787830891.231794:0:9500:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2201def0c0 x1874676443811712/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1787830907 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787830891.231805:0:9500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2201def0c0 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9500:1874676443811712:0@lo:901: 00000100:00080000:2.0:1787830891.232276:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787830891.232283:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787830891.232286:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787830891.233832:0:9499:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000020:00000080:0.0:1787830891.234102:0:9499:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:0.0:1787830891.234147:0:9499:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787830891.234161:0:9499:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x95459fb9d1d287c1 00000100:00080000:0.0:1787830891.234171:0:9499:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787830891.234178:0:9499:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8d2203513800 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:0.0:1787830891.234212:0:9499:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2201dede00 x1874676443811840/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787830891.234252:0:9499:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000040:00080000:0.0:1787830891.234512:0:9499:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000020:01000000:3.0:1787830891.234584:0:9482:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 00000100:00100000:1.0:1787830891.234685:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2201dede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3618:1874676443811840:0@lo:38: 10000000:01000000:3.0:1787830891.234697:0:9482:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787830891.234720:0:9482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d2307c76200/0x95459fb9d1d28797 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2879e expref: -99 pid: 9482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830891.234732:0:9482:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8d2307c76200/0x95459fb9d1d28797 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2879e expref: -99 pid: 9482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830891.234767:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:3.0:1787830891.234789:0:9482:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787830891.234792:0:9482:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787830891.234795:0:9482:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787830891.234797:0:9482:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787830891.234800:0:9482:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787830891.234802:0:9482:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787830891.234805:0:9482:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787830891.234807:0:9482:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787830891.234810:0:9482:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787830891.234813:0:9482:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787830891.234816:0:9482:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1787830891.234817:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443811840 10000000:01000000:3.0:1787830891.234822:0:9482:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000100:00100000:0.0:1787830891.234825:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443811840 00000020:01000004:3.0:1787830891.234829:0:9482:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787830891.234833:0:9482:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787830891.234836:0:9482:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787830891.234838:0:9482:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787830891.234840:0:9482:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787830891.234843:0:9482:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787830891.234845:0:9482:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787830891.234847:0:9482:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787830891.234851:0:9482:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787830891.234853:0:9482:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787830891.234856:0:9482:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1787830891.234863:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787830891.234870:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d232f6cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3618:x1874676443811840:12345-0@lo:38: 10000000:01000000:3.0:1787830891.234881:0:9482:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00010000:00080000:0.0:1787830891.234898:0:8620:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 182 last 0 00000100:00100000:3.0:1787830891.234904:0:9482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2314e71e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:9482:1874676443811968:0@lo:253: 00000020:00000080:0.0:1787830891.234956:0:8620:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x95459fb9d1d287c8 00000004:00100000:0.0:1787830891.234976:0:8620:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:3.0:1787830891.234986:0:9482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787830891.235020:0:8620:0:(import.c:65:import_set_state_nolock()) ffff8d2203516000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787830891.235026:0:9482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2201e976c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787830891.235048:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443811968 00000100:00100000:1.0:1787830891.235054:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443811968 00000100:00100000:0.0:1787830891.235095:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d232f6cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1874676443811840:12345-0@lo:38: Request processed in 221us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830891.235104:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787830891.235113:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787830891.235126:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a687050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+17:9482:x1874676443811968:12345-0@lo:253: 00010000:00080000:3.0:1787830891.235133:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2201dede00 x1874676443811840/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787830901 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787830891.235155:0:3618:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 20000000:01000000:1.0:1787830891.235159:0:6483:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000100:00080000:3.0:1787830891.235164:0:3618:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:3.0:1787830891.235174:0:3618:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 20000000:01000000:1.0:1787830891.235176:0:6483:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00080000:3.0:1787830891.235179:0:3618:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1787830891.235183:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8d2203513800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787830891.235190:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2201dede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3618:1874676443811840:0@lo:38: 20000000:01000000:0.0:1787830891.241238:0:6483:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787830891.241262:0:6483:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1787830891.241289:0:6506:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787830891.241295:0:6506:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787830891.241319:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d2307c77600/0x95459fb9d1d287cf lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830891.241339:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2300030000/0x95459fb9d1d286c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d286be expref: 17 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830891.241348:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d233be95200/0x95459fb9d1d2870b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d28704 expref: 17 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830891.241356:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d2307c77600/0x95459fb9d1d287cf lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830891.241410:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d233be95200/0x95459fb9d1d2870b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x95459fb9d1d28704 expref: 17 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830891.241426:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d233be95200/0x95459fb9d1d2870b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x95459fb9d1d28704 expref: 17 pid: 6483 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830891.241451:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2314e72940 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6506:1874676443812096:0@lo:104: 00000100:00100000:3.0:1787830891.241526:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830891.241578:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443812096 00000100:00100000:2.0:1787830891.241588:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443812096 00010000:00010000:3.0:1787830891.241617:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2300030000/0x95459fb9d1d286c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x95459fb9d1d286be expref: 17 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830891.241647:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a687050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+17:9482:x1874676443811968:12345-0@lo:253: Request processed in 6504us (6642us total) trans 0 rc 0/0 00010000:00010000:3.0:1787830891.241658:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d2300030000/0x95459fb9d1d286c5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x95459fb9d1d286be expref: 17 pid: 6485 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830891.241665:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1787830891.241673:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2309d0bc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6506:1874676443812224:0@lo:104: 00000100:00100000:3.0:1787830891.241722:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830891.241728:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787830891.241737:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2309d09e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a45944b-32e3-4193-a2a5-46f84222bc14+3:6506:x1874676443812096:12345-0@lo:104: 00010000:00010000:2.0:1787830891.241748:0:6473:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff8d2300031e00/0x95459fb9d1d28704 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d2870b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830891.241753:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d23062840c0 going to sleep for 11 seconds 00010000:00010000:2.0:1787830891.241796:0:6473:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787830891.241802:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2309d09e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a45944b-32e3-4193-a2a5-46f84222bc14+3:6506:x1874676443812096:12345-0@lo:104: Request processed in 67us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830891.241807:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787830891.241822:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443812224 00000100:00100000:2.0:1787830891.241825:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443812224 00000100:00100000:3.0:1787830891.241827:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2314e72940 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6506:1874676443812096:0@lo:104: 00000100:00100000:1.0:1787830891.241860:0:9482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2314e71e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a45944b-32e3-4193-a2a5-46f84222bc14:9482:1874676443811968:0@lo:253: 10000000:01000000:1.0:1787830891.241874:0:9482:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1787830891.241878:0:9482:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787830891.241880:0:9482:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787830891.241881:0:9482:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787830891.241883:0:9482:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787830891.241884:0:9482:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787830891.241886:0:9482:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787830891.241887:0:9482:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787830891.241889:0:9482:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787830891.241890:0:9482:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787830891.241898:0:9482:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787830891.241899:0:9482:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787830891.241923:0:9482:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1787830891.242320:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787830891.242332:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203790780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a45944b-32e3-4193-a2a5-46f84222bc14+3:6506:x1874676443812224:12345-0@lo:104: 00010000:00010000:2.0:1787830891.242340:0:7431:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787830891.242344:0:6474:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff8d2307c76a00/0x95459fb9d1d286be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d286c5 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830891.242356:0:7431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8d2300031e00/0x95459fb9d1d28704 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d2870b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830891.242375:0:7431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2300031e00 already unused, calling callback (ffffffffc14f9c20) 10000000:00010000:2.0:1787830891.242380:0:7431:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8d2300031e00/0x95459fb9d1d28704 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x95459fb9d1d2870b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830891.242404:0:7431:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8d2300031e00/0x95459fb9d1d28704 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x95459fb9d1d2870b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787830891.242412:0:7431:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8d2300031e00/0x95459fb9d1d28704 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x95459fb9d1d2870b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787830891.242418:0:7431:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787830891.242425:0:6474:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787830891.242432:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203790780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a45944b-32e3-4193-a2a5-46f84222bc14+3:6506:x1874676443812224:12345-0@lo:104: Request processed in 104us (712us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830891.242441:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:2.0:1787830891.242461:0:7431:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8d2300031e00/0x95459fb9d1d28704 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d2870b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830891.242469:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787830891.242470:0:7431:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787830891.242478:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8d2307c76a00/0x95459fb9d1d286be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d286c5 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830891.242487:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2307c76a00 already unused, calling callback (ffffffffc14f9c20) 00010000:00010000:2.0:1787830891.242493:0:7431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8d2300031e00/0x95459fb9d1d28704 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d2870b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787830891.242493:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8d2307c76a00/0x95459fb9d1d286be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x95459fb9d1d286c5 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830891.242511:0:7431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8d2300031e00/0x95459fb9d1d28704 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d2870b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830891.242514:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8d2307c76a00/0x95459fb9d1d286be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x95459fb9d1d286c5 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830891.242518:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2309d0bc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6506:1874676443812224:0@lo:104: 10000000:00010000:0.0:1787830891.242532:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8d2307c76a00/0x95459fb9d1d286be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x95459fb9d1d286c5 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830891.242537:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787830891.242539:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787830891.242542:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787830891.242546:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787830891.242548:0:6506:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d2307c77600/0x95459fb9d1d287cf lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830891.242562:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8d2307c76a00/0x95459fb9d1d286be lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d286c5 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830891.242570:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787830891.242600:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8d2307c76a00/0x95459fb9d1d286be lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d286c5 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830891.242619:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8d2307c76a00/0x95459fb9d1d286be lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d286c5 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830891.242654:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830891.242657:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830891.242659:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787830891.242672:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2336bfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a45944b-32e3-4193-a2a5-46f84222bc14:3620:1874676443812352:0@lo:103: 00000100:00100000:2.0:1787830891.242675:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2201def840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a45944b-32e3-4193-a2a5-46f84222bc14:3621:1874676443812480:0@lo:103: 00000100:00100000:0.0:1787830891.242719:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830891.242770:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830891.242798:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443812352 00000100:00100000:0.0:1787830891.242809:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443812352 00010000:00010000:0.0:1787830891.242831:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d233be95200/0x95459fb9d1d2870b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d28704 expref: 17 pid: 6483 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830891.242857:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443812480 00000100:00100000:0.0:1787830891.242860:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443812480 00010000:00010000:0.0:1787830891.242873:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2300030000/0x95459fb9d1d286c5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d286be expref: 18 pid: 6485 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830891.242889:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787830891.242896:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787830891.242902:0:7432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2201dec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2a45944b-32e3-4193-a2a5-46f84222bc14+18:3620:x1874676443812352:12345-0@lo:103: 00000100:00100000:0.0:1787830891.242909:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203792940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a45944b-32e3-4193-a2a5-46f84222bc14+18:3621:x1874676443812480:12345-0@lo:103: 00010000:00010000:3.0:1787830891.242916:0:7432:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787830891.242920:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787830891.242924:0:7432:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d233be95200/0x95459fb9d1d2870b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d28704 expref: 18 pid: 6483 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830891.242927:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2300030000/0x95459fb9d1d286c5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d286be expref: 18 pid: 6485 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830891.242946:0:7432:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d233be95200/0x95459fb9d1d2870b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x95459fb9d1d28704 expref: 18 pid: 6483 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830891.242960:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2300030000/0x95459fb9d1d286c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x95459fb9d1d286be expref: 18 pid: 6485 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830891.242979:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d233be95200/0x95459fb9d1d2870b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x95459fb9d1d28704 expref: 18 pid: 6483 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830891.242983:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2300030000/0x95459fb9d1d286c5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x95459fb9d1d286be expref: 18 pid: 6485 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830891.242997:0:7432:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d2307c77600/0x95459fb9d1d287cf lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830891.243018:0:7432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2307c77600/0x95459fb9d1d287cf lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830891.243026:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 20000000:01000000:3.0:1787830891.243031:0:7432:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005365558s 00010000:00010000:3.0:1787830891.243036:0:7432:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d2307c77600/0x95459fb9d1d287cf lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830891.243044:0:7432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d2307c77600/0x95459fb9d1d287cf lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830891.243052:0:7432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d2307c77600/0x95459fb9d1d287cf lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830891.243058:0:7432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d2307c77600/0x95459fb9d1d287cf lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830891.243062:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203792940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a45944b-32e3-4193-a2a5-46f84222bc14+16:3621:x1874676443812480:12345-0@lo:103: Request processed in 155us (291us total) trans 0 rc 0/0 00010000:00010000:3.0:1787830891.243070:0:7432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2307c77600 already unused, calling callback (ffffffffc0ed6420) 00000100:00100000:0.0:1787830891.243075:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:3.0:1787830891.243076:0:7432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d2307c77600/0x95459fb9d1d287cf lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830891.243084:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2201def840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a45944b-32e3-4193-a2a5-46f84222bc14:3621:1874676443812480:0@lo:103: 00010000:00010000:3.0:1787830891.243088:0:7432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d2307c77600/0x95459fb9d1d287cf lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830891.243105:0:7432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d2307c77600/0x95459fb9d1d287cf lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830891.243114:0:7432:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787830891.243150:0:7432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2201dec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2a45944b-32e3-4193-a2a5-46f84222bc14+15:3620:x1874676443812352:12345-0@lo:103: Request processed in 252us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830891.243157:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:3.0:1787830891.243183:0:6506:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d2307c77600/0x95459fb9d1d287cf lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830891.243191:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d2307c77600/0x95459fb9d1d287cf lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830891.243196:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2307c77600/0x95459fb9d1d287cf lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830891.243782:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2336bfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a45944b-32e3-4193-a2a5-46f84222bc14:3620:1874676443812352:0@lo:103: 00080000:10000000:1.0:1787830891.245930:0:9482:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:1.0:1787830891.246081:0:9482:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1787830891.246274:0:9482:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:1.0:1787830891.246433:0:9482:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1787830891.246622:0:9482:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:1.0:1787830891.246869:0:9482:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:1.0:1787830891.247800:0:9482:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1787830891.253004:0:9482:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1787830891.253018:0:9482:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1787830891.253068:0:9482:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787830891.253141:0:9482:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.131@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787830891.253171:0:9482:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:1.0:1787830891.253208:0:9482:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:1.0:1787830891.254305:0:9482:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787830891.254688:0:9482:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:3.0:1787830891.495774:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787830891.634733:0:9556:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787830891.634900:0:9556:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1787830892.262840:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787830892.262871:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203793480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443812608:0@lo:13: 00000100:00100000:0.0:1787830892.262883:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d232f6ca940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443812736:0@lo:13: 00000100:00100000:1.0:1787830892.265009:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830892.265077:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443812608 00000100:00100000:3.0:1787830892.265088:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443812608 00000100:00100000:3.0:1787830892.265162:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787830892.265174:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d232f6c8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1874676443812608:12345-0@lo:13: 00002000:00000024:3.0:1787830892.265209:0:8409:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787830892.265271:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d232f6c8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1874676443812608:12345-0@lo:13: Request processed in 99us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830892.265280:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1787830892.265315:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2203793480 x1874676443812608/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787830908 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787830892.265401:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830892.265409:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203793480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443812608:0@lo:13: 00000100:00100000:2.0:1787830892.265455:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443812736 00000100:00100000:2.0:1787830892.265459:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443812736 00000100:00100000:2.0:1787830892.265488:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787830892.265497:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2201def840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443812736:12345-0@lo:13: 00002000:00000024:2.0:1787830892.265510:0:8410:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787830892.265553:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2201def840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443812736:12345-0@lo:13: Request processed in 58us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830892.265578:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1787830892.265594:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d232f6ca940 x1874676443812736/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787830908 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787830892.265650:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d232f6ca940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443812736:0@lo:13: 00010000:00010000:0.0:1787830892.522670:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787830892.774975:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d232f6c83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1874676443812864:0@lo:41: 00000100:00100000:0.0:1787830892.775046:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830892.775177:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443812864 00000100:00100000:1.0:1787830892.775185:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443812864 00000100:00100000:1.0:1787830892.775245:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787830892.775255:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2201dede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1874676443812864:12345-0@lo:41: 00000004:00000024:1.0:1787830892.775290:0:7448:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1787830892.775334:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2201dede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1874676443812864:12345-0@lo:41: Request processed in 82us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830892.775359:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787830892.778477:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d232f6c83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1874676443812864:0@lo:41: 00000100:00100000:0.0:1787830893.287128:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787830893.287155:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2336bfe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676443812992:0@lo:41: 00000100:00100000:0.0:1787830893.287237:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830893.287420:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443812992 00000100:00100000:2.0:1787830893.287428:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443812992 00000100:00100000:2.0:1787830893.287484:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787830893.287494:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2201def0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676443812992:12345-0@lo:41: 00000004:00000024:2.0:1787830893.287529:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:2.0:1787830893.287584:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2201def0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676443812992:12345-0@lo:41: Request processed in 91us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830893.287603:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787830893.287691:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2336bfe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676443812992:0@lo:41: 00010000:00010000:0.0:1787830893.543525:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830894.567164:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787830895.576917:0:9846:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg331-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787830895.590786:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787830896.294077:0:9898:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787830896.294338:0:9898:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1787830896.358990:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2336bfcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a45944b-32e3-4193-a2a5-46f84222bc14:3622:1874676443813120:0@lo:400: 00000100:00100000:3.0:1787830896.359088:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830896.359162:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2336bfe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676443813632:0@lo:400: 00000100:00100000:3.0:1787830896.359191:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830896.359216:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2336bfda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676443814144:0@lo:400: 00000100:00100000:2.0:1787830896.359246:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443813120 00000100:00100000:3.0:1787830896.359247:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830896.359256:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443813120 00000100:00100000:3.0:1787830896.359271:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787830896.359277:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2336bff840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3622:1874676443813504:0@lo:400: 00000100:00100000:3.0:1787830896.359318:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830896.359354:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2336bfde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676443814016:0@lo:400: 00000100:00100000:3.0:1787830896.359397:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830896.359457:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1787830896.359469:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a686450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+15:3622:x1874676443813120:12345-0@lo:400: 00000100:00100000:3.0:1787830896.359545:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2336bff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874676443813248:0@lo:400: 00000100:00100000:3.0:1787830896.359590:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830896.359614:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2336bfed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3619:1874676443813760:0@lo:400: 00000100:00100000:3.0:1787830896.359661:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830896.359675:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a686450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+15:3622:x1874676443813120:12345-0@lo:400: Request processed in 207us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830896.359685:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1787830896.359729:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443813504 00000100:00100000:2.0:1787830896.359733:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443813504 00000100:00100000:2.0:1787830896.359761:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443813248 00000100:00100000:2.0:1787830896.359774:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443813248 00000100:00100000:2.0:1787830896.359789:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443813760 00000100:00100000:2.0:1787830896.359792:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443813760 00000100:00100000:2.0:1787830896.360068:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787830896.360076:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203792d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1874676443813504:12345-0@lo:400: 00000100:00100000:2.0:1787830896.360124:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203792d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1874676443813504:12345-0@lo:400: Request processed in 49us (805us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830896.360131:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787830896.360145:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787830896.360151:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22037912c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874676443813248:12345-0@lo:400: 00000100:00100000:2.0:1787830896.360180:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22037912c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874676443813248:12345-0@lo:400: Request processed in 30us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830896.360186:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787830896.360197:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787830896.360203:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203790f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874676443813760:12345-0@lo:400: 00000100:00100000:2.0:1787830896.360249:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203790f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874676443813760:12345-0@lo:400: Request processed in 45us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830896.360255:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:2.0:1787830896.360273:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787830896.360680:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2336bfed00 x1874676443813760/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830912 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787830896.360697:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2336bfed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3619:1874676443813760:0@lo:400: 00000100:00100000:3.0:1787830896.360708:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2336bfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3619:1874676443814272:0@lo:400: 00000100:00100000:3.0:1787830896.360751:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1787830896.360807:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2336bff480 x1874676443813248/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830912 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787830896.360818:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2336bff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874676443813248:0@lo:400: 00000100:00100000:2.0:1787830896.360832:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443814272 00000100:00100000:3.0:1787830896.360833:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1787830896.360838:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443814272 00000100:00100000:3.0:1787830896.360844:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2336bfc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443813376:0@lo:400: 00000100:00100000:2.0:1787830896.360878:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787830896.360879:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830896.360890:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22037930c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874676443814272:12345-0@lo:400: 00000100:00100000:3.0:1787830896.360908:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2336bfc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3619:1874676443813888:0@lo:400: 00000100:00100000:2.0:1787830896.360944:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22037930c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874676443814272:12345-0@lo:400: Request processed in 53us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830896.360945:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830896.360956:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787830896.360965:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2336bfe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3619:1874676443814400:0@lo:400: 00000100:00100000:2.0:1787830896.360971:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443813888 00000100:00100000:2.0:1787830896.360976:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443813888 00000100:00100000:3.0:1787830896.360989:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830896.361001:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443814400 00000100:00100000:2.0:1787830896.361005:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443814400 00010000:00080000:3.0:1787830896.361012:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2336bfc000 x1874676443814272/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830912 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787830896.361023:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787830896.361036:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203793c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874676443813888:12345-0@lo:400: 00000100:00100000:3.0:1787830896.361044:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2336bfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3619:1874676443814272:0@lo:400: 00000100:00100000:3.0:1787830896.361079:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443813632 00000100:00100000:3.0:1787830896.361084:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443813632 00000100:00100000:2.0:1787830896.361090:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203793c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874676443813888:12345-0@lo:400: Request processed in 60us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830896.361099:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787830896.361118:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787830896.361129:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443813376 00000100:00100000:2.0:1787830896.361132:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203790000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874676443814400:12345-0@lo:400: 00000100:00100000:3.0:1787830896.361134:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443813376 00000100:00100000:3.0:1787830896.361162:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787830896.361170:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203790000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874676443814400:12345-0@lo:400: Request processed in 44us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830896.361172:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203793840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1874676443813632:12345-0@lo:400: 00000100:00100000:2.0:1787830896.361184:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:2.0:1787830896.361203:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787830896.361208:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787830896.361222:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203793840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1874676443813632:12345-0@lo:400: Request processed in 51us (2028us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830896.361228:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787830896.361244:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787830896.361250:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22037921c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443813376:12345-0@lo:400: 00000100:00100000:3.0:1787830896.361271:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22037921c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443813376:12345-0@lo:400: Request processed in 21us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830896.361276:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787830896.361294:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443814144 00000100:00100000:3.0:1787830896.361297:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443814144 00000100:00100000:3.0:1787830896.361336:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443814016 00000100:00080000:2.0:1787830896.361338:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787830896.361339:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443814016 00000100:00080000:2.0:1787830896.361360:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787830896.361498:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787830896.361507:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203792580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1874676443814144:12345-0@lo:400: 00000100:00100000:3.0:1787830896.361556:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203792580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1874676443814144:12345-0@lo:400: Request processed in 51us (2308us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830896.361562:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787830896.361586:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787830896.361592:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203791680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676443814016:12345-0@lo:400: 00000100:00100000:3.0:1787830896.361655:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203791680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676443814016:12345-0@lo:400: Request processed in 63us (2256us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830896.361662:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1787830896.365006:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2336bff840 x1874676443813504/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830912 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787830896.365028:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2336bff840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3622:1874676443813504:0@lo:400: 00010000:00080000:2.0:1787830896.365046:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2336bfde00 x1874676443814016/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787830912 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787830896.365054:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2336bfde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676443814016:0@lo:400: 00000100:00100000:2.0:1787830896.365067:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2336bfe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676443813632:0@lo:400: 00010000:00080000:2.0:1787830896.365079:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2336bfda40 x1874676443814144/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787830912 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787830896.365087:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2336bfda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676443814144:0@lo:400: 00000100:00100000:2.0:1787830896.365106:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2336bfcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a45944b-32e3-4193-a2a5-46f84222bc14:3622:1874676443813120:0@lo:400: 00000100:00100000:2.0:1787830896.370779:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2336bfc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443813376:0@lo:400: 00010000:00080000:2.0:1787830896.370816:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2336bfc780 x1874676443813888/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830912 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787830896.370829:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2336bfc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3619:1874676443813888:0@lo:400: 00010000:00080000:2.0:1787830896.370862:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2336bfe1c0 x1874676443814400/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830912 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787830896.370871:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2336bfe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3619:1874676443814400:0@lo:400: 00010000:00010000:0.0:1787830896.616876:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787830897.382949:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203791e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443814528:0@lo:13: 00000100:00100000:3.0:1787830897.383103:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830897.383149:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d232f6ca580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676443814656:0@lo:13: 00000100:00100000:2.0:1787830897.383189:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830897.383284:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443814528 00000100:00100000:1.0:1787830897.383294:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443814528 00000100:00100000:1.0:1787830897.383445:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443814656 00000100:00100000:1.0:1787830897.383449:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443814656 00000100:00100000:1.0:1787830897.383465:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787830897.383474:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203791a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1874676443814528:12345-0@lo:13: 00002000:00000024:1.0:1787830897.383504:0:8409:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787830897.383562:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203791a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1874676443814528:12345-0@lo:13: Request processed in 88us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830897.383585:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787830897.383604:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787830897.383611:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2336bfe1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676443814656:12345-0@lo:13: 00002000:00000024:1.0:1787830897.383620:0:8409:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787830897.383681:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2336bfe1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676443814656:12345-0@lo:13: Request processed in 71us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830897.383687:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1787830897.383797:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2203791e00 x1874676443814528/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787830913 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787830897.383818:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203791e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443814528:0@lo:13: 00010000:00080000:2.0:1787830897.383887:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d232f6ca580 x1874676443814656/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787830913 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787830897.383968:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d232f6ca580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676443814656:0@lo:13: 00010000:00010000:1.0:1787830897.638907:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787830897.897680:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d232f6c9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443814784:0@lo:41: 00000100:00100000:2.0:1787830897.897775:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830897.897840:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443814784 00000100:00100000:3.0:1787830897.897850:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443814784 00000100:00100000:3.0:1787830897.897916:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787830897.897927:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2336bfc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676443814784:12345-0@lo:41: 00000004:00000024:3.0:1787830897.897967:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1787830897.898088:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2336bfc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676443814784:12345-0@lo:41: Request processed in 162us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830897.898096:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787830897.898175:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d232f6c9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443814784:0@lo:41: 00000100:00100000:3.0:1787830898.406859:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787830898.406884:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2336bfc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443814912:0@lo:41: 00000100:00100000:3.0:1787830898.407181:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830898.407370:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443814912 00000100:00100000:2.0:1787830898.407377:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443814912 00000100:00100000:2.0:1787830898.407426:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787830898.407436:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203791e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443814912:12345-0@lo:41: 00000004:00000024:2.0:1787830898.407477:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:2.0:1787830898.407519:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203791e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443814912:12345-0@lo:41: Request processed in 86us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830898.407525:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787830898.407603:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2336bfc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443814912:0@lo:41: 00000020:00000004:1.0:1787830898.508963:0:9999:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787830898.509179:0:9999:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787830898.662897:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787830898.950521:0:10047:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787830898.950531:0:10047:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:2.0:1787830899.137171:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787830899.137271:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433289344 00000100:00100000:0.0:1787830899.137281:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433289344 00000100:00100000:0.0:1787830899.137349:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 142 00000100:00100000:0.0:1787830899.137358:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a687850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2393:x1874676433289344:12345-192.168.203.31@tcp:250: 00010000:00080000:0.0:1787830899.137394:0:6483:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 507e0a9e-e0a5-4f06-89fa-c916e7c0c1da@192.168.203.31@tcp t0 exp 0000000000000000 cur 190 last 0 00000020:00000080:0.0:1787830899.137442:0:6483:0:(genops.c:1385:class_connect()) connect: client 507e0a9e-e0a5-4f06-89fa-c916e7c0c1da, cookie 0x95459fb9d1d287d6 00000100:00080000:0.0:1787830899.137677:0:6483:0:(import.c:65:import_set_state_nolock()) ffff8d2203514800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787830899.137770:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a687850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+5:2393:x1874676433289344:12345-192.168.203.31@tcp:250: Request processed in 411us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830899.137779:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 142 00000100:00100000:2.0:1787830899.142994:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787830899.143114:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433289472 00000100:00100000:1.0:1787830899.143127:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433289472 00000100:00100000:1.0:1787830899.143200:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 143 00000100:00100000:1.0:1787830899.143212:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a687c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+5:6147:x1874676433289472:12345-192.168.203.31@tcp:101: 00010000:00010000:1.0:1787830899.143232:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787830899.143252:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d233be94600/0x95459fb9d1d287dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe558a92a99423be6 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830899.143302:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d233be94600/0x95459fb9d1d287dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423be6 expref: 6 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830899.143314:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d233be94600/0x95459fb9d1d287dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423be6 expref: 6 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830899.143324:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233be94600, rc 0) 00000100:00100000:1.0:1787830899.143405:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a687c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+6:6147:x1874676433289472:12345-192.168.203.31@tcp:101: Request processed in 196us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830899.143412:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 143 00000100:00100000:3.0:1787830899.144721:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787830899.145061:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433289600 00000100:00100000:0.0:1787830899.145070:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433289600 00000100:00100000:0.0:1787830899.145122:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 144 00000100:00100000:0.0:1787830899.145132:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a684450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+6:6147:x1874676433289600:12345-192.168.203.31@tcp:501: 00000100:00100000:0.0:1787830899.145269:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a684450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+6:6147:x1874676433289600:12345-192.168.203.31@tcp:501: Request processed in 137us (563us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787830899.145289:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 144 00000100:00100000:2.0:1787830899.149042:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787830899.149108:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433289728 00000100:00100000:1.0:1787830899.149119:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433289728 00000100:00100000:1.0:1787830899.149176:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 145 00000100:00100000:1.0:1787830899.149184:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a684850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+6:6147:x1874676433289728:12345-192.168.203.31@tcp:101: 00010000:00010000:1.0:1787830899.149200:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787830899.149216:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d233be94800/0x95459fb9d1d287e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe558a92a99423bed expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830899.149242:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d233be94800/0x95459fb9d1d287e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423bed expref: 7 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830899.149251:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d233be94800/0x95459fb9d1d287e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423bed expref: 7 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830899.149258:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233be94800, rc 0) 00000100:00100000:1.0:1787830899.149317:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a684850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+7:6147:x1874676433289728:12345-192.168.203.31@tcp:101: Request processed in 133us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830899.149422:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 145 00000100:00100000:2.0:1787830899.151123:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787830899.151190:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433289856 00000100:00100000:0.0:1787830899.151207:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433289856 00000100:00100000:0.0:1787830899.151259:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 146 00000100:00100000:0.0:1787830899.151270:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a685c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+7:6147:x1874676433289856:12345-192.168.203.31@tcp:501: 00000100:00100000:0.0:1787830899.151448:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a685c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+8:6147:x1874676433289856:12345-192.168.203.31@tcp:501: Request processed in 180us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830899.151456:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 146 00000100:00100000:3.0:1787830899.152437:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787830899.152764:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433289984 00000100:00100000:1.0:1787830899.152772:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433289984 00000100:00100000:1.0:1787830899.152821:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 147 00000100:00100000:1.0:1787830899.152831:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a686050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+8:6147:x1874676433289984:12345-192.168.203.31@tcp:503: 00000100:00100000:1.0:1787830899.152976:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a686050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+8:6147:x1874676433289984:12345-192.168.203.31@tcp:503: Request processed in 146us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830899.152984:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 147 00000100:00100000:2.0:1787830899.156929:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787830899.157129:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433290112 00000100:00100000:0.0:1787830899.157140:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433290112 00000100:00100000:0.0:1787830899.157207:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 148 00000100:00100000:0.0:1787830899.157216:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a685450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+8:6165:x1874676433290112:12345-192.168.203.31@tcp:502: 00000100:00100000:0.0:1787830899.157415:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a685450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+8:6165:x1874676433290112:12345-192.168.203.31@tcp:502: Request processed in 199us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830899.157431:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 148 00000100:00100000:2.0:1787830899.173014:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787830899.173433:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433290240 00000100:00100000:1.0:1787830899.173444:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433290240 00000100:00100000:1.0:1787830899.173508:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 149 00000100:00100000:1.0:1787830899.173519:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a684c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+8:6165:x1874676433290240:12345-192.168.203.31@tcp:502: 00000100:00100000:1.0:1787830899.173782:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a684c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+8:6165:x1874676433290240:12345-192.168.203.31@tcp:502: Request processed in 264us (791us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830899.173790:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 149 00000100:00100000:3.0:1787830899.178869:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787830899.178941:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433290368 00000100:00100000:0.0:1787830899.178954:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433290368 00000100:00100000:0.0:1787830899.179042:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 150 00000100:00100000:0.0:1787830899.179054:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a686c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+8:6147:x1874676433290368:12345-192.168.203.31@tcp:101: 00010000:00010000:0.0:1787830899.179074:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787830899.179108:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d233bf10800/0x95459fb9d1d287eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe558a92a99423c1e expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830899.179141:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d233bf10800/0x95459fb9d1d287eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423c1e expref: 9 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830899.179185:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d233bf10800/0x95459fb9d1d287eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423c1e expref: 9 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830899.179197:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233bf10800, rc 0) 00000100:00100000:0.0:1787830899.179274:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a686c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+9:6147:x1874676433290368:12345-192.168.203.31@tcp:101: Request processed in 223us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830899.179283:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 150 00000100:00100000:2.0:1787830899.181826:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787830899.181910:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433290496 00000100:00100000:1.0:1787830899.181919:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433290496 00000100:00100000:1.0:1787830899.182010:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 151 00000100:00100000:1.0:1787830899.182020:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a687450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+9:6147:x1874676433290496:12345-192.168.203.31@tcp:256: 20000000:01000000:1.0:1787830899.182237:0:6484:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1787830899.182273:0:6484:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1787830899.182278:0:6484:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1787830899.182282:0:6484:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1787830899.182285:0:6484:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1787830899.182287:0:6484:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:1.0:1787830899.183304:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a687450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+9:6147:x1874676433290496:12345-192.168.203.31@tcp:256: Request processed in 1279us (1482us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830899.183323:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 151 00000100:00100000:3.0:1787830899.186692:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787830899.186736:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433290624 00000100:00100000:0.0:1787830899.186748:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433290624 00000100:00100000:0.0:1787830899.186819:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 152 00000100:00100000:0.0:1787830899.186830:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a685850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+9:6147:x1874676433290624:12345-192.168.203.31@tcp:101: 00010000:00010000:0.0:1787830899.186847:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787830899.186870:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d233bf11200/0x95459fb9d1d287f2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe558a92a99423c25 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830899.186901:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d233bf11200/0x95459fb9d1d287f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423c25 expref: 10 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830899.186912:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d233bf11200/0x95459fb9d1d287f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423c25 expref: 10 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830899.186922:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233bf11200, rc 0) 00000100:00100000:0.0:1787830899.187006:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a685850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+10:6147:x1874676433290624:12345-192.168.203.31@tcp:101: Request processed in 178us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830899.187014:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 152 00000100:00100000:2.0:1787830899.189247:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787830899.189389:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433290752 00000100:00100000:1.0:1787830899.189400:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433290752 00000100:00100000:1.0:1787830899.189459:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 153 00000100:00100000:1.0:1787830899.189477:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a685050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+10:6147:x1874676433290752:12345-192.168.203.31@tcp:501: 00000100:00100000:1.0:1787830899.189710:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a685050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+10:6147:x1874676433290752:12345-192.168.203.31@tcp:501: Request processed in 241us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830899.189718:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 153 00000100:00100000:1.0:1787830899.190884:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787830899.190975:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433290880 00000100:00100000:2.0:1787830899.190981:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433290880 00000100:00100000:2.0:1787830899.191030:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 154 00000100:00100000:2.0:1787830899.191041:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a684050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+10:6147:x1874676433290880:12345-192.168.203.31@tcp:503: 00000100:00100000:2.0:1787830899.191184:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a684050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+10:6147:x1874676433290880:12345-192.168.203.31@tcp:503: Request processed in 145us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830899.191193:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 154 00000100:00100000:3.0:1787830899.192950:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787830899.193098:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433291008 00000100:00100000:0.0:1787830899.193108:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433291008 00000100:00100000:0.0:1787830899.193178:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 155 00000100:00100000:0.0:1787830899.193189:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a681050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+10:6170:x1874676433291008:12345-192.168.203.31@tcp:502: 00000100:00100000:0.0:1787830899.193350:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a681050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+10:6170:x1874676433291008:12345-192.168.203.31@tcp:502: Request processed in 163us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830899.193356:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 155 00000100:00100000:1.0:1787830899.196802:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787830899.196918:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433291136 00000100:00100000:2.0:1787830899.196930:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433291136 00000100:00100000:0.0:1787830899.197152:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 156 00000100:00100000:0.0:1787830899.197166:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a680050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+10:6170:x1874676433291136:12345-192.168.203.31@tcp:502: 00000100:00100000:0.0:1787830899.197420:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a680050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+10:6170:x1874676433291136:12345-192.168.203.31@tcp:502: Request processed in 258us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830899.197429:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 156 00000100:00100000:2.0:1787830899.199581:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787830899.199650:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787830899.199667:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433291264 00000100:00100000:0.0:1787830899.199677:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433291264 00000100:00100000:3.0:1787830899.199692:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433291520 00000100:00100000:3.0:1787830899.199698:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433291520 00000100:00100000:0.0:1787830899.199742:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 7 00000100:00100000:0.0:1787830899.199751:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2336bfe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2393:x1874676433291264:12345-192.168.203.31@tcp:38: 00010000:00080000:0.0:1787830899.199785:0:6491:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 47d7f0ed-283f-4b70-a741-6e74c5e52619@192.168.203.31@tcp t0 exp 0000000000000000 cur 190 last 0 00000100:00100000:3.0:1787830899.199839:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 8 00000100:00100000:3.0:1787830899.199846:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2336bfde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2393:x1874676433291520:12345-192.168.203.31@tcp:38: 00000020:00000080:0.0:1787830899.199851:0:6491:0:(genops.c:1385:class_connect()) connect: client 47d7f0ed-283f-4b70-a741-6e74c5e52619, cookie 0x95459fb9d1d287f9 00010000:00080000:3.0:1787830899.199866:0:8620:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 47d7f0ed-283f-4b70-a741-6e74c5e52619@192.168.203.31@tcp t0 exp 0000000000000000 cur 190 last 0 00000004:00100000:0.0:1787830899.199884:0:6491:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return 37 00000020:00000080:3.0:1787830899.199912:0:8620:0:(genops.c:1385:class_connect()) connect: client 47d7f0ed-283f-4b70-a741-6e74c5e52619, cookie 0x95459fb9d1d28800 00000004:00100000:3.0:1787830899.199931:0:8620:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return 37 00000100:00080000:0.0:1787830899.200757:0:6491:0:(import.c:65:import_set_state_nolock()) ffff8d2203515000 : changing import state from RECOVER to FULL 00000100:00080000:3.0:1787830899.200774:0:8620:0:(import.c:65:import_set_state_nolock()) ffff8d2203606800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787830899.200853:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2336bfe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+6:2393:x1874676433291264:12345-192.168.203.31@tcp:38: Request processed in 1100us (1297us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830899.200861:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 7 00000100:00100000:3.0:1787830899.201062:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2336bfde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+6:2393:x1874676433291520:12345-192.168.203.31@tcp:38: Request processed in 1214us (1410us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830899.201071:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 8 10000000:01000000:2.0:1787830899.430785:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787830899.430795:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d232f6b0800 from 39 10000000:01000000:2.0:1787830899.430803:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787830899.430856:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233837bc00/0x95459fb9d1d28807 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830899.430867:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8d233837bc00/0x95459fb9d1d28807 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830899.430876:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8d233837bc00/0x95459fb9d1d28807 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830899.430921:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2336bff840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443815040:0@lo:101: 00000100:00100000:2.0:1787830899.432107:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830899.432203:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2334484000 going to sleep for 11 seconds 00000100:00100000:1.0:1787830899.432999:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443815040 00000100:00100000:1.0:1787830899.433010:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443815040 00000100:00100000:1.0:1787830899.433151:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1787830899.433164:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a682850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+15:6487:x1874676443815040:12345-0@lo:101: 00010000:00010000:1.0:1787830899.433190:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787830899.433210:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d233be95e00/0x95459fb9d1d2880e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d28807 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830899.433241:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d233be95e00/0x95459fb9d1d2880e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d28807 expref: 16 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830899.433253:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d233be95e00/0x95459fb9d1d2880e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d28807 expref: 16 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830899.433262:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233be95e00, rc 0) 00000100:00100000:1.0:1787830899.433358:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a682850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+16:6487:x1874676443815040:12345-0@lo:101: Request processed in 197us (1257us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830899.433398:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787830899.433402:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2336bff840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443815040:0@lo:101: 00010000:00010000:3.0:1787830899.433424:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8d233837bc00/0x95459fb9d1d28807 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2880e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830899.433435:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8d233837bc00/0x95459fb9d1d28807 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d2880e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830899.433546:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22037903c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443815168:0@lo:501: 00000100:00100000:3.0:1787830899.433869:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830899.433900:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d230833bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787830899.433917:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443815168 00000100:00100000:0.0:1787830899.433922:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443815168 00000100:00100000:0.0:1787830899.433955:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1787830899.433964:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a683050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+16:6487:x1874676443815168:12345-0@lo:501: 00000100:00100000:0.0:1787830899.434103:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a683050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+16:6487:x1874676443815168:12345-0@lo:501: Request processed in 141us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830899.434112:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787830899.434133:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22037903c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443815168:0@lo:501: 00000100:00100000:3.0:1787830899.434171:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22037903c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443815296:0@lo:503: 00000100:00100000:3.0:1787830899.434207:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830899.434221:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d230833bc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787830899.434248:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443815296 00000100:00100000:1.0:1787830899.434254:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443815296 00000100:00100000:1.0:1787830899.434295:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1787830899.434301:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a682450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+16:6487:x1874676443815296:12345-0@lo:503: 00000100:00100000:1.0:1787830899.434480:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a682450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+16:6487:x1874676443815296:12345-0@lo:503: Request processed in 178us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830899.434489:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1787830899.434506:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22037903c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443815296:0@lo:503: 00000100:00100000:3.0:1787830899.435042:0:10059:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22037903c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:10059:1874676443815424:0@lo:502: 00000100:00100000:3.0:1787830899.435080:0:10059:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830899.435116:0:10059:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d230833bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787830899.435171:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443815424 00000100:00100000:0.0:1787830899.435176:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443815424 00000100:00100000:0.0:1787830899.435210:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1787830899.435219:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a683850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+16:10059:x1874676443815424:12345-0@lo:502: 00000100:00100000:0.0:1787830899.435354:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a683850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+16:10059:x1874676443815424:12345-0@lo:502: Request processed in 136us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830899.435362:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1787830899.435428:0:10059:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22037903c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:10059:1874676443815424:0@lo:502: 00000100:00100000:3.0:1787830899.435483:0:10059:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22037903c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:10059:1874676443815552:0@lo:502: 00000100:00100000:3.0:1787830899.435517:0:10059:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830899.435535:0:10059:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d230833bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1787830899.435578:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443815552 00000100:00100000:1.0:1787830899.435584:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443815552 00000100:00100000:1.0:1787830899.435614:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1787830899.435621:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a683c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+16:10059:x1874676443815552:12345-0@lo:502: 00000100:00100000:1.0:1787830899.435708:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a683c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+16:10059:x1874676443815552:12345-0@lo:502: Request processed in 86us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830899.435716:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1787830899.435733:0:10059:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22037903c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:10059:1874676443815552:0@lo:502: 00000040:00080000:3.0:1787830899.435752:0:10059:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:2.0:1787830899.435842:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:2.0:1787830899.435871:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787830899.435890:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233837bc00/0x95459fb9d1d28807 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2880e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830899.435902:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8d233837bc00/0x95459fb9d1d28807 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2880e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787830899.435913:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1787830899.435916:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:2.0:1787830899.435919:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1787830899.435946:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233837ac00/0x95459fb9d1d28815 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830899.435960:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8d233837ac00/0x95459fb9d1d28815 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830899.435970:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8d233837ac00/0x95459fb9d1d28815 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830899.435983:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2336bffc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443815680:0@lo:101: 00000100:00100000:2.0:1787830899.436010:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830899.436031:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2334484540 going to sleep for 11 seconds 00000100:00100000:0.0:1787830899.436051:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443815680 00000100:00100000:0.0:1787830899.436056:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443815680 00000100:00100000:0.0:1787830899.436083:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1787830899.436090:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a680450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+16:6487:x1874676443815680:12345-0@lo:101: 00010000:00010000:0.0:1787830899.436098:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787830899.436112:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d233bf11800/0x95459fb9d1d2881c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d28815 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830899.436133:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d233bf11800/0x95459fb9d1d2881c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d28815 expref: 17 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830899.436144:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d233bf11800/0x95459fb9d1d2881c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d28815 expref: 17 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830899.436153:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233bf11800, rc 0) 00000100:00100000:0.0:1787830899.436196:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a680450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+17:6487:x1874676443815680:12345-0@lo:101: Request processed in 106us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830899.436203:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1787830899.436220:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2336bffc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443815680:0@lo:101: 00010000:00010000:3.0:1787830899.436235:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8d233837ac00/0x95459fb9d1d28815 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2881c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830899.436246:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8d233837ac00/0x95459fb9d1d28815 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d2881c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830899.436289:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22037903c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443815808:0@lo:501: 00000100:00100000:3.0:1787830899.436316:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830899.436345:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d230833bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1787830899.436390:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443815808 00000100:00100000:1.0:1787830899.436394:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443815808 00000100:00100000:1.0:1787830899.436417:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1787830899.436421:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a680850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+17:6487:x1874676443815808:12345-0@lo:501: 00000100:00100000:1.0:1787830899.436691:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a680850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+17:6487:x1874676443815808:12345-0@lo:501: Request processed in 267us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830899.436707:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1787830899.436743:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22037903c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443815808:0@lo:501: 00000100:00100000:3.0:1787830899.436773:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22037903c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443815936:0@lo:503: 00000100:00100000:3.0:1787830899.436818:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830899.436847:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d230833bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787830899.436859:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443815936 00000100:00100000:0.0:1787830899.436865:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443815936 00000100:00100000:0.0:1787830899.436898:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1787830899.436905:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a681c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+17:6487:x1874676443815936:12345-0@lo:503: 00000100:00100000:0.0:1787830899.436980:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a681c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+17:6487:x1874676443815936:12345-0@lo:503: Request processed in 75us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830899.436987:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1787830899.437021:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22037903c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443815936:0@lo:503: 00000100:00100000:3.0:1787830899.437347:0:10060:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22037903c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:10060:1874676443816064:0@lo:502: 00000100:00100000:3.0:1787830899.437385:0:10060:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830899.437403:0:10060:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d230833b180 going to sleep for 11 seconds 00000100:00100000:1.0:1787830899.437423:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443816064 00000100:00100000:1.0:1787830899.437428:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443816064 00000100:00100000:1.0:1787830899.437454:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1787830899.437462:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a682050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+17:10060:x1874676443816064:12345-0@lo:502: 00000100:00100000:1.0:1787830899.437545:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a682050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+17:10060:x1874676443816064:12345-0@lo:502: Request processed in 85us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830899.437563:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1787830899.437592:0:10060:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22037903c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:10060:1874676443816064:0@lo:502: 00000020:01000000:3.0:1787830899.437617:0:10060:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787830899.437652:0:10060:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787830899.437658:0:10060:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787830899.437666:0:10060:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787830899.437668:0:10060:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1787830899.437682:0:10060:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22037903c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:10060:1874676443816192:0@lo:502: 00000100:00100000:3.0:1787830899.437715:0:10060:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830899.437739:0:10060:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d230833b180 going to sleep for 11 seconds 00000100:00100000:2.0:1787830899.437761:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443816192 00000100:00100000:2.0:1787830899.437766:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443816192 00000100:00100000:2.0:1787830899.437806:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1787830899.437814:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a681450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+17:10060:x1874676443816192:12345-0@lo:502: 00000100:00100000:2.0:1787830899.437887:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a681450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+17:10060:x1874676443816192:12345-0@lo:502: Request processed in 74us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830899.437895:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1787830899.437903:0:10060:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22037903c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:10060:1874676443816192:0@lo:502: 00000020:01000000:3.0:1787830899.437929:0:10060:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787830899.437933:0:10060:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787830899.437934:0:10060:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787830899.437938:0:10060:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:2.0:1787830899.438019:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:2.0:1787830899.438050:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1787830899.438059:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233837ac00/0x95459fb9d1d28815 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2881c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830899.438070:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8d233837ac00/0x95459fb9d1d28815 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2881c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787830899.438080:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787830899.438090:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d232f730000 from 39 10000000:01000000:2.0:1787830899.438093:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787830899.438117:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233837a000/0x95459fb9d1d28823 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830899.438125:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8d233837a000/0x95459fb9d1d28823 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830899.438134:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8d233837a000/0x95459fb9d1d28823 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830899.438145:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2336bff0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443816320:0@lo:101: 00000100:00100000:2.0:1787830899.438175:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830899.438200:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2334484a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787830899.438320:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443816320 00000100:00100000:1.0:1787830899.438325:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443816320 00000100:00100000:1.0:1787830899.438354:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1787830899.438360:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a680c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+17:6487:x1874676443816320:12345-0@lo:101: 00010000:00010000:1.0:1787830899.438369:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787830899.438383:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d233be94e00/0x95459fb9d1d2882a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d28823 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830899.438402:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d233be94e00/0x95459fb9d1d2882a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d28823 expref: 18 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830899.438411:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d233be94e00/0x95459fb9d1d2882a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d28823 expref: 18 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830899.438419:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233be94e00, rc 0) 00000100:00100000:1.0:1787830899.438454:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a680c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+18:6487:x1874676443816320:12345-0@lo:101: Request processed in 94us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830899.438461:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1787830899.438495:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2336bff0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443816320:0@lo:101: 00010000:00010000:2.0:1787830899.438515:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8d233837a000/0x95459fb9d1d28823 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2882a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830899.438523:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8d233837a000/0x95459fb9d1d28823 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d2882a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830899.438579:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2336bff0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443816448:0@lo:501: 00000100:00100000:2.0:1787830899.438615:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830899.438667:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2334484a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787830899.438940:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443816448 00000100:00100000:1.0:1787830899.438944:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443816448 00000100:00100000:1.0:1787830899.438963:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1787830899.438968:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a682c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+18:6487:x1874676443816448:12345-0@lo:501: 00000100:00100000:1.0:1787830899.439067:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a682c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+18:6487:x1874676443816448:12345-0@lo:501: Request processed in 98us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830899.439074:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1787830899.439178:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2336bff0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443816448:0@lo:501: 00000100:00100000:2.0:1787830899.439202:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2336bff0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443816576:0@lo:503: 00000100:00100000:2.0:1787830899.439232:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830899.439255:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2334484a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787830899.439381:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443816576 00000100:00100000:1.0:1787830899.439385:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443816576 00000100:00100000:1.0:1787830899.439409:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1787830899.439415:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a683450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+18:6487:x1874676443816576:12345-0@lo:503: 00000100:00100000:1.0:1787830899.439491:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a683450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+18:6487:x1874676443816576:12345-0@lo:503: Request processed in 75us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830899.439498:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1787830899.439527:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2336bff0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443816576:0@lo:503: 00000100:00100000:2.0:1787830899.439925:0:10061:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2336bfcf00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:10061:1874676443816704:0@lo:502: 00000100:00100000:2.0:1787830899.439959:0:10061:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830899.439986:0:10061:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2334484a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787830899.440068:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443816704 00000100:00100000:0.0:1787830899.440072:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443816704 00000100:00100000:0.0:1787830899.440101:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1787830899.440109:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a681850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+18:10061:x1874676443816704:12345-0@lo:502: 00000100:00100000:0.0:1787830899.440182:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a681850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+18:10061:x1874676443816704:12345-0@lo:502: Request processed in 73us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830899.440188:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1787830899.440277:0:10061:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2336bfcf00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:10061:1874676443816704:0@lo:502: 00000100:00100000:2.0:1787830899.440315:0:10061:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2336bfcf00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:10061:1874676443816832:0@lo:502: 00000100:00100000:2.0:1787830899.440344:0:10061:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830899.440363:0:10061:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2334484a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787830899.440407:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443816832 00000100:00100000:1.0:1787830899.440410:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443816832 00000100:00100000:1.0:1787830899.440432:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1787830899.440442:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d231859cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+18:10061:x1874676443816832:12345-0@lo:502: 00000100:00100000:1.0:1787830899.440516:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d231859cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+18:10061:x1874676443816832:12345-0@lo:502: Request processed in 73us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830899.440522:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1787830899.440660:0:10061:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2336bfcf00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:10061:1874676443816832:0@lo:502: 00000040:00080000:2.0:1787830899.440677:0:10061:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:3.0:1787830899.440743:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:3.0:1787830899.440769:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787830899.440780:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233837a000/0x95459fb9d1d28823 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2882a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830899.440791:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8d233837a000/0x95459fb9d1d28823 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2882a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787830899.440800:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787830899.440810:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d232f730000 from 6 10000000:01000000:3.0:1787830899.440812:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787830899.440836:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d2307c77000/0x95459fb9d1d28831 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830899.440844:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8d2307c77000/0x95459fb9d1d28831 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830899.440859:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8d2307c77000/0x95459fb9d1d28831 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830899.440872:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22037903c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443816960:0@lo:101: 00000100:00100000:3.0:1787830899.440902:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830899.440926:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d230833b180 going to sleep for 11 seconds 00000100:00100000:1.0:1787830899.440944:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443816960 00000100:00100000:1.0:1787830899.440949:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443816960 00000100:00100000:1.0:1787830899.440972:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1787830899.440978:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d231859ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+18:6487:x1874676443816960:12345-0@lo:101: 00010000:00010000:1.0:1787830899.440986:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787830899.440998:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d233be95a00/0x95459fb9d1d28838 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d28831 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830899.441018:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d233be95a00/0x95459fb9d1d28838 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d28831 expref: 19 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830899.441028:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d233be95a00/0x95459fb9d1d28838 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d28831 expref: 19 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830899.441037:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233be95a00, rc 0) 00000100:00100000:1.0:1787830899.441071:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d231859ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+19:6487:x1874676443816960:12345-0@lo:101: Request processed in 93us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830899.441077:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1787830899.441106:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22037903c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443816960:0@lo:101: 00010000:00010000:3.0:1787830899.441119:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8d2307c77000/0x95459fb9d1d28831 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d28838 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830899.441128:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8d2307c77000/0x95459fb9d1d28831 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d28838 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830899.441173:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22037903c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443817088:0@lo:256: 00000100:00100000:3.0:1787830899.441205:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830899.441222:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d230833b180 going to sleep for 11 seconds 00000100:00100000:1.0:1787830899.441253:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443817088 00000100:00100000:1.0:1787830899.441263:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443817088 00000100:00100000:1.0:1787830899.441295:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1787830899.441303:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d231859f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+19:6487:x1874676443817088:12345-0@lo:256: 20000000:01000000:1.0:1787830899.441327:0:6485:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787830899.441354:0:6485:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787830899.441358:0:6485:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1787830899.441426:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d231859f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+19:6487:x1874676443817088:12345-0@lo:256: Request processed in 124us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830899.441432:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1787830899.441444:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22037903c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443817088:0@lo:256: 10000000:01000000:3.0:1787830899.441489:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787830899.441495:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d2307c77000/0x95459fb9d1d28831 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d28838 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830899.441522:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8d2307c77000/0x95459fb9d1d28831 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d28838 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787830899.441528:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1787830899.441530:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:3.0:1787830899.441533:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1787830899.441546:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d2307c77600/0x95459fb9d1d2883f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830899.441568:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8d2307c77600/0x95459fb9d1d2883f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830899.441575:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8d2307c77600/0x95459fb9d1d2883f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830899.441587:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22037903c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443817216:0@lo:101: 00000100:00100000:3.0:1787830899.441612:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830899.441658:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d230833b180 going to sleep for 11 seconds 00000100:00100000:1.0:1787830899.441709:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443817216 00000100:00100000:1.0:1787830899.441713:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443817216 00000100:00100000:1.0:1787830899.441738:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1787830899.441744:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d231859d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+19:6487:x1874676443817216:12345-0@lo:101: 00010000:00010000:1.0:1787830899.441751:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787830899.441759:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d233be94000/0x95459fb9d1d28846 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d2883f expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830899.441773:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d233be94000/0x95459fb9d1d28846 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d2883f expref: 20 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830899.441781:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d233be94000/0x95459fb9d1d28846 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d2883f expref: 20 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830899.441787:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233be94000, rc 0) 00000100:00100000:1.0:1787830899.441853:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d231859d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+20:6487:x1874676443817216:12345-0@lo:101: Request processed in 109us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830899.441865:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1787830899.441917:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22037903c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443817216:0@lo:101: 00010000:00010000:3.0:1787830899.441928:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8d2307c77600/0x95459fb9d1d2883f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d28846 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830899.441934:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8d2307c77600/0x95459fb9d1d2883f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d28846 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830899.441983:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22037903c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443817344:0@lo:501: 00000100:00100000:3.0:1787830899.442006:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830899.442063:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d230833b180 going to sleep for 11 seconds 00000100:00100000:1.0:1787830899.442091:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443817344 00000100:00100000:1.0:1787830899.442095:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443817344 00000100:00100000:1.0:1787830899.442126:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1787830899.442135:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d231859d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+20:6487:x1874676443817344:12345-0@lo:501: 00000100:00100000:1.0:1787830899.442249:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d231859d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+20:6487:x1874676443817344:12345-0@lo:501: Request processed in 116us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830899.442256:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1787830899.442289:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22037903c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443817344:0@lo:501: 00000100:00100000:3.0:1787830899.442320:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22037903c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443817472:0@lo:503: 00000100:00100000:3.0:1787830899.442366:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830899.442389:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d230833b180 going to sleep for 11 seconds 00000100:00100000:1.0:1787830899.442427:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443817472 00000100:00100000:1.0:1787830899.442432:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443817472 00000100:00100000:1.0:1787830899.442465:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1787830899.442472:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d231859c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+20:6487:x1874676443817472:12345-0@lo:503: 00000100:00100000:1.0:1787830899.442565:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d231859c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+20:6487:x1874676443817472:12345-0@lo:503: Request processed in 79us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830899.442572:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1787830899.442601:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22037903c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443817472:0@lo:503: 00000100:00100000:3.0:1787830899.443001:0:10062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22037903c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:10062:1874676443817600:0@lo:502: 00000100:00100000:3.0:1787830899.443053:0:10062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830899.443080:0:10062:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d230833b180 going to sleep for 11 seconds 00000100:00100000:0.0:1787830899.443095:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443817600 00000100:00100000:0.0:1787830899.443101:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443817600 00000100:00100000:0.0:1787830899.443135:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1787830899.443144:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d231859e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+20:10062:x1874676443817600:12345-0@lo:502: 00000100:00100000:0.0:1787830899.443231:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d231859e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+20:10062:x1874676443817600:12345-0@lo:502: Request processed in 88us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830899.443238:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1787830899.443494:0:10062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22037903c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:10062:1874676443817600:0@lo:502: 00000020:01000000:3.0:1787830899.443515:0:10062:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787830899.443522:0:10062:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1787830899.443528:0:10062:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787830899.443530:0:10062:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1787830899.443537:0:10062:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787830899.443540:0:10062:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.131@tcp to nid 0x20000c0a8cb83 (192.168.203.131@tcp) 00000020:01000000:3.0:1787830899.443587:0:10062:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1787830899.443590:0:10062:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787830899.443613:0:10062:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff8d23344a19b8) 00000020:00000080:3.0:1787830899.443669:0:10062:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:3.0:1787830899.443678:0:10062:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787830899.443766:0:10062:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:3.0:1787830899.443773:0:10062:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:3.0:1787830899.443781:0:10062:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x95459fb9d1d28854 00010000:00080000:3.0:1787830899.443829:0:10062:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d233bd97800@lustre-OST0001-osc-MDT0001: add connection 192.168.203.131@tcp at head 00010000:00010000:3.0:1787830899.444109:0:10062:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:3.0:1787830899.444267:0:10062:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1787830899.444286:0:10062:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1787830899.444499:0:10062:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787830899.444599:0:10062:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787830899.444798:0:10062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1787830899.444873:0:10062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1787830899.445149:0:10063:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787830899.445155:0:10063:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1787830899.447930:0:10062:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787830899.447949:0:10062:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787830899.448088:0:10062:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1787830899.448128:0:10062:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x95459fb9d1d2885b 00000100:00080000:0.0:1787830899.448140:0:10062:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787830899.448147:0:10062:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8d233bd97800 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:0.0:1787830899.448251:0:10062:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2201def480 x1874676443817728/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787830899.448296:0:10062:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1787830899.448373:0:10062:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787830899.448378:0:10062:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787830899.448380:0:10062:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1787830899.448384:0:10062:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787830899.448389:0:10062:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787830899.448391:0:10062:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787830899.448395:0:10062:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787830899.448397:0:10062:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1787830899.448437:0:10062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2201dec3c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:10062:1874676443818112:0@lo:502: 00000100:00100000:2.0:1787830899.448457:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d232f6ca940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874676443818240:0@lo:400: 00000100:00100000:1.0:1787830899.448503:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d232f6c83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3621:1874676443817856:0@lo:400: 00000100:00100000:3.0:1787830899.448546:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2201def480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1874676443817728:0@lo:8: 00000100:00100000:2.0:1787830899.448565:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830899.448573:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d232f6c9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676443817984:0@lo:400: 00000100:00100000:3.0:1787830899.448613:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830899.448649:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830899.448651:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2314e72940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443818752:0@lo:400: 00000100:00100000:1.0:1787830899.448683:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d232f6ca580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3622:1874676443818624:0@lo:400: 00000100:00100000:2.0:1787830899.448694:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830899.448719:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830899.448726:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787830899.448734:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d232f6c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443818368:0@lo:400: 00000100:00100000:1.0:1787830899.448740:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233be74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3622:1874676443819136:0@lo:400: 00000100:00100000:3.0:1787830899.448762:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443817728 00000100:00100000:1.0:1787830899.448768:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830899.448770:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443817728 00000100:00100000:2.0:1787830899.448775:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830899.448805:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2314e71e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443818880:0@lo:400: 00000100:00100000:3.0:1787830899.448806:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443818752 00000100:00100000:3.0:1787830899.448811:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443818752 00000100:00100000:1.0:1787830899.448828:0:8631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787830899.448835:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830899.448840:0:8631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22037903c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3618:x1874676443817728:12345-0@lo:8: 00000100:00100000:3.0:1787830899.448852:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443818880 00000100:00100000:3.0:1787830899.448856:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443818880 00010000:00080000:1.0:1787830899.448872:0:8631:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 190 last 0 00000100:00100000:2.0:1787830899.448875:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443818240 00000100:00100000:3.0:1787830899.448879:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787830899.448881:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443818240 00000100:00100000:3.0:1787830899.448887:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2336bff0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443818752:12345-0@lo:400: 00000020:00000080:1.0:1787830899.448928:0:8631:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x95459fb9d1d28862 00000100:00100000:2.0:1787830899.448931:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443818624 00000100:00100000:2.0:1787830899.448935:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443818624 00000100:00100000:3.0:1787830899.448950:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2336bff0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443818752:12345-0@lo:400: Request processed in 63us (255us total) trans 0 rc 0/0 00002000:00100000:1.0:1787830899.448952:0:8631:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff8d233bd1e000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211393d ocd_grant: 0 ocd_index: 1 ocd_group 1 00000100:00100000:2.0:1787830899.448953:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443819136 00000100:00100000:2.0:1787830899.448957:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443819136 00002000:00080000:1.0:1787830899.448960:0:8631:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000100:00100000:3.0:1787830899.448961:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000001:00000004:1.0:1787830899.448968:0:8631:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:2.0:1787830899.448975:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787830899.448984:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2336bfcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874676443818240:12345-0@lo:400: 00000100:00100000:3.0:1787830899.448994:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787830899.449004:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2336bff840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676443818880:12345-0@lo:400: 00000100:00100000:2.0:1787830899.449023:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2336bfcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874676443818240:12345-0@lo:400: Request processed in 40us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830899.449031:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787830899.449043:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2336bff840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676443818880:12345-0@lo:400: Request processed in 41us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830899.449053:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00002000:00100000:1.0:1787830899.449053:0:8631:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:2.0:1787830899.449054:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787830899.449066:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2314ed4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1874676443818624:12345-0@lo:400: 00000100:00080000:3.0:1787830899.449080:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787830899.449085:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787830899.449103:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787830899.449113:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2314ed4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1874676443819136:12345-0@lo:400: 00000100:00100000:2.0:1787830899.449120:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2314ed4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1874676443818624:12345-0@lo:400: Request processed in 56us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830899.449133:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787830899.449173:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2314ed4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1874676443819136:12345-0@lo:400: Request processed in 61us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830899.449181:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:3.0:1787830899.449217:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2314e71e00 x1874676443818880/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787830915 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787830899.449230:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2314e71e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443818880:0@lo:400: 00010000:00080000:3.0:1787830899.449243:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2314e72940 x1874676443818752/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787830915 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787830899.449253:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2314e72940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443818752:0@lo:400: 00010000:00080000:3.0:1787830899.449263:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d232f6ca940 x1874676443818240/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830915 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787830899.449272:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d232f6ca940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874676443818240:0@lo:400: 00000100:00100000:0.0:1787830899.449351:0:10062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830899.449373:0:10062:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d233be68180 going to sleep for 11 seconds 00002000:00080000:1.0:1787830899.449391:0:8631:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00100000:2.0:1787830899.449392:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443818112 00000100:00100000:2.0:1787830899.449398:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443818112 00000100:00080000:1.0:1787830899.449421:0:8631:0:(import.c:65:import_set_state_nolock()) ffff8d233bd1f800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787830899.449475:0:8631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22037903c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3618:x1874676443817728:12345-0@lo:8: Request processed in 638us (862us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830899.449482:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1787830899.449487:0:8631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787830899.449494:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d231859f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+20:10062:x1874676443818112:12345-0@lo:502: 00000100:00100000:1.0:1787830899.449511:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443817984 00000100:00100000:1.0:1787830899.449516:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443817984 00010000:00080000:3.0:1787830899.449536:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2201def480 x1874676443817728/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787830909 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787830899.449546:0:3618:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00100000:1.0:1787830899.449562:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443818368 00000100:00080000:3.0:1787830899.449566:0:3618:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00100000:1.0:1787830899.449567:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443818368 00000100:00080000:3.0:1787830899.449576:0:3618:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787830899.449583:0:3618:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1787830899.449587:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8d233bd97800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787830899.449590:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787830899.449597:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233be74b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676443817984:12345-0@lo:400: 00000004:00080000:3.0:1787830899.449604:0:3618:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787830899.449611:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2201def480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1874676443817728:0@lo:8: 00000004:00080000:3.0:1787830899.449654:0:10063:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:1.0:1787830899.449662:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233be74b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676443817984:12345-0@lo:400: Request processed in 63us (1013us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830899.449670:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787830899.449676:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d231859f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+20:10062:x1874676443818112:12345-0@lo:502: Request processed in 182us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830899.449689:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787830899.449693:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1787830899.449700:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2336bffc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676443818368:12345-0@lo:400: 00000004:00080000:3.0:1787830899.449710:0:10063:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 190450084420ns, next at 0ns, rc = 0 00080000:00080000:3.0:1787830899.449718:0:10063:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1787830899.449741:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2336bffc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676443818368:12345-0@lo:400: Request processed in 45us (967us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830899.449747:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787830899.449777:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830899.449800:0:10062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2201dec3c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:10062:1874676443818112:0@lo:502: 00000100:00100000:3.0:1787830899.449802:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443817856 00000100:00100000:1.0:1787830899.449807:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d232f6c9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3621:1874676443818496:0@lo:400: 00000100:00100000:3.0:1787830899.449808:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443817856 00000020:01000000:0.0:1787830899.449833:0:10062:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000100:00100000:3.0:1787830899.449838:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000020:00000080:0.0:1787830899.449841:0:10062:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000100:00100000:1.0:1787830899.449844:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:0.0:1787830899.449845:0:10062:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000100:00100000:3.0:1787830899.449849:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2314ed52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1874676443817856:12345-0@lo:400: 00000040:00080000:0.0:1787830899.449853:0:10062:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000100:00100000:1.0:1787830899.449881:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233be77c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3621:1874676443819008:0@lo:400: 00000100:00100000:3.0:1787830899.449893:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2314ed52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1874676443817856:12345-0@lo:400: Request processed in 47us (115us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830899.449899:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787830899.449912:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443818496 00000100:00100000:3.0:1787830899.449915:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443818496 00000100:00100000:1.0:1787830899.449932:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:0.0:1787830899.449932:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 00000100:00100000:3.0:1787830899.449938:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443819008 00000100:00100000:3.0:1787830899.449941:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443819008 10000000:01000000:0.0:1787830899.449960:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00000100:00100000:3.0:1787830899.449965:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00010000:00010000:0.0:1787830899.449970:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d2307c77600/0x95459fb9d1d2883f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d28846 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830899.449979:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8d2307c77600/0x95459fb9d1d2883f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d28846 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:1.0:1787830899.449980:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d232f6c83c0 x1874676443817856/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830915 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787830899.449983:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2314ed70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1874676443818496:12345-0@lo:400: 10000000:01000000:0.0:1787830899.450002:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 00000100:00100000:1.0:1787830899.450004:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d232f6c83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3621:1874676443817856:0@lo:400: 10000000:01000000:0.0:1787830899.450005:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d2303f2e000 from 39 10000000:01000000:0.0:1787830899.450009:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00000100:00100000:3.0:1787830899.450035:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2314ed70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1874676443818496:12345-0@lo:400: Request processed in 62us (191us total) trans 0 rc 0/0 00010000:00080000:1.0:1787830899.450038:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d232f6c9680 x1874676443818496/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830915 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1787830899.450038:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233bf11c00/0x95459fb9d1d28869 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830899.450046:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00010000:0.0:1787830899.450062:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8d233bf11c00/0x95459fb9d1d28869 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830899.450063:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787830899.450064:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d232f6c9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3621:1874676443818496:0@lo:400: 00000100:00100000:3.0:1787830899.450077:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2314ed7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1874676443819008:12345-0@lo:400: 00010000:00010000:0.0:1787830899.450078:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8d233bf11c00/0x95459fb9d1d28869 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830899.450100:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d232f6c9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676443817984:0@lo:400: 00000100:00100000:0.0:1787830899.450108:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2201dec3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443819264:0@lo:101: 00010000:00080000:1.0:1787830899.450117:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d232f6ca580 x1874676443818624/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830915 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787830899.450121:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2314ed7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1874676443819008:12345-0@lo:400: Request processed in 46us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830899.450135:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787830899.450138:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d232f6ca580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3622:1874676443818624:0@lo:400: 00000100:00100000:0.0:1787830899.450145:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1787830899.450153:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d233be74000 x1874676443819136/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830915 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787830899.450157:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787830899.450160:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233be74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3622:1874676443819136:0@lo:400: 00000100:00100000:0.0:1787830899.450182:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d233be68180 going to sleep for 11 seconds 00010000:00080000:1.0:1787830899.450194:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d233be77c00 x1874676443819008/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830915 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787830899.450199:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233be77c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3621:1874676443819008:0@lo:400: 00000100:00100000:1.0:1787830899.450216:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d232f6c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443818368:0@lo:400: 00000100:00100000:1.0:1787830899.450233:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443819264 00000100:00100000:1.0:1787830899.450235:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443819264 00000100:00100000:1.0:1787830899.450262:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1787830899.450271:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d231859e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+20:6487:x1874676443819264:12345-0@lo:101: 00010000:00010000:1.0:1787830899.450286:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787830899.450300:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d233be95000/0x95459fb9d1d28870 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d28869 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830899.450324:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d233be95000/0x95459fb9d1d28870 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d28869 expref: 21 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830899.450335:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d233be95000/0x95459fb9d1d28870 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d28869 expref: 21 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830899.450344:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233be95000, rc 0) 00000100:00100000:1.0:1787830899.450378:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d231859e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+21:6487:x1874676443819264:12345-0@lo:101: Request processed in 109us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830899.450383:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1787830899.450603:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2201dec3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443819264:0@lo:101: 00010000:00010000:0.0:1787830899.450617:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8d233bf11c00/0x95459fb9d1d28869 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d28870 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830899.450708:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8d233bf11c00/0x95459fb9d1d28869 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d28870 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830899.450772:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2201dec3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443819392:0@lo:501: 00000100:00100000:0.0:1787830899.450805:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830899.450821:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d233be68180 going to sleep for 11 seconds 00000100:00100000:2.0:1787830899.450910:0:10064:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2336bfda40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10064:1874676443819520:0@lo:700: 00000100:00100000:2.0:1787830899.450961:0:10064:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830899.450988:0:10064:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2334484d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787830899.451009:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443819392 00000100:00100000:3.0:1787830899.451014:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443819392 00000100:00100000:3.0:1787830899.451041:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1787830899.451050:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d231859f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+21:6487:x1874676443819392:12345-0@lo:501: 00000100:00100000:3.0:1787830899.451184:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d231859f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+21:6487:x1874676443819392:12345-0@lo:501: Request processed in 135us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830899.451201:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1787830899.451386:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2201dec3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443819392:0@lo:501: 00000100:00100000:2.0:1787830899.451415:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2336bfc3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443819648:0@lo:503: 00000100:00100000:2.0:1787830899.451454:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830899.451467:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443819520 00000100:00100000:0.0:1787830899.451473:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443819520 00000100:00100000:2.0:1787830899.451486:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2334484780 going to sleep for 11 seconds 00000100:00100000:1.0:1787830899.451504:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443819648 00000100:00100000:1.0:1787830899.451510:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443819648 00000100:00100000:0.0:1787830899.451530:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787830899.451541:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2336bfcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:10064:x1874676443819520:12345-0@lo:700: 00000100:00100000:1.0:1787830899.451570:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1787830899.451580:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d231859fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+21:6487:x1874676443819648:12345-0@lo:503: 00000100:00100000:0.0:1787830899.451587:0:8415:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2201dec3c0 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8415:1874676443819776:0@lo:700: 00000100:00100000:0.0:1787830899.451652:0:8415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830899.451675:0:8415:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d233be68240 going to sleep for 11 seconds 00000100:00100000:1.0:1787830899.451703:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d231859fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+21:6487:x1874676443819648:12345-0@lo:503: Request processed in 123us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830899.451708:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443819776 00000100:00100000:1.0:1787830899.451713:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1787830899.451714:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443819776 00000100:00100000:0.0:1787830899.451757:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787830899.451759:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2336bfc3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443819648:0@lo:503: 00000100:00100000:0.0:1787830899.451769:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2201def480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8415:x1874676443819776:12345-0@lo:700: 00000100:00080000:0.0:1787830899.451885:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787830899.452063:0:10065:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2314ed61c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:10065:1874676443819904:0@lo:502: 00000100:00100000:1.0:1787830899.452099:0:10065:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830899.452144:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443819904 00000100:00100000:1.0:1787830899.452149:0:10065:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2310a403c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787830899.452150:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443819904 00000100:00100000:0.0:1787830899.452178:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1787830899.452185:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d231859c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+21:10065:x1874676443819904:12345-0@lo:502: 00000100:00100000:0.0:1787830899.452273:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d231859c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+21:10065:x1874676443819904:12345-0@lo:502: Request processed in 87us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830899.452281:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1787830899.452345:0:10065:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2314ed61c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:10065:1874676443819904:0@lo:502: 00000100:00100000:1.0:1787830899.452389:0:10065:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2314ed61c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:10065:1874676443820032:0@lo:502: 00000100:00100000:1.0:1787830899.452426:0:10065:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830899.452446:0:10065:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d233bcbcb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787830899.452498:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443820032 00000100:00100000:2.0:1787830899.452502:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443820032 00000100:00100000:2.0:1787830899.452534:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1787830899.452542:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d231859c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+21:10065:x1874676443820032:12345-0@lo:502: 00000100:00100000:2.0:1787830899.452661:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d231859c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+21:10065:x1874676443820032:12345-0@lo:502: Request processed in 119us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830899.452668:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000004:00080000:3.0:1787830899.452761:0:7421:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000001:00100000:3.0:1787830899.452783:0:7421:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 47d7f0ed-283f-4b70-a741-6e74c5e52619 00000100:00100000:1.0:1787830899.452817:0:10065:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2314ed61c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:10065:1874676443820032:0@lo:502: 00000040:00080000:1.0:1787830899.452839:0:10065:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:0.0:1787830899.452916:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:0.0:1787830899.452945:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787830899.452954:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233bf11c00/0x95459fb9d1d28869 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d28870 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830899.452983:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8d233bf11c00/0x95459fb9d1d28869 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d28870 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787830899.452994:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787830899.452997:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d2303f2e000 from 6 10000000:01000000:0.0:1787830899.453001:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787830899.453031:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233bf11e00/0x95459fb9d1d28877 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830899.453040:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8d233bf11e00/0x95459fb9d1d28877 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830899.453049:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8d233bf11e00/0x95459fb9d1d28877 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830899.453068:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220258f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443820160:0@lo:101: 00000100:00100000:0.0:1787830899.453113:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830899.453142:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d233be68a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787830899.453154:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443820160 00000100:00100000:3.0:1787830899.453158:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443820160 00000100:00100000:3.0:1787830899.453191:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1787830899.453200:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d231859dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+21:6487:x1874676443820160:12345-0@lo:101: 00010000:00010000:3.0:1787830899.453209:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787830899.453221:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2307c76800/0x95459fb9d1d2887e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d28877 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830899.453241:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2307c76800/0x95459fb9d1d2887e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d28877 expref: 22 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830899.453249:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2307c76800/0x95459fb9d1d2887e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d28877 expref: 22 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830899.453255:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2307c76800, rc 0) 00000100:00100000:3.0:1787830899.453281:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d231859dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+22:6487:x1874676443820160:12345-0@lo:101: Request processed in 85us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830899.453286:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1787830899.453327:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220258f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443820160:0@lo:101: 00010000:00010000:0.0:1787830899.453340:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8d233bf11e00/0x95459fb9d1d28877 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2887e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830899.453348:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8d233bf11e00/0x95459fb9d1d28877 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d2887e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830899.453417:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220258f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443820288:0@lo:256: 00000100:00100000:0.0:1787830899.453476:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830899.453490:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d233be68a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787830899.453511:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443820288 00000001:00100000:2.0:1787830899.453516:0:6469:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 47d7f0ed-283f-4b70-a741-6e74c5e52619 00000100:00100000:1.0:1787830899.453517:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443820288 40000000:02000000:0.0:1787830899.453565:0:6497:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000100:00100000:1.0:1787830899.453566:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1787830899.453580:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d231859e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+22:6487:x1874676443820288:12345-0@lo:256: 20000000:01000000:1.0:1787830899.453596:0:6484:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787830899.453616:0:6484:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787830899.453620:0:6484:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1787830899.453755:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d231859e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+22:6487:x1874676443820288:12345-0@lo:256: Request processed in 178us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830899.453763:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1787830899.453824:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220258f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443820288:0@lo:256: 10000000:01000000:3.0:1787830899.453868:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787830899.453874:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233bf11e00/0x95459fb9d1d28877 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2887e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830899.453882:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8d233bf11e00/0x95459fb9d1d28877 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2887e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787830899.453895:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1787830899.453897:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:3.0:1787830899.453899:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787830899.453915:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d2307c76600/0x95459fb9d1d28885 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830899.453923:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8d2307c76600/0x95459fb9d1d28885 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830899.453930:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8d2307c76600/0x95459fb9d1d28885 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830899.453943:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203793480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443820416:0@lo:101: 00000100:00100000:3.0:1787830899.453969:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830899.453995:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d230833bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1787830899.454007:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443820416 00000100:00100000:2.0:1787830899.454013:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443820416 00000100:00100000:2.0:1787830899.454042:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1787830899.454050:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d231859d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+22:6487:x1874676443820416:12345-0@lo:101: 00010000:00010000:2.0:1787830899.454059:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787830899.454069:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d233837ae00/0x95459fb9d1d2888c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d28885 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830899.454092:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d233837ae00/0x95459fb9d1d2888c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d28885 expref: 23 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830899.454114:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d233837ae00/0x95459fb9d1d2888c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d28885 expref: 23 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830899.454122:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233837ae00, rc 0) 00000100:00100000:2.0:1787830899.454162:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d231859d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+23:6487:x1874676443820416:12345-0@lo:101: Request processed in 113us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830899.454169:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1787830899.454195:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203793480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443820416:0@lo:101: 00010000:00010000:3.0:1787830899.454209:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8d2307c76600/0x95459fb9d1d28885 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2888c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830899.454216:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8d2307c76600/0x95459fb9d1d28885 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d2888c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830899.454269:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203793480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443820544:0@lo:501: 00000100:00100000:3.0:1787830899.454293:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830899.454315:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d230833bf00 going to sleep for 11 seconds 00000100:00100000:1.0:1787830899.454362:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443820544 00000100:00100000:1.0:1787830899.454368:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443820544 00000100:00100000:1.0:1787830899.454393:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1787830899.454399:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2310886050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+23:6487:x1874676443820544:12345-0@lo:501: 00000100:00100000:1.0:1787830899.454487:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2310886050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+23:6487:x1874676443820544:12345-0@lo:501: Request processed in 88us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830899.454495:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1787830899.454509:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203793480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443820544:0@lo:501: 00000100:00100000:3.0:1787830899.454539:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203793480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443820672:0@lo:503: 00000100:00100000:3.0:1787830899.454595:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830899.454611:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d230833bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1787830899.454652:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443820672 00000100:00100000:2.0:1787830899.454658:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443820672 00000100:00100000:2.0:1787830899.454683:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1787830899.454692:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2310884850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+23:6487:x1874676443820672:12345-0@lo:503: 00000100:00100000:2.0:1787830899.454768:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2310884850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+23:6487:x1874676443820672:12345-0@lo:503: Request processed in 77us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830899.454776:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1787830899.454786:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203793480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443820672:0@lo:503: 00000100:00100000:3.0:1787830899.455109:0:10066:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203793480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:10066:1874676443820800:0@lo:502: 00000100:00100000:3.0:1787830899.455145:0:10066:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830899.455172:0:10066:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d230833b9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787830899.455200:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443820800 00000100:00100000:1.0:1787830899.455205:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443820800 00000100:00100000:1.0:1787830899.455236:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1787830899.455243:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2310887c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+23:10066:x1874676443820800:12345-0@lo:502: 00000100:00100000:1.0:1787830899.455322:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2310887c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+23:10066:x1874676443820800:12345-0@lo:502: Request processed in 79us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830899.455337:0:10066:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203793480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:10066:1874676443820800:0@lo:502: 00000100:00100000:1.0:1787830899.455351:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000020:01000000:3.0:1787830899.455360:0:10066:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787830899.455370:0:10066:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1787830899.455378:0:10066:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787830899.455381:0:10066:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1787830899.455387:0:10066:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787830899.455392:0:10066:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.131@tcp to nid 0x20000c0a8cb83 (192.168.203.131@tcp) 00000020:01000000:3.0:1787830899.455418:0:10066:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1787830899.455421:0:10066:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787830899.455438:0:10066:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8d23344a0000) 00000020:00000080:3.0:1787830899.455463:0:10066:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:3.0:1787830899.455469:0:10066:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787830899.455576:0:10066:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1787830899.455582:0:10066:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:3.0:1787830899.455591:0:10066:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x95459fb9d1d2889a 00010000:00080000:3.0:1787830899.455643:0:10066:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d233f547800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.131@tcp at head 00010000:00010000:3.0:1787830899.455914:0:10066:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:3.0:1787830899.456079:0:10066:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1787830899.456095:0:10066:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1787830899.456295:0:10066:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787830899.456464:0:10066:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787830899.456702:0:10066:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1787830899.456823:0:10066:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1787830899.457107:0:10067:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787830899.457113:0:10067:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000100:00100000:0.0:1787830899.457788:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2201def480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8415:x1874676443819776:12345-0@lo:700: Request processed in 6021us (6161us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830899.457798:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787830899.457829:0:8415:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2201dec3c0 x1874676443819776/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787830915 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787830899.457845:0:8415:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2201dec3c0 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8415:1874676443819776:0@lo:700: 40000000:02000000:3.0:1787830899.457860:0:8415:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000020:00000080:1.0:1787830899.457998:0:10066:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787830899.458010:0:10066:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787830899.458068:0:10066:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1787830899.458097:0:10066:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x95459fb9d1d288a1 00000100:00080000:1.0:1787830899.458106:0:10066:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787830899.458112:0:10066:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d233f547800 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:1.0:1787830899.458142:0:10066:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2314ed61c0 x1874676443820928/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787830899.458172:0:10066:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:2.0:1787830899.458211:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2314ed61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1874676443820928:0@lo:8: 00000020:01000000:1.0:1787830899.458232:0:10066:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787830899.458237:0:10066:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787830899.458239:0:10066:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1787830899.458242:0:10066:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787830899.458246:0:10066:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787830899.458248:0:10066:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787830899.458250:0:10066:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787830899.458252:0:10066:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1787830899.458267:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830899.458273:0:10066:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233be77c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:10066:1874676443821056:0@lo:502: 00000100:00100000:1.0:1787830899.458315:0:10066:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830899.458335:0:10066:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d233bcbc9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787830899.458344:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443820928 00000100:00100000:2.0:1787830899.458351:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443820928 00000100:00100000:0.0:1787830899.458354:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443821056 00000100:00100000:0.0:1787830899.458360:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443821056 00000100:00100000:2.0:1787830899.458387:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787830899.458395:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2336bfe940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3618:x1874676443820928:12345-0@lo:8: 00000100:00100000:0.0:1787830899.458408:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00010000:00080000:2.0:1787830899.458418:0:8406:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 190 last 0 00000100:00100000:0.0:1787830899.458420:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2310887450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+23:10066:x1874676443821056:12345-0@lo:502: 00000020:00000080:2.0:1787830899.458445:0:8406:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x95459fb9d1d288a8 00002000:00100000:2.0:1787830899.458460:0:8406:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8d2202a83000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211393d ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1787830899.458463:0:8406:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1787830899.458466:0:8406:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:0.0:1787830899.458545:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2310887450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+23:10066:x1874676443821056:12345-0@lo:502: Request processed in 127us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830899.458569:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00002000:00080000:2.0:1787830899.458572:0:8406:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00100000:1.0:1787830899.458601:0:10066:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233be77c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:10066:1874676443821056:0@lo:502: 00000100:00080000:2.0:1787830899.458611:0:8406:0:(import.c:65:import_set_state_nolock()) ffff8d2202a86000 : changing import state from RECOVER to FULL 00000020:01000000:1.0:1787830899.458642:0:10066:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787830899.458645:0:10066:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787830899.458646:0:10066:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787830899.458649:0:10066:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000100:00100000:2.0:1787830899.458682:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2336bfe940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3618:x1874676443820928:12345-0@lo:8: Request processed in 285us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830899.458691:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000020:01000000:1.0:1787830899.458711:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 00010000:00080000:2.0:1787830899.458733:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2314ed61c0 x1874676443820928/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787830909 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1787830899.458744:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00000100:00100000:2.0:1787830899.458746:0:3618:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787830899.458753:0:3618:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00010000:00010000:1.0:1787830899.458761:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d2307c76600/0x95459fb9d1d28885 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2888c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787830899.458763:0:3618:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787830899.458769:0:3618:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1787830899.458773:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8d233f547800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00010000:00010000:1.0:1787830899.458777:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8d2307c76600/0x95459fb9d1d28885 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2888c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787830899.458784:0:3618:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787830899.458791:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2314ed61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1874676443820928:0@lo:8: 10000000:01000000:1.0:1787830899.458791:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1787830899.458796:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8d2312953370 from 1 10000000:01000000:1.0:1787830899.458802:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787830899.458826:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233be94200/0x95459fb9d1d288af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830899.458832:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8d233be94200/0x95459fb9d1d288af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830899.458839:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8d233be94200/0x95459fb9d1d288af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830899.458847:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233be77c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443821184:0@lo:101: 00000100:00100000:1.0:1787830899.458877:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830899.458897:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d233bcbc9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787830899.458921:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443821184 00000100:00100000:2.0:1787830899.458926:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443821184 00000100:00100000:2.0:1787830899.458953:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1787830899.458961:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2310884450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+23:6487:x1874676443821184:12345-0@lo:101: 00010000:00010000:2.0:1787830899.458971:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787830899.458985:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d233837be00/0x95459fb9d1d288b6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d288af expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830899.459006:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d233837be00/0x95459fb9d1d288b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d288af expref: 24 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830899.459016:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d233837be00/0x95459fb9d1d288b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d288af expref: 24 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830899.459025:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233837be00, rc 0) 00000100:00100000:2.0:1787830899.459066:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2310884450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+24:6487:x1874676443821184:12345-0@lo:101: Request processed in 106us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830899.459077:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1787830899.459107:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233be77c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443821184:0@lo:101: 00010000:00010000:1.0:1787830899.459121:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8d233be94200/0x95459fb9d1d288af lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d288b6 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830899.459132:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8d233be94200/0x95459fb9d1d288af lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d288b6 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830899.459177:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233be77c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443821312:0@lo:501: 00000100:00100000:1.0:1787830899.459210:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830899.459225:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d233bcbc9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787830899.459249:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443821312 00000100:00100000:0.0:1787830899.459260:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443821312 00000100:00100000:0.0:1787830899.459294:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1787830899.459302:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d230888b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+24:6487:x1874676443821312:12345-0@lo:501: 00000100:00100000:0.0:1787830899.459380:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d230888b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+24:6487:x1874676443821312:12345-0@lo:501: Request processed in 79us (168us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787830899.459387:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1787830899.459473:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233be77c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443821312:0@lo:501: 10000000:01000000:2.0:1787830899.459496:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787830899.459502:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233be94200/0x95459fb9d1d288af lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d288b6 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830899.459510:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8d233be94200/0x95459fb9d1d288af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d288b6 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787830899.462844:0:10067:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787830899.462909:0:10067:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 190463283890ns, next at 0ns, rc = 0 00080000:00080000:3.0:1787830899.462918:0:10067:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:2.0:1787830899.463771:0:10068:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:1.0:1787830899.463791:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2336bfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443821440:0@lo:13: 00000100:00100000:2.0:1787830899.463801:0:10068:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2336bff480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10068:1874676443821568:0@lo:7: 00000100:00100000:2.0:1787830899.463878:0:10068:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830899.463919:0:10068:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2334484840 going to sleep for 11 seconds 00000100:00100000:1.0:1787830899.463925:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830899.463956:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443821440 00000100:00100000:2.0:1787830899.463963:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443821440 00000100:00100000:2.0:1787830899.464026:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787830899.464035:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233be74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3619:x1874676443821440:12345-0@lo:13: 00000100:00080000:1.0:1787830899.464055:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:2.0:1787830899.464062:0:8410:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:2.0:1787830899.464118:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233be74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3619:x1874676443821440:12345-0@lo:13: Request processed in 84us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830899.464126:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:1.0:1787830899.464207:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2336bfc000 x1874676443821440/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787830915 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787830899.464229:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2336bfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443821440:0@lo:13: 00000100:00100000:3.0:1787830899.464296:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443821568 00000100:00100000:3.0:1787830899.464301:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443821568 00000100:00100000:3.0:1787830899.464332:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787830899.464339:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2336bfed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:10068:x1874676443821568:12345-0@lo:7: 00000001:00100000:0.0:1787830899.464714:0:9484:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1787830899.464723:0:9484:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:1.0:1787830899.464810:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2336bfcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:10064:x1874676443819520:12345-0@lo:700: Request processed in 13271us (13848us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830899.464822:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000004:00080000:0.0:1787830899.465195:0:6469:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00080000:2.0:1787830899.465900:0:10064:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2336bfda40 x1874676443819520/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787830915 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787830899.465915:0:10064:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2336bfda40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10064:1874676443819520:0@lo:700: 00002000:00080000:3.0:1787830899.467426:0:8407:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:3.0:1787830899.467434:0:8407:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:3.0:1787830899.467754:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2336bfed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:10068:x1874676443821568:12345-0@lo:7: Request processed in 3411us (3873us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830899.467765:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1787830899.467850:0:10068:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2336bff480 x1874676443821568/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787830915 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787830899.467871:0:10068:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2336bff480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10068:1874676443821568:0@lo:7: 00000004:00080000:2.0:1787830899.467885:0:10068:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:2.0:1787830899.467919:0:10068:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2336bff480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10068:1874676443821696:0@lo:5: 00000100:00100000:2.0:1787830899.467952:0:10068:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830899.467983:0:10068:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2334484840 going to sleep for 11 seconds 00000100:00100000:1.0:1787830899.468027:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443821696 00000100:00100000:1.0:1787830899.468034:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443821696 00000100:00100000:1.0:1787830899.468152:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787830899.468162:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2336bfda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:10068:x1874676443821696:12345-0@lo:5: 00002000:00080000:1.0:1787830899.468188:0:8408:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1787830899.468192:0:8408:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1787830899.468456:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2336bfda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:10068:x1874676443821696:12345-0@lo:5: Request processed in 296us (503us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1787830899.468463:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1787830899.468543:0:10068:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2336bff480 x1874676443821696/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787830915 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787830899.468571:0:10068:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2336bff480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10068:1874676443821696:0@lo:5: 00000004:00080000:3.0:1787830899.468581:0:10068:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:3.0:1787830899.468793:0:10068:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203793480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10068:1874676443821824:0@lo:700: 00000100:00100000:3.0:1787830899.468822:0:10068:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830899.468847:0:10068:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d230659d0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787830899.468861:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443821824 00000100:00100000:2.0:1787830899.468867:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443821824 00000100:00100000:2.0:1787830899.468902:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787830899.468909:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203790b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+6:10068:x1874676443821824:12345-0@lo:700: 00000001:00080000:3.0:1787830899.471041:0:9484:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:2.0:1787830899.471221:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203790b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:10068:x1874676443821824:12345-0@lo:700: Request processed in 2309us (2394us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830899.471232:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1787830899.471307:0:10068:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2203793480 x1874676443821824/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787830915 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787830899.471319:0:10068:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1787830899.471336:0:10068:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203793480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10068:1874676443821824:0@lo:700: 00000004:02000040:3.0:1787830899.472567:0:10068:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000004:00080000:2.0:1787830899.474749:0:10064:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1787830899.474755:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787830899.474778:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2336bff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443821952:0@lo:13: 00000100:00100000:2.0:1787830899.474780:0:10064:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2336bfc000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10064:1874676443822080:0@lo:7: 00000100:00100000:2.0:1787830899.474863:0:10064:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830899.474865:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830899.474899:0:10064:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2334484d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787830899.474905:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443821952 00000100:00100000:1.0:1787830899.474914:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443821952 00000100:00100000:1.0:1787830899.474992:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787830899.475005:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220258c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443821952:12345-0@lo:13: 00002000:00000024:1.0:1787830899.475029:0:8409:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:1.0:1787830899.475085:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220258c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443821952:12345-0@lo:13: Request processed in 83us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830899.475108:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1787830899.475114:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2336bff480 x1874676443821952/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787830915 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787830899.475137:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2336bff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443821952:0@lo:13: 00000100:00100000:1.0:1787830899.475143:0:8631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443822080 00000100:00100000:1.0:1787830899.475148:0:8631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443822080 00000100:00100000:1.0:1787830899.475183:0:8631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787830899.475191:0:8631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2336bfc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:10064:x1874676443822080:12345-0@lo:7: 00002000:00080000:1.0:1787830899.478247:0:8631:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:1.0:1787830899.478258:0:8631:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1787830899.478367:0:8631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2336bfc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:10064:x1874676443822080:12345-0@lo:7: Request processed in 3171us (3502us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830899.478379:0:8631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787830899.478447:0:10068:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203793480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10068:1874676443822208:0@lo:5: 00000100:00100000:3.0:1787830899.478490:0:10068:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830899.478519:0:10068:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d230659d0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787830899.478537:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443822208 00000100:00100000:1.0:1787830899.478545:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443822208 00000100:00100000:1.0:1787830899.478608:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787830899.478617:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2201dec3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:10068:x1874676443822208:12345-0@lo:5: 00010000:00080000:0.0:1787830899.478660:0:10064:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2336bfc000 x1874676443822080/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787830915 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787830899.478678:0:10064:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2336bfc000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10064:1874676443822080:0@lo:7: 00000004:00080000:0.0:1787830899.478694:0:10064:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1787830899.478727:0:10064:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220258cf00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10064:1874676443822336:0@lo:5: 00000100:00100000:0.0:1787830899.478763:0:10064:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830899.478783:0:10064:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d233be68b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787830899.478796:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443822336 00000100:00100000:2.0:1787830899.478802:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443822336 00000100:00100000:2.0:1787830899.478835:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787830899.478845:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220258d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:10064:x1874676443822336:12345-0@lo:5: 00002000:00080000:2.0:1787830899.478861:0:8407:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:2.0:1787830899.478906:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220258d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:10064:x1874676443822336:12345-0@lo:5: Request processed in 63us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830899.478913:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1787830899.478919:0:10064:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d220258cf00 x1874676443822336/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787830915 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787830899.478930:0:10064:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220258cf00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10064:1874676443822336:0@lo:5: 00000004:00080000:0.0:1787830899.478961:0:10064:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1787830899.478992:0:10064:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220258cf00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10064:1874676443822464:0@lo:5: 00000100:00100000:0.0:1787830899.479025:0:10064:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830899.479052:0:10064:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d233be68b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787830899.479159:0:8631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443822464 00000100:00100000:3.0:1787830899.479164:0:8631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443822464 00000100:00100000:3.0:1787830899.479199:0:8631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787830899.479207:0:8631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220258d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:10064:x1874676443822464:12345-0@lo:5: 00002000:00080000:3.0:1787830899.479233:0:8631:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000100:00100000:3.0:1787830899.484223:0:8631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220258d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:10064:x1874676443822464:12345-0@lo:5: Request processed in 5009us (5190us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1787830899.484238:0:8631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00002000:00080000:1.0:1787830899.484365:0:8406:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:1.0:1787830899.484385:0:8406:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00010000:00080000:0.0:1787830899.484387:0:10064:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d220258cf00 x1874676443822464/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787830915 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787830899.484409:0:10064:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220258cf00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10064:1874676443822464:0@lo:5: 00000004:00080000:0.0:1787830899.484427:0:10064:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1787830899.484471:0:10064:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220258de00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:10064:1874676443822592:0@lo:900: 00000100:00100000:0.0:1787830899.484513:0:10064:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830899.484543:0:10064:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d233be68b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787830899.485462:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2201dec3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:10068:x1874676443822208:12345-0@lo:5: Request processed in 6845us (6970us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1787830899.485470:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1787830899.485504:0:10068:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2203793480 x1874676443822208/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787830915 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787830899.485530:0:10068:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203793480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10068:1874676443822208:0@lo:5: 00000004:00080000:2.0:1787830899.485541:0:10068:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00000100:00100000:3.0:1787830899.486293:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443822592 00000100:00100000:3.0:1787830899.486300:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443822592 00000100:00100000:3.0:1787830899.486341:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787830899.486348:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220258cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:10064:x1874676443822592:12345-0@lo:900: 00000100:00100000:3.0:1787830899.486396:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220258cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:10064:x1874676443822592:12345-0@lo:900: Request processed in 49us (1884us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830899.486401:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787830899.486430:0:10064:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d220258de00 x1874676443822592/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787830915 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787830899.486441:0:10064:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220258de00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:10064:1874676443822592:0@lo:900: 00010000:00010000:0.0:1787830899.686968:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787830899.703494:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787830899.703556:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787830899.703655:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433291648 00000100:00100000:2.0:1787830899.703666:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433291648 00000100:00100000:3.0:1787830899.703709:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787830899.703737:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433291392 00000100:00100000:2.0:1787830899.703740:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433291392 00000100:00100000:2.0:1787830899.703753:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433291776 00000100:00100000:2.0:1787830899.703754:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433291776 00000100:00100000:2.0:1787830899.703769:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 9 00000100:00100000:2.0:1787830899.703776:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d232f6c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:0:x1874676433291648:12345-192.168.203.31@tcp:41: 00000100:00100000:3.0:1787830899.703810:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 10 00000100:00100000:3.0:1787830899.703821:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d232f6ca580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+6:0:x1874676433291392:12345-192.168.203.31@tcp:41: 00000004:00000024:2.0:1787830899.703825:0:6492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000004:00000024:3.0:1787830899.703844:0:8620:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00080000:0.0:1787830899.704121:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787830899.704126:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787830899.704152:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d232f6c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:0:x1874676433291648:12345-192.168.203.31@tcp:41: Request processed in 375us (673us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830899.704159:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 9 00000100:00100000:2.0:1787830899.704177:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 11 00000100:00100000:2.0:1787830899.704183:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d232f6c9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+6:6147:x1874676433291776:12345-192.168.203.31@tcp:41: 00000004:00000024:2.0:1787830899.704195:0:6492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1787830899.706554:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d232f6ca580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+6:0:x1874676433291392:12345-192.168.203.31@tcp:41: Request processed in 2711us (2982us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830899.706571:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 10 00000100:00100000:2.0:1787830899.707059:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d232f6c9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:6147:x1874676433291776:12345-192.168.203.31@tcp:41: Request processed in 2872us (3347us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830899.707070:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 11 00000100:00100000:1.0:1787830899.719657:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787830899.719800:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433291904 00000100:00100000:2.0:1787830899.719995:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433291904 00000100:00100000:2.0:1787830899.720069:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 12 00000100:00100000:2.0:1787830899.720095:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233be77c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:6147:x1874676433291904:12345-192.168.203.31@tcp:40: 00000100:00100000:2.0:1787830899.720226:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233be77c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:6147:x1874676433291904:12345-192.168.203.31@tcp:40: Request processed in 147us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830899.720252:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 12 00000100:00100000:1.0:1787830899.731379:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787830899.731444:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787830899.731488:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787830899.731692:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433292032 00000100:00100000:0.0:1787830899.731703:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433292032 00000100:00100000:0.0:1787830899.731752:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433292160 00000100:00100000:0.0:1787830899.731755:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433292160 00000100:00100000:0.0:1787830899.731774:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 16 00000100:00100000:0.0:1787830899.731783:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22036361c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2393:x1874676433292032:12345-192.168.203.31@tcp:8: 00010000:00080000:0.0:1787830899.731837:0:8408:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 47d7f0ed-283f-4b70-a741-6e74c5e52619@192.168.203.31@tcp t0 exp 0000000000000000 cur 190 last 0 00000020:00000080:0.0:1787830899.731878:0:8408:0:(genops.c:1385:class_connect()) connect: client 47d7f0ed-283f-4b70-a741-6e74c5e52619, cookie 0x95459fb9d1d288bd 00002000:00100000:0.0:1787830899.731899:0:8408:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 47d7f0ed-283f-4b70-a741-6e74c5e52619/ffff8d220276f800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211393d ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787830899.731922:0:8408:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return 37 00002000:00080000:0.0:1787830899.732160:0:8408:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787830899.732196:0:8408:0:(import.c:65:import_set_state_nolock()) ffff8d220276b800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787830899.732282:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22036361c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+6:2393:x1874676433292032:12345-192.168.203.31@tcp:8: Request processed in 498us (835us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830899.732290:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 16 00000100:00100000:0.0:1787830899.732313:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 17 00000100:00100000:0.0:1787830899.732318:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203637c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2393:x1874676433292160:12345-192.168.203.31@tcp:8: 00010000:00080000:0.0:1787830899.732334:0:8408:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 47d7f0ed-283f-4b70-a741-6e74c5e52619@192.168.203.31@tcp t0 exp 0000000000000000 cur 190 last 0 00000020:00000080:0.0:1787830899.732351:0:8408:0:(genops.c:1385:class_connect()) connect: client 47d7f0ed-283f-4b70-a741-6e74c5e52619, cookie 0x95459fb9d1d288c4 00002000:00100000:0.0:1787830899.732358:0:8408:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 47d7f0ed-283f-4b70-a741-6e74c5e52619/ffff8d220276a800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211393d ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787830899.732366:0:8408:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return 37 00002000:00080000:0.0:1787830899.732538:0:8408:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787830899.732569:0:8408:0:(import.c:65:import_set_state_nolock()) ffff8d220276c800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787830899.732594:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203637c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+6:2393:x1874676433292160:12345-192.168.203.31@tcp:8: Request processed in 275us (1105us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830899.732601:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 17 00000100:00100000:3.0:1787830899.733320:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433292288 00000100:00100000:3.0:1787830899.733330:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433292288 00000100:00100000:3.0:1787830899.733387:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 4 00000100:00100000:3.0:1787830899.733397:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22036370c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:6147:x1874676433292288:12345-192.168.203.31@tcp:900: 00000100:00100000:3.0:1787830899.733473:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22036370c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:6147:x1874676433292288:12345-192.168.203.31@tcp:900: Request processed in 78us (2110us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830899.733481:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 4 00000100:00100000:1.0:1787830899.738232:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787830899.739614:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433292416 00000100:00100000:2.0:1787830899.739728:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433292416 00000100:00100000:2.0:1787830899.739862:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 0 00000100:00100000:2.0:1787830899.739876:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203634000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:6147:x1874676433292416:12345-192.168.203.31@tcp:33: 00000004:00080000:3.0:1787830899.757408:0:6493:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 17404us 00000004:00200000:2.0:1787830899.766050:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1787830899.766179:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203634000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:6147:x1874676433292416:12345-192.168.203.31@tcp:33: Request processed in 26299us (27958us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830899.766190:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 0 00000100:00100000:3.0:1787830899.869239:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787830899.869438:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433292544 00000100:00100000:0.0:1787830899.869450:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433292544 00000100:00100000:0.0:1787830899.869531:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 13 00000100:00100000:0.0:1787830899.869542:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d232f6c9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:6189:x1874676433292544:12345-192.168.203.31@tcp:101: 00010000:00010000:0.0:1787830899.869577:0:8620:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787830899.869667:0:8620:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10000/0x95459fb9d1d288cb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99423c56 expref: -99 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830899.869782:0:8620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11000/0x95459fb9d1d288d2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830899.869798:0:8620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11000/0x95459fb9d1d288d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830899.869815:0:8620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11000/0x95459fb9d1d288d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787830899.869873:0:8620:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787830899.869877:0:8620:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787830899.869894:0:8620:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11000/0x95459fb9d1d288d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830899.869924:0:8620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10000/0x95459fb9d1d288cb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423c56 expref: 7 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830899.869947:0:8620:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11000/0x95459fb9d1d288d2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423c56 expref: 6 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830899.869955:0:8620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d23119f9f00) 00010000:00010000:0.0:1787830899.869959:0:8620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787830899.869962:0:8620:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233bf11000, rc 0) 00000100:00100000:0.0:1787830899.870444:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d232f6c9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+6:6189:x1874676433292544:12345-192.168.203.31@tcp:101: Request processed in 899us (1213us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830899.870453:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 13 00010000:00010000:1.0:1787830900.711260:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787830901.551927:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787830901.552405:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433292672 00000100:00100000:2.0:1787830901.552418:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433292672 00000100:00100000:2.0:1787830901.552510:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 14 00000100:00100000:2.0:1787830901.552526:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203635e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+6:6241:x1874676433292672:12345-192.168.203.31@tcp:41: 00000100:00080000:0.0:1787830901.552799:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:2.0:1787830901.552911:0:6491:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1787830901.553067:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203635e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+6:6241:x1874676433292672:12345-192.168.203.31@tcp:41: Request processed in 545us (1154us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830901.553076:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 14 00000100:00100000:1.0:1787830901.556802:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787830901.557245:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433292800 00000100:00100000:2.0:1787830901.557287:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433292800 00000100:00100000:2.0:1787830901.557564:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 15 00000100:00100000:2.0:1787830901.557578:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203635a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:6241:x1874676433292800:12345-192.168.203.31@tcp:41: 00000004:00000024:2.0:1787830901.557660:0:6492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787830901.557754:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203635a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:6241:x1874676433292800:12345-192.168.203.31@tcp:41: Request processed in 181us (967us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830901.557762:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 15 00000100:00100000:3.0:1787830901.560174:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787830901.562242:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433292928 00000100:00100000:2.0:1787830901.562326:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433292928 00000100:00080000:0.0:1787830901.563119:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787830901.564423:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 12 00000100:00100000:2.0:1787830901.564438:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d232f6c83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:47d7f0ed-283f-4b70-a741-6e74c5e52619+6:6241:x1874676433292928:12345-192.168.203.31@tcp:13: 00000100:00080000:0.0:1787830901.564710:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1787830901.565290:0:8410:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787830901.565449:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d232f6c83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:47d7f0ed-283f-4b70-a741-6e74c5e52619+6:6241:x1874676433292928:12345-192.168.203.31@tcp:13: Request processed in 1014us (5287us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830901.565460:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 12 00000100:00100000:1.0:1787830901.568257:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787830901.568507:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433293056 00000100:00100000:2.0:1787830901.568519:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433293056 00000100:00100000:2.0:1787830901.568718:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 13 00000100:00100000:2.0:1787830901.568730:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203634780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:47d7f0ed-283f-4b70-a741-6e74c5e52619+6:6241:x1874676433293056:12345-192.168.203.31@tcp:13: 00002000:00000024:2.0:1787830901.568768:0:8409:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787830901.568843:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203634780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:47d7f0ed-283f-4b70-a741-6e74c5e52619+6:6241:x1874676433293056:12345-192.168.203.31@tcp:13: Request processed in 115us (859us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830901.568852:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 13 00000100:00080000:0.0:1787830901.569026:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787830901.735138:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787830902.502896:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203634b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443822720:0@lo:13: 00000100:00100000:2.0:1787830902.503002:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830902.503158:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443822720 00000100:00100000:3.0:1787830902.503167:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443822720 00000100:00100000:1.0:1787830902.503176:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220258de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676443822848:0@lo:13: 00000100:00100000:1.0:1787830902.503208:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830902.503225:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443822848 00000100:00100000:3.0:1787830902.503228:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443822848 00000100:00100000:1.0:1787830902.503246:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787830902.503263:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2336bfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443822720:12345-0@lo:13: 00002000:00000024:1.0:1787830902.503299:0:8409:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1787830902.503376:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787830902.503445:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2336bfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443822720:12345-0@lo:13: Request processed in 184us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830902.503453:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1787830902.503472:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2203634b40 x1874676443822720/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787830918 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787830902.503493:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203634b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443822720:0@lo:13: 00000100:00100000:0.0:1787830902.503547:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787830902.503556:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203637480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1874676443822848:12345-0@lo:13: 00002000:00000024:0.0:1787830902.503567:0:8409:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787830902.503651:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203637480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1874676443822848:12345-0@lo:13: Request processed in 96us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830902.503658:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1787830902.503719:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d220258de00 x1874676443822848/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787830918 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787830902.503732:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220258de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676443822848:0@lo:13: 00010000:00010000:1.0:1787830902.761835:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787830903.014937:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2314e72940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443822976:0@lo:41: 00000100:00100000:2.0:1787830903.015050:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830903.017549:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443822976 00000100:00100000:3.0:1787830903.017570:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443822976 00000100:00100000:3.0:1787830903.017670:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787830903.017683:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2336bff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676443822976:12345-0@lo:41: 00000004:00000024:3.0:1787830903.017731:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787830903.028604:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2336bff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676443822976:12345-0@lo:41: Request processed in 10907us (13537us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830903.028659:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787830903.030940:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2314e72940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443822976:0@lo:41: 00000001:02000400:3.0:1787830903.418868:0:10155:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:3.0:1787830903.527840:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2314e71e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1874676443823104:0@lo:41: 00000100:00100000:3.0:1787830903.527931:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830903.528013:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443823104 00000100:00100000:3.0:1787830903.528020:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443823104 00000100:00100000:3.0:1787830903.528196:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787830903.528207:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2314e72940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1874676443823104:12345-0@lo:41: 00000004:00000024:3.0:1787830903.528245:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1787830903.528292:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2314e72940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1874676443823104:12345-0@lo:41: Request processed in 87us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830903.528300:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787830903.529094:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2314e71e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1874676443823104:0@lo:41: 00010000:00010000:1.0:1787830903.783434:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787830904.550993:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220390a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443823232:0@lo:13: 00000100:00100000:1.0:1787830904.551120:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830904.551192:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443823232 00000100:00100000:2.0:1787830904.551208:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443823232 00000100:00100000:2.0:1787830904.551278:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787830904.551286:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22036343c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3621:x1874676443823232:12345-0@lo:13: 00002000:00000024:2.0:1787830904.551318:0:8410:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787830904.551364:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22036343c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3621:x1874676443823232:12345-0@lo:13: Request processed in 79us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830904.551369:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:1.0:1787830904.551464:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787830904.551499:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d220390a940 x1874676443823232/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787830920 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787830904.551531:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220390a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443823232:0@lo:13: 00000100:00100000:1.0:1787830904.556863:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203637840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676443823360:0@lo:13: 00000100:00100000:1.0:1787830904.556957:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830904.557047:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443823360 00000100:00100000:1.0:1787830904.557055:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443823360 00000100:00100000:1.0:1787830904.557128:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787830904.557139:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203636580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3622:x1874676443823360:12345-0@lo:13: 00000100:00100000:0.0:1787830904.557145:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220258fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a45944b-32e3-4193-a2a5-46f84222bc14:3619:1874676443823488:0@lo:400: 00002000:00000024:1.0:1787830904.557164:0:8410:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787830904.557193:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830904.557222:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d232f7943c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443824000:0@lo:400: 00000100:00100000:1.0:1787830904.557230:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203636580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3622:x1874676443823360:12345-0@lo:13: Request processed in 92us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830904.557239:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:1.0:1787830904.557272:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787830904.557273:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830904.557291:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d232f7952c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3622:1874676443823872:0@lo:400: 00000100:00100000:0.0:1787830904.557301:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220390e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443824512:0@lo:400: 00000100:00100000:1.0:1787830904.557326:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830904.557335:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830904.557351:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220390f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676443824384:0@lo:400: 00000100:00100000:0.0:1787830904.557374:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1787830904.557381:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220258de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874676443823616:0@lo:400: 00000100:00100000:1.0:1787830904.557387:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830904.557412:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830904.557431:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220390d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3619:1874676443824128:0@lo:400: 00010000:00080000:1.0:1787830904.557432:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2203637840 x1874676443823360/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787830920 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787830904.557456:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203637840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676443823360:0@lo:13: 00000100:00100000:0.0:1787830904.557466:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830904.557474:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1787830904.557483:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220258f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676443823744:0@lo:400: 00000100:00100000:0.0:1787830904.557491:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220390fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3619:1874676443824640:0@lo:400: 00000100:00100000:1.0:1787830904.557511:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830904.557531:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830904.557545:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220390cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3622:1874676443824256:0@lo:400: 00000100:00100000:1.0:1787830904.557572:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830904.557573:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443824000 00000100:00100000:1.0:1787830904.557584:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220390c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3622:1874676443824768:0@lo:400: 00000100:00100000:0.0:1787830904.557590:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443824000 00000100:00100000:1.0:1787830904.557607:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830904.557654:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443823744 00000100:00100000:0.0:1787830904.557659:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443823744 00000100:00100000:0.0:1787830904.557683:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787830904.557696:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220390de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676443824000:12345-0@lo:400: 00000100:00100000:2.0:1787830904.557724:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443823488 00000100:00100000:2.0:1787830904.557730:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443823488 00000100:00100000:1.0:1787830904.557733:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443823872 00000100:00100000:1.0:1787830904.557739:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443823872 00000100:00100000:1.0:1787830904.557771:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443823616 00000100:00100000:1.0:1787830904.557774:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443823616 00000100:00100000:2.0:1787830904.557790:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1787830904.557793:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443824128 00000100:00100000:1.0:1787830904.557798:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443824128 00000100:00100000:2.0:1787830904.557802:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d230888bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+24:3619:x1874676443823488:12345-0@lo:400: 00000100:00100000:1.0:1787830904.557823:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443824640 00000100:00100000:1.0:1787830904.557827:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443824640 00000100:00100000:0.0:1787830904.558130:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220390de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676443824000:12345-0@lo:400: Request processed in 438us (858us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830904.558138:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787830904.558153:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787830904.558161:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203637840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676443823744:12345-0@lo:400: 00000100:00100000:0.0:1787830904.558198:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203637840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676443823744:12345-0@lo:400: Request processed in 39us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830904.558204:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787830904.558225:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443824512 00000100:00100000:0.0:1787830904.558230:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443824512 00000100:00100000:1.0:1787830904.558423:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443824256 00000100:00100000:1.0:1787830904.558428:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443824256 00000100:00100000:1.0:1787830904.558448:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443824768 00000100:00100000:1.0:1787830904.558451:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443824768 00000100:00100000:1.0:1787830904.558465:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787830904.558470:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203636d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1874676443823872:12345-0@lo:400: 00000100:00100000:1.0:1787830904.558503:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203636d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1874676443823872:12345-0@lo:400: Request processed in 33us (1179us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830904.558509:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787830904.558536:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787830904.558542:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220390c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874676443823616:12345-0@lo:400: 00000100:00100000:0.0:1787830904.558665:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443824384 00000100:00100000:0.0:1787830904.558669:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443824384 00000100:00100000:0.0:1787830904.558696:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787830904.558703:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220390da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676443824512:12345-0@lo:400: 00000100:00100000:3.0:1787830904.558887:0:8631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787830904.558906:0:8631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203635680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676443824384:12345-0@lo:400: 00000100:00100000:2.0:1787830904.559970:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d230888bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+24:3619:x1874676443823488:12345-0@lo:400: Request processed in 2165us (2770us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830904.559981:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220390c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874676443823616:12345-0@lo:400: Request processed in 1436us (2565us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830904.559982:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1787830904.559992:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220390da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676443824512:12345-0@lo:400: Request processed in 1285us (2652us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830904.559997:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787830904.560006:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787830904.560023:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787830904.560034:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220390e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874676443824128:12345-0@lo:400: 00000100:00100000:0.0:1787830904.560043:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787830904.560054:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220390cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874676443824640:12345-0@lo:400: 00000100:00100000:1.0:1787830904.560080:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220390e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874676443824128:12345-0@lo:400: Request processed in 49us (2613us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830904.560086:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787830904.560106:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787830904.560107:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220390cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874676443824640:12345-0@lo:400: Request processed in 52us (2573us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830904.560115:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22036352c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1874676443824256:12345-0@lo:400: 00000100:00100000:0.0:1787830904.560116:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787830904.560140:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787830904.560149:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203634f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1874676443824768:12345-0@lo:400: 00000100:00100000:1.0:1787830904.560981:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22036352c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1874676443824256:12345-0@lo:400: Request processed in 866us (3406us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830904.560989:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:1.0:1787830904.561026:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787830904.561033:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787830904.561039:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787830904.561088:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220258f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676443823744:0@lo:400: 00000100:00100000:3.0:1787830904.561095:0:8631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203635680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676443824384:12345-0@lo:400: Request processed in 2188us (3700us total) trans 0 rc 0/0 00010000:00080000:1.0:1787830904.561109:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d220390cf00 x1874676443824256/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830920 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787830904.561112:0:8631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787830904.561133:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220390cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3622:1874676443824256:0@lo:400: 00010000:00080000:1.0:1787830904.561205:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d220390c000 x1874676443824768/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830920 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787830904.561211:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203634f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1874676443824768:12345-0@lo:400: Request processed in 1061us (3600us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830904.561220:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220390c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3622:1874676443824768:0@lo:400: 00000100:00100000:0.0:1787830904.561235:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787830904.561237:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d232f7952c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3622:1874676443823872:0@lo:400: 00010000:00080000:1.0:1787830904.561254:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d220390f0c0 x1874676443824384/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787830920 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787830904.561263:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220390f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676443824384:0@lo:400: 00000100:00100000:0.0:1787830904.561309:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220258de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874676443823616:0@lo:400: 00000100:00100000:0.0:1787830904.561323:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220390d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3619:1874676443824128:0@lo:400: 00000100:00100000:0.0:1787830904.561335:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220390fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3619:1874676443824640:0@lo:400: 00000100:00100000:0.0:1787830904.561346:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220258fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a45944b-32e3-4193-a2a5-46f84222bc14:3619:1874676443823488:0@lo:400: 00000100:00100000:0.0:1787830904.561357:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d232f7943c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443824000:0@lo:400: 00010000:00080000:0.0:1787830904.561371:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d220390e1c0 x1874676443824512/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787830920 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787830904.561381:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220390e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443824512:0@lo:400: 00010000:00010000:2.0:1787830904.811657:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787830904.921809:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787830904.921864:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787830904.921897:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433293312 00000100:00100000:3.0:1787830904.921910:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433293312 00000100:00100000:1.0:1787830904.921954:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787830904.921985:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787830904.922000:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433293440 00000100:00100000:3.0:1787830904.922005:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433293440 00000100:00100000:3.0:1787830904.922040:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 45 00000100:00100000:1.0:1787830904.922044:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787830904.922055:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203634b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+6:2396:x1874676433293312:12345-192.168.203.31@tcp:400: 00000100:00100000:1.0:1787830904.922159:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433293184 00000100:00100000:1.0:1787830904.922164:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433293184 00000100:00100000:1.0:1787830904.922196:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 194 00000100:00100000:1.0:1787830904.922205:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2308888450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+10:2396:x1874676433293184:12345-192.168.203.31@tcp:400: 00000100:00100000:3.0:1787830904.922208:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203634b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+6:2396:x1874676433293312:12345-192.168.203.31@tcp:400: Request processed in 155us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830904.922232:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 45 00000100:00100000:1.0:1787830904.922237:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2308888450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+10:2396:x1874676433293184:12345-192.168.203.31@tcp:400: Request processed in 31us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830904.922255:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 46 00000100:00100000:1.0:1787830904.922259:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 194 00000100:00100000:3.0:1787830904.922267:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d232f7943c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:2396:x1874676433293440:12345-192.168.203.31@tcp:400: 00000100:00080000:2.0:1787830904.922311:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787830904.922317:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787830904.922377:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d232f7943c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:2396:x1874676433293440:12345-192.168.203.31@tcp:400: Request processed in 36us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830904.922386:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 46 00000100:00100000:0.0:1787830904.922425:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433293568 00000100:00100000:0.0:1787830904.922432:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433293568 00000100:00100000:0.0:1787830904.922482:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433293696 00000100:00100000:0.0:1787830904.922486:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433293696 00000100:00100000:0.0:1787830904.922526:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 9 00000100:00100000:0.0:1787830904.922535:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203636940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+6:2396:x1874676433293568:12345-192.168.203.31@tcp:400: 00000100:00100000:0.0:1787830904.922568:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203636940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+6:2396:x1874676433293568:12345-192.168.203.31@tcp:400: Request processed in 34us (703us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830904.922575:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 9 00000100:00100000:0.0:1787830904.922591:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 10 00000100:00100000:0.0:1787830904.922598:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d232f7952c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+6:2396:x1874676433293696:12345-192.168.203.31@tcp:400: 00000100:00080000:3.0:1787830904.922649:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787830904.922653:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787830904.922666:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d232f7952c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+6:2396:x1874676433293696:12345-192.168.203.31@tcp:400: Request processed in 68us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830904.922673:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 10 00000001:00100000:0.0:1787830905.073408:0:9484:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 47d7f0ed-283f-4b70-a741-6e74c5e52619 00000001:00080000:0.0:1787830905.073436:0:9484:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00080000:0.0:1787830905.073455:0:9484:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:1.0:1787830905.832089:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787830906.091482:0:8401:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 47d7f0ed-283f-4b70-a741-6e74c5e52619 00000020:00000080:3.0:1787830906.330831:0:10302:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffeb4ca9520 20000000:00000080:3.0:1787830906.330851:0:10302:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d22037e5000 uarg=0000000000000000 20000000:01000000:3.0:1787830906.330905:0:10302:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:3.0:1787830906.330908:0:10302:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:3.0:1787830906.330911:0:10302:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:3.0:1787830906.330915:0:10302:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:3.0:1787830906.330922:0:10302:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:3.0:1787830906.330998:0:10302:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1787830906.331001:0:10302:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1787830906.331937:0:10303:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:3.0:1787830906.332201:0:10302:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:3.0:1787830906.332236:0:10302:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:3.0:1787830906.332251:0:10302:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 20000000:01000000:3.0:1787830906.332261:0:10302:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1787830906.332263:0:10302:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1787830906.332897:0:10304:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:3.0:1787830906.333066:0:10302:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:3.0:1787830906.333087:0:10302:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:3.0:1787830906.333100:0:10302:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 20000000:01000000:3.0:1787830906.333108:0:10302:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1787830906.333110:0:10302:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1787830906.333451:0:10305:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:3.0:1787830906.333604:0:10302:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:3.0:1787830906.333855:0:10302:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:3.0:1787830906.333884:0:10302:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 20000000:01000000:3.0:1787830906.333896:0:10302:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1787830906.333898:0:10302:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1787830906.334176:0:10306:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:3.0:1787830906.335038:0:10302:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:3.0:1787830906.335070:0:10302:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:3.0:1787830906.335089:0:10302:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 20000000:01000000:3.0:1787830906.335100:0:10302:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1787830906.335102:0:10302:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1787830906.335508:0:10307:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:3.0:1787830906.335976:0:10302:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:3.0:1787830906.336002:0:10302:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:3.0:1787830906.336018:0:10302:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 10000000:01000000:3.0:1787830906.336031:0:10302:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1787830906.336055:0:10302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d2307c77400/0x95459fb9d1d288d9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830906.336075:0:10302:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d233bf11600/0x95459fb9d1d28774 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d2876d expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830906.336083:0:10302:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d233be94a00/0x95459fb9d1d2879e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d28797 expref: 23 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830906.336094:0:10302:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d233be94600/0x95459fb9d1d287dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423be6 expref: 9 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830906.336101:0:10302:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d233be94800/0x95459fb9d1d287e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423bed expref: 9 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830906.336108:0:10302:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d233be95e00/0x95459fb9d1d2880e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d28807 expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830906.336116:0:10302:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d233bf11800/0x95459fb9d1d2881c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d28815 expref: 23 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830906.336135:0:10302:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d233be94e00/0x95459fb9d1d2882a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d28823 expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830906.336142:0:10302:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d233be94000/0x95459fb9d1d28846 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d2883f expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830906.336150:0:10302:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d233be95000/0x95459fb9d1d28870 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d28869 expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830906.336157:0:10302:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d233837ae00/0x95459fb9d1d2888c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d28885 expref: 23 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830906.336163:0:10302:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d233837be00/0x95459fb9d1d288b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d288af expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830906.336171:0:10302:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d2307c77400/0x95459fb9d1d288d9 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830906.336211:0:10302:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d233837be00/0x95459fb9d1d288b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x95459fb9d1d288af expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830906.336224:0:10302:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d233837be00/0x95459fb9d1d288b6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x95459fb9d1d288af expref: 23 pid: 6484 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830906.336239:0:10302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2314e71e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10302:1874676443824896:0@lo:104: 00000100:00100000:3.0:1787830906.336307:0:10302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787830906.336513:0:10302:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d233837ae00/0x95459fb9d1d2888c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x95459fb9d1d28885 expref: 23 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830906.336522:0:10302:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d233837ae00/0x95459fb9d1d2888c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x95459fb9d1d28885 expref: 23 pid: 6483 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830906.336536:0:10302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2309d0bc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10302:1874676443825024:0@lo:104: 00000100:00100000:3.0:1787830906.336574:0:10302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787830906.336858:0:10302:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d233be95000/0x95459fb9d1d28870 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x95459fb9d1d28869 expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830906.336866:0:10302:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d233be95000/0x95459fb9d1d28870 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x95459fb9d1d28869 expref: 23 pid: 6484 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830906.336874:0:10302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220394e580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10302:1874676443825152:0@lo:104: 00000100:00100000:3.0:1787830906.336897:0:10302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830906.337033:0:9493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443824896 00000100:00100000:2.0:1787830906.337040:0:9493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443824896 00000100:00100000:2.0:1787830906.337091:0:9493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443825024 00000100:00100000:2.0:1787830906.337095:0:9493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443825024 00000100:00100000:2.0:1787830906.337127:0:9493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787830906.337137:0:9493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2314ed61c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2a45944b-32e3-4193-a2a5-46f84222bc14+4:10302:x1874676443824896:12345-0@lo:104: 00010000:00010000:2.0:1787830906.337150:0:9493:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff8d233be94200/0x95459fb9d1d288af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d288b6 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830906.337203:0:9493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787830906.337210:0:9493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2314ed61c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2a45944b-32e3-4193-a2a5-46f84222bc14+4:10302:x1874676443824896:12345-0@lo:104: Request processed in 74us (902us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830906.337224:0:9493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787830906.337246:0:9493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787830906.337252:0:9493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220394f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2a45944b-32e3-4193-a2a5-46f84222bc14+3:10302:x1874676443825024:12345-0@lo:104: 00010000:00010000:2.0:1787830906.337260:0:9493:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff8d2307c76600/0x95459fb9d1d28885 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d2888c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830906.337293:0:9493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787830906.337298:0:9493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220394f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2a45944b-32e3-4193-a2a5-46f84222bc14+3:10302:x1874676443825024:12345-0@lo:104: Request processed in 48us (725us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830906.337304:0:9493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:2.0:1787830906.337323:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787830906.337445:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8d233be94200/0x95459fb9d1d288af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d288b6 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830906.337453:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233be94200 already unused, calling callback (ffffffffc14f9c20) 10000000:00010000:2.0:1787830906.337458:0:6479:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8d233be94200/0x95459fb9d1d288af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x95459fb9d1d288b6 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830906.337466:0:6479:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8d233be94200/0x95459fb9d1d288af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x95459fb9d1d288b6 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787830906.337473:0:6479:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8d233be94200/0x95459fb9d1d288af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x95459fb9d1d288b6 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787830906.337479:0:6479:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787830906.337552:0:6479:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8d233be94200/0x95459fb9d1d288af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d288b6 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830906.337559:0:6479:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787830906.337591:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8d233be94200/0x95459fb9d1d288af lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d288b6 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830906.337598:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8d233be94200/0x95459fb9d1d288af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d288b6 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830906.337620:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787830906.337644:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8d2307c76600/0x95459fb9d1d28885 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d2888c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830906.337650:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2307c76600 already unused, calling callback (ffffffffc14f9c20) 10000000:00010000:2.0:1787830906.337653:0:6479:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8d2307c76600/0x95459fb9d1d28885 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x95459fb9d1d2888c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830906.337660:0:6479:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8d2307c76600/0x95459fb9d1d28885 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x95459fb9d1d2888c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787830906.337665:0:6479:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8d2307c76600/0x95459fb9d1d28885 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x95459fb9d1d2888c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787830906.337669:0:6479:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1787830906.337716:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443825152 00000100:00100000:0.0:1787830906.337721:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443825152 00010000:00010000:3.0:1787830906.337740:0:10302:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d233be94000/0x95459fb9d1d28846 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x95459fb9d1d2883f expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830906.337751:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787830906.337759:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220394ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a45944b-32e3-4193-a2a5-46f84222bc14+3:10302:x1874676443825152:12345-0@lo:104: 00010000:00010000:0.0:1787830906.337768:0:6474:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff8d233bf11c00/0x95459fb9d1d28869 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d28870 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830906.337806:0:6474:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787830906.337811:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220394ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a45944b-32e3-4193-a2a5-46f84222bc14+3:10302:x1874676443825152:12345-0@lo:104: Request processed in 54us (913us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830906.337817:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:3.0:1787830906.337865:0:10302:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d233be94000/0x95459fb9d1d28846 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x95459fb9d1d2883f expref: 23 pid: 6484 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830906.337876:0:10302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220394d680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10302:1874676443825408:0@lo:104: 00000100:00100000:3.0:1787830906.337905:0:10302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787830906.337923:0:10302:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d233be94e00/0x95459fb9d1d2882a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x95459fb9d1d28823 expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830906.337932:0:10302:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d233be94e00/0x95459fb9d1d2882a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x95459fb9d1d28823 expref: 23 pid: 6484 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830906.337940:0:10302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220394d2c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10302:1874676443825536:0@lo:104: 00010000:00010000:3.0:1787830906.337964:0:10302:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d233bf11800/0x95459fb9d1d2881c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x95459fb9d1d28815 expref: 23 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830906.337983:0:10302:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d233bf11800/0x95459fb9d1d2881c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x95459fb9d1d28815 expref: 23 pid: 6483 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830906.337992:0:10302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220394cf00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10302:1874676443825664:0@lo:104: 00000100:00100000:0.0:1787830906.338009:0:6474:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:3.0:1787830906.338018:0:10302:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d233be95e00/0x95459fb9d1d2880e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x95459fb9d1d28807 expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830906.338025:0:6474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787830906.338026:0:10302:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d233be95e00/0x95459fb9d1d2880e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x95459fb9d1d28807 expref: 23 pid: 6484 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830906.338035:0:10302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220394f0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10302:1874676443825792:0@lo:104: 00000100:00100000:0.0:1787830906.338037:0:6474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830906.338053:0:10302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787830906.338075:0:10302:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d233be94800/0x95459fb9d1d287e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423bed expref: 9 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830906.338086:0:10302:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d233be94800/0x95459fb9d1d287e4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423bed expref: 9 pid: 6484 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830906.338096:0:10302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220394fc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10302:1874676443825920:192.168.203.31@tcp:104: 00010000:00010000:3.0:1787830906.338150:0:10302:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d233be94600/0x95459fb9d1d287dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423be6 expref: 9 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830906.338159:0:10302:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d233be94600/0x95459fb9d1d287dd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423be6 expref: 9 pid: 6484 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830906.338168:0:10302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220394c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10302:1874676443826048:192.168.203.31@tcp:104: 00010000:00010000:3.0:1787830906.338196:0:10302:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d233be94a00/0x95459fb9d1d2879e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x95459fb9d1d28797 expref: 23 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830906.338199:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443825408 00000100:00100000:0.0:1787830906.338203:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443825408 00010000:00010000:3.0:1787830906.338210:0:10302:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d233be94a00/0x95459fb9d1d2879e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x95459fb9d1d28797 expref: 23 pid: 6485 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830906.338218:0:10302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220394de00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10302:1874676443826176:0@lo:104: 00000100:00100000:0.0:1787830906.338218:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443825536 00000100:00100000:0.0:1787830906.338220:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443825536 00000100:00100000:0.0:1787830906.338229:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443825664 00000100:00100000:0.0:1787830906.338231:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443825664 00000100:00100000:0.0:1787830906.338239:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443825792 00000100:00100000:3.0:1787830906.338241:0:10302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830906.338241:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443825792 00000100:00100000:0.0:1787830906.338249:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443826176 00000100:00100000:0.0:1787830906.338256:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443826176 00010000:00010000:3.0:1787830906.338258:0:10302:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d233bf11600/0x95459fb9d1d28774 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x95459fb9d1d2876d expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830906.338266:0:10302:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d233bf11600/0x95459fb9d1d28774 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x95459fb9d1d2876d expref: 23 pid: 6484 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830906.338270:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787830906.338273:0:10302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220394c780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10302:1874676443826304:0@lo:104: 00000100:00100000:0.0:1787830906.338275:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233bef5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a45944b-32e3-4193-a2a5-46f84222bc14+7:10302:x1874676443825408:12345-0@lo:104: 00000100:00100000:3.0:1787830906.338292:0:10302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830906.338302:0:10302:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2310003840 going to sleep for 11 seconds 00000100:00100000:3.0:1787830906.338321:0:10302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2314e71e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10302:1874676443824896:0@lo:104: 00010000:00010000:0.0:1787830906.338352:0:6474:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff8d2307c77600/0x95459fb9d1d2883f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d28846 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830906.338383:0:6474:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787830906.338388:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233bef5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a45944b-32e3-4193-a2a5-46f84222bc14+7:10302:x1874676443825408:12345-0@lo:104: Request processed in 113us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830906.338395:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787830906.338409:0:10302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2309d0bc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10302:1874676443825024:0@lo:104: 00000100:00100000:3.0:1787830906.338415:0:10302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220394e580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10302:1874676443825152:0@lo:104: 00000100:00100000:3.0:1787830906.338421:0:10302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220394d680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10302:1874676443825408:0@lo:104: 00000100:00100000:0.0:1787830906.338427:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443826304 00000100:00100000:0.0:1787830906.338429:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443826304 00000100:00100000:0.0:1787830906.338442:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787830906.338447:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220390d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a45944b-32e3-4193-a2a5-46f84222bc14+7:10302:x1874676443825536:12345-0@lo:104: 00010000:00010000:0.0:1787830906.338454:0:6474:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff8d233837a000/0x95459fb9d1d28823 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d2882a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830906.338585:0:6479:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8d2307c76600/0x95459fb9d1d28885 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d2888c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830906.338591:0:6479:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787830906.338607:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8d2307c76600/0x95459fb9d1d28885 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d2888c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830906.338645:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8d2307c76600/0x95459fb9d1d28885 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d2888c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830906.338656:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787830906.338666:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8d233bf11c00/0x95459fb9d1d28869 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d28870 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830906.338672:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233bf11c00 already unused, calling callback (ffffffffc14f9c20) 10000000:00010000:2.0:1787830906.338675:0:6479:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8d233bf11c00/0x95459fb9d1d28869 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x95459fb9d1d28870 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830906.338682:0:6479:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8d233bf11c00/0x95459fb9d1d28869 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x95459fb9d1d28870 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787830906.338688:0:6479:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8d233bf11c00/0x95459fb9d1d28869 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x95459fb9d1d28870 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787830906.338693:0:6479:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787830906.338706:0:6479:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8d233bf11c00/0x95459fb9d1d28869 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d28870 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830906.338712:0:6479:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787830906.338718:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8d233bf11c00/0x95459fb9d1d28869 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d28870 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830906.338724:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8d233bf11c00/0x95459fb9d1d28869 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d28870 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830906.338735:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787830906.338737:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8d2307c77600/0x95459fb9d1d2883f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d28846 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830906.338848:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2307c77600 already unused, calling callback (ffffffffc14f9c20) 10000000:00010000:2.0:1787830906.338853:0:6479:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8d2307c77600/0x95459fb9d1d2883f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x95459fb9d1d28846 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830906.338869:0:6479:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8d2307c77600/0x95459fb9d1d2883f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x95459fb9d1d28846 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787830906.338876:0:6479:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8d2307c77600/0x95459fb9d1d2883f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x95459fb9d1d28846 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787830906.338882:0:6479:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787830906.338898:0:6479:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8d2307c77600/0x95459fb9d1d2883f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d28846 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830906.338903:0:6479:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787830906.338910:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8d2307c77600/0x95459fb9d1d2883f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d28846 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830906.338916:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8d2307c77600/0x95459fb9d1d2883f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d28846 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830906.338927:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787830906.338929:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787830906.338930:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787830906.338938:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787830906.338950:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203908b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a45944b-32e3-4193-a2a5-46f84222bc14:3622:1874676443825280:0@lo:103: 00000100:00100000:1.0:1787830906.339790:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220390b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a45944b-32e3-4193-a2a5-46f84222bc14:3619:1874676443826432:0@lo:103: 00000100:00100000:1.0:1787830906.339845:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830906.339861:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220390b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a45944b-32e3-4193-a2a5-46f84222bc14:3621:1874676443826688:0@lo:103: 00000100:00100000:3.0:1787830906.339888:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830906.339903:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787830906.339909:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22039083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a45944b-32e3-4193-a2a5-46f84222bc14:3619:1874676443826560:0@lo:103: 00000100:00100000:1.0:1787830906.339930:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787830906.339959:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787830906.339976:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787830906.339990:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220390f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a45944b-32e3-4193-a2a5-46f84222bc14+7:10302:x1874676443825664:12345-0@lo:104: 00010000:00010000:1.0:1787830906.340000:0:6473:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff8d233837ac00/0x95459fb9d1d28815 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d2881c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830906.340055:0:6473:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787830906.340057:0:7432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443826432 00000100:00100000:1.0:1787830906.340060:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220390f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a45944b-32e3-4193-a2a5-46f84222bc14+7:10302:x1874676443825664:12345-0@lo:104: Request processed in 76us (2022us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830906.340062:0:7432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443826432 00000100:00100000:1.0:1787830906.340066:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787830906.340085:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787830906.340091:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220394e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a45944b-32e3-4193-a2a5-46f84222bc14+6:10302:x1874676443825792:12345-0@lo:104: 00010000:00010000:1.0:1787830906.340098:0:6473:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff8d233837bc00/0x95459fb9d1d28807 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d2880e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830906.340099:0:7432:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d233837ae00/0x95459fb9d1d2888c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d28885 expref: 24 pid: 6483 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830906.340121:0:7432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443826688 00000100:00100000:3.0:1787830906.340125:0:7432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443826688 00010000:00010000:3.0:1787830906.340144:0:7432:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d233be94000/0x95459fb9d1d28846 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d2883f expref: 25 pid: 6484 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830906.340157:0:7432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443826560 00000100:00100000:3.0:1787830906.340160:0:7432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443826560 00010000:00010000:3.0:1787830906.340170:0:7432:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d233be95000/0x95459fb9d1d28870 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d28869 expref: 26 pid: 6484 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830906.340181:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787830906.340186:0:7432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2321e75050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2a45944b-32e3-4193-a2a5-46f84222bc14+26:3619:x1874676443826432:12345-0@lo:103: 00010000:00010000:3.0:1787830906.340197:0:7432:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787830906.340203:0:7432:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d233837ae00/0x95459fb9d1d2888c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d28885 expref: 26 pid: 6483 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830906.340212:0:7432:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d233837ae00/0x95459fb9d1d2888c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x95459fb9d1d28885 expref: 26 pid: 6483 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830906.340228:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d233837ae00/0x95459fb9d1d2888c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x95459fb9d1d28885 expref: 26 pid: 6483 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830906.340243:0:7432:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787830906.340272:0:7432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2321e75050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2a45944b-32e3-4193-a2a5-46f84222bc14+25:3619:x1874676443826432:12345-0@lo:103: Request processed in 85us (426us total) trans 0 rc 0/0 00010000:00010000:1.0:1787830906.340272:0:6473:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787830906.340279:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787830906.340288:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220394e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a45944b-32e3-4193-a2a5-46f84222bc14+6:10302:x1874676443825792:12345-0@lo:104: Request processed in 198us (2234us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830906.340293:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787830906.340304:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787830906.340310:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220394da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a45944b-32e3-4193-a2a5-46f84222bc14+5:10302:x1874676443826176:12345-0@lo:104: 00010000:00010000:1.0:1787830906.340317:0:6473:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff8d2307c76200/0x95459fb9d1d28797 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d2879e expref: -99 pid: 9482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830906.340319:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787830906.340335:0:7432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220394cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2a45944b-32e3-4193-a2a5-46f84222bc14+24:3621:x1874676443826688:12345-0@lo:103: 00010000:00010000:3.0:1787830906.340343:0:7432:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787830906.340347:0:7432:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d233be94000/0x95459fb9d1d28846 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d2883f expref: 24 pid: 6484 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830906.340347:0:6473:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787830906.340357:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220394da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a45944b-32e3-4193-a2a5-46f84222bc14+5:10302:x1874676443826176:12345-0@lo:104: Request processed in 47us (2115us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830906.340363:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00010000:3.0:1787830906.340365:0:7432:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d233be94000/0x95459fb9d1d28846 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x95459fb9d1d2883f expref: 24 pid: 6484 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830906.340375:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d233be94000/0x95459fb9d1d28846 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x95459fb9d1d2883f expref: 24 pid: 6484 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830906.340375:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787830906.340381:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220394e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a45944b-32e3-4193-a2a5-46f84222bc14+4:10302:x1874676443826304:12345-0@lo:104: 00010000:00010000:3.0:1787830906.340384:0:7432:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787830906.340388:0:6473:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff8d233837b200/0x95459fb9d1d2876d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d28774 expref: -99 pid: 9482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830906.340408:0:7432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220394cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2a45944b-32e3-4193-a2a5-46f84222bc14+23:3621:x1874676443826688:12345-0@lo:103: Request processed in 84us (519us total) trans 0 rc 0/0 00010000:00010000:1.0:1787830906.340410:0:6473:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1787830906.340413:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220394e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a45944b-32e3-4193-a2a5-46f84222bc14+4:10302:x1874676443826304:12345-0@lo:104: Request processed in 34us (2121us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830906.340414:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787830906.340419:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787830906.340426:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00010000:00010000:1.0:1787830906.340431:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00000100:00100000:3.0:1787830906.340432:0:7432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220258de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2a45944b-32e3-4193-a2a5-46f84222bc14+22:3619:x1874676443826560:12345-0@lo:103: 00010000:00010000:1.0:1787830906.340436:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8d233837ac00/0x95459fb9d1d28815 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d2881c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830906.340438:0:7432:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787830906.340442:0:7432:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d233be95000/0x95459fb9d1d28870 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d28869 expref: 22 pid: 6484 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830906.340443:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233837ac00 already unused, calling callback (ffffffffc14f9c20) 10000000:00010000:1.0:1787830906.340446:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8d233837ac00/0x95459fb9d1d28815 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x95459fb9d1d2881c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830906.340450:0:7432:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d233be95000/0x95459fb9d1d28870 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x95459fb9d1d28869 expref: 22 pid: 6484 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830906.340454:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8d233837ac00/0x95459fb9d1d28815 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x95459fb9d1d2881c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830906.340459:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d233be95000/0x95459fb9d1d28870 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x95459fb9d1d28869 expref: 22 pid: 6484 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787830906.340461:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8d233837ac00/0x95459fb9d1d28815 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x95459fb9d1d2881c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787830906.340467:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787830906.340468:0:7432:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787830906.340487:0:7432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220258de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2a45944b-32e3-4193-a2a5-46f84222bc14+21:3619:x1874676443826560:12345-0@lo:103: Request processed in 56us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830906.340493:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787830906.340552:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220390b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a45944b-32e3-4193-a2a5-46f84222bc14:3621:1874676443826688:0@lo:103: 00000100:00100000:3.0:1787830906.340587:0:10302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220394cf00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10302:1874676443825664:0@lo:104: 00000100:00100000:3.0:1787830906.340604:0:10302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220394f0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10302:1874676443825792:0@lo:104: 00010000:00010000:1.0:1787830906.340609:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8d233837ac00/0x95459fb9d1d28815 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d2881c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830906.340642:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787830906.340714:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8d233837ac00/0x95459fb9d1d28815 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d2881c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830906.340722:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8d233837ac00/0x95459fb9d1d28815 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d2881c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830906.340732:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787830906.340735:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8d233837bc00/0x95459fb9d1d28807 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d2880e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830906.340740:0:10302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220394de00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10302:1874676443826176:0@lo:104: 00010000:00010000:1.0:1787830906.340741:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233837bc00 already unused, calling callback (ffffffffc14f9c20) 10000000:00010000:1.0:1787830906.340744:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8d233837bc00/0x95459fb9d1d28807 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x95459fb9d1d2880e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830906.340751:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8d233837bc00/0x95459fb9d1d28807 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x95459fb9d1d2880e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787830906.340757:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8d233837bc00/0x95459fb9d1d28807 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x95459fb9d1d2880e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830906.340758:0:10302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220394c780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10302:1874676443826304:0@lo:104: 10000000:01000000:1.0:1787830906.340763:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787830906.340982:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8d233837bc00/0x95459fb9d1d28807 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d2880e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830906.340989:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787830906.340994:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8d233837bc00/0x95459fb9d1d28807 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d2880e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830906.340999:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8d233837bc00/0x95459fb9d1d28807 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d2880e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830906.341013:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787830906.341015:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8d2307c76200/0x95459fb9d1d28797 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d2879e expref: -99 pid: 9482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830906.341020:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2307c76200 already unused, calling callback (ffffffffc14f9c20) 10000000:00010000:1.0:1787830906.341022:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8d2307c76200/0x95459fb9d1d28797 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x95459fb9d1d2879e expref: -99 pid: 9482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830906.341028:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8d2307c76200/0x95459fb9d1d28797 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x95459fb9d1d2879e expref: -99 pid: 9482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787830906.341034:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8d2307c76200/0x95459fb9d1d28797 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x95459fb9d1d2879e expref: -99 pid: 9482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787830906.341038:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787830906.341206:0:6474:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787830906.341213:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220390d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a45944b-32e3-4193-a2a5-46f84222bc14+3:10302:x1874676443825536:12345-0@lo:104: Request processed in 2766us (3186us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830906.341221:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787830906.341241:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787830906.341250:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220258e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a45944b-32e3-4193-a2a5-46f84222bc14:3620:1874676443826944:0@lo:103: 00010000:00010000:1.0:1787830906.341473:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8d2307c76200/0x95459fb9d1d28797 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d2879e expref: -99 pid: 9482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830906.341481:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787830906.341557:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8d2307c76200/0x95459fb9d1d28797 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d2879e expref: -99 pid: 9482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830906.341565:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8d2307c76200/0x95459fb9d1d28797 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d2879e expref: -99 pid: 9482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830906.341576:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787830906.341579:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8d233837b200/0x95459fb9d1d2876d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d28774 expref: -99 pid: 9482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830906.341597:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233837b200 already unused, calling callback (ffffffffc14f9c20) 10000000:00010000:1.0:1787830906.341600:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8d233837b200/0x95459fb9d1d2876d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x95459fb9d1d28774 expref: -99 pid: 9482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830906.341606:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8d233837b200/0x95459fb9d1d2876d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x95459fb9d1d28774 expref: -99 pid: 9482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787830906.341611:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8d233837b200/0x95459fb9d1d2876d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x95459fb9d1d28774 expref: -99 pid: 9482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787830906.341616:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1787830906.341729:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830906.341769:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d232f6ca940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a45944b-32e3-4193-a2a5-46f84222bc14:3620:1874676443827072:0@lo:103: 00000100:00100000:0.0:1787830906.341792:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830906.341815:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443826944 00000100:00100000:0.0:1787830906.341820:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443826944 00010000:00010000:0.0:1787830906.341848:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d233be95e00/0x95459fb9d1d2880e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d28807 expref: 21 pid: 6484 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830906.341865:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443827072 00000100:00100000:0.0:1787830906.341867:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443827072 00010000:00010000:1.0:1787830906.341953:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8d233837b200/0x95459fb9d1d2876d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d28774 expref: -99 pid: 9482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830906.341960:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787830906.341967:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8d233837b200/0x95459fb9d1d2876d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d28774 expref: -99 pid: 9482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830906.341973:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8d233837b200/0x95459fb9d1d2876d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d28774 expref: -99 pid: 9482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830906.341983:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787830906.341986:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8d233837a000/0x95459fb9d1d28823 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d2882a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830906.341992:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233837a000 already unused, calling callback (ffffffffc14f9c20) 10000000:00010000:1.0:1787830906.341995:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8d233837a000/0x95459fb9d1d28823 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x95459fb9d1d2882a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830906.342011:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8d233837a000/0x95459fb9d1d28823 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x95459fb9d1d2882a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787830906.342019:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8d233837a000/0x95459fb9d1d28823 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x95459fb9d1d2882a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787830906.342023:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787830906.342037:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8d233837a000/0x95459fb9d1d28823 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d2882a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830906.342158:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787830906.342165:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8d233837a000/0x95459fb9d1d28823 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d2882a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830906.342172:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8d233837a000/0x95459fb9d1d28823 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d2882a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830906.342186:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830906.342188:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830906.342189:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787830906.342200:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220395e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a45944b-32e3-4193-a2a5-46f84222bc14:3621:1874676443827200:0@lo:103: 00000100:00100000:1.0:1787830906.342227:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830906.342240:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787830906.342245:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220258f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a45944b-32e3-4193-a2a5-46f84222bc14:3621:1874676443826816:0@lo:103: 00000100:00100000:1.0:1787830906.342264:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830906.342273:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220395fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a45944b-32e3-4193-a2a5-46f84222bc14:3621:1874676443827328:0@lo:103: 00010000:00010000:0.0:1787830906.342343:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d233be94a00/0x95459fb9d1d2879e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d28797 expref: 22 pid: 6485 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830906.342358:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443827200 00000100:00100000:0.0:1787830906.342361:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443827200 00010000:00010000:0.0:1787830906.342374:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d233bf11600/0x95459fb9d1d28774 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d2876d expref: 23 pid: 6484 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830906.342385:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443826816 00000100:00100000:0.0:1787830906.342387:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443826816 00010000:00010000:0.0:1787830906.342395:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d233bf11800/0x95459fb9d1d2881c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d28815 expref: 24 pid: 6483 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830906.342407:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787830906.342414:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220390c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a45944b-32e3-4193-a2a5-46f84222bc14+24:3620:x1874676443826944:12345-0@lo:103: 00010000:00010000:0.0:1787830906.342424:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787830906.342428:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d233be95e00/0x95459fb9d1d2880e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d28807 expref: 24 pid: 6484 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830906.342437:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d233be95e00/0x95459fb9d1d2880e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x95459fb9d1d28807 expref: 24 pid: 6484 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830906.342450:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d233be95e00/0x95459fb9d1d2880e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x95459fb9d1d28807 expref: 24 pid: 6484 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830906.342463:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787830906.342585:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830906.342619:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22039083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a45944b-32e3-4193-a2a5-46f84222bc14:3619:1874676443826560:0@lo:103: 00000100:00100000:0.0:1787830906.342751:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220390c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a45944b-32e3-4193-a2a5-46f84222bc14+23:3620:x1874676443826944:12345-0@lo:103: Request processed in 336us (1021us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830906.342764:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787830906.342778:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443827328 00000100:00100000:0.0:1787830906.342781:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443827328 00010000:00010000:0.0:1787830906.342793:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d233be94e00/0x95459fb9d1d2882a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d28823 expref: 23 pid: 6484 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830906.342805:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787830906.342811:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220390f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a45944b-32e3-4193-a2a5-46f84222bc14+23:3620:x1874676443827072:12345-0@lo:103: 00010000:00010000:0.0:1787830906.342818:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787830906.342821:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d233be94a00/0x95459fb9d1d2879e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d28797 expref: 23 pid: 6485 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830906.342829:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d233be94a00/0x95459fb9d1d2879e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x95459fb9d1d28797 expref: 23 pid: 6485 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830906.342839:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d233be94a00/0x95459fb9d1d2879e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x95459fb9d1d28797 expref: 23 pid: 6485 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830906.342851:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787830906.342954:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220390b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a45944b-32e3-4193-a2a5-46f84222bc14:3619:1874676443826432:0@lo:103: 00000100:00100000:0.0:1787830906.343016:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220390f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a45944b-32e3-4193-a2a5-46f84222bc14+22:3620:x1874676443827072:12345-0@lo:103: Request processed in 64us (1081us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830906.343024:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787830906.343037:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787830906.343054:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220395c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a45944b-32e3-4193-a2a5-46f84222bc14+21:3621:x1874676443827200:12345-0@lo:103: 00010000:00010000:0.0:1787830906.343063:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787830906.343067:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d233bf11600/0x95459fb9d1d28774 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d2876d expref: 21 pid: 6484 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830906.343085:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d233bf11600/0x95459fb9d1d28774 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x95459fb9d1d2876d expref: 21 pid: 6484 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830906.343095:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d233bf11600/0x95459fb9d1d28774 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x95459fb9d1d2876d expref: 21 pid: 6484 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830906.343105:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787830906.343142:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220395c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a45944b-32e3-4193-a2a5-46f84222bc14+20:3621:x1874676443827200:12345-0@lo:103: Request processed in 99us (914us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830906.343148:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787830906.343161:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787830906.343167:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220395de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a45944b-32e3-4193-a2a5-46f84222bc14+19:3621:x1874676443826816:12345-0@lo:103: 00010000:00010000:0.0:1787830906.343176:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787830906.343180:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d233bf11800/0x95459fb9d1d2881c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d28815 expref: 19 pid: 6483 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830906.343188:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d233bf11800/0x95459fb9d1d2881c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x95459fb9d1d28815 expref: 19 pid: 6483 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830906.343198:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d233bf11800/0x95459fb9d1d2881c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x95459fb9d1d28815 expref: 19 pid: 6483 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830906.343206:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787830906.343229:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220395de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a45944b-32e3-4193-a2a5-46f84222bc14+18:3621:x1874676443826816:12345-0@lo:103: Request processed in 63us (964us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830906.343235:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787830906.343246:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787830906.343253:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2321e74050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a45944b-32e3-4193-a2a5-46f84222bc14+17:3621:x1874676443827328:12345-0@lo:103: 00010000:00010000:0.0:1787830906.343266:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787830906.343271:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d233be94e00/0x95459fb9d1d2882a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d28823 expref: 17 pid: 6484 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830906.343412:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220258f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a45944b-32e3-4193-a2a5-46f84222bc14:3621:1874676443826816:0@lo:103: 00000100:00100000:1.0:1787830906.343420:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220395e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a45944b-32e3-4193-a2a5-46f84222bc14:3621:1874676443827200:0@lo:103: 00010000:00010000:0.0:1787830906.343457:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d233be94e00/0x95459fb9d1d2882a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x95459fb9d1d28823 expref: 17 pid: 6484 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830906.343469:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787830906.343532:0:10302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d233be94e00/0x95459fb9d1d2882a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x95459fb9d1d28823 expref: 17 pid: 6484 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830906.343544:0:10302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220394d2c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10302:1874676443825536:0@lo:104: 00000100:00100000:3.0:1787830906.343929:0:10302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220394fc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10302:1874676443825920:192.168.203.31@tcp:104: 00000100:00100000:3.0:1787830906.343939:0:10302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220394c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10302:1874676443826048:192.168.203.31@tcp:104: 00000100:00100000:0.0:1787830906.343975:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2321e74050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a45944b-32e3-4193-a2a5-46f84222bc14+16:3621:x1874676443827328:12345-0@lo:103: Request processed in 722us (1389us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830906.343982:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00010000:3.0:1787830906.343985:0:10302:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d2307c77400/0x95459fb9d1d288d9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830906.344029:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d232f6ca940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a45944b-32e3-4193-a2a5-46f84222bc14:3620:1874676443827072:0@lo:103: 00000100:00100000:0.0:1787830906.344038:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220258e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a45944b-32e3-4193-a2a5-46f84222bc14:3620:1874676443826944:0@lo:103: 00000100:00100000:1.0:1787830906.344162:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220395fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a45944b-32e3-4193-a2a5-46f84222bc14:3621:1874676443827328:0@lo:103: 00000100:00100000:1.0:1787830906.344528:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787830906.344911:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433293824 00000100:00100000:3.0:1787830906.344917:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433293824 00010000:00010000:3.0:1787830906.344948:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d233be94800/0x95459fb9d1d287e4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423bed expref: 10 pid: 6484 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830906.344990:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 32 00000100:00100000:3.0:1787830906.344999:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220395fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+10:2396:x1874676433293824:12345-192.168.203.31@tcp:103: 00010000:00010000:3.0:1787830906.345012:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787830906.345017:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d233be94800/0x95459fb9d1d287e4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423bed expref: 10 pid: 6484 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830906.345027:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d233be94800/0x95459fb9d1d287e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423bed expref: 10 pid: 6484 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830906.345046:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d233be94800/0x95459fb9d1d287e4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423bed expref: 10 pid: 6484 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830906.345071:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787830906.345136:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220395fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+9:2396:x1874676433293824:12345-192.168.203.31@tcp:103: Request processed in 138us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830906.345143:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 32 00010000:00010000:3.0:1787830906.346149:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787830906.346237:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787830906.346351:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787830906.346493:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443825280 00000100:00100000:1.0:1787830906.346499:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443825280 00010000:00010000:1.0:1787830906.346534:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d233837be00/0x95459fb9d1d288b6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d288af expref: 16 pid: 6484 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830906.346595:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787830906.346605:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220390a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a45944b-32e3-4193-a2a5-46f84222bc14+16:3622:x1874676443825280:12345-0@lo:103: 00010000:00010000:1.0:1787830906.346807:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787830906.346814:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d233837be00/0x95459fb9d1d288b6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d288af expref: 16 pid: 6484 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830906.346825:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d233837be00/0x95459fb9d1d288b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x95459fb9d1d288af expref: 16 pid: 6484 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830906.346849:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d233837be00/0x95459fb9d1d288b6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x95459fb9d1d288af expref: 16 pid: 6484 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830906.346862:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787830906.346903:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220390a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a45944b-32e3-4193-a2a5-46f84222bc14+15:3622:x1874676443825280:12345-0@lo:103: Request processed in 300us (667us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830906.346910:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787830906.347070:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203908b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a45944b-32e3-4193-a2a5-46f84222bc14:3622:1874676443825280:0@lo:103: 00000100:00100000:1.0:1787830906.351835:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787830906.351971:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433293952 00000100:00100000:3.0:1787830906.351982:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433293952 00010000:00010000:3.0:1787830906.352024:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d233be94600/0x95459fb9d1d287dd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423be6 expref: 9 pid: 6484 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830906.352071:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 34 00000100:00100000:3.0:1787830906.352082:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220395e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+9:2397:x1874676433293952:12345-192.168.203.31@tcp:103: 00010000:00010000:3.0:1787830906.352100:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787830906.352107:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d233be94600/0x95459fb9d1d287dd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423be6 expref: 9 pid: 6484 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830906.352121:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d233be94600/0x95459fb9d1d287dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423be6 expref: 9 pid: 6484 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830906.352142:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d233be94600/0x95459fb9d1d287dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423be6 expref: 9 pid: 6484 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830906.352161:0:6477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d2307c77400/0x95459fb9d1d288d9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830906.352169:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2307c77400/0x95459fb9d1d288d9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830906.352196:0:6477:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d2307c77400/0x95459fb9d1d288d9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830906.352204:0:6477:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d2307c77400/0x95459fb9d1d288d9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830906.352211:0:6477:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d2307c77400/0x95459fb9d1d288d9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830906.352218:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d2307c77400/0x95459fb9d1d288d9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830906.352224:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2307c77400 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:3.0:1787830906.352229:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d2307c77400/0x95459fb9d1d288d9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830906.352237:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d2307c77400/0x95459fb9d1d288d9 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830906.352260:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d2307c77400/0x95459fb9d1d288d9 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830906.352271:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787830906.352337:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220395e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+8:2397:x1874676433293952:12345-192.168.203.31@tcp:103: Request processed in 256us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830906.352345:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 34 00010000:00010000:0.0:1787830906.352534:0:10302:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d2307c77400/0x95459fb9d1d288d9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830906.352543:0:10302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d2307c77400/0x95459fb9d1d288d9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830906.352551:0:10302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2307c77400/0x95459fb9d1d288d9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830906.854949:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787830907.344749:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787830907.345671:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433294080 00000100:00100000:0.0:1787830907.345684:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433294080 00000100:00100000:0.0:1787830907.345796:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 195 00000100:00100000:0.0:1787830907.345806:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2308888850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+8:6161:x1874676433294080:12345-192.168.203.31@tcp:101: 00010000:00010000:0.0:1787830907.345825:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787830907.345848:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d233bf11800/0x95459fb9d1d288e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe558a92a99423c5d expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830907.345896:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d233bf11800/0x95459fb9d1d288e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423c5d expref: 9 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830907.345909:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d233bf11800/0x95459fb9d1d288e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423c5d expref: 9 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830907.345919:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233bf11800, rc 0) 00000100:00100000:0.0:1787830907.345984:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2308888850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+9:6161:x1874676433294080:12345-192.168.203.31@tcp:101: Request processed in 181us (1247us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830907.345991:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 195 00000100:00100000:1.0:1787830907.352720:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787830907.352852:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433294208 00000100:00100000:2.0:1787830907.352862:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433294208 00000100:00100000:2.0:1787830907.352923:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 196 00000100:00100000:2.0:1787830907.352932:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2308889c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+9:6161:x1874676433294208:12345-192.168.203.31@tcp:501: 00000100:00100000:2.0:1787830907.353129:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2308889c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+9:6161:x1874676433294208:12345-192.168.203.31@tcp:501: Request processed in 196us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830907.353138:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 196 00000100:00100000:2.0:1787830907.361111:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787830907.361217:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433294336 00000100:00100000:0.0:1787830907.361227:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433294336 00000100:00100000:0.0:1787830907.361320:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 197 00000100:00100000:0.0:1787830907.361335:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d230888a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+9:6161:x1874676433294336:12345-192.168.203.31@tcp:503: 00000100:00100000:0.0:1787830907.361651:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d230888a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+9:6161:x1874676433294336:12345-192.168.203.31@tcp:503: Request processed in 318us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830907.361658:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 197 00000100:00100000:3.0:1787830907.364840:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787830907.365123:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433294464 00000100:00100000:1.0:1787830907.365133:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433294464 00000100:00100000:1.0:1787830907.365201:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 198 00000100:00100000:1.0:1787830907.365213:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2308889450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+9:6636:x1874676433294464:12345-192.168.203.31@tcp:502: 00000100:00100000:1.0:1787830907.365403:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2308889450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+9:6636:x1874676433294464:12345-192.168.203.31@tcp:502: Request processed in 191us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830907.365412:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 198 00000100:00100000:1.0:1787830907.370746:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787830907.370847:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433294592 00000100:00100000:0.0:1787830907.370858:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433294592 00000100:00100000:0.0:1787830907.370959:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 199 00000100:00100000:0.0:1787830907.370970:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2308888c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+9:6636:x1874676433294592:12345-192.168.203.31@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787830907.371183:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2308888c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+9:6636:x1874676433294592:12345-192.168.203.31@tcp:502:llog_process_th.0 Request processed in 213us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830907.371192:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 199 00000100:00100000:3.0:1787830907.375352:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787830907.375525:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433294720 00000100:00100000:2.0:1787830907.375537:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433294720 00000100:00100000:2.0:1787830907.375603:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 200 00000100:00100000:2.0:1787830907.375614:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d230888ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+9:6161:x1874676433294720:12345-192.168.203.31@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787830907.375663:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787830907.375685:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d233837a000/0x95459fb9d1d288e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe558a92a99423c64 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830907.375720:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d233837a000/0x95459fb9d1d288e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423c64 expref: 10 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830907.375732:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d233837a000/0x95459fb9d1d288e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423c64 expref: 10 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830907.375744:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233837a000, rc 0) 00000100:00100000:2.0:1787830907.375811:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d230888ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+10:6161:x1874676433294720:12345-192.168.203.31@tcp:101:ll_cfg_requeue.0 Request processed in 199us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830907.375819:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 200 00000100:00100000:3.0:1787830907.377386:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787830907.377841:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433294848 00000100:00100000:0.0:1787830907.377858:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433294848 00000100:00100000:0.0:1787830907.377920:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 201 00000100:00100000:0.0:1787830907.377931:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d230888b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+10:6161:x1874676433294848:12345-192.168.203.31@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787830907.378391:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d230888b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+10:6161:x1874676433294848:12345-192.168.203.31@tcp:501:ll_cfg_requeue.0 Request processed in 460us (1012us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787830907.378402:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 201 10000000:01000000:1.0:1787830907.430768:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787830907.430778:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d2334556800 from 48 10000000:01000000:1.0:1787830907.430784:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787830907.430842:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233be95200/0x95459fb9d1d288ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830907.430853:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8d233be95200/0x95459fb9d1d288ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830907.430865:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8d233be95200/0x95459fb9d1d288ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830907.430904:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220395da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443827456:0@lo:101: 00000100:00100000:1.0:1787830907.430981:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830907.431060:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d22027a7600 going to sleep for 11 seconds 00000100:00100000:2.0:1787830907.431714:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443827456 00000100:00100000:2.0:1787830907.431724:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443827456 00000100:00100000:2.0:1787830907.431793:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1787830907.431804:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2308889850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+15:6487:x1874676443827456:12345-0@lo:101: 00010000:00010000:2.0:1787830907.431821:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787830907.431853:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d233837b200/0x95459fb9d1d288f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d288ee expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830907.431885:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d233837b200/0x95459fb9d1d288f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d288ee expref: 16 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830907.431900:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d233837b200/0x95459fb9d1d288f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d288ee expref: 16 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830907.431910:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233837b200, rc 0) 00000100:00100000:2.0:1787830907.431981:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2308889850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+16:6487:x1874676443827456:12345-0@lo:101: Request processed in 178us (999us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830907.431988:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1787830907.432164:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220395da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443827456:0@lo:101: 00010000:00010000:1.0:1787830907.432183:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8d233be95200/0x95459fb9d1d288ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d288f5 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830907.432201:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8d233be95200/0x95459fb9d1d288ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d288f5 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830907.432284:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220395da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443827584:0@lo:501: 00000100:00100000:1.0:1787830907.432315:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830907.432348:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d22027a7600 going to sleep for 11 seconds 00000100:00100000:1.0:1787830907.432364:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443827584 00000100:00100000:1.0:1787830907.432367:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443827584 00000100:00100000:1.0:1787830907.432400:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1787830907.432407:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a686850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+16:6487:x1874676443827584:12345-0@lo:501: 00000100:00100000:1.0:1787830907.432546:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a686850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+16:6487:x1874676443827584:12345-0@lo:501: Request processed in 139us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830907.432553:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1787830907.432595:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220395da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443827584:0@lo:501: 00000100:00100000:1.0:1787830907.432648:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220395da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443827712:0@lo:503: 00000100:00100000:1.0:1787830907.432691:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830907.432709:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d22027a7600 going to sleep for 11 seconds 00000100:00100000:1.0:1787830907.432720:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443827712 00000100:00100000:1.0:1787830907.432723:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443827712 00000100:00100000:1.0:1787830907.432741:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1787830907.432747:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a687050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+16:6487:x1874676443827712:12345-0@lo:503: 00000100:00100000:1.0:1787830907.432819:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a687050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+16:6487:x1874676443827712:12345-0@lo:503: Request processed in 72us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830907.432825:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1787830907.432859:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220395da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443827712:0@lo:503: 00000100:00100000:0.0:1787830907.440522:0:10319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220390fc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:10319:1874676443827840:0@lo:502: 00000100:00100000:0.0:1787830907.440805:0:10319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830907.440852:0:10319:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2202852d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787830907.440927:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443827840 00000100:00100000:1.0:1787830907.440935:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443827840 00000100:00100000:1.0:1787830907.440991:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1787830907.441000:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a686450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+16:10319:x1874676443827840:12345-0@lo:502: 00000100:00100000:1.0:1787830907.441148:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a686450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+16:10319:x1874676443827840:12345-0@lo:502: Request processed in 148us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830907.441156:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1787830907.441277:0:10319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220390fc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:10319:1874676443827840:0@lo:502: 00000100:00100000:2.0:1787830907.441323:0:10319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203908b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:10319:1874676443827968:0@lo:502: 00000100:00100000:2.0:1787830907.441362:0:10319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830907.441401:0:10319:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2307ca0d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787830907.441597:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443827968 00000100:00100000:1.0:1787830907.441602:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443827968 00000100:00100000:1.0:1787830907.441653:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1787830907.441660:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a687850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+16:10319:x1874676443827968:12345-0@lo:502: 00000100:00100000:1.0:1787830907.441749:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a687850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+16:10319:x1874676443827968:12345-0@lo:502: Request processed in 89us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830907.441755:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1787830907.441991:0:10319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203908b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:10319:1874676443827968:0@lo:502: 00000040:00080000:3.0:1787830907.442026:0:10319:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1787830907.443356:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1787830907.443400:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787830907.443412:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233be95200/0x95459fb9d1d288ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d288f5 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830907.443425:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8d233be95200/0x95459fb9d1d288ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d288f5 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787830907.443435:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1787830907.443438:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:1.0:1787830907.443441:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1787830907.443480:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233be95600/0x95459fb9d1d288fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830907.443489:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8d233be95600/0x95459fb9d1d288fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830907.443522:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8d233be95600/0x95459fb9d1d288fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830907.443543:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220395da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443828096:0@lo:101: 00000100:00100000:1.0:1787830907.443716:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830907.443831:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d22027a7c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787830907.446981:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443828096 00000100:00100000:2.0:1787830907.446996:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443828096 00000100:00100000:2.0:1787830907.447180:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1787830907.447194:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a687c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+16:6487:x1874676443828096:12345-0@lo:101: 00010000:00010000:2.0:1787830907.447225:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787830907.447249:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d233837bc00/0x95459fb9d1d28903 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d288fc expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830907.447292:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d233837bc00/0x95459fb9d1d28903 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d288fc expref: 17 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830907.447304:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d233837bc00/0x95459fb9d1d28903 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d288fc expref: 17 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830907.447332:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233837bc00, rc 0) 00000100:00100000:2.0:1787830907.447452:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a687c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+17:6487:x1874676443828096:12345-0@lo:101: Request processed in 260us (3735us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830907.447459:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1787830907.447556:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220395da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443828096:0@lo:101: 00010000:00010000:3.0:1787830907.447578:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8d233be95600/0x95459fb9d1d288fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d28903 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830907.447589:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8d233be95600/0x95459fb9d1d288fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d28903 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830907.447721:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220394c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443828224:0@lo:501: 00000100:00100000:3.0:1787830907.447761:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830907.449937:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2310003840 going to sleep for 11 seconds 00000100:00100000:1.0:1787830907.450738:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443828224 00000100:00100000:1.0:1787830907.450749:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443828224 00000100:00100000:1.0:1787830907.450817:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1787830907.450826:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a684450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+17:6487:x1874676443828224:12345-0@lo:501: 00000100:00100000:1.0:1787830907.451453:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a684450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+17:6487:x1874676443828224:12345-0@lo:501: Request processed in 625us (3690us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830907.451462:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1787830907.451838:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220394c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443828224:0@lo:501: 00000100:00100000:3.0:1787830907.452015:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220394c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443828352:0@lo:503: 00000100:00100000:3.0:1787830907.452241:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830907.452454:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2310003840 going to sleep for 11 seconds 00000100:00100000:1.0:1787830907.452503:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443828352 00000100:00100000:1.0:1787830907.452510:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443828352 00000100:00100000:1.0:1787830907.452713:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1787830907.452723:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a684850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+17:6487:x1874676443828352:12345-0@lo:503: 00000100:00100000:1.0:1787830907.452879:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a684850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+17:6487:x1874676443828352:12345-0@lo:503: Request processed in 150us (788us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830907.452887:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1787830907.452969:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220394c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443828352:0@lo:503: 00000100:00100000:3.0:1787830907.453732:0:10320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220394c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:10320:1874676443828480:0@lo:502: 00000100:00100000:3.0:1787830907.453786:0:10320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830907.455169:0:10320:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2310003180 going to sleep for 11 seconds 00000100:00100000:2.0:1787830907.455816:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443828480 00000100:00100000:2.0:1787830907.455827:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443828480 00000100:00100000:2.0:1787830907.456011:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1787830907.456021:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a685c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+17:10320:x1874676443828480:12345-0@lo:502: 00000100:00100000:2.0:1787830907.457101:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a685c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+17:10320:x1874676443828480:12345-0@lo:502: Request processed in 1076us (3309us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830907.457113:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1787830907.457289:0:10320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220394c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:10320:1874676443828480:0@lo:502: 00000020:01000000:3.0:1787830907.457439:0:10320:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787830907.457449:0:10320:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787830907.457452:0:10320:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787830907.457479:0:10320:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1787830907.457581:0:10320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220394c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:10320:1874676443828608:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787830907.457671:0:10320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830907.457754:0:10320:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2310003180 going to sleep for 11 seconds 00000100:00100000:1.0:1787830907.457788:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443828608 00000100:00100000:1.0:1787830907.457795:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443828608 00000100:00100000:1.0:1787830907.457888:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1787830907.457906:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a686050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+17:10320:x1874676443828608:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787830907.458028:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a686050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+17:10320:x1874676443828608:12345-0@lo:502:llog_process_th.0 Request processed in 132us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830907.458045:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1787830907.458109:0:10320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220394c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:10320:1874676443828608:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787830907.458132:0:10320:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787830907.458137:0:10320:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787830907.458149:0:10320:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787830907.458154:0:10320:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:2.0:1787830907.458827:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:2.0:1787830907.458854:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1787830907.458865:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233be95600/0x95459fb9d1d288fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d28903 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830907.458888:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8d233be95600/0x95459fb9d1d288fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d28903 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787830907.458906:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787830907.458909:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d232f6b0800 from 48 10000000:01000000:2.0:1787830907.458912:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787830907.458945:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233837ac00/0x95459fb9d1d2890a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830907.458953:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8d233837ac00/0x95459fb9d1d2890a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830907.458975:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8d233837ac00/0x95459fb9d1d2890a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830907.458993:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220390ad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443828736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787830907.459033:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830907.459650:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d220257d9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787830907.460065:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443828736 00000100:00100000:0.0:1787830907.460073:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443828736 00000100:00100000:0.0:1787830907.460116:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1787830907.460126:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a685450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+17:6487:x1874676443828736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787830907.460150:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787830907.460169:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d233bf10c00/0x95459fb9d1d28911 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d2890a expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830907.460199:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d233bf10c00/0x95459fb9d1d28911 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d2890a expref: 18 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830907.460211:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d233bf10c00/0x95459fb9d1d28911 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d2890a expref: 18 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830907.460221:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233bf10c00, rc 0) 00000100:00100000:0.0:1787830907.460278:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a685450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+18:6487:x1874676443828736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 153us (1244us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830907.460285:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1787830907.467361:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220390ad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443828736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787830907.467397:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8d233837ac00/0x95459fb9d1d2890a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d28911 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830907.467411:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8d233837ac00/0x95459fb9d1d2890a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d28911 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830907.467522:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220390ad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443828864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787830907.467590:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830907.467700:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d220257d9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787830907.467822:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443828864 00000100:00100000:3.0:1787830907.467830:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443828864 00000100:00100000:3.0:1787830907.467903:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1787830907.467913:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a684c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+18:6487:x1874676443828864:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787830907.468321:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a684c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+18:6487:x1874676443828864:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 407us (728us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830907.468330:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1787830907.468397:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220390ad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443828864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787830907.468441:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220395c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443828992:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787830907.468505:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830907.468538:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d22027a7000 going to sleep for 11 seconds 00000100:00100000:0.0:1787830907.468882:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443828992 00000100:00100000:0.0:1787830907.468889:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443828992 00000100:00100000:0.0:1787830907.468934:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1787830907.468943:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a686c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+18:6487:x1874676443828992:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787830907.469053:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a686c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+18:6487:x1874676443828992:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 110us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830907.469060:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1787830907.469229:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220395c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443828992:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787830907.469800:0:10321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203909680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:10321:1874676443829120:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787830907.469848:0:10321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830907.469896:0:10321:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d220257d3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787830907.469945:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443829120 00000100:00100000:3.0:1787830907.469950:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443829120 00000100:00100000:3.0:1787830907.469989:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1787830907.469997:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a687450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+18:10321:x1874676443829120:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787830907.470106:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a687450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+18:10321:x1874676443829120:12345-0@lo:502:llog_process_th.0 Request processed in 108us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830907.470114:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1787830907.470192:0:10321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203909680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:10321:1874676443829120:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787830907.470234:0:10321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203909680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:10321:1874676443829248:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787830907.470268:0:10321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830907.470299:0:10321:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d220257d3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787830907.470443:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443829248 00000100:00100000:1.0:1787830907.470448:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443829248 00000100:00100000:1.0:1787830907.470486:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1787830907.470505:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a685850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+18:10321:x1874676443829248:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787830907.470589:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a685850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+18:10321:x1874676443829248:12345-0@lo:502:llog_process_th.0 Request processed in 96us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830907.470596:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1787830907.470667:0:10321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203909680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:10321:1874676443829248:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1787830907.470688:0:10321:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1787830907.470879:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1787830907.470904:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787830907.470915:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233837ac00/0x95459fb9d1d2890a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d28911 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830907.470927:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8d233837ac00/0x95459fb9d1d2890a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d28911 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787830907.470943:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1787830907.470946:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:3.0:1787830907.470949:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1787830907.470974:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d2307c77e00/0x95459fb9d1d28918 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830907.470983:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8d2307c77e00/0x95459fb9d1d28918 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830907.470993:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8d2307c77e00/0x95459fb9d1d28918 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830907.471006:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220394c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443829376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787830907.471036:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830907.471066:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2310003840 going to sleep for 11 seconds 00000100:00100000:2.0:1787830907.471117:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443829376 00000100:00100000:2.0:1787830907.471121:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443829376 00000100:00100000:2.0:1787830907.471156:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1787830907.471163:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a685050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+18:6487:x1874676443829376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787830907.471173:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787830907.471187:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d233837aa00/0x95459fb9d1d2891f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d28918 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830907.471213:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d233837aa00/0x95459fb9d1d2891f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d28918 expref: 19 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830907.471225:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d233837aa00/0x95459fb9d1d2891f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d28918 expref: 19 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830907.471236:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233837aa00, rc 0) 00000100:00100000:2.0:1787830907.471279:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a685050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+19:6487:x1874676443829376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830907.471286:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1787830907.471349:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220394c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443829376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787830907.471362:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8d2307c77e00/0x95459fb9d1d28918 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2891f expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830907.471373:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8d2307c77e00/0x95459fb9d1d28918 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d2891f expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830907.471426:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220394c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443829504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787830907.471451:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830907.471475:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2310003840 going to sleep for 11 seconds 00000100:00100000:0.0:1787830907.471543:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443829504 00000100:00100000:0.0:1787830907.471547:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443829504 00000100:00100000:0.0:1787830907.471580:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1787830907.471588:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a684050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+19:6487:x1874676443829504:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787830907.471806:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a684050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+19:6487:x1874676443829504:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 218us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830907.471814:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1787830907.471972:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220394c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443829504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787830907.472005:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220394c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443829632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787830907.472050:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830907.472164:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2310003840 going to sleep for 11 seconds 00000100:00100000:0.0:1787830907.472194:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443829632 00000100:00100000:0.0:1787830907.472198:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443829632 00000100:00100000:1.0:1787830907.472263:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1787830907.472275:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a681050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+19:6487:x1874676443829632:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787830907.473672:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a681050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+19:6487:x1874676443829632:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1394us (1614us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830907.473685:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1787830907.473744:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220394c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443829632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787830907.474923:0:10322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220394c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:10322:1874676443829760:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787830907.475050:0:10322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830907.475090:0:10322:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2310003300 going to sleep for 11 seconds 00000100:00100000:0.0:1787830907.475243:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443829760 00000100:00100000:0.0:1787830907.475251:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443829760 00000100:00100000:0.0:1787830907.475296:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1787830907.475324:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a680050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+19:10322:x1874676443829760:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787830907.475448:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a680050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+19:10322:x1874676443829760:12345-0@lo:502:llog_process_th.0 Request processed in 143us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830907.475456:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1787830907.475476:0:10322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220394c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:10322:1874676443829760:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787830907.475521:0:10322:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787830907.475532:0:10322:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787830907.475535:0:10322:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787830907.475545:0:10322:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1787830907.475566:0:10322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220394c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:10322:1874676443829888:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787830907.475601:0:10322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830907.475666:0:10322:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2310003300 going to sleep for 11 seconds 00000100:00100000:1.0:1787830907.475760:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443829888 00000100:00100000:1.0:1787830907.475766:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443829888 00000100:00100000:1.0:1787830907.475798:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1787830907.475806:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a682850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+19:10322:x1874676443829888:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787830907.475887:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a682850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+19:10322:x1874676443829888:12345-0@lo:502:llog_process_th.0 Request processed in 82us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830907.475894:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1787830907.475974:0:10322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220394c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:10322:1874676443829888:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787830907.475994:0:10322:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787830907.475998:0:10322:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787830907.476000:0:10322:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787830907.476005:0:10322:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:2.0:1787830907.476252:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:2.0:1787830907.476279:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1787830907.476292:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d2307c77e00/0x95459fb9d1d28918 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2891f expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830907.476420:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8d2307c77e00/0x95459fb9d1d28918 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2891f expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787830907.476444:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787830907.476447:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d232f730000 from 48 10000000:01000000:2.0:1787830907.476449:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787830907.476479:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233837b600/0x95459fb9d1d28926 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830907.476485:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8d233837b600/0x95459fb9d1d28926 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830907.476505:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8d233837b600/0x95459fb9d1d28926 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830907.476588:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203909680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443830016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787830907.476996:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830907.477086:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d220257d300 going to sleep for 11 seconds 00000100:00100000:0.0:1787830907.477124:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443830016 00000100:00100000:0.0:1787830907.477130:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443830016 00000100:00100000:0.0:1787830907.477274:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1787830907.477283:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a683050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+19:6487:x1874676443830016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787830907.477314:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787830907.477405:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d233bf10000/0x95459fb9d1d2892d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d28926 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830907.477435:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d233bf10000/0x95459fb9d1d2892d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d28926 expref: 20 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830907.477447:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d233bf10000/0x95459fb9d1d2892d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d28926 expref: 20 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830907.477457:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233bf10000, rc 0) 00000100:00100000:0.0:1787830907.477525:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a683050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+20:6487:x1874676443830016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 235us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830907.477532:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1787830907.477604:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203909680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443830016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787830907.477621:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8d233837b600/0x95459fb9d1d28926 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2892d expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830907.477661:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8d233837b600/0x95459fb9d1d28926 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d2892d expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830907.477743:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220394c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443830144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787830907.477775:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830907.478089:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2310003300 going to sleep for 11 seconds 00000100:00100000:2.0:1787830907.478164:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443830144 00000100:00100000:2.0:1787830907.478169:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443830144 00000100:00100000:2.0:1787830907.478197:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1787830907.478204:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a682450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+20:6487:x1874676443830144:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787830907.478550:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a682450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+20:6487:x1874676443830144:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 346us (773us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830907.478559:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1787830907.478981:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220394c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443830144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787830907.479024:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220394c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443830272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787830907.479074:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830907.479100:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2310003300 going to sleep for 11 seconds 00000100:00100000:2.0:1787830907.479162:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443830272 00000100:00100000:2.0:1787830907.479167:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443830272 00000100:00100000:2.0:1787830907.479187:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1787830907.479193:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a683850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+20:6487:x1874676443830272:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787830907.479300:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a683850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+20:6487:x1874676443830272:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 106us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830907.479508:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220394c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443830272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787830907.479762:0:10323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220394c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:10323:1874676443830400:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787830907.479797:0:10323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830907.479814:0:10323:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d23100036c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787830907.482396:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1787830907.482470:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443830400 00000100:00100000:2.0:1787830907.482479:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443830400 00000100:00100000:2.0:1787830907.482526:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1787830907.482535:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a683c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+20:10323:x1874676443830400:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787830907.482769:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a683c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+20:10323:x1874676443830400:12345-0@lo:502:llog_process_th.0 Request processed in 235us (2970us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830907.482776:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1787830907.482962:0:10323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220394c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:10323:1874676443830400:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787830907.483033:0:10323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220394c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:10323:1874676443830528:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787830907.483081:0:10323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830907.483119:0:10323:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d23100036c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787830907.483308:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443830528 00000100:00100000:2.0:1787830907.483313:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443830528 00000100:00100000:2.0:1787830907.483393:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1787830907.483401:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a680450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+20:10323:x1874676443830528:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787830907.483535:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a680450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+20:10323:x1874676443830528:12345-0@lo:502:llog_process_th.0 Request processed in 134us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830907.483542:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1787830907.485761:0:10323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220394c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:10323:1874676443830528:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1787830907.485820:0:10323:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1787830907.488617:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1787830907.489463:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787830907.489479:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233837b600/0x95459fb9d1d28926 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2892d expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830907.489500:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8d233837b600/0x95459fb9d1d28926 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2892d expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787830907.489513:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1787830907.489515:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:0.0:1787830907.489518:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1787830907.489563:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233bf10200/0x95459fb9d1d28934 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830907.489572:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8d233bf10200/0x95459fb9d1d28934 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830907.489607:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8d233bf10200/0x95459fb9d1d28934 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830907.489775:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220390c3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443830656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787830907.489851:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830907.489939:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2202852180 going to sleep for 11 seconds 00000100:00100000:2.0:1787830907.494502:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443830656 00000100:00100000:2.0:1787830907.494527:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443830656 00000100:00100000:2.0:1787830907.494668:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1787830907.494680:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a680850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+20:6487:x1874676443830656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787830907.494701:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787830907.494724:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d233837b000/0x95459fb9d1d2893b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d28934 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830907.494759:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d233837b000/0x95459fb9d1d2893b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d28934 expref: 21 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830907.494772:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d233837b000/0x95459fb9d1d2893b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d28934 expref: 21 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830907.494799:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233837b000, rc 0) 00000100:00100000:2.0:1787830907.495261:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a680850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+21:6487:x1874676443830656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 581us (5407us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830907.495269:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1787830907.500703:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220390c3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443830656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787830907.500741:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8d233bf10200/0x95459fb9d1d28934 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2893b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830907.500754:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8d233bf10200/0x95459fb9d1d28934 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d2893b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830907.500896:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220394c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443830784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787830907.500965:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830907.501010:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d23100036c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787830907.501128:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443830784 00000100:00100000:1.0:1787830907.501136:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443830784 00000100:00100000:1.0:1787830907.501206:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1787830907.501216:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a681c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+21:6487:x1874676443830784:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787830907.501516:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a681c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+21:6487:x1874676443830784:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 300us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830907.501524:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1787830907.501589:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220394c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443830784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787830907.501760:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220394c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443830912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787830907.501866:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830907.501956:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d23100036c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787830907.501969:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443830912 00000100:00100000:2.0:1787830907.501976:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443830912 00000100:00100000:2.0:1787830907.502017:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1787830907.502025:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a682050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+21:6487:x1874676443830912:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787830907.502147:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a682050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+21:6487:x1874676443830912:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 122us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830907.502155:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1787830907.502181:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220394c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443830912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787830907.503438:0:10324:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220390f840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:10324:1874676443831040:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787830907.503525:0:10324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830907.503562:0:10324:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2202852180 going to sleep for 11 seconds 00000100:00100000:1.0:1787830907.503643:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443831040 00000100:00100000:1.0:1787830907.503649:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443831040 00000100:00100000:1.0:1787830907.503692:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1787830907.503702:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a681450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+21:10324:x1874676443831040:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787830907.503824:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a681450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+21:10324:x1874676443831040:12345-0@lo:502:llog_process_th.0 Request processed in 123us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830907.503832:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1787830907.504074:0:10324:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220390f840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:10324:1874676443831040:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787830907.504105:0:10324:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787830907.504115:0:10324:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787830907.504118:0:10324:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787830907.504125:0:10324:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1787830907.504159:0:10324:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220390f840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:10324:1874676443831168:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787830907.504196:0:10324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830907.504225:0:10324:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2202852180 going to sleep for 11 seconds 00000100:00100000:2.0:1787830907.504308:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443831168 00000100:00100000:2.0:1787830907.504324:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443831168 00000100:00100000:2.0:1787830907.504365:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1787830907.504373:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a680c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+21:10324:x1874676443831168:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787830907.504529:0:10324:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220390f840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:10324:1874676443831168:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787830907.504549:0:10324:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787830907.504553:0:10324:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787830907.504555:0:10324:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787830907.504558:0:10324:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000100:00100000:2.0:1787830907.505120:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a680c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+21:10324:x1874676443831168:12345-0@lo:502:llog_process_th.0 Request processed in 745us (920us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830907.505131:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000020:01000000:1.0:1787830907.505476:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:1.0:1787830907.505595:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1787830907.505607:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233bf10200/0x95459fb9d1d28934 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2893b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830907.505619:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8d233bf10200/0x95459fb9d1d28934 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2893b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787830907.505706:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787830907.505709:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d2303f2e000 from 48 10000000:01000000:1.0:1787830907.505712:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787830907.505746:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233be95c00/0x95459fb9d1d28942 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830907.505754:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8d233be95c00/0x95459fb9d1d28942 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830907.505775:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8d233be95c00/0x95459fb9d1d28942 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830907.505796:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220395e940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443831296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787830907.505843:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830907.505931:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d22027a7000 going to sleep for 11 seconds 00000100:00100000:2.0:1787830907.505977:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443831296 00000100:00100000:2.0:1787830907.505983:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443831296 00000100:00100000:2.0:1787830907.508423:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1787830907.508454:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a682c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+21:6487:x1874676443831296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787830907.508815:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787830907.508884:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d233837a800/0x95459fb9d1d28949 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d28942 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830907.508947:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d233837a800/0x95459fb9d1d28949 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d28942 expref: 22 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830907.508960:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d233837a800/0x95459fb9d1d28949 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d28942 expref: 22 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830907.508971:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233837a800, rc 0) 00000100:00100000:2.0:1787830907.509086:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a682c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+22:6487:x1874676443831296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 647us (3241us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830907.509093:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1787830907.509201:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220395e940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443831296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787830907.509225:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8d233be95c00/0x95459fb9d1d28942 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d28949 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830907.509236:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8d233be95c00/0x95459fb9d1d28942 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d28949 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830907.509342:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220394c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443831424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787830907.509380:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830907.510344:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2310003300 going to sleep for 11 seconds 00000100:00100000:1.0:1787830907.511233:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443831424 00000100:00100000:1.0:1787830907.511245:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443831424 00000100:00100000:1.0:1787830907.511297:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1787830907.511307:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a683450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+22:6487:x1874676443831424:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787830907.513452:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a683450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+22:6487:x1874676443831424:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2137us (4063us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830907.513467:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1787830907.513541:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220394c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443831424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787830907.513603:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220394c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443831552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787830907.513705:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830907.513746:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2310003300 going to sleep for 11 seconds 00000100:00100000:1.0:1787830907.513833:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443831552 00000100:00100000:1.0:1787830907.513839:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443831552 00000100:00100000:1.0:1787830907.513884:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1787830907.513893:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a681850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+22:6487:x1874676443831552:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787830907.514007:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a681850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+22:6487:x1874676443831552:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 115us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830907.514014:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1787830907.514085:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220394c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443831552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787830907.514786:0:10325:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22039092c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:10325:1874676443831680:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787830907.514832:0:10325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830907.514935:0:10325:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d23082b69c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787830907.514974:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443831680 00000100:00100000:1.0:1787830907.514978:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443831680 00000100:00100000:1.0:1787830907.515044:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1787830907.515052:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d231859cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+22:10325:x1874676443831680:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787830907.515157:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d231859cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+22:10325:x1874676443831680:12345-0@lo:502:llog_process_th.0 Request processed in 106us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830907.515171:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1787830907.515237:0:10325:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22039092c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:10325:1874676443831680:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787830907.515279:0:10325:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220394c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:10325:1874676443831808:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787830907.515312:0:10325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830907.515381:0:10325:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2310003300 going to sleep for 11 seconds 00000100:00100000:2.0:1787830907.515490:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443831808 00000100:00100000:2.0:1787830907.515502:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443831808 00000100:00100000:2.0:1787830907.515529:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1787830907.515536:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d231859ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+22:10325:x1874676443831808:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787830907.515616:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d231859ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+22:10325:x1874676443831808:12345-0@lo:502:llog_process_th.0 Request processed in 80us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830907.515648:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1787830907.516268:0:10325:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220394c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:10325:1874676443831808:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1787830907.516298:0:10325:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1787830907.516689:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1787830907.516713:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787830907.516723:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233be95c00/0x95459fb9d1d28942 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d28949 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830907.516734:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8d233be95c00/0x95459fb9d1d28942 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d28949 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787830907.516744:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1787830907.516746:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:1.0:1787830907.516749:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787830907.516781:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233be94600/0x95459fb9d1d28950 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830907.516788:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8d233be94600/0x95459fb9d1d28950 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830907.516799:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8d233be94600/0x95459fb9d1d28950 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830907.516817:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220395cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443831936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787830907.516862:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830907.516932:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d22034db300 going to sleep for 11 seconds 00000100:00100000:2.0:1787830907.516972:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443831936 00000100:00100000:2.0:1787830907.516977:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443831936 00000100:00100000:2.0:1787830907.517047:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1787830907.517056:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d231859f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+22:6487:x1874676443831936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787830907.517067:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787830907.517083:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d233837a600/0x95459fb9d1d28957 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d28950 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830907.517117:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d233837a600/0x95459fb9d1d28957 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d28950 expref: 23 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830907.517127:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d233837a600/0x95459fb9d1d28957 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d28950 expref: 23 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830907.517136:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233837a600, rc 0) 00000100:00100000:2.0:1787830907.517188:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d231859f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+23:6487:x1874676443831936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830907.517195:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1787830907.517252:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220395cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443831936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787830907.517266:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8d233be94600/0x95459fb9d1d28950 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d28957 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830907.517275:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8d233be94600/0x95459fb9d1d28950 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d28957 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830907.517400:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220394c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443832064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787830907.517426:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830907.517520:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2310003300 going to sleep for 11 seconds 00000100:00100000:1.0:1787830907.517586:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443832064 00000100:00100000:1.0:1787830907.517590:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443832064 00000100:00100000:1.0:1787830907.517613:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1787830907.517620:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d231859d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+23:6487:x1874676443832064:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787830907.517763:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d231859d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+23:6487:x1874676443832064:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 143us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830907.517777:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1787830907.517871:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220394c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443832064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787830907.517903:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220394c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443832192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787830907.517943:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830907.517961:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2310003300 going to sleep for 11 seconds 00000100:00100000:1.0:1787830907.518007:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443832192 00000100:00100000:1.0:1787830907.518011:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443832192 00000100:00100000:1.0:1787830907.518028:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1787830907.518034:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d231859d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+23:6487:x1874676443832192:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787830907.518119:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d231859d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+23:6487:x1874676443832192:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 84us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830907.518126:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1787830907.518205:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220394c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443832192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787830907.518776:0:10326:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220394c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:10326:1874676443832320:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787830907.518819:0:10326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830907.518848:0:10326:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d23100036c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787830907.518894:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443832320 00000100:00100000:1.0:1787830907.518899:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443832320 00000100:00100000:1.0:1787830907.518933:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1787830907.518941:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d231859c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+23:10326:x1874676443832320:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787830907.519033:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d231859c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+23:10326:x1874676443832320:12345-0@lo:502:llog_process_th.0 Request processed in 93us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830907.519039:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1787830907.519148:0:10326:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220394c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:10326:1874676443832320:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787830907.519174:0:10326:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787830907.519185:0:10326:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787830907.519188:0:10326:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787830907.519193:0:10326:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1787830907.519211:0:10326:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220394c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:10326:1874676443832448:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787830907.519244:0:10326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830907.519265:0:10326:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d23100036c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787830907.519307:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443832448 00000100:00100000:1.0:1787830907.519310:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443832448 00000100:00100000:1.0:1787830907.519416:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1787830907.519422:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d231859e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+23:10326:x1874676443832448:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787830907.519489:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d231859e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+23:10326:x1874676443832448:12345-0@lo:502:llog_process_th.0 Request processed in 67us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830907.519504:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1787830907.519605:0:10326:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220394c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:10326:1874676443832448:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787830907.519650:0:10326:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787830907.519654:0:10326:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787830907.519656:0:10326:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787830907.519659:0:10326:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:1.0:1787830907.520484:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:1.0:1787830907.520533:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787830907.520546:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233be94600/0x95459fb9d1d28950 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d28957 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830907.520570:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8d233be94600/0x95459fb9d1d28950 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d28957 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787830907.520581:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1787830907.520585:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8d2312953370 from 1 10000000:01000000:1.0:1787830907.520588:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787830907.521315:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233be95800/0x95459fb9d1d2895e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830907.521454:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8d233be95800/0x95459fb9d1d2895e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830907.521467:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8d233be95800/0x95459fb9d1d2895e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830907.521504:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220395f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443832576:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787830907.521573:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830907.521612:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d22034db240 going to sleep for 11 seconds 00000100:00100000:2.0:1787830907.521907:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443832576 00000100:00100000:2.0:1787830907.521915:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443832576 00000100:00100000:2.0:1787830907.521972:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1787830907.521981:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d231859f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+23:6487:x1874676443832576:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787830907.521994:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787830907.522011:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d233837b800/0x95459fb9d1d28965 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d2895e expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830907.522039:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d233837b800/0x95459fb9d1d28965 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d2895e expref: 24 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830907.522052:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d233837b800/0x95459fb9d1d28965 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d2895e expref: 24 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830907.522062:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233837b800, rc 0) 00000100:00100000:2.0:1787830907.522124:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d231859f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+24:6487:x1874676443832576:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 144us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830907.522132:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1787830907.522257:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220395f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443832576:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787830907.522275:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8d233be95800/0x95459fb9d1d2895e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d28965 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830907.522284:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8d233be95800/0x95459fb9d1d2895e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d28965 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830907.522432:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220395f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443832704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787830907.522462:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830907.522507:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d22034db240 going to sleep for 11 seconds 00000100:00100000:2.0:1787830907.522558:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443832704 00000100:00100000:2.0:1787830907.522563:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443832704 00000100:00100000:2.0:1787830907.522592:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1787830907.522599:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d231859e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+24:6487:x1874676443832704:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787830907.522720:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d231859e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+24:6487:x1874676443832704:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 121us (257us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787830907.522728:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1787830907.522928:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220395f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443832704:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1787830907.522957:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787830907.522963:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233be95800/0x95459fb9d1d2895e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d28965 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830907.522971:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8d233be95800/0x95459fb9d1d2895e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d28965 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830907.623041:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220390f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443832832:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787830907.623126:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830907.623387:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443832832 00000100:00100000:3.0:1787830907.623396:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443832832 00000100:00100000:3.0:1787830907.623467:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1787830907.623644:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787830907.623702:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220395f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676443832832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787830907.623735:0:8410:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787830907.623788:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220395f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676443832832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 313us (663us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830907.623796:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:0.0:1787830907.623878:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d220390f840 x1874676443832832/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787830923 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787830907.623898:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220390f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443832832:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787830907.626104:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787830907.626131:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220395c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443832960:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787830907.626207:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830907.626706:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443832960 00000100:00100000:3.0:1787830907.626715:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443832960 00000100:00100000:3.0:1787830907.626825:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787830907.626835:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220390f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443832960:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787830907.626861:0:8410:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787830907.626935:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220390f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443832960:12345-0@lo:13:osp-pre-0-1.0 Request processed in 101us (726us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830907.626959:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:2.0:1787830907.627033:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d220395c3c0 x1874676443832960/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787830923 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787830907.627054:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220395c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443832960:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1787830907.627120:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787830907.878919:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787830908.134906:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203908f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443833088:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787830908.134996:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830908.135286:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443833088 00000100:00100000:0.0:1787830908.135305:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443833088 00000100:00100000:0.0:1787830908.135395:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787830908.135406:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220395f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1874676443833088:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787830908.135443:0:7448:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787830908.135511:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220395f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1874676443833088:12345-0@lo:41:osp-pre-1-0.0 Request processed in 107us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830908.135525:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787830908.135609:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203908f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443833088:0@lo:41:osp-pre-1-0.0 00000020:00000080:0.0:1787830908.380111:0:10363:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe3e80a950 20000000:00000080:0.0:1787830908.380127:0:10363:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d2203911800 uarg=0000000000000000 20000000:01000000:0.0:1787830908.380173:0:10363:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787830908.380179:0:10363:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787830908.380184:0:10363:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1787830908.385711:0:10364:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:2.0:1787830908.387836:0:10363:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:0.0:1787830908.398155:0:10363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:0.0:1787830908.398189:0:10363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:0.0:1787830908.398205:0:10363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:0.0:1787830908.398220:0:10363:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787830908.398242:0:10363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d233bf10400/0x95459fb9d1d2896c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830908.398260:0:10363:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d233837ba00/0x95459fb9d1d285b4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d285ad expref: 23 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830908.398268:0:10363:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d233be95400/0x95459fb9d1d28608 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d28601 expref: 23 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830908.398286:0:10363:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d233be94400/0x95459fb9d1d2866a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d28663 expref: 23 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830908.398293:0:10363:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d233be94c00/0x95459fb9d1d28790 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d28789 expref: 23 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830908.398302:0:10363:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d233bf11200/0x95459fb9d1d287f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423c25 expref: 9 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830908.398311:0:10363:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d233bf10400/0x95459fb9d1d2896c lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830908.398357:0:10363:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d233bf11200/0x95459fb9d1d287f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423c25 expref: 9 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830908.398373:0:10363:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d233bf11200/0x95459fb9d1d287f2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423c25 expref: 9 pid: 6483 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830908.398389:0:10363:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220390ed00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10363:1874676443833216:192.168.203.31@tcp:104: 00010000:00010000:0.0:1787830908.398549:0:10363:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d233be94c00/0x95459fb9d1d28790 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x95459fb9d1d28789 expref: 23 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830908.398558:0:10363:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d233be94c00/0x95459fb9d1d28790 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x95459fb9d1d28789 expref: 23 pid: 6483 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830908.398568:0:10363:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220390d680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10363:1874676443833344:0@lo:104: 00000100:00100000:0.0:1787830908.398610:0:10363:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787830908.398676:0:10363:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d233be94400/0x95459fb9d1d2866a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x95459fb9d1d28663 expref: 23 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830908.398690:0:10363:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d233be94400/0x95459fb9d1d2866a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x95459fb9d1d28663 expref: 23 pid: 6483 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830908.398699:0:10363:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220390fc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10363:1874676443833472:0@lo:104: 00000100:00100000:0.0:1787830908.398725:0:10363:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787830908.399875:0:10363:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d233be95400/0x95459fb9d1d28608 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x95459fb9d1d28601 expref: 23 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830908.399888:0:10363:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d233be95400/0x95459fb9d1d28608 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x95459fb9d1d28601 expref: 23 pid: 6483 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830908.399898:0:10363:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220390e1c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10363:1874676443833600:0@lo:104: 00010000:00010000:0.0:1787830908.399930:0:10363:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d233837ba00/0x95459fb9d1d285b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x95459fb9d1d285ad expref: 23 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830908.399938:0:10363:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d233837ba00/0x95459fb9d1d285b4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x95459fb9d1d285ad expref: 23 pid: 6483 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830908.399946:0:10363:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220390f0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10363:1874676443833728:0@lo:104: 00000100:00100000:0.0:1787830908.399972:0:10363:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2307cb9300 going to sleep for 11 seconds 00000100:00100000:1.0:1787830908.399977:0:6473:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787830908.399999:0:6473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830908.400035:0:6473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830908.400046:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443833344 00000100:00100000:1.0:1787830908.400052:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443833344 00000100:00100000:1.0:1787830908.400089:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443833472 00000100:00100000:1.0:1787830908.400093:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443833472 00000100:00100000:1.0:1787830908.400103:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443833600 00000100:00100000:1.0:1787830908.400105:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443833600 00000100:00100000:1.0:1787830908.400112:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443833728 00000100:00100000:1.0:1787830908.400115:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443833728 00000100:00100000:1.0:1787830908.400125:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787830908.400133:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220390c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a45944b-32e3-4193-a2a5-46f84222bc14+6:10363:x1874676443833344:12345-0@lo:104: 00010000:00010000:1.0:1787830908.400146:0:6473:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff8d233bf10e00/0x95459fb9d1d28789 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d28790 expref: -99 pid: 9482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830908.400212:0:6473:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787830908.400217:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220390c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a45944b-32e3-4193-a2a5-46f84222bc14+6:10363:x1874676443833344:12345-0@lo:104: Request processed in 86us (1608us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830908.400226:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787830908.400243:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787830908.400249:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203913c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a45944b-32e3-4193-a2a5-46f84222bc14+5:10363:x1874676443833472:12345-0@lo:104: 00010000:00010000:1.0:1787830908.400257:0:6473:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff8d2307c76c00/0x95459fb9d1d28663 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d2866a expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830908.400288:0:6473:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787830908.400293:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203913c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a45944b-32e3-4193-a2a5-46f84222bc14+5:10363:x1874676443833472:12345-0@lo:104: Request processed in 45us (1567us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830908.401548:0:9493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787830908.401564:0:9493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220395e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2a45944b-32e3-4193-a2a5-46f84222bc14+5:10363:x1874676443833600:12345-0@lo:104: 00010000:00010000:0.0:1787830908.401576:0:9493:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff8d2301669600/0x95459fb9d1d28601 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d28608 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830908.401650:0:9493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1787830908.401655:0:9493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220395e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2a45944b-32e3-4193-a2a5-46f84222bc14+5:10363:x1874676443833600:12345-0@lo:104: Request processed in 100us (1656us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830908.401671:0:9493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787830908.401695:0:9493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787830908.401701:0:9493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220395ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2a45944b-32e3-4193-a2a5-46f84222bc14+4:10363:x1874676443833728:12345-0@lo:104: 00010000:00010000:0.0:1787830908.401708:0:9493:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff8d2301668800/0x95459fb9d1d285ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d285b4 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830908.401746:0:9493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1787830908.401750:0:9493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220395ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2a45944b-32e3-4193-a2a5-46f84222bc14+4:10363:x1874676443833728:12345-0@lo:104: Request processed in 51us (1715us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830908.401756:0:9493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787830908.401798:0:10363:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220390d680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10363:1874676443833344:0@lo:104: 00000100:00100000:0.0:1787830908.401807:0:10363:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220390fc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10363:1874676443833472:0@lo:104: 00000100:00100000:0.0:1787830908.401814:0:10363:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220390e1c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10363:1874676443833600:0@lo:104: 00000100:00100000:0.0:1787830908.401820:0:10363:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220390f0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10363:1874676443833728:0@lo:104: 00010000:00010000:0.0:1787830908.401849:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1787830908.401855:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8d233bf10e00/0x95459fb9d1d28789 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d28790 expref: -99 pid: 9482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830908.401863:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233bf10e00 already unused, calling callback (ffffffffc14f9c20) 10000000:00010000:0.0:1787830908.401867:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8d233bf10e00/0x95459fb9d1d28789 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x95459fb9d1d28790 expref: -99 pid: 9482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830908.401876:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8d233bf10e00/0x95459fb9d1d28789 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x95459fb9d1d28790 expref: -99 pid: 9482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787830908.401883:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8d233bf10e00/0x95459fb9d1d28789 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x95459fb9d1d28790 expref: -99 pid: 9482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787830908.401898:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787830908.401933:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8d233bf10e00/0x95459fb9d1d28789 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d28790 expref: -99 pid: 9482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830908.401940:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787830908.401961:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8d233bf10e00/0x95459fb9d1d28789 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d28790 expref: -99 pid: 9482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830908.401968:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8d233bf10e00/0x95459fb9d1d28789 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d28790 expref: -99 pid: 9482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830908.401981:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787830908.401984:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8d2307c76c00/0x95459fb9d1d28663 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d2866a expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830908.401989:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2307c76c00 already unused, calling callback (ffffffffc14f9c20) 10000000:00010000:0.0:1787830908.401992:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8d2307c76c00/0x95459fb9d1d28663 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x95459fb9d1d2866a expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830908.401998:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8d2307c76c00/0x95459fb9d1d28663 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x95459fb9d1d2866a expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787830908.402004:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8d2307c76c00/0x95459fb9d1d28663 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x95459fb9d1d2866a expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787830908.402008:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787830908.402020:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8d2307c76c00/0x95459fb9d1d28663 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d2866a expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830908.402025:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787830908.402049:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8d2307c76c00/0x95459fb9d1d28663 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d2866a expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830908.402056:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8d2307c76c00/0x95459fb9d1d28663 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d2866a expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830908.402066:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787830908.402069:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8d2301669600/0x95459fb9d1d28601 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d28608 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830908.402076:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2301669600 already unused, calling callback (ffffffffc14f9c20) 10000000:00010000:0.0:1787830908.402078:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8d2301669600/0x95459fb9d1d28601 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x95459fb9d1d28608 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830908.402084:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8d2301669600/0x95459fb9d1d28601 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x95459fb9d1d28608 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787830908.402091:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8d2301669600/0x95459fb9d1d28601 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x95459fb9d1d28608 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787830908.402095:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787830908.402108:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8d2301669600/0x95459fb9d1d28601 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d28608 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830908.402113:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787830908.402118:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8d2301669600/0x95459fb9d1d28601 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d28608 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830908.402124:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8d2301669600/0x95459fb9d1d28601 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d28608 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830908.402132:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787830908.402141:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8d2301668800/0x95459fb9d1d285ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d285b4 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830908.402147:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2301668800 already unused, calling callback (ffffffffc14f9c20) 10000000:00010000:0.0:1787830908.402150:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8d2301668800/0x95459fb9d1d285ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x95459fb9d1d285b4 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830908.402157:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8d2301668800/0x95459fb9d1d285ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x95459fb9d1d285b4 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787830908.402164:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8d2301668800/0x95459fb9d1d285ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x95459fb9d1d285b4 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787830908.402169:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787830908.402195:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8d2301668800/0x95459fb9d1d285ad lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d285b4 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830908.402202:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787830908.402208:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8d2301668800/0x95459fb9d1d285ad lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d285b4 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830908.402214:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8d2301668800/0x95459fb9d1d285ad lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d285b4 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830908.402230:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830908.402232:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830908.402234:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787830908.403010:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787830908.403027:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220390c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a45944b-32e3-4193-a2a5-46f84222bc14:3622:1874676443833856:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787830908.403080:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830908.403125:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787830908.403131:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2201defc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a45944b-32e3-4193-a2a5-46f84222bc14:3622:1874676443834240:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787830908.403152:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830908.403188:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443833856 00000100:00100000:3.0:1787830908.403194:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443833856 00010000:00010000:3.0:1787830908.403227:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d233be94c00/0x95459fb9d1d28790 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d28789 expref: 24 pid: 6483 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830908.403253:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443834240 00000100:00100000:3.0:1787830908.403272:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443834240 00010000:00010000:3.0:1787830908.403285:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d233837ba00/0x95459fb9d1d285b4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d285ad expref: 25 pid: 6483 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830908.403312:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787830908.403322:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220394fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2a45944b-32e3-4193-a2a5-46f84222bc14+25:3622:x1874676443833856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787830908.403335:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787830908.403350:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d233be94c00/0x95459fb9d1d28790 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d28789 expref: 25 pid: 6483 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830908.403360:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d233be94c00/0x95459fb9d1d28790 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x95459fb9d1d28789 expref: 25 pid: 6483 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830908.403395:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d233be94c00/0x95459fb9d1d28790 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x95459fb9d1d28789 expref: 25 pid: 6483 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830908.403417:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787830908.403422:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220394d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a45944b-32e3-4193-a2a5-46f84222bc14+25:3622:x1874676443834240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787830908.403430:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787830908.403433:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d233837ba00/0x95459fb9d1d285b4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d285ad expref: 25 pid: 6483 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830908.403441:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d233837ba00/0x95459fb9d1d285b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x95459fb9d1d285ad expref: 25 pid: 6483 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830908.403459:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d233837ba00/0x95459fb9d1d285b4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x95459fb9d1d285ad expref: 25 pid: 6483 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830908.403474:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787830908.403502:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787830908.403526:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220394fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2a45944b-32e3-4193-a2a5-46f84222bc14+23:3622:x1874676443833856:12345-0@lo:103:ldlm_bl.0 Request processed in 207us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830908.403533:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787830908.403932:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220394d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a45944b-32e3-4193-a2a5-46f84222bc14+22:3622:x1874676443834240:12345-0@lo:103:ldlm_bl.0 Request processed in 508us (777us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830908.404135:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787830908.404179:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2201defc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a45944b-32e3-4193-a2a5-46f84222bc14:3622:1874676443834240:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787830908.404187:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220390c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a45944b-32e3-4193-a2a5-46f84222bc14:3622:1874676443833856:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787830908.404573:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220390cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a45944b-32e3-4193-a2a5-46f84222bc14:3619:1874676443833984:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787830908.404605:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830908.404647:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787830908.404653:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787830908.404658:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d232f6ca940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a45944b-32e3-4193-a2a5-46f84222bc14:3619:1874676443834112:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787830908.404678:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787830908.404698:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787830908.404706:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443833984 00000100:00100000:3.0:1787830908.404710:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443833984 00000100:00100000:0.0:1787830908.404998:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443834112 00000100:00100000:0.0:1787830908.405003:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443834112 00010000:00010000:0.0:1787830908.405018:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d233be95400/0x95459fb9d1d28608 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d28601 expref: 23 pid: 6483 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830908.405150:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787830908.405157:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2321e76850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2a45944b-32e3-4193-a2a5-46f84222bc14+23:3619:x1874676443834112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787830908.405168:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787830908.405173:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d233be95400/0x95459fb9d1d28608 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d28601 expref: 23 pid: 6483 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830908.405183:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d233be95400/0x95459fb9d1d28608 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x95459fb9d1d28601 expref: 23 pid: 6483 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830908.405196:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d233be95400/0x95459fb9d1d28608 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x95459fb9d1d28601 expref: 23 pid: 6483 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830908.405208:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787830908.405252:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2321e76850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2a45944b-32e3-4193-a2a5-46f84222bc14+22:3619:x1874676443834112:12345-0@lo:103:ldlm_bl.0 Request processed in 96us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830908.405258:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787830908.405406:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d232f6ca940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a45944b-32e3-4193-a2a5-46f84222bc14:3619:1874676443834112:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787830908.405546:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d233be94400/0x95459fb9d1d2866a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d28663 expref: 21 pid: 6483 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830908.405575:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787830908.405582:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220394c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a45944b-32e3-4193-a2a5-46f84222bc14+21:3619:x1874676443833984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787830908.405589:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787830908.405593:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d233be94400/0x95459fb9d1d2866a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d28663 expref: 21 pid: 6483 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830908.405611:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d233be94400/0x95459fb9d1d2866a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x95459fb9d1d28663 expref: 21 pid: 6483 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830908.405809:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d233be94400/0x95459fb9d1d2866a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x95459fb9d1d28663 expref: 21 pid: 6483 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830908.405822:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787830908.405856:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220394c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a45944b-32e3-4193-a2a5-46f84222bc14+20:3619:x1874676443833984:12345-0@lo:103:ldlm_bl.0 Request processed in 275us (1251us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830908.405942:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220390cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a45944b-32e3-4193-a2a5-46f84222bc14:3619:1874676443833984:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787830908.405982:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787830908.419875:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787830908.420119:0:10363:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220390ed00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10363:1874676443833216:192.168.203.31@tcp:104: 00010000:00010000:0.0:1787830908.420163:0:10363:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d233bf10400/0x95459fb9d1d2896c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830908.420709:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433294976 00000100:00100000:1.0:1787830908.420717:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433294976 00010000:00010000:1.0:1787830908.420760:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d233bf11200/0x95459fb9d1d287f2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423c25 expref: 10 pid: 6483 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830908.420800:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 39 00000100:00100000:1.0:1787830908.420809:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220394fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+10:2396:x1874676433294976:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787830908.420825:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787830908.420830:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d233bf11200/0x95459fb9d1d287f2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423c25 expref: 10 pid: 6483 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830908.420842:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d233bf11200/0x95459fb9d1d287f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423c25 expref: 10 pid: 6483 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830908.420881:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d233bf11200/0x95459fb9d1d287f2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423c25 expref: 10 pid: 6483 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830908.420901:0:6476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d233bf10400/0x95459fb9d1d2896c lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830908.420911:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d233bf10400/0x95459fb9d1d2896c lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830908.420928:0:6476:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d233bf10400/0x95459fb9d1d2896c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830908.420944:0:6476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d233bf10400/0x95459fb9d1d2896c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830908.420952:0:6476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d233bf10400/0x95459fb9d1d2896c lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830908.420959:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d233bf10400/0x95459fb9d1d2896c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830908.420965:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233bf10400 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:1.0:1787830908.420971:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d233bf10400/0x95459fb9d1d2896c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830908.420979:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d233bf10400/0x95459fb9d1d2896c lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830908.420999:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d233bf10400/0x95459fb9d1d2896c lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830908.421018:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787830908.421080:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220394fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+9:2396:x1874676433294976:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 272us (1217us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830908.421088:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 39 00010000:00010000:0.0:1787830908.421246:0:10363:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d233bf10400/0x95459fb9d1d2896c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830908.421255:0:10363:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d233bf10400/0x95459fb9d1d2896c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830908.421262:0:10363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d233bf10400/0x95459fb9d1d2896c lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830908.648163:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787830908.648186:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220394d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443834368:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787830908.648253:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830908.648374:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443834368 00000100:00100000:3.0:1787830908.648381:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443834368 00000100:00100000:3.0:1787830908.648440:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787830908.648449:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220395d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443834368:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787830908.648491:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787830908.648551:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220395d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443834368:12345-0@lo:41:osp-pre-0-1.0 Request processed in 102us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830908.648558:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787830908.648646:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220394d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443834368:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787830908.902822:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787830909.289107:0:6487:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787830909.289115:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d2334556800 from 4 10000000:01000000:3.0:1787830909.289121:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787830909.289169:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d2307c77800/0x95459fb9d1d28973 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830909.289182:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8d2307c77800/0x95459fb9d1d28973 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830909.289195:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8d2307c77800/0x95459fb9d1d28973 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830909.289240:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220394de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443834496:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787830909.289319:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830909.289382:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2310003840 going to sleep for 11 seconds 00000100:00100000:0.0:1787830909.289736:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443834496 00000100:00100000:0.0:1787830909.289744:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443834496 00000100:00100000:0.0:1787830909.289799:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1787830909.289814:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d231859f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+20:6487:x1874676443834496:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787830909.289828:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787830909.289844:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d233bf10600/0x95459fb9d1d2897a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d28973 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830909.289873:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d233bf10600/0x95459fb9d1d2897a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d28973 expref: 21 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830909.289886:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d233bf10600/0x95459fb9d1d2897a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d28973 expref: 21 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830909.289902:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233bf10600, rc 0) 00000100:00100000:0.0:1787830909.289950:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d231859f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+21:6487:x1874676443834496:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 139us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830909.289958:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1787830909.289985:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220394de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443834496:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787830909.290004:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8d2307c77800/0x95459fb9d1d28973 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2897a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830909.290014:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8d2307c77800/0x95459fb9d1d28973 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d2897a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830909.290151:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220395d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443834624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787830909.290330:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830909.290361:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d233be686c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787830909.290701:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443834624 00000100:00100000:0.0:1787830909.290706:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443834624 00000100:00100000:0.0:1787830909.290741:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1787830909.290749:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d231859fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+21:6487:x1874676443834624:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787830909.290870:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d231859fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+21:6487:x1874676443834624:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 121us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830909.290877:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1787830909.290909:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220395d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443834624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787830909.290943:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2201dec000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443834752:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787830909.290990:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830909.291017:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2307cb9840 going to sleep for 11 seconds 00000100:00100000:1.0:1787830909.291098:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443834752 00000100:00100000:1.0:1787830909.291102:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443834752 00000100:00100000:1.0:1787830909.291137:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1787830909.291144:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d231859c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+21:6487:x1874676443834752:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787830909.291239:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d231859c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+21:6487:x1874676443834752:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 95us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830909.291246:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1787830909.291465:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2201dec000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443834752:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787830909.291731:0:10389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220394f0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:10389:1874676443834880:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787830909.291784:0:10389:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830909.291806:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443834880 00000100:00100000:3.0:1787830909.291810:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443834880 00000100:00100000:3.0:1787830909.291843:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1787830909.291851:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d231859c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+21:10389:x1874676443834880:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787830909.291930:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d231859c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+21:10389:x1874676443834880:12345-0@lo:502:llog_process_th.0 Request processed in 80us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830909.291937:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1787830909.291966:0:10389:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d230833bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787830909.291979:0:10389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220394f0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:10389:1874676443834880:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787830909.292000:0:10389:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787830909.292011:0:10389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787830909.292013:0:10389:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787830909.292018:0:10389:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d2334556800 00000020:00000080:3.0:1787830909.292020:0:10389:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787830909.292096:0:10389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220394f0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:10389:1874676443835008:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787830909.292133:0:10389:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830909.292150:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443835008 00000100:00100000:3.0:1787830909.292154:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443835008 00000100:00100000:3.0:1787830909.292184:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1787830909.292189:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d231859dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+21:10389:x1874676443835008:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787830909.292829:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d231859dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+21:10389:x1874676443835008:12345-0@lo:502:llog_process_th.0 Request processed in 637us (694us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830909.292836:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1787830909.292874:0:10389:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d232f686b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787830909.292889:0:10389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220394f0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:10389:1874676443835008:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787830909.292908:0:10389:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787830909.292913:0:10389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787830909.292915:0:10389:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1787830909.292918:0:10389:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1787830909.293303:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1787830909.293331:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787830909.293342:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d2307c77800/0x95459fb9d1d28973 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2897a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830909.293353:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8d2307c77800/0x95459fb9d1d28973 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2897a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787830909.293364:0:6487:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787830909.293366:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d232f6b0800 from 4 10000000:01000000:0.0:1787830909.293369:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787830909.293406:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233bf11400/0x95459fb9d1d28981 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830909.293414:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8d233bf11400/0x95459fb9d1d28981 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830909.293423:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8d233bf11400/0x95459fb9d1d28981 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830909.293438:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2201dee580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443835136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787830909.293472:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830909.293504:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2307cb9180 going to sleep for 11 seconds 00000100:00100000:3.0:1787830909.294376:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443835136 00000100:00100000:3.0:1787830909.294384:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443835136 00000100:00100000:3.0:1787830909.294428:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1787830909.294437:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d231859e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+21:6487:x1874676443835136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787830909.294451:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787830909.294467:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2307c77a00/0x95459fb9d1d28988 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d28981 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830909.294504:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2307c77a00/0x95459fb9d1d28988 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d28981 expref: 22 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830909.294517:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2307c77a00/0x95459fb9d1d28988 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d28981 expref: 22 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830909.294527:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2307c77a00, rc 0) 00000100:00100000:3.0:1787830909.294579:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d231859e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+22:6487:x1874676443835136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 143us (1106us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830909.294597:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1787830909.298818:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2201dee580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443835136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787830909.298852:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8d233bf11400/0x95459fb9d1d28981 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d28988 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830909.298867:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8d233bf11400/0x95459fb9d1d28981 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d28988 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830909.298949:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2201dee580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443835264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787830909.298998:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830909.299041:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2307cb9180 going to sleep for 11 seconds 00000100:00100000:3.0:1787830909.300568:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443835264 00000100:00100000:3.0:1787830909.300578:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443835264 00000100:00100000:3.0:1787830909.300643:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1787830909.300653:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d231859d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+22:6487:x1874676443835264:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787830909.300826:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d231859d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+22:6487:x1874676443835264:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 174us (1826us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830909.300833:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1787830909.301523:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2201dee580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443835264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787830909.301577:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2201dee580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443835392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787830909.301653:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830909.301688:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2307cb9180 going to sleep for 11 seconds 00000100:00100000:0.0:1787830909.301707:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443835392 00000100:00100000:0.0:1787830909.301718:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443835392 00000100:00100000:0.0:1787830909.301757:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1787830909.301766:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2310886050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+22:6487:x1874676443835392:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787830909.301855:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2310886050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+22:6487:x1874676443835392:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 90us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830909.301863:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1787830909.301922:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2201dee580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443835392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787830909.302643:0:10392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2201dee580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:10392:1874676443835520:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787830909.302684:0:10392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830909.302701:0:10392:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2307cb9180 going to sleep for 11 seconds 00000100:00100000:3.0:1787830909.304543:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443835520 00000100:00100000:3.0:1787830909.304553:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443835520 00000100:00100000:3.0:1787830909.304602:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1787830909.304611:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2310884850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+22:10392:x1874676443835520:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787830909.304772:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2310884850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+22:10392:x1874676443835520:12345-0@lo:502:llog_process_th.0 Request processed in 162us (2087us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830909.304780:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1787830909.304854:0:10392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2201dee580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:10392:1874676443835520:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787830909.307021:0:10392:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787830909.307035:0:10392:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787830909.307037:0:10392:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787830909.307045:0:10392:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d232f6b0800 00000020:00000080:3.0:1787830909.307048:0:10392:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787830909.307790:0:10392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220395cf00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:10392:1874676443835648:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787830909.307887:0:10392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830909.308685:0:10392:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2202713f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787830909.309705:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443835648 00000100:00100000:3.0:1787830909.309716:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443835648 00000100:00100000:3.0:1787830909.309772:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1787830909.309782:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2310887c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+22:10392:x1874676443835648:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787830909.312160:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2310887c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+22:10392:x1874676443835648:12345-0@lo:502:llog_process_th.0 Request processed in 2371us (4264us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830909.312183:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1787830909.314941:0:10392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220395cf00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:10392:1874676443835648:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787830909.314991:0:10392:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787830909.314999:0:10392:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787830909.315002:0:10392:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1787830909.315006:0:10392:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1787830909.315927:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1787830909.315953:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787830909.315965:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233bf11400/0x95459fb9d1d28981 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d28988 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830909.315977:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8d233bf11400/0x95459fb9d1d28981 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d28988 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787830909.315987:0:6487:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787830909.315990:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d232f730000 from 4 10000000:01000000:0.0:1787830909.315993:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787830909.316029:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233bf11c00/0x95459fb9d1d2898f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830909.316048:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8d233bf11c00/0x95459fb9d1d2898f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830909.316058:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8d233bf11c00/0x95459fb9d1d2898f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830909.316089:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2201dee580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443835776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787830909.316148:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830909.316186:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2307cb9180 going to sleep for 11 seconds 00000100:00100000:3.0:1787830909.317841:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443835776 00000100:00100000:3.0:1787830909.317854:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443835776 00000100:00100000:3.0:1787830909.317919:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1787830909.317929:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2310887450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+22:6487:x1874676443835776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787830909.317945:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787830909.317966:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2307c76c00/0x95459fb9d1d28996 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d2898f expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830909.317997:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2307c76c00/0x95459fb9d1d28996 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d2898f expref: 23 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830909.318010:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2307c76c00/0x95459fb9d1d28996 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d2898f expref: 23 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830909.318020:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2307c76c00, rc 0) 00000100:00100000:3.0:1787830909.318090:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2310887450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+23:6487:x1874676443835776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 163us (1942us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830909.318097:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1787830909.318148:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2201dee580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443835776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787830909.318165:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8d233bf11c00/0x95459fb9d1d2898f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d28996 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830909.318176:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8d233bf11c00/0x95459fb9d1d2898f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d28996 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830909.318253:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220394f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443835904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787830909.318312:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830909.318344:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d230833bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787830909.318359:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443835904 00000100:00100000:3.0:1787830909.318363:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443835904 00000100:00100000:3.0:1787830909.318386:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1787830909.318393:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2310884450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+23:6487:x1874676443835904:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787830909.318518:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2310884450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+23:6487:x1874676443835904:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 124us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830909.318526:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1787830909.318559:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220394f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443835904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787830909.318593:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220394f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443836032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787830909.318666:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830909.318689:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d230833bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787830909.318702:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443836032 00000100:00100000:3.0:1787830909.318705:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443836032 00000100:00100000:3.0:1787830909.318723:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1787830909.318729:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d230888b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+23:6487:x1874676443836032:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787830909.318810:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d230888b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+23:6487:x1874676443836032:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 80us (144us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830909.318817:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1787830909.318864:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220394f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443836032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787830909.319083:0:10397:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220394f0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:10397:1874676443836160:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787830909.319121:0:10397:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830909.319142:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443836160 00000100:00100000:3.0:1787830909.319152:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443836160 00000100:00100000:3.0:1787830909.319183:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1787830909.319191:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d230888bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+23:10397:x1874676443836160:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787830909.319268:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d230888bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+23:10397:x1874676443836160:12345-0@lo:502:llog_process_th.0 Request processed in 78us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830909.319274:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1787830909.319305:0:10397:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2307ca0cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787830909.319318:0:10397:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220394f0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:10397:1874676443836160:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787830909.319339:0:10397:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787830909.319348:0:10397:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787830909.319351:0:10397:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787830909.319358:0:10397:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d232f730000 00000020:00000080:3.0:1787830909.319360:0:10397:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787830909.319688:0:10397:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220394f0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:10397:1874676443836288:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787830909.319725:0:10397:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830909.319745:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443836288 00000100:00100000:3.0:1787830909.319749:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443836288 00000100:00100000:3.0:1787830909.319771:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1787830909.319777:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2308888450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+23:10397:x1874676443836288:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787830909.319843:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2308888450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+23:10397:x1874676443836288:12345-0@lo:502:llog_process_th.0 Request processed in 66us (116us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830909.319850:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1787830909.319886:0:10397:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2307ca0cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787830909.319899:0:10397:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220394f0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:10397:1874676443836288:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787830909.319918:0:10397:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787830909.319923:0:10397:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787830909.319929:0:10397:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1787830909.319933:0:10397:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1787830909.319990:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1787830909.320011:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787830909.320019:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233bf11c00/0x95459fb9d1d2898f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d28996 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830909.320029:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8d233bf11c00/0x95459fb9d1d2898f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d28996 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787830909.320039:0:6487:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787830909.320042:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d2303f2e000 from 4 10000000:01000000:3.0:1787830909.320044:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787830909.320068:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d2307c77400/0x95459fb9d1d2899d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830909.320075:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8d2307c77400/0x95459fb9d1d2899d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830909.320084:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8d2307c77400/0x95459fb9d1d2899d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830909.320098:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220394f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443836416:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787830909.320126:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830909.320140:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2307ca0cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787830909.320152:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443836416 00000100:00100000:3.0:1787830909.320155:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443836416 00000100:00100000:3.0:1787830909.320180:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1787830909.320188:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2308888850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+23:6487:x1874676443836416:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787830909.320196:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787830909.320212:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2307c77600/0x95459fb9d1d289a4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d2899d expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830909.320235:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2307c77600/0x95459fb9d1d289a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d2899d expref: 24 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830909.320246:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2307c77600/0x95459fb9d1d289a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d2899d expref: 24 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830909.320255:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2307c77600, rc 0) 00000100:00100000:3.0:1787830909.320286:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2308888850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+24:6487:x1874676443836416:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 100us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830909.320293:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1787830909.320323:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220394f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443836416:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787830909.320335:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8d2307c77400/0x95459fb9d1d2899d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d289a4 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830909.320344:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8d2307c77400/0x95459fb9d1d2899d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d289a4 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830909.320391:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220394f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443836544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787830909.320417:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830909.320430:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2307ca0cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787830909.320441:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443836544 00000100:00100000:3.0:1787830909.320444:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443836544 00000100:00100000:3.0:1787830909.320469:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1787830909.320475:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2308889c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+24:6487:x1874676443836544:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787830909.320562:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2308889c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+24:6487:x1874676443836544:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 87us (144us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830909.320573:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1787830909.320601:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220394f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443836544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787830909.320621:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220394f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443836672:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787830909.320669:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830909.320681:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2307ca0cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787830909.320691:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443836672 00000100:00100000:3.0:1787830909.320694:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443836672 00000100:00100000:3.0:1787830909.320713:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1787830909.320718:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d230888a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+24:6487:x1874676443836672:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787830909.320780:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d230888a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+24:6487:x1874676443836672:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 61us (110us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830909.320787:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1787830909.320822:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220394f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443836672:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787830909.328193:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787830909.328234:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433295104 00000100:00100000:3.0:1787830909.328244:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433295104 00000100:00100000:3.0:1787830909.328295:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 262 00000100:00100000:3.0:1787830909.328306:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2308889450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+9:6161:x1874676433295104:12345-192.168.203.31@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787830909.328326:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787830909.328346:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2307c76600/0x95459fb9d1d289ab lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe558a92a99423c6b expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830909.328379:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2307c76600/0x95459fb9d1d289ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423c6b expref: 10 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830909.328404:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2307c76600/0x95459fb9d1d289ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423c6b expref: 10 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830909.328416:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2307c76600, rc 0) 00000100:00100000:3.0:1787830909.328473:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2308889450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+10:6161:x1874676433295104:12345-192.168.203.31@tcp:101:ll_cfg_requeue.0 Request processed in 168us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830909.328492:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 262 00000100:00100000:1.0:1787830909.330727:0:10398:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220395f0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:10398:1874676443836800:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787830909.331194:0:10398:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830909.331315:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787830909.331354:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443836800 00000100:00100000:2.0:1787830909.331360:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443836800 00000100:00100000:2.0:1787830909.331400:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1787830909.331411:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2308888c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+24:10398:x1874676443836800:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787830909.331551:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2308888c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+24:10398:x1874676443836800:12345-0@lo:502:llog_process_th.0 Request processed in 141us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830909.331574:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1787830909.331609:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433295232 00000100:00100000:2.0:1787830909.331613:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433295232 00000100:00100000:2.0:1787830909.331658:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 264 00000100:00100000:2.0:1787830909.331667:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d230888ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+10:6161:x1874676433295232:12345-192.168.203.31@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787830909.331762:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d230888ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+10:6161:x1874676433295232:12345-192.168.203.31@tcp:501:ll_cfg_requeue.0 Request processed in 96us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830909.331773:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 264 00000100:00100000:3.0:1787830909.333985:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787830909.334028:0:10398:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2202713c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787830909.334059:0:10398:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220395f0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:10398:1874676443836800:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787830909.334098:0:10398:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787830909.334107:0:10398:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787830909.334109:0:10398:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787830909.334115:0:10398:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d2303f2e000 00000020:00000080:1.0:1787830909.334117:0:10398:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787830909.334181:0:10398:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220395f0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:10398:1874676443836928:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787830909.334248:0:10398:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830909.335205:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433295360 00000100:00100000:2.0:1787830909.335213:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433295360 00000100:00100000:2.0:1787830909.335257:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443836928 00000100:00100000:2.0:1787830909.335261:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443836928 00000100:00100000:2.0:1787830909.335280:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 265 00000100:00100000:2.0:1787830909.335289:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d230888b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+10:6161:x1874676433295360:12345-192.168.203.31@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787830909.335385:0:10398:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2202713c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787830909.335416:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d230888b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+10:6161:x1874676433295360:12345-192.168.203.31@tcp:503:ll_cfg_requeue.0 Request processed in 126us (1435us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830909.335425:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 265 00000100:00100000:2.0:1787830909.335454:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1787830909.335460:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2308889850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+24:10398:x1874676443836928:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787830909.335546:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2308889850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+24:10398:x1874676443836928:12345-0@lo:502:llog_process_th.0 Request processed in 86us (1298us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830909.335551:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1787830909.335658:0:10398:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220395f0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:10398:1874676443836928:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787830909.335690:0:10398:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787830909.335697:0:10398:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787830909.335699:0:10398:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1787830909.335703:0:10398:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1787830909.336169:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1787830909.336197:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787830909.336209:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d2307c77400/0x95459fb9d1d2899d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d289a4 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830909.336220:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8d2307c77400/0x95459fb9d1d2899d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d289a4 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830909.340477:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787830909.340535:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433295488 00000100:00100000:2.0:1787830909.340545:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433295488 00000100:00100000:2.0:1787830909.340601:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 267 00000100:00100000:2.0:1787830909.340620:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a686850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+10:6693:x1874676433295488:12345-192.168.203.31@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787830909.340791:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a686850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+10:6693:x1874676433295488:12345-192.168.203.31@tcp:502:llog_process_th.0 Request processed in 174us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830909.340800:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 267 00000100:00100000:3.0:1787830909.347684:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787830909.347784:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433295616 00000100:00100000:1.0:1787830909.347793:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433295616 00000100:00100000:1.0:1787830909.347851:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 268 00000100:00100000:1.0:1787830909.347861:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a687050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+10:6693:x1874676433295616:12345-192.168.203.31@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787830909.348007:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a687050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+10:6693:x1874676433295616:12345-192.168.203.31@tcp:502:llog_process_th.0 Request processed in 147us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830909.348027:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 268 00000100:00100000:1.0:1787830909.677522:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220395f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874676443837056:0@lo:400:kworker.0 00000100:00100000:1.0:1787830909.677600:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830909.677668:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220395e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3619:1874676443837568:0@lo:400:kworker.0 00000100:00100000:1.0:1787830909.677696:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830909.677720:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220395c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3619:1874676443838080:0@lo:400:kworker.0 00000100:00100000:1.0:1787830909.677763:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830909.677785:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220258fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443838592:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787830909.677812:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830909.677837:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1787830909.677843:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220395cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443837184:0@lo:400:kworker.0 00000100:00100000:1.0:1787830909.677868:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830909.677886:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220395c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3619:1874676443837696:0@lo:400:kworker.0 00000100:00100000:1.0:1787830909.677908:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830909.677925:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220395da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3619:1874676443838208:0@lo:400:kworker.0 00000100:00100000:1.0:1787830909.677945:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830909.677955:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220258e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443838720:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787830909.677972:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830909.678001:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220395d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3621:1874676443837312:0@lo:400:kworker.0 00000100:00100000:1.0:1787830909.678023:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830909.678034:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220395cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443837824:0@lo:400:kworker.0 00000100:00100000:1.0:1787830909.678055:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830909.678077:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220395c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443838336:0@lo:400:kworker.0 00000100:00100000:1.0:1787830909.678106:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830909.678126:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1787830909.678131:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220395fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443837440:0@lo:400:kworker.0 00000100:00100000:1.0:1787830909.678159:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830909.678177:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220395e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443837952:0@lo:400:kworker.0 00000100:00100000:1.0:1787830909.678199:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830909.678214:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220395de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443838464:0@lo:400:kworker.0 00000100:00100000:1.0:1787830909.678232:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830909.678262:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443837056 00000100:00100000:1.0:1787830909.678269:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443837056 00000100:00100000:1.0:1787830909.678303:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443837568 00000100:00100000:1.0:1787830909.678306:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443837568 00000100:00100000:1.0:1787830909.678330:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443838080 00000100:00100000:1.0:1787830909.678333:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443838080 00000100:00100000:1.0:1787830909.678347:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443837696 00000100:00100000:1.0:1787830909.678349:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443837696 00000100:00100000:1.0:1787830909.678361:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443838208 00000100:00100000:1.0:1787830909.678363:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443838208 00000100:00100000:1.0:1787830909.678374:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443837312 00000100:00100000:1.0:1787830909.678376:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443837312 00000100:00100000:1.0:1787830909.678390:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787830909.678397:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220258de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874676443837056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830909.678449:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220258de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874676443837056:12345-0@lo:400:kworker.0 Request processed in 52us (849us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830909.678457:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787830909.678474:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787830909.678494:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220258f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874676443837568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830909.678522:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220258f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874676443837568:12345-0@lo:400:kworker.0 Request processed in 43us (825us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830909.678534:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787830909.678547:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787830909.678554:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203997480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874676443838080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830909.678580:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203997480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874676443838080:12345-0@lo:400:kworker.0 Request processed in 28us (823us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830909.678586:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787830909.678597:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787830909.678602:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203996580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874676443837696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830909.678652:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203996580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874676443837696:12345-0@lo:400:kworker.0 Request processed in 50us (743us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830909.678658:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787830909.678670:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787830909.678676:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203996d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874676443838208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830909.678702:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203996d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874676443838208:12345-0@lo:400:kworker.0 Request processed in 27us (757us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830909.678708:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787830909.678720:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787830909.678726:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22039952c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1874676443837312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830909.678757:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22039952c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1874676443837312:12345-0@lo:400:kworker.0 Request processed in 31us (732us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830909.678763:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787830909.678793:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443838592 00000100:00100000:1.0:1787830909.678797:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443838592 00000100:00100000:1.0:1787830909.678819:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443838720 00000100:00100000:1.0:1787830909.678822:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443838720 00000100:00100000:1.0:1787830909.678848:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787830909.678854:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22039943c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443838592:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787830909.678879:0:8409:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787830909.678909:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22039943c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443838592:12345-0@lo:13:osp-pre-1-1.0 Request processed in 56us (1097us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830909.678916:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787830909.678929:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787830909.678935:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203995680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676443838720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787830909.678944:0:8409:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787830909.678967:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203995680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676443838720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 32us (993us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830909.678973:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787830909.678991:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443837184 00000100:00100000:1.0:1787830909.678995:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443837184 00000100:00100000:1.0:1787830909.679027:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443837440 00000100:00100000:1.0:1787830909.679030:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443837440 00000100:00100000:1.0:1787830909.679050:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787830909.679058:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203997840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443837184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830909.679092:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203997840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443837184:12345-0@lo:400:kworker.0 Request processed in 37us (1223us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830909.679098:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787830909.679113:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787830909.679119:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22039961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1874676443837440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830909.679147:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22039961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1874676443837440:12345-0@lo:400:kworker.0 Request processed in 29us (988us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830909.679153:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787830909.679187:0:8631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443837824 00000100:00100000:1.0:1787830909.679191:0:8631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443837824 00000100:00100000:1.0:1787830909.679211:0:8631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443838336 00000100:00100000:1.0:1787830909.679214:0:8631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443838336 00000100:00100000:1.0:1787830909.679227:0:8631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443837952 00000100:00100000:1.0:1787830909.679230:0:8631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443837952 00000100:00100000:1.0:1787830909.679243:0:8631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443838464 00000100:00100000:1.0:1787830909.679245:0:8631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443838464 00000100:00100000:1.0:1787830909.679258:0:8631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787830909.679265:0:8631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203994f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443837824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830909.679300:0:8631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203994f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443837824:12345-0@lo:400:kworker.0 Request processed in 35us (1244us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830909.679306:0:8631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787830909.679321:0:8631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787830909.679327:0:8631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22039970c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443838336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830909.679359:0:8631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22039970c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443838336:12345-0@lo:400:kworker.0 Request processed in 32us (1251us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830909.679365:0:8631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787830909.679378:0:8631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787830909.679385:0:8631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203997c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3621:x1874676443837952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830909.679416:0:8631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203997c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3621:x1874676443837952:12345-0@lo:400:kworker.0 Request processed in 32us (1216us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830909.679428:0:8631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787830909.679439:0:8631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787830909.679445:0:8631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203994000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3621:x1874676443838464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830909.679476:0:8631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203994000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3621:x1874676443838464:12345-0@lo:400:kworker.0 Request processed in 31us (1243us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830909.679504:0:8631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1787830909.679543:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787830909.679549:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787830909.679552:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787830909.679555:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787830909.679595:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220395fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443837440:0@lo:400:kworker.0 00010000:00080000:1.0:1787830909.679615:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d220395e940 x1874676443837952/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787830925 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787830909.679794:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220395e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443837952:0@lo:400:kworker.0 00010000:00080000:1.0:1787830909.679809:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d220395de00 x1874676443838464/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787830925 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787830909.679816:0:3621:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:1.0:1787830909.679831:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220395de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443838464:0@lo:400:kworker.0 00000100:00100000:1.0:1787830909.679845:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220395d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3621:1874676443837312:0@lo:400:kworker.0 00010000:00080000:1.0:1787830909.679857:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d220395cb40 x1874676443837824/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787830925 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787830909.679866:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220395cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443837824:0@lo:400:kworker.0 00010000:00080000:1.0:1787830909.679878:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d220395c000 x1874676443838336/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787830925 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787830909.679886:0:3621:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1787830909.679899:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220395c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443838336:0@lo:400:kworker.0 00000100:00100000:1.0:1787830909.686132:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220395cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443837184:0@lo:400:kworker.0 00010000:00080000:1.0:1787830909.686183:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d220395c3c0 x1874676443837696/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830925 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787830909.686195:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220395c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3619:1874676443837696:0@lo:400:kworker.0 00010000:00080000:1.0:1787830909.686210:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d220395da40 x1874676443838208/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830925 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787830909.686219:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220395da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3619:1874676443838208:0@lo:400:kworker.0 00010000:00080000:1.0:1787830909.686233:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d220258e1c0 x1874676443838720/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787830925 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787830909.686254:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220258e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443838720:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787830909.686270:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220395f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874676443837056:0@lo:400:kworker.0 00000100:00100000:1.0:1787830909.686294:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220395e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3619:1874676443837568:0@lo:400:kworker.0 00000100:00100000:1.0:1787830909.686307:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220395c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3619:1874676443838080:0@lo:400:kworker.0 00010000:00080000:1.0:1787830909.686320:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d220258fc00 x1874676443838592/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787830925 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787830909.686333:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220258fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443838592:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1787830909.927522:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787830910.033294:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787830910.033375:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787830910.033411:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787830910.033425:0:8631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433296128 00000100:00100000:0.0:1787830910.033435:0:8631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433296128 00000100:00100000:1.0:1787830910.033445:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787830910.033513:0:8631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 15 00000100:00100000:0.0:1787830910.033532:0:8631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203995a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:2396:x1874676433296128:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1787830910.033609:0:8631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203995a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:2396:x1874676433296128:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 82us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830910.033617:0:8631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 15 00000100:00100000:2.0:1787830910.034104:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433295744 00000100:00100000:2.0:1787830910.034110:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433295744 00000100:00100000:2.0:1787830910.034152:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 269 00000100:00100000:2.0:1787830910.034159:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a686450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+10:2396:x1874676433295744:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1787830910.034201:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a686450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+10:2396:x1874676433295744:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 43us (791us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830910.034209:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 269 00000100:00080000:2.0:1787830910.034696:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787830910.034896:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787830910.035012:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433296256 00000100:00100000:1.0:1787830910.035018:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433296256 00000100:00100000:1.0:1787830910.035491:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 16 00000100:00100000:1.0:1787830910.035501:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203996940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:2396:x1874676433296256:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1787830910.035552:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203996940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:2396:x1874676433296256:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 54us (659us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830910.035559:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 16 00000100:00080000:0.0:1787830910.035730:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787830910.036892:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433295872 00000100:00100000:3.0:1787830910.036902:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433295872 00000100:00100000:2.0:1787830910.037285:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433296000 00000100:00100000:2.0:1787830910.037292:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433296000 00000100:00100000:3.0:1787830910.037412:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 53 00000100:00100000:3.0:1787830910.037421:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203995e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+6:2396:x1874676433295872:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1787830910.037502:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203995e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+6:2396:x1874676433295872:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 82us (4219us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830910.037510:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 53 00000100:00100000:2.0:1787830910.037816:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 54 00000100:00100000:2.0:1787830910.037826:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203994780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:2396:x1874676433296000:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1787830910.037878:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203994780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:2396:x1874676433296000:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 54us (4433us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830910.037885:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 54 00000100:00080000:0.0:1787830910.038453:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787830910.038459:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787830910.951522:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830911.974849:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787830912.742851:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787830912.742883:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2201dec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676443838848:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787830912.742986:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830912.743068:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443838848 00000100:00100000:0.0:1787830912.743076:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443838848 00000100:00100000:0.0:1787830912.743144:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787830912.743157:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2201defc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1874676443838848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787830912.743204:0:8409:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787830912.743257:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2201defc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1874676443838848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830912.743265:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:0.0:1787830912.743302:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787830912.743339:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2201dec000 x1874676443838848/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787830928 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787830912.743361:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2201dec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676443838848:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787830912.743833:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2201dec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676443838976:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787830912.743877:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830912.745491:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443838976 00000100:00100000:2.0:1787830912.745507:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443838976 00000100:00100000:2.0:1787830912.745590:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787830912.745600:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220390a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676443838976:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787830912.745657:0:8409:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1787830912.745834:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787830912.745887:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220390a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676443838976:12345-0@lo:13:osp-pre-0-1.0 Request processed in 287us (2008us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830912.745895:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:2.0:1787830912.746015:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2201dec000 x1874676443838976/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787830928 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787830912.746035:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2201dec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676443838976:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1787830913.000901:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787830913.256364:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787830913.256399:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220390bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1874676443839104:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787830913.256503:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830913.256704:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443839104 00000100:00100000:3.0:1787830913.256713:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443839104 00000100:00100000:3.0:1787830913.256786:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787830913.256797:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203908000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1874676443839104:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787830913.257031:0:7448:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787830913.257096:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203908000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1874676443839104:12345-0@lo:41:osp-pre-1-0.0 Request processed in 301us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830913.257114:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787830913.257512:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220390bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1874676443839104:0@lo:41:osp-pre-1-0.0 00000001:02000400:3.0:1787830913.407447:0:10663:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg331-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:3.0:1787830913.766980:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787830913.767005:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220394d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443839232:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787830913.767095:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830913.767269:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443839232 00000100:00100000:3.0:1787830913.767276:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443839232 00000100:00100000:3.0:1787830913.767322:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787830913.767329:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220394e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443839232:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787830913.767364:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787830913.767409:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220394e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443839232:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830913.767416:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787830913.767470:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220394d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443839232:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787830914.022885:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787830914.792252:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220395c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a45944b-32e3-4193-a2a5-46f84222bc14:3621:1874676443839360:0@lo:400:kworker.0 00000100:00100000:3.0:1787830914.792344:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830914.792420:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220395da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3621:1874676443839872:0@lo:400:kworker.0 00000100:00100000:3.0:1787830914.792461:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830914.792481:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787830914.792487:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220390bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443839488:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787830914.792533:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830914.792553:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2201dee580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443840000:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787830914.792573:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830914.792598:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220395e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874676443839616:0@lo:400:kworker.0 00000100:00100000:3.0:1787830914.792621:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830914.792664:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787830914.792670:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220395f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443839744:0@lo:400:kworker.0 00000100:00100000:3.0:1787830914.792692:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830914.792721:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443839872 00000100:00100000:3.0:1787830914.792728:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443839872 00000100:00100000:0.0:1787830914.792894:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443839360 00000100:00100000:0.0:1787830914.792899:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443839360 00000100:00100000:0.0:1787830914.792931:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1787830914.792941:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a687850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+24:3621:x1874676443839360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787830914.792947:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443839616 00000100:00100000:3.0:1787830914.792950:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443839616 00000100:00100000:3.0:1787830914.792975:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787830914.792981:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220394d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1874676443839872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787830914.792996:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a687850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+24:3621:x1874676443839360:12345-0@lo:400:kworker.0 Request processed in 56us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830914.793003:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1787830914.793013:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220394d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1874676443839872:12345-0@lo:400:kworker.0 Request processed in 32us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830914.793018:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787830914.793030:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787830914.793037:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220394c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874676443839616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787830914.793067:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220394c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874676443839616:12345-0@lo:400:kworker.0 Request processed in 31us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830914.793073:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787830914.793090:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443839488 00000100:00100000:3.0:1787830914.793094:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443839488 00000100:00100000:3.0:1787830914.793120:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443840000 00000100:00100000:3.0:1787830914.793123:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443840000 00000100:00100000:3.0:1787830914.793137:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787830914.793150:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220394f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443839488:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787830914.793173:0:8410:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787830914.793206:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220394f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443839488:12345-0@lo:13:osp-pre-1-1.0 Request processed in 58us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830914.793212:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787830914.793222:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787830914.793227:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220394c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1874676443840000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787830914.793237:0:8410:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787830914.793258:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220394c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1874676443840000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 31us (684us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830914.793263:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787830914.793290:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443839744 00000100:00100000:3.0:1787830914.793294:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443839744 00000100:00100000:3.0:1787830914.793316:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787830914.793322:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220394cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443839744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787830914.793359:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220394cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443839744:12345-0@lo:400:kworker.0 Request processed in 36us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830914.793378:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787830914.793430:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220395f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443839744:0@lo:400:kworker.0 00000100:00100000:3.0:1787830914.793456:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220395e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874676443839616:0@lo:400:kworker.0 00010000:00080000:3.0:1787830914.793491:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d220390bc00 x1874676443839488/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787830930 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787830914.793507:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220390bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443839488:0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1787830914.793518:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2201dee580 x1874676443840000/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787830930 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787830914.793536:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2201dee580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443840000:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787830914.793550:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220395da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3621:1874676443839872:0@lo:400:kworker.0 00000100:00100000:3.0:1787830914.793558:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220395c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a45944b-32e3-4193-a2a5-46f84222bc14:3621:1874676443839360:0@lo:400:kworker.0 00000100:00100000:3.0:1787830914.796016:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220395c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443840128:0@lo:400:kworker.0 00000100:00100000:2.0:1787830914.796016:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220395c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3621:1874676443840384:0@lo:400:kworker.0 00000100:00080000:1.0:1787830914.796128:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787830914.796142:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220395cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3620:1874676443840256:0@lo:400:kworker.0 00000100:00100000:3.0:1787830914.797296:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830914.797358:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220395d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443840640:0@lo:400:kworker.0 00000100:00100000:2.0:1787830914.797463:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830914.797509:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220395e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3621:1874676443840896:0@lo:400:kworker.0 00000100:00100000:2.0:1787830914.797535:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830914.797556:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787830914.797561:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220395cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443840512:0@lo:400:kworker.0 00000100:00100000:2.0:1787830914.797585:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830914.797654:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443840128 00000100:00100000:2.0:1787830914.797662:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443840128 00000100:00100000:2.0:1787830914.797713:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787830914.797721:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220394f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676443840128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787830914.797943:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220394f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676443840128:12345-0@lo:400:kworker.0 Request processed in 221us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830914.797959:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787830914.797988:0:8631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443840512 00000100:00100000:2.0:1787830914.797992:0:8631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443840512 00000100:00100000:2.0:1787830914.798033:0:8631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787830914.798040:0:8631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203908780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443840512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787830914.798179:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830914.798324:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220395c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443840128:0@lo:400:kworker.0 00000100:00100000:3.0:1787830914.798752:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443840384 00000100:00100000:3.0:1787830914.798757:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443840384 00000100:00100000:3.0:1787830914.798859:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443840896 00000100:00100000:3.0:1787830914.798863:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443840896 00000100:00100000:3.0:1787830914.798889:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787830914.798897:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203909e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1874676443840384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787830914.798947:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203909e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1874676443840384:12345-0@lo:400:kworker.0 Request processed in 51us (1483us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830914.798954:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787830914.799017:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787830914.799040:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203909a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1874676443840896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787830914.799118:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203909a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1874676443840896:12345-0@lo:400:kworker.0 Request processed in 94us (1581us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830914.799124:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787830914.799596:0:8631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203908780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443840512:12345-0@lo:400:kworker.0 Request processed in 1555us (2008us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830914.799605:0:8631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787830914.799621:0:8631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443840640 00000100:00100000:2.0:1787830914.799905:0:8631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443840640 00000100:00100000:2.0:1787830914.799979:0:8631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787830914.799987:0:8631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220394de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676443840640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787830914.800034:0:8631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220394de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676443840640:12345-0@lo:400:kworker.0 Request processed in 48us (1855us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830914.800041:0:8631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:2.0:1787830914.800350:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d220395cb40 x1874676443840512/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787830930 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787830914.800728:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220395cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443840512:0@lo:400:kworker.0 00010000:00080000:2.0:1787830914.800749:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d220395e940 x1874676443840896/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830930 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787830914.800758:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220395e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3621:1874676443840896:0@lo:400:kworker.0 00010000:00080000:2.0:1787830914.800768:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d220395c000 x1874676443840384/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830930 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787830914.800776:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220395c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3621:1874676443840384:0@lo:400:kworker.0 00010000:00080000:2.0:1787830914.800943:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d220395d2c0 x1874676443840640/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787830930 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787830914.800953:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220395d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443840640:0@lo:400:kworker.0 00000100:00080000:0.0:1787830914.802025:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787830914.802033:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787830914.802219:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830914.802271:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220395de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3620:1874676443840768:0@lo:400:kworker.0 00000100:00100000:1.0:1787830914.802302:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830914.802349:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443840256 00000100:00100000:1.0:1787830914.802355:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443840256 00000100:00100000:1.0:1787830914.802426:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443840768 00000100:00100000:1.0:1787830914.802430:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443840768 00000100:00080000:2.0:1787830914.802457:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787830914.802469:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787830914.802478:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220395fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1874676443840256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830914.802541:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220395fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1874676443840256:12345-0@lo:400:kworker.0 Request processed in 65us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830914.802549:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787830914.802566:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787830914.802573:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220395d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1874676443840768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830914.802599:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220395d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1874676443840768:12345-0@lo:400:kworker.0 Request processed in 28us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830914.802605:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787830914.802702:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220395cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3620:1874676443840256:0@lo:400:kworker.0 00000100:00100000:2.0:1787830914.802720:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220395de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3620:1874676443840768:0@lo:400:kworker.0 00010000:00010000:1.0:1787830915.048042:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787830915.154972:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787830915.155026:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787830915.155064:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787830915.155102:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433296896 00000100:00100000:1.0:1787830915.155112:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433296896 00000100:00100000:1.0:1787830915.155179:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 19 00000100:00100000:1.0:1787830915.155190:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220395cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:2396:x1874676433296896:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1787830915.155260:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433296640 00000100:00100000:0.0:1787830915.155265:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433296640 00000100:00100000:1.0:1787830915.155269:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220395cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:2396:x1874676433296896:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 81us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830915.155276:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 19 00000100:00080000:1.0:1787830915.155299:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787830915.155299:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 61 00000100:00080000:1.0:1787830915.155304:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787830915.155307:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220395e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:2396:x1874676433296640:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1787830915.155337:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220395e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:2396:x1874676433296640:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 32us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830915.155343:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 61 00000100:00100000:3.0:1787830915.155647:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433296384 00000100:00100000:3.0:1787830915.155659:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433296384 00000100:00100000:3.0:1787830915.155753:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 271 00000100:00100000:3.0:1787830915.155760:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a687c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+10:2396:x1874676433296384:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1787830915.155805:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a687c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+10:2396:x1874676433296384:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 46us (848us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830915.155811:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 271 00000100:00100000:1.0:1787830915.156353:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787830915.156380:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787830915.156426:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433296512 00000100:00100000:0.0:1787830915.156431:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433296512 00000100:00100000:1.0:1787830915.158491:0:8631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433296768 00000100:00100000:1.0:1787830915.158506:0:8631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433296768 00000100:00100000:0.0:1787830915.160095:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 62 00000100:00100000:0.0:1787830915.160110:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220395c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+6:2396:x1874676433296512:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1787830915.160203:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220395c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+6:2396:x1874676433296512:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 96us (3851us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830915.160218:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 62 00000100:00100000:1.0:1787830915.161307:0:8631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 20 00000100:00100000:1.0:1787830915.161321:0:8631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220395c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:2396:x1874676433296768:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1787830915.161373:0:8631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220395c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:2396:x1874676433296768:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 56us (4991us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830915.161380:0:8631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 20 00000100:00080000:0.0:1787830915.161950:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787830915.161957:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787830916.071689:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787830917.044524:0:10907:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg331-server.virtnet: executing yml_node 00010000:00010000:3.0:1787830917.095767:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787830917.862820:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787830917.862844:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220390bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443841024:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787830917.863246:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830917.863292:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443841024 00000100:00100000:3.0:1787830917.863302:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443841024 00000100:00100000:3.0:1787830917.863384:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787830917.863397:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220390b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443841024:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787830917.863445:0:8410:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787830917.863512:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220390b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443841024:12345-0@lo:13:osp-pre-0-1.0 Request processed in 117us (268us total) trans 0 rc 0/0 00010000:00080000:2.0:1787830917.863613:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d220390bc00 x1874676443841024/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787830933 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787830917.863658:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220390bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443841024:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787830917.865508:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787830917.865549:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2201dee580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443841152:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787830917.865647:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830917.865691:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443841152 00000100:00100000:3.0:1787830917.865699:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443841152 00000100:00100000:3.0:1787830917.865743:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787830917.865752:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220390bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676443841152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787830917.865776:0:8410:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787830917.865833:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220390bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676443841152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830917.865840:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:3.0:1787830917.865859:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787830917.866214:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2201dee580 x1874676443841152/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787830933 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787830917.866234:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2201dee580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443841152:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787830918.123655:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787830918.375070:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787830918.375093:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220390a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443841280:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787830918.375174:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830918.375304:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443841280 00000100:00100000:1.0:1787830918.375311:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443841280 00000100:00100000:1.0:1787830918.375356:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787830918.375365:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220394d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676443841280:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787830918.375407:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787830918.375471:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220394d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676443841280:12345-0@lo:41:osp-pre-1-0.0 Request processed in 106us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830918.375478:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787830918.375689:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220390a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443841280:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787830918.887919:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220394c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443841408:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787830918.887998:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830918.888119:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443841408 00000100:00100000:3.0:1787830918.888127:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443841408 00000100:00100000:3.0:1787830918.888194:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787830918.888205:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203908f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443841408:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787830918.888240:0:7448:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787830918.888301:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203908f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443841408:12345-0@lo:41:osp-pre-0-1.0 Request processed in 98us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830918.888309:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787830918.888346:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220394c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443841408:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1787830919.143275:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787830919.901243:0:11090:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.61 00000100:00100000:1.0:1787830919.911952:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2201dee580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a45944b-32e3-4193-a2a5-46f84222bc14:3622:1874676443841536:0@lo:400:kworker.0 00000100:00100000:1.0:1787830919.912053:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830919.912205:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2309d0bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874676443841664:0@lo:400:kworker.0 00000100:00100000:3.0:1787830919.912248:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830919.912285:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787830919.912292:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787830919.912293:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2309d09e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443841792:0@lo:400:kworker.0 00000100:00100000:1.0:1787830919.912306:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203793480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3622:1874676443841920:0@lo:400:kworker.0 00000100:00100000:3.0:1787830919.912326:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830919.912350:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830919.912377:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443841664 00000100:00100000:1.0:1787830919.912381:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22039092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676443842048:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787830919.912385:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443841664 00000100:00100000:1.0:1787830919.912423:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830919.912465:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443841920 00000100:00100000:1.0:1787830919.912470:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443841920 00000100:00100000:1.0:1787830919.912531:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787830919.912543:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220395da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1874676443841920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830919.912604:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220395da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1874676443841920:12345-0@lo:400:kworker.0 Request processed in 64us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830919.912612:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787830919.912655:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443842048 00000100:00100000:1.0:1787830919.912659:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443842048 00000100:00100000:1.0:1787830919.912700:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787830919.912707:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220395e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676443842048:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787830919.912733:0:8409:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787830919.912768:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220395e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676443842048:12345-0@lo:13:osp-pre-1-1.0 Request processed in 62us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830919.912775:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:1.0:1787830919.912897:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d22039092c0 x1874676443842048/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787830935 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787830919.912918:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22039092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676443842048:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787830919.912932:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203793480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3622:1874676443841920:0@lo:400:kworker.0 00000100:00100000:2.0:1787830919.913336:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203792940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443842176:0@lo:400:kworker.0 00000100:00100000:1.0:1787830919.913359:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787830919.913391:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830919.913446:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787830919.913447:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2314ed61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676443842560:0@lo:400:kworker.0 00000100:00100000:2.0:1787830919.913456:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203790780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3619:1874676443842304:0@lo:400:kworker.0 00000100:00100000:1.0:1787830919.913492:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830919.913499:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830919.913518:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203793480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3622:1874676443842432:0@lo:400:kworker.0 00000100:00100000:1.0:1787830919.913548:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830919.913596:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443842560 00000100:00100000:1.0:1787830919.913601:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443842560 00000100:00100000:3.0:1787830919.913618:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443842304 00000100:00100000:1.0:1787830919.913758:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787830919.913767:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220395f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676443842560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787830919.913779:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443842304 00000100:00100000:3.0:1787830919.913807:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443842432 00000100:00100000:3.0:1787830919.913811:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443842432 00000100:00100000:3.0:1787830919.913830:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787830919.913838:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220395f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676443842560:12345-0@lo:400:kworker.0 Request processed in 70us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830919.913842:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220394da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874676443841664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830919.913850:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787830919.913880:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787830919.913892:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220390ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874676443842304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787830919.913899:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220394da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874676443841664:12345-0@lo:400:kworker.0 Request processed in 60us (1650us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830919.913912:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787830919.913933:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787830919.913944:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220390ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874676443842304:12345-0@lo:400:kworker.0 Request processed in 54us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830919.913952:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220395c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1874676443842432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787830919.913953:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787830919.913993:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220395c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1874676443842432:12345-0@lo:400:kworker.0 Request processed in 45us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830919.914000:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787830919.914023:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443841792 00000100:00100000:3.0:1787830919.914027:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443841792 00000100:00100000:3.0:1787830919.914101:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443842176 00000100:00100000:3.0:1787830919.914106:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443842176 00000100:00100000:2.0:1787830919.914154:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787830919.914164:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220394e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443841792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787830919.914220:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220394e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443841792:12345-0@lo:400:kworker.0 Request processed in 59us (1894us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830919.914228:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787830919.914251:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a22580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676443843072:0@lo:400:kworker.0 00000100:00100000:1.0:1787830919.914282:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830919.914289:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787830919.914300:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203909680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676443842176:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1787830919.914321:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2314ed61c0 x1874676443842560/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787830935 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787830919.914336:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2314ed61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676443842560:0@lo:400:kworker.0 00000100:00100000:3.0:1787830919.914343:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203909680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676443842176:12345-0@lo:400:kworker.0 Request processed in 45us (953us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830919.914353:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:1.0:1787830919.914354:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2203793480 x1874676443842432/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830935 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787830919.914366:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203793480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3622:1874676443842432:0@lo:400:kworker.0 00000100:00080000:3.0:1787830919.914379:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787830919.914385:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787830919.914389:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787830919.914393:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787830919.914395:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787830919.914403:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a23840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3622:1874676443842944:0@lo:400:kworker.0 00000100:00100000:1.0:1787830919.914447:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830919.914496:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443841536 00000100:00100000:0.0:1787830919.914501:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443841536 00000100:00100000:0.0:1787830919.914536:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1787830919.914543:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a684450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+24:3622:x1874676443841536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787830919.914608:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443842944 00000100:00100000:2.0:1787830919.914613:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443842944 00000100:00100000:0.0:1787830919.914621:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a684450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+24:3622:x1874676443841536:12345-0@lo:400:kworker.0 Request processed in 78us (2567us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830919.914650:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1787830919.914691:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787830919.914700:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220395cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1874676443842944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787830919.914724:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a203c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3620:1874676443842816:0@lo:400:kworker.0 00000100:00100000:2.0:1787830919.914743:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220395cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1874676443842944:12345-0@lo:400:kworker.0 Request processed in 44us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830919.914751:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787830919.914760:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830919.914769:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443842816 00000100:00100000:2.0:1787830919.914773:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443842816 00000100:00100000:0.0:1787830919.914782:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787830919.914790:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1874676443842688:0@lo:400:kworker.0 00000100:00100000:2.0:1787830919.914797:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787830919.914804:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a21680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1874676443842816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787830919.914836:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a21680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1874676443842816:12345-0@lo:400:kworker.0 Request processed in 34us (78us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830919.914849:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00080000:1.0:1787830919.914950:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2203a23840 x1874676443842944/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830935 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787830919.914960:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a23840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3622:1874676443842944:0@lo:400:kworker.0 00000100:00100000:1.0:1787830919.914971:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2201dee580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a45944b-32e3-4193-a2a5-46f84222bc14:3622:1874676443841536:0@lo:400:kworker.0 00000100:00100000:1.0:1787830919.914995:0:8631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443843072 00000100:00100000:1.0:1787830919.914998:0:8631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443843072 00000100:00100000:0.0:1787830919.915092:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787830919.915253:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787830919.915258:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787830919.915262:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787830919.915272:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a22d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1874676443843200:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787830919.915293:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203790780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3619:1874676443842304:0@lo:400:kworker.0 00000100:00100000:3.0:1787830919.915308:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203792940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443842176:0@lo:400:kworker.0 00000100:00100000:0.0:1787830919.915313:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830919.915325:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2309d09e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443841792:0@lo:400:kworker.0 00000100:00100000:3.0:1787830919.915342:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2309d0bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874676443841664:0@lo:400:kworker.0 00000100:00100000:0.0:1787830919.915352:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a203c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3620:1874676443842816:0@lo:400:kworker.0 00000100:00100000:0.0:1787830919.915395:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443843200 00000100:00100000:0.0:1787830919.915399:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443843200 00000100:00100000:0.0:1787830919.915440:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787830919.915449:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a20f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3620:x1874676443843200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787830919.915466:0:8409:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787830919.915509:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a20f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3620:x1874676443843200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830919.915524:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787830919.915588:0:8631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443842688 00000100:00100000:1.0:1787830919.915592:0:8631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443842688 00000100:00100000:1.0:1787830919.915642:0:8631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787830919.915649:0:8631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220395de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3622:x1874676443843072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830919.915689:0:8631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220395de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3622:x1874676443843072:12345-0@lo:400:kworker.0 Request processed in 40us (1407us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830919.915696:0:8631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787830919.915708:0:8631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787830919.915714:0:8631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a212c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3620:x1874676443842688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830919.915740:0:8631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a212c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3620:x1874676443842688:12345-0@lo:400:kworker.0 Request processed in 27us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830919.915745:0:8631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:1.0:1787830919.915762:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787830919.915816:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2203a22580 x1874676443843072/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787830935 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787830919.915827:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a22580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676443843072:0@lo:400:kworker.0 00010000:00080000:3.0:1787830919.916313:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2203a23480 x1874676443842688/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787830935 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787830919.916339:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1874676443842688:0@lo:400:kworker.0 00010000:00080000:3.0:1787830919.916355:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2203a22d00 x1874676443843200/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787830935 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787830919.916371:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a22d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1874676443843200:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787830920.166949:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787830920.274154:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787830920.274200:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787830920.274229:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787830920.274255:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787830920.274294:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787830920.274331:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433297280 00000100:00100000:1.0:1787830920.274344:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433297280 00000100:00100000:1.0:1787830920.274428:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433297152 00000100:00100000:1.0:1787830920.274431:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433297152 00000100:00100000:1.0:1787830920.274458:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 69 00000100:00100000:1.0:1787830920.274468:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2201dec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:2397:x1874676433297280:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1787830920.274561:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2201dec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:2397:x1874676433297280:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 94us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830920.274570:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 69 00000100:00100000:1.0:1787830920.274588:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 70 00000100:00100000:1.0:1787830920.274595:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2201dee580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+6:2396:x1874676433297152:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1787830920.274620:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2201dee580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+6:2396:x1874676433297152:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 27us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830920.274645:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 70 00000100:00100000:1.0:1787830920.274669:0:8631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433297408 00000100:00100000:1.0:1787830920.274673:0:8631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433297408 00000100:00100000:1.0:1787830920.274713:0:8631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433297536 00000100:00100000:1.0:1787830920.274716:0:8631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433297536 00000100:00100000:1.0:1787830920.274738:0:8631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 24 00000100:00100000:1.0:1787830920.274745:0:8631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203792940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:2396:x1874676433297408:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1787830920.274770:0:8631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203792940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:2396:x1874676433297408:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 27us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830920.274784:0:8631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 24 00000100:00100000:1.0:1787830920.274795:0:8631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 25 00000100:00100000:1.0:1787830920.274801:0:8631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203790780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:2397:x1874676433297536:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1787830920.274823:0:8631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203790780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:2397:x1874676433297536:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 22us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830920.274828:0:8631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 25 00000100:00080000:1.0:1787830920.274847:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787830920.274852:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787830920.274854:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787830920.274856:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787830920.277598:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433297024 00000100:00100000:3.0:1787830920.277617:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433297024 00000100:00100000:3.0:1787830920.277727:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 273 00000100:00100000:3.0:1787830920.277740:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a684850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+10:2397:x1874676433297024:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1787830920.277838:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a684850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+10:2397:x1874676433297024:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 101us (3700us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830920.277847:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 273 00010000:00010000:1.0:1787830921.191472:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787830921.724042:0:11187:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.61 00010000:00010000:2.0:1787830922.214794:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787830922.982883:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220390b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1874676443843328:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787830922.982982:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830922.983070:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443843328 00000100:00100000:1.0:1787830922.983080:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443843328 00000100:00100000:1.0:1787830922.983154:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787830922.983164:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22039083c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1874676443843328:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787830922.983196:0:8409:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787830922.983249:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22039083c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1874676443843328:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830922.983257:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:1.0:1787830922.983305:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d220390b480 x1874676443843328/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787830938 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787830922.983325:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220390b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1874676443843328:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1787830922.984602:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787830922.985779:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a230c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443843456:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787830922.985855:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830922.985965:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443843456 00000100:00100000:1.0:1787830922.985973:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443843456 00000100:00100000:1.0:1787830922.986042:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787830922.986070:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220390b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1874676443843456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787830922.986095:0:8409:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1787830922.986169:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787830922.991817:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220390b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1874676443843456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 5736us (5948us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830922.991834:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:2.0:1787830922.991952:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2203a230c0 x1874676443843456/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787830938 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787830922.991982:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a230c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443843456:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787830923.240550:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787830923.494848:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787830923.494878:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220390a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443843584:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787830923.494971:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830923.495085:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443843584 00000100:00100000:2.0:1787830923.495095:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443843584 00000100:00100000:2.0:1787830923.495222:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787830923.495233:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a23c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1874676443843584:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787830923.495275:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787830923.495342:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a23c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1874676443843584:12345-0@lo:41:osp-pre-1-0.0 Request processed in 111us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830923.495349:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787830923.495541:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220390a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443843584:0@lo:41:osp-pre-1-0.0 00000001:02000400:2.0:1787830923.555731:0:11285:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.61 00000100:00100000:2.0:1787830924.012581:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787830924.012610:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220394ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1874676443843712:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787830924.012745:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830924.015058:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443843712 00000100:00100000:3.0:1787830924.015073:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443843712 00000100:00100000:3.0:1787830924.015135:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787830924.015146:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220390a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1874676443843712:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787830924.015189:0:7448:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787830924.015294:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220390a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1874676443843712:12345-0@lo:41:osp-pre-0-1.0 Request processed in 149us (2548us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830924.015303:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787830924.015752:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220394ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1874676443843712:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787830924.265036:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787830924.900613:0:11333:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Thu Aug 27 07:42:04 EDT 2026 00000100:00100000:2.0:1787830925.031909:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787830925.031939:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203908b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676443843968:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787830925.032034:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830925.032144:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443843968 00000100:00100000:2.0:1787830925.032153:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443843968 00000100:00100000:2.0:1787830925.032224:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787830925.032236:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22039092c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1874676443843968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787830925.032270:0:8410:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787830925.032327:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22039092c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1874676443843968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830925.032334:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:2.0:1787830925.032360:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787830925.032478:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2203908b40 x1874676443843968/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787830941 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787830925.032497:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203908b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676443843968:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787830925.032845:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220390b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1874676443843840:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787830925.032886:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830925.032930:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443843840 00000100:00100000:1.0:1787830925.032934:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443843840 00000100:00100000:1.0:1787830925.032966:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787830925.032974:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203793480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1874676443843840:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787830925.032986:0:8409:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787830925.033021:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203793480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1874676443843840:12345-0@lo:13:osp-pre-1-1.0 Request processed in 48us (134us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830925.033027:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:1.0:1787830925.033055:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d220390b480 x1874676443843840/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787830941 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787830925.033070:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220390b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1874676443843840:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1787830925.033086:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787830925.035331:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220394f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a45944b-32e3-4193-a2a5-46f84222bc14:3622:1874676443844096:0@lo:400:kworker.0 00000100:00100000:2.0:1787830925.035440:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830925.035497:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220394ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676443844608:0@lo:400:kworker.0 00000100:00100000:2.0:1787830925.035528:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830925.035555:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220390e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676443845120:0@lo:400:kworker.0 00000100:00100000:2.0:1787830925.035583:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830925.035616:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787830925.035645:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220394c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3622:1874676443844480:0@lo:400:kworker.0 00000100:00100000:2.0:1787830925.035680:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830925.035703:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203994b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676443844992:0@lo:400:kworker.0 00000100:00100000:2.0:1787830925.035729:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830925.036015:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220394cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874676443844224:0@lo:400:kworker.0 00000100:00100000:0.0:1787830925.036052:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443844608 00000100:00100000:3.0:1787830925.036059:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830925.036064:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443844608 00000100:00100000:1.0:1787830925.036105:0:8631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443845120 00000100:00100000:3.0:1787830925.036107:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2309d0bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3619:1874676443844736:0@lo:400:kworker.0 00000100:00100000:3.0:1787830925.036135:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830925.036155:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220390ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3619:1874676443845248:0@lo:400:kworker.0 00000100:00100000:0.0:1787830925.036165:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787830925.036181:0:8631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443845120 00000100:00100000:0.0:1787830925.036183:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203908b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1874676443844608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787830925.036184:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830925.036213:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1787830925.036221:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220394e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443844352:0@lo:400:kworker.0 00000100:00100000:1.0:1787830925.036236:0:8631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443844992 00000100:00100000:1.0:1787830925.036241:0:8631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443844992 00000100:00100000:3.0:1787830925.036258:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830925.036275:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203908b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1874676443844608:12345-0@lo:400:kworker.0 Request processed in 98us (745us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830925.036278:0:8631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787830925.036284:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2309d09e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3619:1874676443844864:0@lo:400:kworker.0 00000100:00100000:0.0:1787830925.036289:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787830925.036299:0:8631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220390a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3622:x1874676443845120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787830925.036312:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443844352 00000100:00100000:3.0:1787830925.036316:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830925.036318:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443844352 00000100:00100000:3.0:1787830925.036330:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220390f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3619:1874676443845376:0@lo:400:kworker.0 00000100:00100000:0.0:1787830925.036341:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787830925.036350:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220390cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443844352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787830925.036357:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830925.036406:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220390cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443844352:12345-0@lo:400:kworker.0 Request processed in 57us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830925.036413:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787830925.036428:0:8631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220390a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3622:x1874676443845120:12345-0@lo:400:kworker.0 Request processed in 133us (844us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830925.036436:0:8631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787830925.036450:0:8631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787830925.036527:0:8631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d232f6ca940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676443844992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830925.036560:0:8631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d232f6ca940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676443844992:12345-0@lo:400:kworker.0 Request processed in 36us (830us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830925.036567:0:8631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787830925.036590:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443844480 00000100:00100000:1.0:1787830925.036594:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443844480 00000100:00100000:1.0:1787830925.036716:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443844224 00000100:00100000:1.0:1787830925.036720:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443844224 00000100:00100000:1.0:1787830925.036733:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443844736 00000100:00100000:1.0:1787830925.036735:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443844736 00000100:00100000:1.0:1787830925.036749:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443845248 00000100:00100000:1.0:1787830925.036752:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443845248 00000100:00100000:1.0:1787830925.036766:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443844864 00000100:00100000:1.0:1787830925.036768:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443844864 00000100:00100000:1.0:1787830925.036781:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443845376 00000100:00100000:1.0:1787830925.036783:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443845376 00000100:00100000:1.0:1787830925.036798:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787830925.036805:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220390b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1874676443844480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787830925.036855:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220394e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443844352:0@lo:400:kworker.0 00000100:00100000:1.0:1787830925.036856:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220390b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1874676443844480:12345-0@lo:400:kworker.0 Request processed in 49us (1173us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830925.036865:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787830925.036880:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787830925.036888:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220390e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874676443844224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787830925.036907:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443844096 00000100:00100000:3.0:1787830925.036913:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443844096 00000100:00100000:1.0:1787830925.036937:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220390e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874676443844224:12345-0@lo:400:kworker.0 Request processed in 50us (880us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830925.036947:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787830925.036953:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1787830925.036964:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a685c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+24:3622:x1874676443844096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830925.036967:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787830925.036980:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220390fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874676443844736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787830925.037018:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a685c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+24:3622:x1874676443844096:12345-0@lo:400:kworker.0 Request processed in 56us (1579us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830925.037026:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220390fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874676443844736:12345-0@lo:400:kworker.0 Request processed in 47us (888us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830925.037030:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1787830925.037040:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787830925.037056:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787830925.037064:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220390d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874676443845248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787830925.037076:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787830925.037087:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220390f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874676443844864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830925.037102:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220390d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874676443845248:12345-0@lo:400:kworker.0 Request processed in 38us (922us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830925.037129:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220390f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874676443844864:12345-0@lo:400:kworker.0 Request processed in 43us (814us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830925.037178:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787830925.038037:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787830925.038069:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787830925.038082:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220390d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874676443845376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830925.038210:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220390d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874676443845376:12345-0@lo:400:kworker.0 Request processed in 132us (1853us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830925.038217:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:1.0:1787830925.038257:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787830925.038263:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787830925.038267:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787830925.038413:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2309d09e00 x1874676443844864/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830941 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787830925.038427:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2309d09e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3619:1874676443844864:0@lo:400:kworker.0 00010000:00080000:1.0:1787830925.038439:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d220390f0c0 x1874676443845376/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830941 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787830925.039249:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220394c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3622:1874676443844480:0@lo:400:kworker.0 00010000:00080000:0.0:1787830925.039267:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2203994b40 x1874676443844992/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787830941 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787830925.039277:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203994b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676443844992:0@lo:400:kworker.0 00000100:00100000:0.0:1787830925.039296:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220394f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a45944b-32e3-4193-a2a5-46f84222bc14:3622:1874676443844096:0@lo:400:kworker.0 00000100:00100000:0.0:1787830925.039308:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220394ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676443844608:0@lo:400:kworker.0 00010000:00080000:0.0:1787830925.039319:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d220390e580 x1874676443845120/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787830941 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787830925.039328:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220390e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676443845120:0@lo:400:kworker.0 00000100:00100000:1.0:1787830925.040572:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220390f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3619:1874676443845376:0@lo:400:kworker.0 00000100:00100000:1.0:1787830925.040698:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220394cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874676443844224:0@lo:400:kworker.0 00000100:00100000:1.0:1787830925.040716:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2309d0bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3619:1874676443844736:0@lo:400:kworker.0 00000100:00100000:1.0:1787830925.040729:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220390ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3619:1874676443845248:0@lo:400:kworker.0 00010000:00010000:2.0:1787830925.286894:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787830925.396562:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787830925.396621:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787830925.396692:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787830925.396724:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433297792 00000100:00100000:1.0:1787830925.396724:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433297920 00000100:00100000:2.0:1787830925.396736:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433297792 00000100:00100000:1.0:1787830925.396736:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433297920 00000100:00100000:0.0:1787830925.396800:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433297664 00000100:00100000:0.0:1787830925.396805:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433297664 00000100:00100000:1.0:1787830925.396821:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 77 00000100:00100000:1.0:1787830925.396831:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a9da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:2396:x1874676433297920:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1787830925.396834:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 275 00000100:00100000:0.0:1787830925.396840:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a686050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+10:2396:x1874676433297664:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1787830925.396912:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a686050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+10:2396:x1874676433297664:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 71us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830925.396920:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 275 00000100:00100000:2.0:1787830925.397584:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 78 00000100:00100000:2.0:1787830925.397593:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a9c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+6:2396:x1874676433297792:12345-192.168.203.31@tcp:400:kworker.0 00000100:00080000:0.0:1787830925.397657:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787830925.397662:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787830925.397670:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a9da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:2396:x1874676433297920:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 840us (1048us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830925.397677:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 77 00000100:00100000:2.0:1787830925.398059:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a9c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+6:2396:x1874676433297792:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 465us (1364us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830925.398067:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 78 00000100:00100000:2.0:1787830925.399276:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787830925.399692:0:8631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433298048 00000100:00100000:1.0:1787830925.399701:0:8631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433298048 00000100:00100000:1.0:1787830925.399779:0:8631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 18 00000100:00100000:1.0:1787830925.399790:0:8631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a9e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:2393:x1874676433298048:12345-192.168.203.31@tcp:9:kworker.0 00000020:00000080:1.0:1787830925.399828:0:8631:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x95459fb9d1d288bd 00000100:00080000:1.0:1787830925.399838:0:8631:0:(import.c:65:import_set_state_nolock()) ffff8d220276b800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787830925.399893:0:8631:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00010000:00010000:3.0:1787830925.400035:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787830925.400063:0:8631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a9e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+2:2393:x1874676433298048:12345-192.168.203.31@tcp:9:kworker.0 Request processed in 275us (795us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830925.400071:0:8631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 18 00000100:00080000:0.0:1787830925.400169:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787830925.400646:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787830925.400709:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433298176 00000100:00100000:0.0:1787830925.400715:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433298176 00000100:00100000:0.0:1787830925.400797:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 19 00000100:00100000:0.0:1787830925.400806:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2309d0bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:2393:x1874676433298176:12345-192.168.203.31@tcp:9:kworker.0 00000020:00000080:0.0:1787830925.400831:0:8408:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x95459fb9d1d288c4 00000100:00080000:0.0:1787830925.400839:0:8408:0:(import.c:65:import_set_state_nolock()) ffff8d220276c800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787830925.400877:0:8408:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1787830925.400989:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2309d0bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+2:2393:x1874676433298176:12345-192.168.203.31@tcp:9:kworker.0 Request processed in 184us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830925.400997:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 19 00010000:00010000:0.0:1787830925.401019:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787830925.401125:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787830926.311374:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787830927.335830:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787830928.102978:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a21a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443845632:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787830928.103057:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830928.103063:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a9f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676443845504:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787830928.103106:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830928.103161:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443845632 00000100:00100000:1.0:1787830928.103168:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443845632 00000100:00100000:1.0:1787830928.103214:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443845504 00000100:00100000:1.0:1787830928.103218:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443845504 00000100:00080000:0.0:1787830928.103231:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787830928.103239:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787830928.103249:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220390c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1874676443845632:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787830928.103249:0:8410:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:0.0:1787830928.103261:0:8410:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00002000:00000024:1.0:1787830928.103285:0:8409:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787830928.104013:0:11489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787830928.104024:0:11489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2309d09e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676443845504:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787830928.104038:0:11489:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787830928.104083:0:11489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2309d09e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676443845504:12345-0@lo:13:osp-pre-0-1.0 Request processed in 60us (976us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830928.104091:0:11489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:0.0:1787830928.104132:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2203a9f840 x1874676443845504/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787830944 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787830928.104151:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a9f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676443845504:0@lo:13:osp-pre-0-1.0 00010000:00080000:3.0:1787830928.104567:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2203a21a40 x1874676443845632/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787830944 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787830928.104584:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a21a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443845632:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787830928.105205:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220390c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1874676443845632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1953us (2144us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830928.105216:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00010000:0.0:1787830928.360120:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787830928.614782:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787830928.614809:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a20b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1874676443845760:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787830928.614952:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830928.615031:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443845760 00000100:00100000:0.0:1787830928.615040:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443845760 00000100:00100000:0.0:1787830928.615090:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787830928.615110:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a21a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1874676443845760:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787830928.615146:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787830928.616143:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a21a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1874676443845760:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1037us (1184us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830928.616158:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787830928.616233:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a20b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1874676443845760:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787830929.132529:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220390ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1874676443845888:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787830929.132619:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830929.132780:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443845888 00000100:00100000:3.0:1787830929.132795:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443845888 00000100:00100000:3.0:1787830929.132853:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787830929.132862:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a9e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1874676443845888:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787830929.132899:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787830929.136764:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a9e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1874676443845888:12345-0@lo:41:osp-pre-0-1.0 Request processed in 3888us (4130us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830929.136780:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787830929.137515:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220390ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1874676443845888:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787830929.383977:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787830930.154941:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787830930.154972:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a9ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676443846016:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787830930.155070:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830930.155139:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443846016 00000100:00100000:0.0:1787830930.155146:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443846016 00000100:00100000:0.0:1787830930.155205:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787830930.155215:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1874676443846016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787830930.155246:0:8410:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787830930.155296:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1874676443846016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830930.155303:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:0.0:1787830930.155329:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787830930.155377:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2203a9ed00 x1874676443846016/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787830946 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787830930.155399:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a9ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676443846016:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787830930.157097:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220390f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676443846144:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787830930.157177:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830930.157213:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443846144 00000100:00100000:1.0:1787830930.157222:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443846144 00000100:00100000:1.0:1787830930.157283:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787830930.157293:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a21e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676443846144:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787830930.157317:0:8409:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787830930.157519:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a9cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443846528:0@lo:400:kworker.0 00000100:00100000:3.0:1787830930.157558:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830930.157594:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443846528 00000100:00100000:3.0:1787830930.157598:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443846528 00000100:00100000:3.0:1787830930.157648:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787830930.157656:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220390e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443846528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787830930.157696:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220390e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443846528:12345-0@lo:400:kworker.0 Request processed in 40us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830930.157703:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787830930.157745:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a9cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443846528:0@lo:400:kworker.0 00000100:00100000:1.0:1787830930.158161:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a21e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676443846144:12345-0@lo:13:osp-pre-1-1.0 Request processed in 867us (983us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830930.158170:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:1.0:1787830930.158193:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787830930.158296:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3621:1874676443847040:0@lo:400:kworker.0 00000100:00100000:3.0:1787830930.158362:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830930.158402:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a9f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3621:1874676443847552:0@lo:400:kworker.0 00000100:00100000:3.0:1787830930.158425:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830930.158445:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787830930.158451:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a9f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3621:1874676443846656:0@lo:400:kworker.0 00000100:00100000:3.0:1787830930.158475:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830930.158492:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a9de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443847168:0@lo:400:kworker.0 00000100:00100000:3.0:1787830930.158515:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830930.158544:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443847168 00000100:00100000:3.0:1787830930.158548:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443847168 00000100:00100000:3.0:1787830930.158591:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787830930.158599:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220394ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443847168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787830930.158661:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220394ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443847168:12345-0@lo:400:kworker.0 Request processed in 63us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830930.158668:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:3.0:1787830930.158699:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2203a9de00 x1874676443847168/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787830946 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787830930.158711:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a9de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443847168:0@lo:400:kworker.0 00000100:00100000:1.0:1787830930.158835:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443847040 00000100:00100000:1.0:1787830930.158839:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443847040 00000100:00100000:1.0:1787830930.158872:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443847552 00000100:00100000:1.0:1787830930.158874:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443847552 00000100:00100000:1.0:1787830930.158896:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443846656 00000100:00100000:1.0:1787830930.158899:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443846656 00000100:00100000:1.0:1787830930.158911:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787830930.158916:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220390c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1874676443847040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787830930.159300:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787830930.159310:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220390ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1874676443847552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787830930.159371:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220390ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1874676443847552:12345-0@lo:400:kworker.0 Request processed in 63us (944us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830930.159473:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787830930.159491:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787830930.159497:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220394cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1874676443846656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787830930.159534:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220394cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1874676443846656:12345-0@lo:400:kworker.0 Request processed in 38us (1058us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830930.159541:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787830930.159573:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a9f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3621:1874676443846656:0@lo:400:kworker.0 00010000:00080000:3.0:1787830930.159586:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2203a9f840 x1874676443847552/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830946 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787830930.159596:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a9f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3621:1874676443847552:0@lo:400:kworker.0 00010000:00080000:0.0:1787830930.159704:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d220390f0c0 x1874676443846144/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787830946 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787830930.159725:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220390f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676443846144:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787830930.159851:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a9d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a45944b-32e3-4193-a2a5-46f84222bc14:3619:1874676443846272:0@lo:400:kworker.0 00000100:00100000:3.0:1787830930.159887:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830930.159924:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a9e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443846784:0@lo:400:kworker.0 00000100:00100000:3.0:1787830930.159949:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830930.159967:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a9cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443847296:0@lo:400:kworker.0 00000100:00100000:3.0:1787830930.159990:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830930.160010:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1787830930.160015:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a9d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874676443846400:0@lo:400:kworker.0 00000100:00100000:3.0:1787830930.160035:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830930.160051:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a9fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3619:1874676443846912:0@lo:400:kworker.0 00000100:00100000:3.0:1787830930.160072:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830930.160086:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a9ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3619:1874676443847424:0@lo:400:kworker.0 00000100:00100000:3.0:1787830930.160107:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830930.160132:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443846784 00000100:00100000:3.0:1787830930.160137:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443846784 00000100:00100000:3.0:1787830930.160167:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787830930.160173:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220394f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676443846784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787830930.160221:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220394f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676443846784:12345-0@lo:400:kworker.0 Request processed in 48us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830930.160227:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787830930.160247:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443847296 00000100:00100000:3.0:1787830930.160249:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443847296 00000100:00100000:3.0:1787830930.160277:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787830930.160283:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220394c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676443847296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787830930.160312:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220394c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676443847296:12345-0@lo:400:kworker.0 Request processed in 29us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830930.160318:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787830930.160347:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443846400 00000100:00100000:3.0:1787830930.160351:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443846400 00000100:00100000:3.0:1787830930.160366:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443846912 00000100:00100000:3.0:1787830930.160369:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443846912 00000100:00100000:3.0:1787830930.160561:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443847424 00000100:00100000:3.0:1787830930.160565:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443847424 00000100:00100000:3.0:1787830930.160583:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787830930.160588:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220394e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874676443846400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787830930.160620:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220394e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874676443846400:12345-0@lo:400:kworker.0 Request processed in 31us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830930.160648:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787830930.160660:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787830930.160666:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2314e71e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874676443846912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787830930.160692:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2314e71e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874676443846912:12345-0@lo:400:kworker.0 Request processed in 27us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830930.160698:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787830930.160709:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787830930.160722:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2314e72d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874676443847424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787830930.160753:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2314e72d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874676443847424:12345-0@lo:400:kworker.0 Request processed in 32us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830930.160759:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787830930.160850:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a9d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874676443846400:0@lo:400:kworker.0 00000100:00100000:3.0:1787830930.160862:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a9fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3619:1874676443846912:0@lo:400:kworker.0 00000100:00100000:3.0:1787830930.160870:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a9ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3619:1874676443847424:0@lo:400:kworker.0 00000100:00100000:3.0:1787830930.160878:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a9e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443846784:0@lo:400:kworker.0 00010000:00080000:3.0:1787830930.160887:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2203a9cf00 x1874676443847296/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787830946 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787830930.160897:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a9cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443847296:0@lo:400:kworker.0 00000100:00100000:0.0:1787830930.160971:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443846272 00000100:00100000:0.0:1787830930.160976:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443846272 00000100:00100000:0.0:1787830930.161019:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1787830930.161025:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a685450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+24:3619:x1874676443846272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787830930.161064:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a685450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+24:3619:x1874676443846272:12345-0@lo:400:kworker.0 Request processed in 40us (1177us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830930.161071:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1787830930.161123:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a9d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a45944b-32e3-4193-a2a5-46f84222bc14:3619:1874676443846272:0@lo:400:kworker.0 00000100:00080000:0.0:1787830930.161757:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787830930.161763:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787830930.161767:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787830930.162174:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220390c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1874676443847040:12345-0@lo:400:kworker.0 Request processed in 3253us (3807us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830930.162185:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00080000:3.0:1787830930.174573:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2203a9c000 x1874676443847040/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830946 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787830930.174599:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3621:1874676443847040:0@lo:400:kworker.0 00010000:00010000:3.0:1787830930.413915:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787830930.514992:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787830930.515046:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787830930.515078:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787830930.516923:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433298432 00000100:00100000:3.0:1787830930.516940:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433298432 00000100:00100000:3.0:1787830930.517028:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433298560 00000100:00100000:3.0:1787830930.517032:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433298560 00000100:00100000:3.0:1787830930.517065:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 85 00000100:00100000:3.0:1787830930.517076:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2314ed61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+6:2396:x1874676433298432:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1787830930.517182:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2314ed61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+6:2396:x1874676433298432:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 107us (2203us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830930.517210:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 85 00000100:00100000:3.0:1787830930.517229:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 86 00000100:00100000:3.0:1787830930.517235:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220258fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:2397:x1874676433298560:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1787830930.517263:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220258fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:2397:x1874676433298560:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 27us (2184us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830930.517269:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 86 00000100:00080000:2.0:1787830930.517352:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787830930.517357:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787830930.517407:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433298304 00000100:00100000:2.0:1787830930.517412:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433298304 00000100:00100000:2.0:1787830930.517455:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 277 00000100:00100000:2.0:1787830930.517464:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a684c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+10:2397:x1874676433298304:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1787830930.517493:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a684c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+10:2397:x1874676433298304:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 31us (2446us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830930.517500:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 277 00000001:00100000:0.0:1787830931.179773:0:8401:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 47d7f0ed-283f-4b70-a741-6e74c5e52619 00000020:00000080:0.0:1787830931.179786:0:8401:0:(genops.c:885:class_export_put()) final put ffff8d220276f800/47d7f0ed-283f-4b70-a741-6e74c5e52619 00000020:00000080:0.0:1787830931.179816:0:478:0:(genops.c:844:class_export_destroy()) destroying export ffff8d220276f800/47d7f0ed-283f-4b70-a741-6e74c5e52619 for lustre-OST0000 00000020:00000080:0.0:1787830931.179872:0:478:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d220276b800 for lustre-OST0000 00000001:00100000:0.0:1787830931.184782:0:9484:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 47d7f0ed-283f-4b70-a741-6e74c5e52619 00000020:00000080:0.0:1787830931.184793:0:9484:0:(genops.c:885:class_export_put()) final put ffff8d220276a800/47d7f0ed-283f-4b70-a741-6e74c5e52619 00000020:00000080:2.0:1787830931.185870:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d220276a800/47d7f0ed-283f-4b70-a741-6e74c5e52619 for lustre-OST0001 00000020:00000080:2.0:1787830931.185998:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d220276c800 for lustre-OST0001 00010000:00010000:1.0:1787830931.432610:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830932.459883:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787830933.224250:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a203c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676443847808:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787830933.224338:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830933.224401:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220258e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676443847680:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787830933.224428:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830933.226331:0:11489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443847808 00000100:00100000:0.0:1787830933.226343:0:11489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443847808 00000100:00100000:0.0:1787830933.226406:0:11489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443847680 00000100:00100000:0.0:1787830933.226410:0:11489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443847680 00000100:00100000:0.0:1787830933.226430:0:11489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787830933.226439:0:11489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a22d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676443847808:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787830933.226486:0:11489:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787830933.226568:0:11489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a22d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676443847808:12345-0@lo:13:osp-pre-0-1.0 Request processed in 129us (2232us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830933.226575:0:11489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787830933.226593:0:11489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787830933.226599:0:11489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1874676443847680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787830933.226621:0:11489:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787830933.226665:0:11489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1874676443847680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (2237us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830933.226671:0:11489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:0.0:1787830933.226687:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787830933.226737:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2203a203c0 x1874676443847808/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787830949 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787830933.226768:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a203c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676443847808:0@lo:13:osp-pre-0-1.0 00010000:00080000:0.0:1787830933.226780:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d220258e1c0 x1874676443847680/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787830949 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787830933.226909:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220258e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676443847680:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787830933.480026:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787830933.735769:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787830933.735794:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a203c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1874676443847936:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787830933.735867:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830933.736047:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443847936 00000100:00100000:3.0:1787830933.736054:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443847936 00000100:00100000:3.0:1787830933.736107:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787830933.736117:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a22580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1874676443847936:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787830933.736153:0:7448:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787830933.736205:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a22580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1874676443847936:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830933.736213:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787830933.736266:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a203c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1874676443847936:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787830934.247077:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220392cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1874676443848064:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787830934.247160:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830934.247296:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443848064 00000100:00100000:3.0:1787830934.247304:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443848064 00000100:00100000:3.0:1787830934.247371:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787830934.247381:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a23840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1874676443848064:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787830934.247420:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787830934.247483:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a23840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1874676443848064:12345-0@lo:41:osp-pre-0-1.0 Request processed in 103us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830934.247491:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787830934.248384:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220392cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1874676443848064:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787830934.502994:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787830935.270955:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220258cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443848192:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787830935.271052:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830935.271109:0:11489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443848192 00000100:00100000:1.0:1787830935.271118:0:11489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443848192 00000100:00100000:2.0:1787830935.271319:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a9cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443848448:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787830935.271353:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787830935.273422:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787830935.273499:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220392f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a45944b-32e3-4193-a2a5-46f84222bc14:3622:1874676443848320:0@lo:400:kworker.0 00000100:00100000:0.0:1787830935.273588:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830935.273694:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443848320 00000100:00100000:0.0:1787830935.273786:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443848320 00000100:00100000:0.0:1787830935.273844:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1787830935.273872:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a686c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+24:3622:x1874676443848320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787830935.273931:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a686c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+24:3622:x1874676443848320:12345-0@lo:400:kworker.0 Request processed in 62us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830935.273939:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1787830935.273991:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220392f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a45944b-32e3-4193-a2a5-46f84222bc14:3622:1874676443848320:0@lo:400:kworker.0 00000100:00100000:3.0:1787830935.274344:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220392e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3620:1874676443848576:0@lo:400:kworker.0 00000100:00100000:3.0:1787830935.274390:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830935.274413:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220392da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3620:1874676443849088:0@lo:400:kworker.0 00000100:00100000:3.0:1787830935.274435:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830935.274451:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220392f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3620:1874676443849600:0@lo:400:kworker.0 00000100:00100000:3.0:1787830935.274469:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830935.274512:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220392fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443848704:0@lo:400:kworker.0 00000100:00100000:0.0:1787830935.274550:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830935.274568:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787830935.274577:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220392de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1874676443848960:0@lo:400:kworker.0 00000100:00100000:0.0:1787830935.274580:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220392c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3621:1874676443849216:0@lo:400:kworker.0 00000100:00100000:3.0:1787830935.274611:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830935.274618:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830935.274652:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220392cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1874676443849472:0@lo:400:kworker.0 00000100:00100000:0.0:1787830935.274666:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220392c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3621:1874676443849728:0@lo:400:kworker.0 00000100:00100000:3.0:1787830935.274684:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830935.274718:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830935.274720:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443848576 00000100:00100000:3.0:1787830935.274727:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443848576 00000100:00100000:0.0:1787830935.274738:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1787830935.274746:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220392c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3621:1874676443848832:0@lo:400:kworker.0 00000100:00100000:3.0:1787830935.274757:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443849088 00000100:00100000:3.0:1787830935.274762:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443849088 00000100:00100000:0.0:1787830935.274773:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830935.274787:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220392e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443849344:0@lo:400:kworker.0 00000100:00100000:3.0:1787830935.274791:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443849600 00000100:00100000:3.0:1787830935.274795:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443849600 00000100:00100000:0.0:1787830935.274811:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830935.274831:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443849216 00000100:00100000:3.0:1787830935.274836:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443849216 00000100:00100000:0.0:1787830935.274836:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220392f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443849856:0@lo:400:kworker.0 00000100:00100000:3.0:1787830935.274859:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443849728 00000100:00100000:3.0:1787830935.274863:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443849728 00000100:00100000:0.0:1787830935.274872:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830935.274877:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443848832 00000100:00100000:3.0:1787830935.274881:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443848832 00000100:00100000:3.0:1787830935.274900:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787830935.274990:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787830935.275000:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220392ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1874676443849088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787830935.275050:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220392ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1874676443849088:12345-0@lo:400:kworker.0 Request processed in 52us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830935.275057:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787830935.275073:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787830935.275079:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220392d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1874676443849600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787830935.275124:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220392e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1874676443848576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787830935.275143:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220392d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1874676443849600:12345-0@lo:400:kworker.0 Request processed in 31us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830935.275149:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787830935.275162:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787830935.275190:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220392e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1874676443848576:12345-0@lo:400:kworker.0 Request processed in 283us (800us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830935.275212:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a221c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1874676443849216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787830935.275247:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a221c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1874676443849216:12345-0@lo:400:kworker.0 Request processed in 36us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830935.275978:0:11489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443848448 00000100:00100000:1.0:1787830935.275988:0:11489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443848448 00000100:00100000:0.0:1787830935.275995:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787830935.276009:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a203c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1874676443848192:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787830935.276031:0:11489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787830935.276041:0:11489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443848448:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787830935.276041:0:8410:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00002000:00000024:1.0:1787830935.276059:0:11489:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787830935.276128:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787830935.276149:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787830935.276171:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a20b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1874676443849728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787830935.276328:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787830935.276345:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787830935.276353:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a20780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1874676443848832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830935.276412:0:11489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443848448:12345-0@lo:13:osp-pre-1-1.0 Request processed in 372us (5057us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830935.276419:0:11489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787830935.276478:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443848704 00000100:00100000:1.0:1787830935.276483:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443848704 00000100:00100000:1.0:1787830935.276505:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443848960 00000100:00100000:1.0:1787830935.276508:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443848960 00000100:00100000:1.0:1787830935.276520:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787830935.276533:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a230c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443848704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830935.276566:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a230c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443848704:12345-0@lo:400:kworker.0 Request processed in 34us (2016us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830935.276573:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787830935.276583:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787830935.276588:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220392f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1874676443848960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830935.276611:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220392f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1874676443848960:12345-0@lo:400:kworker.0 Request processed in 24us (2002us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830935.276617:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:1.0:1787830935.276655:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787830935.276660:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787830935.276663:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787830935.276684:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443849472 00000100:00100000:1.0:1787830935.276688:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443849472 00000100:00100000:1.0:1787830935.276717:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443849344 00000100:00100000:1.0:1787830935.276720:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443849344 00000100:00100000:1.0:1787830935.276733:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443849856 00000100:00100000:1.0:1787830935.276736:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443849856 00000100:00100000:1.0:1787830935.276748:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787830935.276753:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220392cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1874676443849472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830935.276787:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220392cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1874676443849472:12345-0@lo:400:kworker.0 Request processed in 34us (2104us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830935.276793:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787830935.276821:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787830935.276828:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a22940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443849344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830935.276857:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a22940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443849344:12345-0@lo:400:kworker.0 Request processed in 30us (2045us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830935.276871:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787830935.276883:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787830935.276889:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2335780850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443849856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830935.276914:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2335780850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443849856:12345-0@lo:400:kworker.0 Request processed in 26us (2043us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830935.276918:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:1.0:1787830935.277084:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787830935.277126:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d220392e940 x1874676443849344/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787830951 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787830935.277141:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220392e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443849344:0@lo:400:kworker.0 00010000:00080000:1.0:1787830935.277154:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d220392f840 x1874676443849856/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787830951 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787830935.277163:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220392f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443849856:0@lo:400:kworker.0 00000100:00100000:1.0:1787830935.277173:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220392fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443848704:0@lo:400:kworker.0 00010000:00080000:1.0:1787830935.277185:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d220392c780 x1874676443849216/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830951 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787830935.277193:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220392c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3621:1874676443849216:0@lo:400:kworker.0 00010000:00080000:1.0:1787830935.277206:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d220258cf00 x1874676443848192/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787830951 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787830935.277221:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220258cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443848192:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787830935.277275:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220392de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1874676443848960:0@lo:400:kworker.0 00010000:00080000:1.0:1787830935.277286:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d220392cb40 x1874676443849472/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787830951 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787830935.277314:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220392cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1874676443849472:0@lo:400:kworker.0 00000100:00100000:1.0:1787830935.277330:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220392e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3620:1874676443848576:0@lo:400:kworker.0 00000100:00100000:1.0:1787830935.277341:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220392da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3620:1874676443849088:0@lo:400:kworker.0 00000100:00100000:1.0:1787830935.277353:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220392f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3620:1874676443849600:0@lo:400:kworker.0 00000100:00100000:0.0:1787830935.279512:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a203c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1874676443848192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3496us (8449us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830935.279529:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:0.0:1787830935.279685:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2203a9cb40 x1874676443848448/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787830951 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787830935.279712:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a9cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443848448:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787830935.281995:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a20b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1874676443849728:12345-0@lo:400:kworker.0 Request processed in 5815us (7268us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830935.282011:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787830935.282171:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a20780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1874676443848832:12345-0@lo:400:kworker.0 Request processed in 5817us (7396us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830935.282179:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787830935.282375:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220392c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3621:1874676443848832:0@lo:400:kworker.0 00010000:00080000:1.0:1787830935.282394:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d220392c3c0 x1874676443849728/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830951 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787830935.282406:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220392c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3621:1874676443849728:0@lo:400:kworker.0 00010000:00010000:1.0:1787830935.527722:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787830935.639013:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787830935.639095:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787830935.639135:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787830935.639244:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433298688 00000100:00100000:3.0:1787830935.639257:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433298688 00000100:00100000:3.0:1787830935.639336:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 279 00000100:00100000:3.0:1787830935.639348:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a687450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+10:2395:x1874676433298688:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1787830935.639436:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a687450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+10:2395:x1874676433298688:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 90us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830935.639443:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 279 00000100:00100000:0.0:1787830935.640909:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433298944 00000100:00100000:0.0:1787830935.640921:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433298944 00000100:00100000:0.0:1787830935.640998:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433298816 00000100:00100000:0.0:1787830935.641002:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433298816 00000100:00100000:0.0:1787830935.641031:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 93 00000100:00100000:0.0:1787830935.641040:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a9cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:2395:x1874676433298944:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1787830935.641125:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a9cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:2395:x1874676433298944:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 86us (2030us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830935.641133:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 93 00000100:00100000:0.0:1787830935.641149:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 94 00000100:00100000:0.0:1787830935.641156:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a9e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+6:2395:x1874676433298816:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1787830935.641183:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a9e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+6:2395:x1874676433298816:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 28us (2049us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830935.641190:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 94 00000100:00080000:2.0:1787830935.641470:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787830935.641475:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:02000400:2.0:1787830936.246954:0:11962:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 07:42:15 (1787830935) === 00000100:00100000:3.0:1787830936.486700:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787830936.486969:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433299072 00000100:00100000:0.0:1787830936.486981:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433299072 00000100:00100000:0.0:1787830936.487061:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 280 00000100:00100000:0.0:1787830936.487072:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a685850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+10:8705:x1874676433299072:12345-192.168.203.31@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787830936.487092:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787830936.487114:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d233bf11600/0x95459fb9d1d289b2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xe558a92a99423c72 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830936.487146:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d233bf11600/0x95459fb9d1d289b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423c72 expref: 11 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830936.487179:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d233bf11600/0x95459fb9d1d289b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423c72 expref: 11 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830936.487188:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233bf11600, rc 0) 00000100:00100000:0.0:1787830936.487338:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a685850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+11:8705:x1874676433299072:12345-192.168.203.31@tcp:101:mount.lustre.0 Request processed in 266us (715us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830936.487348:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 280 00000100:00100000:2.0:1787830936.489183:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787830936.492137:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433299200 00000100:00100000:0.0:1787830936.492158:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433299200 00000100:00100000:0.0:1787830936.492257:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 281 00000100:00100000:0.0:1787830936.492268:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a685050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+11:8705:x1874676433299200:12345-192.168.203.31@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787830936.493592:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a685050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+11:8705:x1874676433299200:12345-192.168.203.31@tcp:501:mount.lustre.0 Request processed in 1315us (4404us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830936.493607:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 281 00000100:00100000:2.0:1787830936.495452:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787830936.495666:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433299328 00000100:00100000:0.0:1787830936.495677:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433299328 00000100:00100000:0.0:1787830936.495740:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 282 00000100:00100000:0.0:1787830936.495752:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a684050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+11:8705:x1874676433299328:12345-192.168.203.31@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787830936.495943:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a684050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+11:8705:x1874676433299328:12345-192.168.203.31@tcp:503:mount.lustre.0 Request processed in 192us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830936.495951:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 282 00000100:00100000:3.0:1787830936.498514:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787830936.498985:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433299456 00000100:00100000:0.0:1787830936.498997:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433299456 00000100:00100000:0.0:1787830936.499132:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 283 00000100:00100000:0.0:1787830936.499144:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a681050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+11:8709:x1874676433299456:12345-192.168.203.31@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787830936.499393:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a681050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+11:8709:x1874676433299456:12345-192.168.203.31@tcp:502:llog_process_th.0 Request processed in 250us (890us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830936.499401:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 283 00000100:00100000:2.0:1787830936.519942:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787830936.520014:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433299584 00000100:00100000:0.0:1787830936.520025:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433299584 00000100:00100000:0.0:1787830936.520289:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 284 00000100:00100000:0.0:1787830936.520312:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a680050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+11:8709:x1874676433299584:12345-192.168.203.31@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787830936.520580:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a680050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+11:8709:x1874676433299584:12345-192.168.203.31@tcp:502:llog_process_th.0 Request processed in 269us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830936.520590:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 284 00000100:00100000:1.0:1787830936.524363:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787830936.524510:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433299712 00000100:00100000:0.0:1787830936.524523:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433299712 00000100:00100000:0.0:1787830936.524596:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 285 00000100:00100000:0.0:1787830936.524608:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a682850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+11:8709:x1874676433299712:12345-192.168.203.31@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787830936.524857:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a682850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+11:8709:x1874676433299712:12345-192.168.203.31@tcp:502:llog_process_th.0 Request processed in 251us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830936.524867:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 285 00000100:00100000:3.0:1787830936.528830:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787830936.528887:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433299840 00000100:00100000:0.0:1787830936.528898:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433299840 00000100:00100000:0.0:1787830936.529112:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 286 00000100:00100000:0.0:1787830936.529125:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a683050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+11:8705:x1874676433299840:12345-192.168.203.31@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787830936.529154:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787830936.529175:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d233bf10a00/0x95459fb9d1d289b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe558a92a99423ca3 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830936.529226:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d233bf10a00/0x95459fb9d1d289b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423ca3 expref: 12 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830936.529239:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d233bf10a00/0x95459fb9d1d289b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423ca3 expref: 12 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830936.529249:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233bf10a00, rc 0) 00000100:00100000:0.0:1787830936.529325:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a683050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+12:8705:x1874676433299840:12345-192.168.203.31@tcp:101:mount.lustre.0 Request processed in 203us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830936.529332:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 286 00000100:00100000:1.0:1787830936.534101:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787830936.534180:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433299968 00000100:00100000:2.0:1787830936.534194:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433299968 00000100:00100000:2.0:1787830936.534266:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 287 00000100:00100000:2.0:1787830936.534277:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a682450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+12:8705:x1874676433299968:12345-192.168.203.31@tcp:256:mount.lustre.0 20000000:01000000:2.0:1787830936.534322:0:6484:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1787830936.534693:0:6484:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787830936.534698:0:6484:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1787830936.534702:0:6484:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1787830936.534706:0:6484:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1787830936.534708:0:6484:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:2.0:1787830936.537713:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a682450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+12:8705:x1874676433299968:12345-192.168.203.31@tcp:256:mount.lustre.0 Request processed in 3423us (3616us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830936.537732:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 287 00000100:00100000:1.0:1787830936.543066:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787830936.543340:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433300096 00000100:00100000:0.0:1787830936.543352:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433300096 00000100:00100000:0.0:1787830936.543426:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 288 00000100:00100000:0.0:1787830936.543437:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a683850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+12:8705:x1874676433300096:12345-192.168.203.31@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787830936.543457:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787830936.543477:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d233bf10e00/0x95459fb9d1d289c0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xe558a92a99423caa expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830936.543508:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d233bf10e00/0x95459fb9d1d289c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423caa expref: 13 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830936.543521:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d233bf10e00/0x95459fb9d1d289c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423caa expref: 13 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830936.543532:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233bf10e00, rc 0) 00000100:00100000:0.0:1787830936.543606:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a683850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+13:8705:x1874676433300096:12345-192.168.203.31@tcp:101:mount.lustre.0 Request processed in 170us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830936.543923:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 288 00000100:00100000:1.0:1787830936.546090:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787830936.548492:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433300224 00000100:00100000:2.0:1787830936.548511:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433300224 00000100:00100000:2.0:1787830936.548602:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 289 00000100:00100000:2.0:1787830936.548613:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a683c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+13:8705:x1874676433300224:12345-192.168.203.31@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787830936.549063:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a683c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+13:8705:x1874676433300224:12345-192.168.203.31@tcp:501:mount.lustre.0 Request processed in 450us (2982us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830936.549072:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 289 00010000:00010000:0.0:1787830936.551335:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787830936.551725:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787830936.551853:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433300352 00000100:00100000:0.0:1787830936.551864:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433300352 00000100:00100000:0.0:1787830936.551923:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 290 00000100:00100000:0.0:1787830936.551934:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a680450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+13:8705:x1874676433300352:12345-192.168.203.31@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787830936.552118:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a680450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+13:8705:x1874676433300352:12345-192.168.203.31@tcp:503:mount.lustre.0 Request processed in 185us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830936.552129:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 290 00000100:00100000:1.0:1787830936.554691:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787830936.555422:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433300480 00000100:00100000:2.0:1787830936.555433:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433300480 00000100:00100000:2.0:1787830936.555494:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 291 00000100:00100000:2.0:1787830936.555503:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a680850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+13:8713:x1874676433300480:12345-192.168.203.31@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787830936.555698:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a680850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+13:8713:x1874676433300480:12345-192.168.203.31@tcp:502:llog_process_th.0 Request processed in 195us (1020us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830936.555707:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 291 00000100:00100000:2.0:1787830936.557809:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787830936.557916:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433300608 00000100:00100000:0.0:1787830936.557926:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433300608 00000100:00100000:0.0:1787830936.557986:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 292 00000100:00100000:0.0:1787830936.557996:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a681c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+13:8713:x1874676433300608:12345-192.168.203.31@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787830936.558188:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a681c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+13:8713:x1874676433300608:12345-192.168.203.31@tcp:502:llog_process_th.0 Request processed in 192us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830936.558197:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 292 00000100:00100000:3.0:1787830936.564908:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787830936.565012:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787830936.565149:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787830936.565171:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433301376 00000100:00100000:2.0:1787830936.565175:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433300736 00000100:00100000:2.0:1787830936.565183:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433300736 00000100:00100000:1.0:1787830936.565183:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433301376 00000100:00100000:2.0:1787830936.565312:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433300992 00000100:00100000:2.0:1787830936.565316:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433300992 00000100:00100000:2.0:1787830936.565334:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 95 00000100:00100000:3.0:1787830936.565342:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787830936.565350:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220392d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+6:2394:x1874676433301376:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1787830936.565392:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433301504 00000100:00100000:1.0:1787830936.565398:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433301504 00000100:00100000:1.0:1787830936.565476:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 16 00000100:00100000:1.0:1787830936.565485:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220392c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2393:x1874676433300736:12345-192.168.203.31@tcp:38:mount.lustre.0 00000100:00100000:2.0:1787830936.565492:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220392d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+6:2394:x1874676433301376:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 145us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830936.565502:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 95 00010000:00080000:1.0:1787830936.565515:0:6491:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from c901c2b2-479b-44dc-8fa8-34fbacf02f07@192.168.203.31@tcp t0 exp 0000000000000000 cur 227 last 0 00000100:00100000:2.0:1787830936.565524:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 96 00000100:00100000:2.0:1787830936.565533:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220392f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:2394:x1874676433301504:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1787830936.565565:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220392f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:2394:x1874676433301504:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 33us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830936.565571:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 96 00000020:00000080:1.0:1787830936.565571:0:6491:0:(genops.c:1385:class_connect()) connect: client c901c2b2-479b-44dc-8fa8-34fbacf02f07, cookie 0x95459fb9d1d289c7 00000100:00100000:2.0:1787830936.565584:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 17 00000100:00100000:2.0:1787830936.565589:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220392c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2393:x1874676433300992:12345-192.168.203.31@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787830936.565604:0:8620:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from c901c2b2-479b-44dc-8fa8-34fbacf02f07@192.168.203.31@tcp t0 exp 0000000000000000 cur 227 last 0 00000020:00000080:2.0:1787830936.565647:0:8620:0:(genops.c:1385:class_connect()) connect: client c901c2b2-479b-44dc-8fa8-34fbacf02f07, cookie 0x95459fb9d1d289ce 00000004:00100000:2.0:1787830936.565664:0:8620:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return 37 00000004:00100000:1.0:1787830936.565683:0:6491:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return 37 00000100:00080000:2.0:1787830936.565865:0:8620:0:(import.c:65:import_set_state_nolock()) ffff8d2202a81000 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1787830936.565866:0:6491:0:(import.c:65:import_set_state_nolock()) ffff8d233f525800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787830936.565905:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220392c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c901c2b2-479b-44dc-8fa8-34fbacf02f07+6:2393:x1874676433300736:12345-192.168.203.31@tcp:38:mount.lustre.0 Request processed in 420us (892us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830936.565913:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220392c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c901c2b2-479b-44dc-8fa8-34fbacf02f07+6:2393:x1874676433300992:12345-192.168.203.31@tcp:38:mount.lustre.0 Request processed in 319us (762us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830936.565917:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 16 00000100:00100000:2.0:1787830936.565926:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 17 00000100:00100000:1.0:1787830936.570130:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787830936.570230:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787830936.570409:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433301120 00000100:00100000:0.0:1787830936.570421:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433301120 00000100:00100000:0.0:1787830936.570520:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433300864 00000100:00100000:0.0:1787830936.570524:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433300864 00000100:00100000:0.0:1787830936.570554:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 18 00000100:00100000:0.0:1787830936.570565:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220258cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c901c2b2-479b-44dc-8fa8-34fbacf02f07+6:0:x1874676433301120:12345-192.168.203.31@tcp:41:mount.lustre.0 00000100:00080000:1.0:1787830936.570694:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787830936.570698:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787830936.570714:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 19 00000100:00100000:1.0:1787830936.570723:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220258e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c901c2b2-479b-44dc-8fa8-34fbacf02f07+6:0:x1874676433300864:12345-192.168.203.31@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787830936.570764:0:6490:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787830936.570879:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220258e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c901c2b2-479b-44dc-8fa8-34fbacf02f07+6:0:x1874676433300864:12345-192.168.203.31@tcp:41:mount.lustre.0 Request processed in 158us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830936.570888:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 19 00000004:00000024:0.0:1787830936.571312:0:6492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787830936.571366:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220258cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c901c2b2-479b-44dc-8fa8-34fbacf02f07+6:0:x1874676433301120:12345-192.168.203.31@tcp:41:mount.lustre.0 Request processed in 803us (1249us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830936.571392:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 18 00000100:00100000:3.0:1787830936.571580:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787830936.571601:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433301248 00000100:00100000:2.0:1787830936.571607:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433301248 00000100:00100000:2.0:1787830936.571662:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 20 00000100:00100000:2.0:1787830936.571671:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220392da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c901c2b2-479b-44dc-8fa8-34fbacf02f07+6:8705:x1874676433301248:12345-192.168.203.31@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787830936.572158:0:6491:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787830936.572201:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220392da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c901c2b2-479b-44dc-8fa8-34fbacf02f07+6:8705:x1874676433301248:12345-192.168.203.31@tcp:41:mount.lustre.0 Request processed in 532us (625us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830936.572277:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 20 00000100:00100000:3.0:1787830936.575143:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787830936.575280:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433301632 00000100:00100000:0.0:1787830936.575306:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433301632 00000100:00100000:0.0:1787830936.575428:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 21 00000100:00100000:0.0:1787830936.575440:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220392e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c901c2b2-479b-44dc-8fa8-34fbacf02f07+6:8705:x1874676433301632:12345-192.168.203.31@tcp:40:mount.lustre.0 00000100:00100000:0.0:1787830936.575559:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220392e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c901c2b2-479b-44dc-8fa8-34fbacf02f07+6:8705:x1874676433301632:12345-192.168.203.31@tcp:40:mount.lustre.0 Request processed in 121us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830936.575567:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 21 00000100:00100000:3.0:1787830936.580551:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787830936.580710:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787830936.583850:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433301760 00000100:00100000:1.0:1787830936.583870:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433301760 00000100:00100000:1.0:1787830936.583932:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433301888 00000100:00100000:1.0:1787830936.583936:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433301888 00000100:00100000:3.0:1787830936.583945:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787830936.583964:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 20 00000100:00100000:1.0:1787830936.583974:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220392cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2393:x1874676433301760:12345-192.168.203.31@tcp:8:mount.lustre.0 00000100:00100000:0.0:1787830936.584069:0:8631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 21 00000100:00100000:0.0:1787830936.584077:0:8631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220392de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2393:x1874676433301888:12345-192.168.203.31@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787830936.584081:0:8408:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from c901c2b2-479b-44dc-8fa8-34fbacf02f07@192.168.203.31@tcp t0 exp 0000000000000000 cur 227 last 0 00010000:00080000:0.0:1787830936.584101:0:8631:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from c901c2b2-479b-44dc-8fa8-34fbacf02f07@192.168.203.31@tcp t0 exp 0000000000000000 cur 227 last 0 00000020:00000080:1.0:1787830936.584137:0:8408:0:(genops.c:1385:class_connect()) connect: client c901c2b2-479b-44dc-8fa8-34fbacf02f07, cookie 0x95459fb9d1d289d5 00000020:00000080:0.0:1787830936.584137:0:8631:0:(genops.c:1385:class_connect()) connect: client c901c2b2-479b-44dc-8fa8-34fbacf02f07, cookie 0x95459fb9d1d289dc 00002000:00100000:1.0:1787830936.584155:0:8408:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli c901c2b2-479b-44dc-8fa8-34fbacf02f07/ffff8d233f520800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211393d ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787830936.584178:0:8408:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return 37 00002000:00080000:1.0:1787830936.584279:0:8408:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787830936.584325:0:8408:0:(import.c:65:import_set_state_nolock()) ffff8d233f522000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787830936.584429:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220392cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c901c2b2-479b-44dc-8fa8-34fbacf02f07+6:2393:x1874676433301760:12345-192.168.203.31@tcp:8:mount.lustre.0 Request processed in 454us (3892us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830936.584438:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 20 00000100:00100000:1.0:1787830936.584465:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433302016 00000100:00100000:1.0:1787830936.584468:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433302016 00000100:00100000:1.0:1787830936.584517:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 5 00000100:00100000:1.0:1787830936.584525:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220392c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:c901c2b2-479b-44dc-8fa8-34fbacf02f07+6:8705:x1874676433302016:12345-192.168.203.31@tcp:900:mount.lustre.0 00000100:00100000:1.0:1787830936.584565:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220392c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:c901c2b2-479b-44dc-8fa8-34fbacf02f07+6:8705:x1874676433302016:12345-192.168.203.31@tcp:900:mount.lustre.0 Request processed in 40us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830936.584572:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 5 00002000:00100000:0.0:1787830936.586080:0:8631:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli c901c2b2-479b-44dc-8fa8-34fbacf02f07/ffff8d2203601800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211393d ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787830936.586102:0:8631:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return 37 00002000:00080000:0.0:1787830936.586193:0:8631:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787830936.586506:0:8631:0:(import.c:65:import_set_state_nolock()) ffff8d2203603800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787830936.586758:0:8631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220392de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c901c2b2-479b-44dc-8fa8-34fbacf02f07+6:2393:x1874676433301888:12345-192.168.203.31@tcp:8:mount.lustre.0 Request processed in 2673us (6040us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830936.586770:0:8631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 21 00000100:00100000:3.0:1787830936.587481:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787830936.587734:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433302144 00000100:00100000:2.0:1787830936.587745:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433302144 00000100:00100000:2.0:1787830936.587803:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 1 00000100:00100000:2.0:1787830936.587813:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220392fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c901c2b2-479b-44dc-8fa8-34fbacf02f07+6:8705:x1874676433302144:12345-192.168.203.31@tcp:33:mount.lustre.0 00000004:00200000:2.0:1787830936.587916:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1787830936.588045:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220392fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c901c2b2-479b-44dc-8fa8-34fbacf02f07+6:8705:x1874676433302144:12345-192.168.203.31@tcp:33:mount.lustre.0 Request processed in 232us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830936.588052:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 1 00010000:00010000:1.0:1787830937.575590:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787830938.343005:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787830938.343034:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a212c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1874676443849984:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787830938.343152:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830938.344512:0:11489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443849984 00000100:00100000:0.0:1787830938.344524:0:11489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443849984 00000100:00080000:2.0:1787830938.344642:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787830938.344800:0:11489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787830938.344813:0:11489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220392cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1874676443849984:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787830938.344848:0:11489:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787830938.344945:0:11489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220392cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1874676443849984:12345-0@lo:13:osp-pre-0-1.0 Request processed in 136us (1793us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830938.344953:0:11489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:3.0:1787830938.345288:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2203a212c0 x1874676443849984/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787830954 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787830938.345314:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a212c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1874676443849984:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787830938.348553:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a212c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1874676443850112:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787830938.348691:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830938.349012:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443850112 00000100:00100000:0.0:1787830938.349023:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443850112 00000100:00100000:0.0:1787830938.349094:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787830938.349104:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220392e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1874676443850112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787830938.349127:0:8410:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787830938.349176:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220392e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1874676443850112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830938.349184:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:3.0:1787830938.349223:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2203a212c0 x1874676443850112/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787830954 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787830938.349247:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a212c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1874676443850112:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787830938.349304:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787830938.598763:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787830938.855164:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787830938.855246:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a22940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676443850240:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787830938.855337:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830938.855471:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443850240 00000100:00100000:1.0:1787830938.855481:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443850240 00000100:00100000:1.0:1787830938.855534:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787830938.855544:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a9c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1874676443850240:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787830938.855583:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787830938.855668:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a9c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1874676443850240:12345-0@lo:41:osp-pre-1-0.0 Request processed in 125us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830938.855675:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787830938.855970:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a22940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676443850240:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787830939.367268:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220392f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676443850368:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787830939.367359:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830939.368115:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443850368 00000100:00100000:3.0:1787830939.368135:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443850368 00000100:00100000:3.0:1787830939.368194:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787830939.368204:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676443850368:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787830939.368266:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787830939.368347:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676443850368:12345-0@lo:41:osp-pre-0-1.0 Request processed in 144us (988us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830939.368359:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787830939.368413:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220392f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676443850368:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787830939.623220:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787830939.865414:0:12155:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg331-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:3.0:1787830940.390989:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220258da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1874676443850624:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787830940.391066:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830940.391174:0:11489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443850624 00000100:00100000:0.0:1787830940.391183:0:11489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443850624 00000100:00100000:0.0:1787830940.391247:0:11489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787830940.391257:0:11489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220392f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1874676443850624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787830940.391301:0:11489:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787830940.392735:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a9d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443850496:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787830940.392793:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830940.392849:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220258d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443851008:0@lo:400:kworker.0 00000100:00100000:2.0:1787830940.392875:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830940.392907:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787830940.392913:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233be76580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874676443851136:0@lo:400:kworker.0 00000100:00100000:2.0:1787830940.392937:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830940.393033:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443851136 00000100:00100000:2.0:1787830940.393039:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443851136 00000100:00100000:2.0:1787830940.393142:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787830940.393152:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a9fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874676443851136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787830940.393208:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a9fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874676443851136:12345-0@lo:400:kworker.0 Request processed in 58us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830940.393215:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787830940.393262:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233be76580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874676443851136:0@lo:400:kworker.0 00000100:00100000:2.0:1787830940.393884:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443850496 00000100:00100000:2.0:1787830940.393890:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443850496 00000100:00100000:2.0:1787830940.393925:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787830940.393932:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a9e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443850496:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787830940.393950:0:8409:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787830940.394171:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a9e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443850496:12345-0@lo:13:osp-pre-1-1.0 Request processed in 238us (1376us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830940.394178:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787830940.394208:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220258d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3622:1874676443850880:0@lo:400:kworker.0 00000100:00100000:2.0:1787830940.394239:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830940.394288:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787830940.394325:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220258e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a45944b-32e3-4193-a2a5-46f84222bc14:3622:1874676443850752:0@lo:400:kworker.0 00000100:00100000:2.0:1787830940.394355:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830940.394619:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443850752 00000100:00100000:2.0:1787830940.394652:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443850752 00000100:00100000:2.0:1787830940.394753:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:2.0:1787830940.394762:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a682050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+24:3622:x1874676443850752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787830940.394806:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a682050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+24:3622:x1874676443850752:12345-0@lo:400:kworker.0 Request processed in 46us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830940.394812:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:2.0:1787830940.394851:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220258e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a45944b-32e3-4193-a2a5-46f84222bc14:3622:1874676443850752:0@lo:400:kworker.0 00010000:00080000:2.0:1787830940.394881:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2203a9d680 x1874676443850496/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787830956 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787830940.394899:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a9d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443850496:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1787830940.394950:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787830940.395044:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443851008 00000100:00100000:2.0:1787830940.395050:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443851008 00000100:00100000:2.0:1787830940.395078:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787830940.395154:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a9ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443851008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787830940.395201:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a9ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443851008:12345-0@lo:400:kworker.0 Request processed in 116us (2324us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830940.395217:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787830940.395245:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220258d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443851008:0@lo:400:kworker.0 00000100:00100000:2.0:1787830940.395279:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443850880 00000100:00100000:2.0:1787830940.395283:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443850880 00000100:00100000:2.0:1787830940.395310:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787830940.395315:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a9d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1874676443850880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787830940.395353:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a9d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1874676443850880:12345-0@lo:400:kworker.0 Request processed in 38us (1113us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830940.395360:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787830940.395386:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220258d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3622:1874676443850880:0@lo:400:kworker.0 00000100:00100000:1.0:1787830940.398721:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233be76580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443851264:0@lo:400:kworker.0 00000100:00100000:1.0:1787830940.398794:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830940.398864:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2336bff840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3622:1874676443851392:0@lo:400:kworker.0 00000100:00100000:1.0:1787830940.399221:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830940.399280:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443851392 00000100:00100000:1.0:1787830940.399287:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443851392 00000100:00100000:1.0:1787830940.399344:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787830940.399369:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2336bfe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1874676443851392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830940.399425:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2336bfe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1874676443851392:12345-0@lo:400:kworker.0 Request processed in 60us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830940.399433:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:1.0:1787830940.399458:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787830940.399487:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2336bff840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3622:1874676443851392:0@lo:400:kworker.0 00000100:00100000:3.0:1787830940.399491:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443851264 00000100:00100000:3.0:1787830940.399495:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443851264 00000100:00100000:3.0:1787830940.399526:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787830940.399533:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2336bff0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1874676443851264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830940.399561:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2336bfda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443851776:0@lo:400:kworker.0 00000100:00100000:3.0:1787830940.399570:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2336bff0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1874676443851264:12345-0@lo:400:kworker.0 Request processed in 39us (776us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830940.399583:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787830940.399585:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830940.399608:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233be76580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443851264:0@lo:400:kworker.0 00000100:00100000:3.0:1787830940.399640:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2336bff840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3619:1874676443851520:0@lo:400:kworker.0 00000100:00100000:1.0:1787830940.399642:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443851776 00000100:00100000:1.0:1787830940.399645:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443851776 00000100:00100000:3.0:1787830940.399667:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830940.399676:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787830940.399682:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2336bfc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1874676443851776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787830940.399686:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787830940.399691:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2336bfed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443851648:0@lo:400:kworker.0 00000100:00100000:1.0:1787830940.399716:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2336bfc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1874676443851776:12345-0@lo:400:kworker.0 Request processed in 35us (130us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830940.399723:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830940.399723:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787830940.399930:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443851520 00000100:00100000:2.0:1787830940.399935:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443851520 00000100:00100000:0.0:1787830940.399952:0:11489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220392f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1874676443850624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 8695us (8883us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830940.399962:0:11489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:0.0:1787830940.400005:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d220258da40 x1874676443850624/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787830956 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787830940.400025:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220258da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1874676443850624:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1787830940.400055:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787830940.400060:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443851648 00000100:00080000:0.0:1787830940.400060:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787830940.400062:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787830940.400066:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443851648 00000100:00100000:2.0:1787830940.400072:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2314e70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874676443851520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787830940.400100:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a212c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3622:1874676443851904:0@lo:400:kworker.0 00000100:00100000:1.0:1787830940.400102:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787830940.400111:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443851648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787830940.400159:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830940.400164:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443851648:12345-0@lo:400:kworker.0 Request processed in 52us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830940.400171:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:1.0:1787830940.400196:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787830940.400198:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2314e70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874676443851520:12345-0@lo:400:kworker.0 Request processed in 127us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830940.400204:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00010000:00080000:1.0:1787830940.400215:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2336bfda40 x1874676443851776/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787830956 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787830940.400219:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443851904 00000100:00100000:2.0:1787830940.400222:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443851904 00000100:00100000:0.0:1787830940.400226:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787830940.400238:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220390f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3620:1874676443852032:0@lo:400:kworker.0 00000100:00100000:1.0:1787830940.400243:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2336bfda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443851776:0@lo:400:kworker.0 00000100:00100000:2.0:1787830940.400248:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787830940.400253:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220390da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1874676443851904:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1787830940.400274:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787830940.400293:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830940.400309:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220390da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1874676443851904:12345-0@lo:400:kworker.0 Request processed in 54us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830940.400315:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787830940.400323:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a212c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3622:1874676443851904:0@lo:400:kworker.0 00000100:00100000:2.0:1787830940.400330:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443852032 00000100:00100000:2.0:1787830940.400339:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443852032 00000100:00080000:1.0:1787830940.400362:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787830940.400377:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787830940.400383:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203994f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1874676443852032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787830940.400429:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203994f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1874676443852032:12345-0@lo:400:kworker.0 Request processed in 46us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830940.400434:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00010000:00080000:3.0:1787830940.400447:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2336bfed00 x1874676443851648/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787830956 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787830940.400459:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2336bfed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443851648:0@lo:400:kworker.0 00010000:00080000:2.0:1787830940.400486:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2336bff840 x1874676443851520/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830956 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787830940.400496:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2336bff840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3619:1874676443851520:0@lo:400:kworker.0 00010000:00080000:0.0:1787830940.400866:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d220390f0c0 x1874676443852032/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830956 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787830940.400876:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220390f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3620:1874676443852032:0@lo:400:kworker.0 00010000:00010000:1.0:1787830940.647901:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787830941.671184:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787830941.775874:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787830941.775958:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787830941.775987:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787830941.776008:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787830941.776040:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787830941.776058:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787830941.776080:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787830941.776104:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433302528 00000100:00100000:2.0:1787830941.776113:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433302528 00000100:00100000:2.0:1787830941.776162:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433302784 00000100:00100000:2.0:1787830941.776165:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433302784 00000100:00100000:2.0:1787830941.776179:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433302400 00000100:00100000:2.0:1787830941.776182:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433302400 00000100:00100000:2.0:1787830941.776196:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433302656 00000100:00100000:2.0:1787830941.776199:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433302656 00000100:00100000:2.0:1787830941.776214:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 103 00000100:00100000:2.0:1787830941.776223:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a9f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:2394:x1874676433302528:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1787830941.776314:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a9f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:2394:x1874676433302528:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 92us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830941.776329:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 103 00000100:00100000:2.0:1787830941.776350:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 104 00000100:00100000:2.0:1787830941.776357:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a9f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c901c2b2-479b-44dc-8fa8-34fbacf02f07+6:2394:x1874676433302784:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1787830941.776383:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a9f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c901c2b2-479b-44dc-8fa8-34fbacf02f07+6:2394:x1874676433302784:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 26us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830941.776389:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 104 00000100:00100000:2.0:1787830941.776415:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 105 00000100:00100000:2.0:1787830941.776421:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a9cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+6:2394:x1874676433302400:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1787830941.776454:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a9cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+6:2394:x1874676433302400:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 25us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830941.776464:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 105 00000100:00100000:2.0:1787830941.776478:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 106 00000100:00100000:2.0:1787830941.776484:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220258da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c901c2b2-479b-44dc-8fa8-34fbacf02f07+6:2394:x1874676433302656:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1787830941.776507:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220258da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c901c2b2-479b-44dc-8fa8-34fbacf02f07+6:2394:x1874676433302656:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 23us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830941.776513:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 106 00000100:00100000:0.0:1787830941.776741:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433302272 00000100:00100000:0.0:1787830941.776746:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433302272 00000100:00100000:0.0:1787830941.776782:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 294 00000100:00100000:0.0:1787830941.776789:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a681450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+13:2394:x1874676433302272:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1787830941.776821:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a681450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+13:2394:x1874676433302272:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 32us (954us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830941.776827:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 294 00000100:00100000:1.0:1787830941.776957:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433303040 00000100:00100000:1.0:1787830941.776962:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433303040 00000100:00100000:1.0:1787830941.776999:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433302912 00000100:00100000:1.0:1787830941.777002:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433302912 00000100:00100000:1.0:1787830941.777029:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 35 00000100:00100000:1.0:1787830941.777036:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a9de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c901c2b2-479b-44dc-8fa8-34fbacf02f07+6:2394:x1874676433303040:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1787830941.777065:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a9de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c901c2b2-479b-44dc-8fa8-34fbacf02f07+6:2394:x1874676433303040:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 30us (1056us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830941.777071:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 35 00000100:00100000:1.0:1787830941.777083:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 36 00000100:00100000:1.0:1787830941.777089:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220258d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c901c2b2-479b-44dc-8fa8-34fbacf02f07+6:2394:x1874676433302912:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1787830941.777112:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220258d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c901c2b2-479b-44dc-8fa8-34fbacf02f07+6:2394:x1874676433302912:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 24us (1032us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830941.777118:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 36 00000100:00080000:1.0:1787830941.777136:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787830941.777139:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787830941.777142:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787830941.777144:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:00100000:0.0:1787830941.932677:0:9484:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c901c2b2-479b-44dc-8fa8-34fbacf02f07 00000001:00100000:2.0:1787830941.932790:0:7421:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of c901c2b2-479b-44dc-8fa8-34fbacf02f07 00000001:00100000:2.0:1787830941.932866:0:6469:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of c901c2b2-479b-44dc-8fa8-34fbacf02f07 00000001:00100000:1.0:1787830941.933092:0:8401:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c901c2b2-479b-44dc-8fa8-34fbacf02f07 00010000:00010000:0.0:1787830942.695013:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787830943.463905:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220258d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1874676443852160:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787830943.463972:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830943.464044:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443852160 00000100:00100000:2.0:1787830943.464051:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443852160 00000100:00100000:2.0:1787830943.464105:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787830943.464115:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2336bfda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1874676443852160:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787830943.464149:0:8409:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787830943.464225:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2336bfda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1874676443852160:12345-0@lo:13:osp-pre-0-1.0 Request processed in 112us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830943.464233:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:1.0:1787830943.464238:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d220258d2c0 x1874676443852160/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787830959 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787830943.464267:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220258d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1874676443852160:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1787830943.464272:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787830943.465283:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203994000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443852288:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787830943.465326:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830943.465461:0:11489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443852288 00000100:00100000:0.0:1787830943.465467:0:11489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443852288 00000100:00100000:0.0:1787830943.465570:0:11489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787830943.465585:0:11489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2336bff840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1874676443852288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787830943.465603:0:11489:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787830943.465681:0:11489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2336bff840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1874676443852288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830943.465688:0:11489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:3.0:1787830943.465724:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2203994000 x1874676443852288/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787830959 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787830943.465744:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203994000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443852288:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787830943.467401:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787830943.723278:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787830943.978899:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203995a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676443852416:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787830943.978974:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830943.979295:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443852416 00000100:00100000:1.0:1787830943.979304:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443852416 00000100:00100000:1.0:1787830943.979362:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787830943.979372:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a79a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1874676443852416:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787830943.979407:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787830943.979474:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a79a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1874676443852416:12345-0@lo:41:osp-pre-1-0.0 Request processed in 103us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830943.979482:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787830943.979514:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203995a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676443852416:0@lo:41:osp-pre-1-0.0 00000020:00000004:2.0:1787830944.312582:0:12469:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787830944.312939:0:12469:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1787830944.487160:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a78780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443852544:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787830944.487251:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830944.487361:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443852544 00000100:00100000:1.0:1787830944.487368:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443852544 00000100:00100000:1.0:1787830944.487426:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787830944.487437:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220258e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443852544:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787830944.487470:0:7448:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787830944.488379:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a78780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443852544:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787830944.488430:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220258e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443852544:12345-0@lo:41:osp-pre-0-1.0 Request processed in 932us (1116us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830944.488503:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00010000:00010000:2.0:1787830944.743047:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787830945.511717:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787830945.511740:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220258d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443852672:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787830945.511874:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830945.511903:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443852672 00000100:00100000:3.0:1787830945.511911:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443852672 00000100:00100000:3.0:1787830945.511965:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787830945.511975:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203765a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443852672:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787830945.512002:0:8410:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787830945.512046:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203765a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443852672:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830945.512063:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:3.0:1787830945.512084:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787830945.512113:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d220258d2c0 x1874676443852672/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787830961 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787830945.512139:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220258d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443852672:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787830945.512552:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2336bfed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443852800:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787830945.512582:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830945.512662:0:11489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443852800 00000100:00100000:1.0:1787830945.512667:0:11489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443852800 00000100:00100000:1.0:1787830945.512708:0:11489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787830945.512715:0:11489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a78b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1874676443852800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787830945.512727:0:11489:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787830945.512762:0:11489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a78b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1874676443852800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 48us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830945.512769:0:11489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:3.0:1787830945.512992:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787830945.513018:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2336bfed00 x1874676443852800/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787830961 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787830945.513031:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2336bfed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443852800:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787830945.515278:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203996940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a45944b-32e3-4193-a2a5-46f84222bc14:3622:1874676443852928:0@lo:400:kworker.0 00000100:00100000:0.0:1787830945.515348:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830945.515385:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22039970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676443853440:0@lo:400:kworker.0 00000100:00100000:0.0:1787830945.515409:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830945.515425:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203affc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676443853952:0@lo:400:kworker.0 00000100:00100000:0.0:1787830945.515503:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830945.515530:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787830945.515535:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203994000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3622:1874676443853312:0@lo:400:kworker.0 00000100:00100000:0.0:1787830945.515558:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830945.515572:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203afe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676443853824:0@lo:400:kworker.0 00000100:00100000:0.0:1787830945.515589:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830945.515610:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203997c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1874676443853184:0@lo:400:kworker.0 00000100:00100000:0.0:1787830945.515675:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830945.515692:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220390f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3620:1874676443853696:0@lo:400:kworker.0 00000100:00100000:1.0:1787830945.515696:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443853440 00000100:00100000:1.0:1787830945.515704:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443853440 00000100:00100000:0.0:1787830945.515716:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830945.515746:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443853184 00000100:00100000:0.0:1787830945.515748:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203afde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3620:1874676443854208:0@lo:400:kworker.0 00000100:00100000:1.0:1787830945.515750:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443853184 00000100:00100000:1.0:1787830945.515770:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787830945.515781:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203afda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1874676443853440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787830945.515788:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830945.515811:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1787830945.515818:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203994b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3620:1874676443853056:0@lo:400:kworker.0 00000100:00100000:1.0:1787830945.515842:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203afda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1874676443853440:12345-0@lo:400:kworker.0 Request processed in 62us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830945.515851:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830945.515855:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787830945.515875:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787830945.515878:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a9d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3620:1874676443853568:0@lo:400:kworker.0 00000100:00100000:1.0:1787830945.515885:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203aff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1874676443853184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787830945.515903:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830945.515922:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203afc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3620:1874676443854080:0@lo:400:kworker.0 00000100:00100000:1.0:1787830945.515926:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203aff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1874676443853184:12345-0@lo:400:kworker.0 Request processed in 42us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830945.515933:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787830945.516688:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443853952 00000100:00100000:1.0:1787830945.516695:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443853952 00000100:00100000:3.0:1787830945.516700:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443853312 00000100:00100000:3.0:1787830945.516706:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443853312 00000100:00100000:1.0:1787830945.516734:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443853824 00000100:00100000:1.0:1787830945.516738:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443853824 00000100:00100000:1.0:1787830945.516759:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787830945.516765:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203afc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1874676443853952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830945.516807:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203afc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1874676443853952:12345-0@lo:400:kworker.0 Request processed in 42us (1303us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830945.516820:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787830945.516833:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787830945.516839:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203afcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676443853824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830945.516869:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203afcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676443853824:12345-0@lo:400:kworker.0 Request processed in 29us (1277us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830945.516875:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787830945.516881:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443853696 00000100:00100000:3.0:1787830945.516886:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443853696 00000100:00100000:1.0:1787830945.516898:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443854208 00000100:00100000:1.0:1787830945.516903:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443854208 00000100:00100000:1.0:1787830945.516923:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443853056 00000100:00100000:1.0:1787830945.516926:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443853056 00000100:00100000:1.0:1787830945.516935:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443853568 00000100:00100000:1.0:1787830945.516937:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443853568 00000100:00100000:1.0:1787830945.516949:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787830945.516955:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203afe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1874676443853312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830945.516983:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203afe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1874676443853312:12345-0@lo:400:kworker.0 Request processed in 29us (1424us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830945.516989:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787830945.517001:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787830945.517007:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203afc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1874676443853696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787830945.517033:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787830945.517040:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203afc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1874676443853696:12345-0@lo:400:kworker.0 Request processed in 32us (1324us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830945.517050:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787830945.517062:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787830945.517068:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203afe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1874676443853056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830945.517093:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203afe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1874676443853056:12345-0@lo:400:kworker.0 Request processed in 26us (1246us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830945.517106:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203aff840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1874676443854208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830945.517110:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787830945.517127:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787830945.517134:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203afed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1874676443853568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787830945.517163:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203aff840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1874676443854208:12345-0@lo:400:kworker.0 Request processed in 121us (1374us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830945.517171:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787830945.517176:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203afed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1874676443853568:12345-0@lo:400:kworker.0 Request processed in 42us (1272us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830945.517183:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00080000:3.0:1787830945.517206:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787830945.517213:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787830945.517215:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443852928 00000100:00080000:3.0:1787830945.517217:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787830945.517221:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443852928 00000100:00100000:1.0:1787830945.517267:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1787830945.517275:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a680c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+24:3622:x1874676443852928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787830945.517304:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830945.517316:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a680c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+24:3622:x1874676443852928:12345-0@lo:400:kworker.0 Request processed in 41us (1967us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830945.517324:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1787830945.517356:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203997c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1874676443853184:0@lo:400:kworker.0 00010000:00080000:0.0:1787830945.517371:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d220390f0c0 x1874676443853696/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830961 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787830945.517381:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220390f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3620:1874676443853696:0@lo:400:kworker.0 00010000:00080000:0.0:1787830945.517392:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2203afde00 x1874676443854208/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830961 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787830945.517400:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203afde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3620:1874676443854208:0@lo:400:kworker.0 00000100:00100000:0.0:1787830945.517424:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203994b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3620:1874676443853056:0@lo:400:kworker.0 00000100:00100000:0.0:1787830945.517434:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a9d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3620:1874676443853568:0@lo:400:kworker.0 00000100:00100000:3.0:1787830945.517585:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443854080 00000100:00100000:3.0:1787830945.517589:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443854080 00000100:00100000:3.0:1787830945.517652:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787830945.517726:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203afd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1874676443854080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787830945.517892:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203994000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3622:1874676443853312:0@lo:400:kworker.0 00010000:00080000:0.0:1787830945.518135:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2203afe1c0 x1874676443853824/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787830961 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787830945.518145:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203afe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676443853824:0@lo:400:kworker.0 00000100:00100000:0.0:1787830945.518155:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203996940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a45944b-32e3-4193-a2a5-46f84222bc14:3622:1874676443852928:0@lo:400:kworker.0 00000100:00100000:0.0:1787830945.518167:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22039970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676443853440:0@lo:400:kworker.0 00010000:00080000:0.0:1787830945.518178:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2203affc00 x1874676443853952/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787830961 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787830945.518186:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203affc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676443853952:0@lo:400:kworker.0 00000100:00100000:3.0:1787830945.518294:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203afd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1874676443854080:12345-0@lo:400:kworker.0 Request processed in 570us (991us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830945.518311:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787830945.518582:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203afc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3620:1874676443854080:0@lo:400:kworker.0 00000100:00080000:1.0:1787830945.518662:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000004:1.0:1787830945.706324:0:12567:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787830945.706552:0:12567:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787830945.769295:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830946.791969:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787830946.897057:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787830946.897110:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787830946.897239:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433303168 00000100:00100000:3.0:1787830946.897249:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433303168 00000100:00100000:3.0:1787830946.897305:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 296 00000100:00100000:3.0:1787830946.897315:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a682c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+13:2395:x1874676433303168:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1787830946.897508:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433303424 00000100:00100000:0.0:1787830946.897513:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433303424 00000100:00100000:3.0:1787830946.898803:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a682c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+13:2395:x1874676433303168:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 1483us (1819us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830946.898815:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 296 00000100:00100000:2.0:1787830946.898946:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787830946.898998:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433303680 00000100:00080000:1.0:1787830946.899004:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787830946.899005:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433303680 00000100:00080000:1.0:1787830946.899037:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787830946.899056:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 113 00000100:00100000:3.0:1787830946.899064:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203766940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c901c2b2-479b-44dc-8fa8-34fbacf02f07+5:2395:x1874676433303680:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1787830946.899074:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787830946.899127:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 114 00000100:00100000:0.0:1787830946.899138:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203764780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:2395:x1874676433303424:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1787830946.899181:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203764780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:2395:x1874676433303424:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 46us (2071us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830946.899187:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 114 00000100:00100000:3.0:1787830946.899308:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203766940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c901c2b2-479b-44dc-8fa8-34fbacf02f07+5:2395:x1874676433303680:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 63us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830946.899316:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 113 00000100:00100000:2.0:1787830946.899319:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787830946.899331:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433303296 00000100:00100000:3.0:1787830946.899335:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433303296 00000100:00100000:3.0:1787830946.899360:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 115 00000100:00100000:2.0:1787830946.899364:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787830946.899366:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203767480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+6:2395:x1874676433303296:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1787830946.899380:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787830946.899394:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203767480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+6:2395:x1874676433303296:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 28us (75us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830946.899401:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 115 00000100:00100000:3.0:1787830946.899411:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433303552 00000100:00100000:3.0:1787830946.899414:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433303552 00000100:00100000:2.0:1787830946.899415:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433303936 00000100:00100000:2.0:1787830946.899417:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433303936 00000100:00100000:3.0:1787830946.899429:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 116 00000100:00100000:2.0:1787830946.899444:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433303808 00000100:00100000:2.0:1787830946.899446:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433303808 00000100:00100000:3.0:1787830946.899449:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22037643c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c901c2b2-479b-44dc-8fa8-34fbacf02f07+5:2395:x1874676433303552:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1787830946.899465:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 39 00000100:00100000:2.0:1787830946.899472:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203764b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c901c2b2-479b-44dc-8fa8-34fbacf02f07+5:2395:x1874676433303936:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1787830946.899478:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22037643c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c901c2b2-479b-44dc-8fa8-34fbacf02f07+5:2395:x1874676433303552:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 31us (115us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830946.899485:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 116 00000100:00100000:2.0:1787830946.899496:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203764b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c901c2b2-479b-44dc-8fa8-34fbacf02f07+5:2395:x1874676433303936:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 26us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830946.899512:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 39 00000100:00080000:3.0:1787830946.899526:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787830946.899526:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 40 00000100:00080000:3.0:1787830946.899529:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787830946.899531:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203767840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c901c2b2-479b-44dc-8fa8-34fbacf02f07+5:2395:x1874676433303808:12345-192.168.203.31@tcp:400:kworker.0 00000100:00080000:3.0:1787830946.899532:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787830946.899560:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203767840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c901c2b2-479b-44dc-8fa8-34fbacf02f07+5:2395:x1874676433303808:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 29us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830946.899566:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 40 00000020:00000004:2.0:1787830947.089781:0:12665:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787830947.090028:0:12665:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787830947.814878:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787830948.510707:0:12762:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787830948.511017:0:12762:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1787830948.582858:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203afe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443854336:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787830948.582952:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830948.583053:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203766580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676443854464:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787830948.583088:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830948.583140:0:11489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443854336 00000100:00100000:0.0:1787830948.583149:0:11489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443854336 00000100:00100000:0.0:1787830948.583221:0:11489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443854464 00000100:00100000:0.0:1787830948.583224:0:11489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443854464 00000100:00100000:0.0:1787830948.583248:0:11489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787830948.583257:0:11489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a7ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1874676443854336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787830948.583293:0:11489:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787830948.583542:0:11489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a7ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1874676443854336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 284us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830948.583551:0:11489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787830948.583570:0:11489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787830948.583577:0:11489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203afde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676443854464:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787830948.583588:0:11489:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787830948.583690:0:11489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203afde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676443854464:12345-0@lo:13:osp-pre-0-1.0 Request processed in 112us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830948.583696:0:11489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:2.0:1787830948.583758:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2203766580 x1874676443854464/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787830964 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787830948.583780:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203766580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676443854464:0@lo:13:osp-pre-0-1.0 00010000:00080000:3.0:1787830948.583917:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2203afe1c0 x1874676443854336/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787830964 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787830948.583932:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203afe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443854336:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787830948.583959:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787830948.838991:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787830949.095375:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787830949.095413:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2336bfed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1874676443854592:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787830949.095484:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830949.095620:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443854592 00000100:00100000:1.0:1787830949.095662:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443854592 00000100:00100000:2.0:1787830949.095771:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787830949.095781:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203afd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1874676443854592:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787830949.095815:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787830949.095884:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203afd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1874676443854592:12345-0@lo:41:osp-pre-1-0.0 Request processed in 104us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830949.095892:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787830949.096075:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2336bfed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1874676443854592:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787830949.607555:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a792c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1874676443854720:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787830949.607643:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830949.607792:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443854720 00000100:00100000:3.0:1787830949.607800:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443854720 00000100:00100000:3.0:1787830949.607845:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787830949.607854:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2336bfed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1874676443854720:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787830949.607883:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787830949.607995:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2336bfed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1874676443854720:12345-0@lo:41:osp-pre-0-1.0 Request processed in 142us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830949.608003:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787830949.608086:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a792c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1874676443854720:0@lo:41:osp-pre-0-1.0 00000020:00000004:1.0:1787830949.811392:0:12859:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787830949.811610:0:12859:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787830949.864697:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787830950.631472:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203aff0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a45944b-32e3-4193-a2a5-46f84222bc14:3621:1874676443854848:0@lo:400:kworker.0 00000100:00100000:1.0:1787830950.631558:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830950.633272:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a7b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676443854976:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787830950.633342:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830950.633398:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787830950.633405:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203afe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3622:1874676443855360:0@lo:400:kworker.0 00000100:00100000:2.0:1787830950.633444:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830950.633481:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203afc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1874676443855232:0@lo:400:kworker.0 00000100:00100000:2.0:1787830950.633507:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830950.633529:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787830950.633535:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203afcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3620:1874676443855104:0@lo:400:kworker.0 00000100:00100000:2.0:1787830950.633556:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830950.633586:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443855360 00000100:00100000:2.0:1787830950.633594:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443855360 00000100:00100000:2.0:1787830950.633650:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443855104 00000100:00100000:2.0:1787830950.633654:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443855104 00000100:00100000:2.0:1787830950.633674:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1787830950.633681:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203765680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1874676443855360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787830950.633735:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203765680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1874676443855360:12345-0@lo:400:kworker.0 Request processed in 54us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830950.633742:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1787830950.633761:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1787830950.633767:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203764f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1874676443855104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787830950.633802:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203764f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1874676443855104:12345-0@lo:400:kworker.0 Request processed in 36us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830950.633808:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1787830950.634131:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443855232 00000100:00100000:3.0:1787830950.634136:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443855232 00000100:00100000:3.0:1787830950.634163:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787830950.634170:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22037652c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1874676443855232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787830950.634229:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22037652c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1874676443855232:12345-0@lo:400:kworker.0 Request processed in 59us (720us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830950.634236:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787830950.634284:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203afe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3622:1874676443855360:0@lo:400:kworker.0 00000100:00100000:3.0:1787830950.634319:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203afcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3620:1874676443855104:0@lo:400:kworker.0 00000100:00100000:3.0:1787830950.634328:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203afc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1874676443855232:0@lo:400:kworker.0 00000100:00100000:3.0:1787830950.634365:0:11489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443854976 00000100:00100000:3.0:1787830950.634369:0:11489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443854976 00000100:00100000:3.0:1787830950.634404:0:11489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787830950.634410:0:11489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203766d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676443854976:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787830950.634433:0:11489:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787830950.634468:0:11489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203766d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676443854976:12345-0@lo:13:osp-pre-1-1.0 Request processed in 59us (1127us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830950.634474:0:11489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:3.0:1787830950.634493:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787830950.634511:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2203a7b0c0 x1874676443854976/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787830966 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787830950.634527:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a7b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676443854976:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787830950.634952:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a212c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676443855488:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787830950.634955:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443854848 00000100:00100000:1.0:1787830950.634961:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443854848 00000100:00100000:2.0:1787830950.634996:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830950.635004:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1787830950.635014:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a683450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+24:3621:x1874676443854848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787830950.635042:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443855488 00000100:00100000:2.0:1787830950.635047:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443855488 00000100:00100000:1.0:1787830950.635064:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a683450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+24:3621:x1874676443854848:12345-0@lo:400:kworker.0 Request processed in 52us (3506us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830950.635073:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:2.0:1787830950.635085:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787830950.635094:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22037670c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1874676443855488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787830950.635119:0:8409:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787830950.635157:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22037670c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1874676443855488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830950.635164:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:2.0:1787830950.635180:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787830950.635212:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2203a212c0 x1874676443855488/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787830966 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787830950.635225:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a212c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676443855488:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787830950.635264:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203aff0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a45944b-32e3-4193-a2a5-46f84222bc14:3621:1874676443854848:0@lo:400:kworker.0 00000100:00100000:1.0:1787830950.635578:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203affc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443855616:0@lo:400:kworker.0 00000100:00100000:1.0:1787830950.635611:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830950.635715:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787830950.635722:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203aff0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3619:1874676443855744:0@lo:400:kworker.0 00000100:00100000:1.0:1787830950.635752:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830950.635791:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443855616 00000100:00100000:1.0:1787830950.635795:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443855616 00000100:00100000:1.0:1787830950.635825:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787830950.635831:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a212c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676443855616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830950.635869:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a212c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676443855616:12345-0@lo:400:kworker.0 Request processed in 38us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830950.635876:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787830950.635905:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203affc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443855616:0@lo:400:kworker.0 00000100:00100000:0.0:1787830950.636015:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203afc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3621:1874676443855872:0@lo:400:kworker.0 00000100:00100000:0.0:1787830950.636045:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830950.636064:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a9d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3621:1874676443856384:0@lo:400:kworker.0 00000100:00100000:0.0:1787830950.636083:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830950.636098:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787830950.636103:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203afcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443856000:0@lo:400:kworker.0 00000100:00100000:1.0:1787830950.636661:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203afe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443856128:0@lo:400:kworker.0 00000100:00100000:0.0:1787830950.636721:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830950.636757:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830950.636782:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787830950.636802:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203affc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3619:1874676443856256:0@lo:400:kworker.0 00000100:00100000:1.0:1787830950.636832:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830950.636858:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443855744 00000100:00100000:1.0:1787830950.636862:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443855744 00000100:00100000:1.0:1787830950.636890:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443855872 00000100:00100000:1.0:1787830950.636893:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443855872 00000100:00100000:1.0:1787830950.636905:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443856384 00000100:00100000:1.0:1787830950.636907:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443856384 00000100:00100000:1.0:1787830950.636919:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443856256 00000100:00100000:1.0:1787830950.636920:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443856256 00000100:00100000:1.0:1787830950.636933:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1787830950.636941:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233be76580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874676443855744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830950.636985:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233be76580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874676443855744:12345-0@lo:400:kworker.0 Request processed in 45us (1231us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830950.636992:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1787830950.637007:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1787830950.637014:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220390f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1874676443855872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830950.637048:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220390f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1874676443855872:12345-0@lo:400:kworker.0 Request processed in 35us (1002us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830950.637055:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1787830950.637070:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1787830950.637076:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203995a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1874676443856384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830950.637103:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203995a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1874676443856384:12345-0@lo:400:kworker.0 Request processed in 28us (1019us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830950.637109:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1787830950.637136:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1787830950.637143:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2201dec3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874676443856256:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1787830950.637252:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2203afc000 x1874676443855872/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830966 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787830950.637264:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203afc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3621:1874676443855872:0@lo:400:kworker.0 00010000:00080000:0.0:1787830950.637275:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2203a9d680 x1874676443856384/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830966 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787830950.637284:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a9d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3621:1874676443856384:0@lo:400:kworker.0 00000100:00100000:0.0:1787830950.637329:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203aff0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3619:1874676443855744:0@lo:400:kworker.0 00000100:00100000:0.0:1787830950.637356:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443856000 00000100:00100000:0.0:1787830950.637359:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443856000 00000100:00100000:0.0:1787830950.637390:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443856128 00000100:00100000:0.0:1787830950.637394:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443856128 00000100:00100000:0.0:1787830950.637416:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787830950.637424:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22039970c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443856000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787830950.637466:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22039970c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443856000:12345-0@lo:400:kworker.0 Request processed in 43us (746us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830950.637480:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787830950.637498:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787830950.637506:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2201ded680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676443856128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787830950.637545:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2201ded680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676443856128:12345-0@lo:400:kworker.0 Request processed in 41us (788us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830950.637552:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:0.0:1787830950.637592:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2203afcf00 x1874676443856000/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787830966 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787830950.637602:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203afcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443856000:0@lo:400:kworker.0 00010000:00080000:0.0:1787830950.637661:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2203afe1c0 x1874676443856128/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787830966 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787830950.637670:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203afe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443856128:0@lo:400:kworker.0 00000100:00100000:1.0:1787830950.637870:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2201dec3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874676443856256:12345-0@lo:400:kworker.0 Request processed in 728us (1036us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830950.637877:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00080000:2.0:1787830950.637968:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787830950.637969:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203affc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3619:1874676443856256:0@lo:400:kworker.0 00000100:00080000:2.0:1787830950.637975:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787830950.637979:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787830950.886769:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830951.911779:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787830952.019420:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787830952.019511:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787830952.019541:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787830952.019806:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433304192 00000100:00100000:2.0:1787830952.019809:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787830952.019825:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433304192 00000100:00100000:2.0:1787830952.019845:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787830952.019869:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787830952.019915:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787830952.019945:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433304320 00000100:00100000:2.0:1787830952.019953:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433304320 00000100:00100000:2.0:1787830952.020008:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433304448 00000100:00100000:0.0:1787830952.020010:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433304576 00000100:00100000:2.0:1787830952.020012:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433304448 00000100:00100000:0.0:1787830952.020017:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433304576 00000100:00100000:2.0:1787830952.020039:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 123 00000100:00100000:2.0:1787830952.020055:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22037661c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+6:2397:x1874676433304192:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1787830952.020138:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22037661c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+6:2397:x1874676433304192:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 85us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830952.020248:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 123 00000100:00100000:0.0:1787830952.020257:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 124 00000100:00100000:0.0:1787830952.020271:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203767c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:2396:x1874676433304320:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1787830952.020276:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 125 00000100:00100000:1.0:1787830952.020304:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 126 00000100:00100000:0.0:1787830952.020311:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203767c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:2396:x1874676433304320:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 45us (769us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830952.020319:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203766580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c901c2b2-479b-44dc-8fa8-34fbacf02f07+5:2396:x1874676433304576:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1787830952.020325:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 124 00000100:00100000:0.0:1787830952.020355:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433304704 00000100:00100000:1.0:1787830952.020356:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203766580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c901c2b2-479b-44dc-8fa8-34fbacf02f07+5:2396:x1874676433304576:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 43us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830952.020364:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 126 00000100:00100000:0.0:1787830952.020369:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433304704 00000100:00100000:2.0:1787830952.020870:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203764000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c901c2b2-479b-44dc-8fa8-34fbacf02f07+5:2397:x1874676433304448:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1787830952.020872:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433304064 00000100:00100000:3.0:1787830952.020879:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433304064 00000100:00100000:2.0:1787830952.020910:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203764000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c901c2b2-479b-44dc-8fa8-34fbacf02f07+5:2397:x1874676433304448:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 624us (1104us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830952.020918:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 125 00000100:00100000:3.0:1787830952.020923:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 298 00000100:00100000:3.0:1787830952.020933:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a681850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+13:2396:x1874676433304064:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1787830952.020971:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a681850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+13:2396:x1874676433304064:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 40us (1561us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830952.020992:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 298 00000100:00100000:3.0:1787830952.021053:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433304832 00000100:00100000:3.0:1787830952.021057:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433304832 00000100:00080000:2.0:1787830952.021125:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787830952.021129:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787830952.021132:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787830952.021134:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787830952.021485:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 43 00000100:00100000:3.0:1787830952.021556:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 44 00000100:00100000:0.0:1787830952.021562:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203765e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c901c2b2-479b-44dc-8fa8-34fbacf02f07+5:2397:x1874676433304704:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1787830952.021573:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220380da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c901c2b2-479b-44dc-8fa8-34fbacf02f07+5:2396:x1874676433304832:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1787830952.021752:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203765e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c901c2b2-479b-44dc-8fa8-34fbacf02f07+5:2397:x1874676433304704:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 196us (1906us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830952.021757:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220380da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c901c2b2-479b-44dc-8fa8-34fbacf02f07+5:2396:x1874676433304832:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 187us (1838us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830952.021765:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 43 00000100:00100000:3.0:1787830952.021773:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 44 00000001:02000400:1.0:1787830952.151830:0:13004:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1787830952.934779:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787830953.702799:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787830953.702822:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220380f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443856512:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787830953.702902:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830953.703138:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203997c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443856640:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787830953.703168:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830953.705226:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443856512 00000100:00100000:2.0:1787830953.705347:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443856512 00000100:00100000:2.0:1787830953.705447:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443856640 00000100:00100000:2.0:1787830953.705451:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443856640 00000100:00080000:0.0:1787830953.705469:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787830953.707065:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787830953.707078:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a22940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443856512:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787830953.707106:0:8410:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787830953.707184:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a22940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443856512:12345-0@lo:13:osp-pre-0-1.0 Request processed in 110us (4282us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830953.707192:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787830953.707214:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787830953.707221:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203996940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676443856640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787830953.707231:0:8410:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787830953.707263:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203996940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676443856640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 43us (4094us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830953.707269:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:1.0:1787830953.707415:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2203997c00 x1874676443856640/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787830969 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787830953.707450:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203997c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443856640:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1787830953.707492:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d220380f480 x1874676443856512/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787830969 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787830953.707505:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220380f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443856512:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1787830953.958838:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787830954.217202:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220380c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1874676443856768:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787830954.217276:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830954.217488:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443856768 00000100:00100000:3.0:1787830954.217496:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443856768 00000100:00100000:2.0:1787830954.217800:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787830954.217811:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22036361c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1874676443856768:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787830954.217853:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787830954.217934:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22036361c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1874676443856768:12345-0@lo:41:osp-pre-1-0.0 Request processed in 125us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830954.217941:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787830954.217960:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220380c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1874676443856768:0@lo:41:osp-pre-1-0.0 00000020:00000080:0.0:1787830954.507569:0:13151:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd6e41ddc0 20000000:00000080:0.0:1787830954.507586:0:13151:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d233f429000 uarg=0000000000000000 20000000:01000000:0.0:1787830954.507745:0:13151:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787830954.507750:0:13151:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787830954.507754:0:13151:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1787830954.510457:0:13152:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:0.0:1787830954.510839:0:13151:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1787830954.516585:0:13151:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787830954.516614:0:13151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d233bf10400/0x95459fb9d1d289e3 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830954.516909:0:13151:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d233bf10600/0x95459fb9d1d2897a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d28973 expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830954.516917:0:13151:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2307c77a00/0x95459fb9d1d28988 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d28981 expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830954.516925:0:13151:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2307c76c00/0x95459fb9d1d28996 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d2898f expref: 23 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830954.516945:0:13151:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2307c77600/0x95459fb9d1d289a4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d2899d expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830954.516955:0:13151:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2307c76600/0x95459fb9d1d289ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423c6b expref: 12 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830954.516963:0:13151:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d233bf10e00/0x95459fb9d1d289c0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423caa expref: 12 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830954.516970:0:13151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d233bf10400/0x95459fb9d1d289e3 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830954.517016:0:13151:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d233bf10e00/0x95459fb9d1d289c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423caa expref: 12 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830954.517029:0:13151:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d233bf10e00/0x95459fb9d1d289c0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423caa expref: 12 pid: 6485 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830954.517045:0:13151:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203994b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13151:1874676443856896:192.168.203.31@tcp:104: 00010000:00010000:0.0:1787830954.517154:0:13151:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2307c76600/0x95459fb9d1d289ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423c6b expref: 12 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830954.517163:0:13151:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d2307c76600/0x95459fb9d1d289ab lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423c6b expref: 12 pid: 6484 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830954.517182:0:13151:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203997c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13151:1874676443857024:192.168.203.31@tcp:104: 00010000:00010000:0.0:1787830954.517214:0:13151:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2307c77600/0x95459fb9d1d289a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x95459fb9d1d2899d expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830954.517234:0:13151:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d2307c77600/0x95459fb9d1d289a4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x95459fb9d1d2899d expref: 23 pid: 6484 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830954.517244:0:13151:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a9d680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13151:1874676443857152:0@lo:104: 00000100:00100000:0.0:1787830954.517286:0:13151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787830954.517333:0:13151:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2307c76c00/0x95459fb9d1d28996 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x95459fb9d1d2898f expref: 23 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830954.517342:0:13151:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d2307c76c00/0x95459fb9d1d28996 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x95459fb9d1d2898f expref: 23 pid: 6485 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830954.517350:0:13151:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203afe1c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13151:1874676443857280:0@lo:104: 00000100:00100000:0.0:1787830954.517386:0:13151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830954.517417:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443857152 00000100:00100000:0.0:1787830954.517423:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443857152 00000100:00100000:0.0:1787830954.517464:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443857280 00000100:00100000:0.0:1787830954.517467:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443857280 00000100:00100000:0.0:1787830954.517482:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787830954.517489:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203affc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a45944b-32e3-4193-a2a5-46f84222bc14+4:13151:x1874676443857152:12345-0@lo:104: 00010000:00010000:0.0:1787830954.517500:0:6473:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff8d2307c77400/0x95459fb9d1d2899d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d289a4 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830954.517544:0:6473:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787830954.517550:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203affc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a45944b-32e3-4193-a2a5-46f84222bc14+4:13151:x1874676443857152:12345-0@lo:104: Request processed in 62us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830954.517556:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787830954.517571:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787830954.517577:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203afcf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a45944b-32e3-4193-a2a5-46f84222bc14+3:13151:x1874676443857280:12345-0@lo:104: 00010000:00010000:0.0:1787830954.517590:0:6473:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff8d233bf11c00/0x95459fb9d1d2898f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d28996 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830954.517663:0:6473:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787830954.517669:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203afcf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a45944b-32e3-4193-a2a5-46f84222bc14+3:13151:x1874676443857280:12345-0@lo:104: Request processed in 92us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830954.517675:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00010000:0.0:1787830954.517694:0:7431:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787830954.517700:0:7431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8d2307c77400/0x95459fb9d1d2899d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d289a4 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830954.517706:0:7431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2307c77400 already unused, calling callback (ffffffffc14f9c20) 10000000:00010000:0.0:1787830954.517710:0:7431:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8d2307c77400/0x95459fb9d1d2899d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x95459fb9d1d289a4 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830954.517719:0:7431:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8d2307c77400/0x95459fb9d1d2899d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x95459fb9d1d289a4 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787830954.517725:0:7431:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8d2307c77400/0x95459fb9d1d2899d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x95459fb9d1d289a4 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787830954.517730:0:7431:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787830954.517757:0:7431:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8d2307c77400/0x95459fb9d1d2899d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d289a4 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830954.517764:0:7431:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787830954.517782:0:7431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8d2307c77400/0x95459fb9d1d2899d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d289a4 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830954.517789:0:7431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8d2307c77400/0x95459fb9d1d2899d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d289a4 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830954.517807:0:7431:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787830954.517810:0:7431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8d233bf11c00/0x95459fb9d1d2898f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d28996 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830954.517815:0:7431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233bf11c00 already unused, calling callback (ffffffffc14f9c20) 10000000:00010000:0.0:1787830954.517818:0:7431:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8d233bf11c00/0x95459fb9d1d2898f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x95459fb9d1d28996 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830954.517824:0:7431:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8d233bf11c00/0x95459fb9d1d2898f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x95459fb9d1d28996 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787830954.517830:0:7431:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8d233bf11c00/0x95459fb9d1d2898f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x95459fb9d1d28996 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787830954.517835:0:7431:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787830954.517848:0:7431:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8d233bf11c00/0x95459fb9d1d2898f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d28996 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830954.517853:0:7431:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787830954.517859:0:7431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8d233bf11c00/0x95459fb9d1d2898f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d28996 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830954.517864:0:7431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8d233bf11c00/0x95459fb9d1d2898f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d28996 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830954.517875:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830954.517876:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830954.517878:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830954.517883:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787830954.517902:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203afc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a45944b-32e3-4193-a2a5-46f84222bc14:3622:1874676443857536:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787830954.517937:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830954.517968:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787830954.517974:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203aff0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a45944b-32e3-4193-a2a5-46f84222bc14:3622:1874676443857408:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787830954.517994:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787830954.518027:0:13151:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2307c77a00/0x95459fb9d1d28988 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x95459fb9d1d28981 expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830954.518035:0:13151:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d2307c77a00/0x95459fb9d1d28988 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x95459fb9d1d28981 expref: 23 pid: 6484 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830954.518044:0:13151:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a492c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13151:1874676443857664:0@lo:104: 00000100:00100000:0.0:1787830954.518065:0:13151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830954.518082:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443857664 00000100:00100000:0.0:1787830954.518085:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443857664 00000100:00100000:0.0:1787830954.518103:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787830954.518109:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a48f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a45944b-32e3-4193-a2a5-46f84222bc14+3:13151:x1874676443857664:12345-0@lo:104: 00010000:00010000:0.0:1787830954.518115:0:6473:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff8d233bf11400/0x95459fb9d1d28981 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d28988 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830954.518142:0:6473:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787830954.518147:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a48f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a45944b-32e3-4193-a2a5-46f84222bc14+3:13151:x1874676443857664:12345-0@lo:104: Request processed in 39us (82us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830954.518152:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787830954.518233:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443857536 00000100:00100000:1.0:1787830954.518237:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443857536 00010000:00010000:1.0:1787830954.518257:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2307c76c00/0x95459fb9d1d28996 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d2898f expref: 24 pid: 6485 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830954.518276:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443857408 00000100:00100000:1.0:1787830954.518279:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443857408 00010000:00010000:1.0:1787830954.518289:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2307c77600/0x95459fb9d1d289a4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d2899d expref: 25 pid: 6484 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830954.518303:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787830954.518309:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a4ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2a45944b-32e3-4193-a2a5-46f84222bc14+25:3622:x1874676443857536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787830954.518317:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787830954.518322:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2307c76c00/0x95459fb9d1d28996 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d2898f expref: 25 pid: 6485 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830954.518325:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787830954.518330:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8d233bf11400/0x95459fb9d1d28981 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d28988 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830954.518331:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2307c76c00/0x95459fb9d1d28996 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x95459fb9d1d2898f expref: 25 pid: 6485 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830954.518338:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233bf11400 already unused, calling callback (ffffffffc14f9c20) 10000000:00010000:2.0:1787830954.518345:0:6479:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8d233bf11400/0x95459fb9d1d28981 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x95459fb9d1d28988 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830954.518347:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787830954.518353:0:6479:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8d233bf11400/0x95459fb9d1d28981 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x95459fb9d1d28988 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787830954.518359:0:6479:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8d233bf11400/0x95459fb9d1d28981 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x95459fb9d1d28988 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787830954.518364:0:6479:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:1.0:1787830954.518374:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a4ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2a45944b-32e3-4193-a2a5-46f84222bc14+25:3622:x1874676443857536:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830954.518386:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787830954.518400:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787830954.518405:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a49680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2a45944b-32e3-4193-a2a5-46f84222bc14+24:3622:x1874676443857408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787830954.518414:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787830954.518418:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2307c77600/0x95459fb9d1d289a4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d2899d expref: 24 pid: 6484 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830954.518426:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2307c77600/0x95459fb9d1d289a4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x95459fb9d1d2899d expref: 24 pid: 6484 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830954.518435:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787830954.518451:0:6479:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8d233bf11400/0x95459fb9d1d28981 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d28988 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830954.518456:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a49680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2a45944b-32e3-4193-a2a5-46f84222bc14+24:3622:x1874676443857408:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (461us total) trans 0 rc 0/0 00010000:00010000:2.0:1787830954.518457:0:6479:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787830954.518462:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00010000:2.0:1787830954.518474:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8d233bf11400/0x95459fb9d1d28981 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d28988 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830954.518480:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8d233bf11400/0x95459fb9d1d28981 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d28988 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830954.518489:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787830954.518491:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787830954.518493:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787830954.518496:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203aff0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a45944b-32e3-4193-a2a5-46f84222bc14:3622:1874676443857408:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787830954.518501:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220380e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a45944b-32e3-4193-a2a5-46f84222bc14:3619:1874676443857792:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787830954.518504:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203afc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a45944b-32e3-4193-a2a5-46f84222bc14:3622:1874676443857536:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787830954.518528:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830954.518563:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443857792 00000100:00100000:2.0:1787830954.518566:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443857792 00010000:00010000:2.0:1787830954.518581:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2307c77a00/0x95459fb9d1d28988 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d28981 expref: 24 pid: 6484 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830954.518609:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787830954.518668:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220380ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2a45944b-32e3-4193-a2a5-46f84222bc14+24:3619:x1874676443857792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787830954.518676:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787830954.518680:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2307c77a00/0x95459fb9d1d28988 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d28981 expref: 24 pid: 6484 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830954.518688:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2307c77a00/0x95459fb9d1d28988 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x95459fb9d1d28981 expref: 24 pid: 6484 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830954.518697:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787830954.518726:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220380ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2a45944b-32e3-4193-a2a5-46f84222bc14+24:3619:x1874676443857792:12345-0@lo:103:ldlm_bl.0 Request processed in 105us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830954.518732:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787830954.518861:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220380e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a45944b-32e3-4193-a2a5-46f84222bc14:3619:1874676443857792:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787830954.518905:0:13151:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d233bf10600/0x95459fb9d1d2897a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x95459fb9d1d28973 expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830954.518915:0:13151:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d233bf10600/0x95459fb9d1d2897a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x95459fb9d1d28973 expref: 23 pid: 6484 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830954.518934:0:13151:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a4b0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13151:1874676443857920:0@lo:104: 00000100:00100000:0.0:1787830954.518957:0:13151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830954.519018:0:13151:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2202713300 going to sleep for 11 seconds 00010000:00010000:0.0:1787830954.519030:0:13151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2307c77600/0x95459fb9d1d289a4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x95459fb9d1d2899d expref: 23 pid: 6484 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830954.519039:0:13151:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a9d680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13151:1874676443857152:0@lo:104: 00010000:00010000:0.0:1787830954.519047:0:13151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2307c76c00/0x95459fb9d1d28996 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x95459fb9d1d2898f expref: 22 pid: 6485 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830954.519055:0:13151:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203afe1c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13151:1874676443857280:0@lo:104: 00010000:00010000:0.0:1787830954.519062:0:13151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2307c77a00/0x95459fb9d1d28988 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x95459fb9d1d28981 expref: 21 pid: 6484 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830954.519069:0:13151:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a492c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13151:1874676443857664:0@lo:104: 00000100:00100000:1.0:1787830954.519366:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443857920 00000100:00100000:1.0:1787830954.519371:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443857920 00000100:00100000:1.0:1787830954.519429:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787830954.519437:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a4a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a45944b-32e3-4193-a2a5-46f84222bc14+3:13151:x1874676443857920:12345-0@lo:104: 00010000:00010000:1.0:1787830954.519446:0:6473:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff8d2307c77800/0x95459fb9d1d28973 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d2897a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830954.519510:0:6473:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787830954.519516:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a4a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a45944b-32e3-4193-a2a5-46f84222bc14+3:13151:x1874676443857920:12345-0@lo:104: Request processed in 81us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830954.519530:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787830954.519590:0:13151:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a4b0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13151:1874676443857920:0@lo:104: 00010000:00010000:2.0:1787830954.520176:0:7431:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787830954.520182:0:7431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8d2307c77800/0x95459fb9d1d28973 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d2897a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830954.520189:0:7431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2307c77800 already unused, calling callback (ffffffffc14f9c20) 10000000:00010000:2.0:1787830954.520193:0:7431:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8d2307c77800/0x95459fb9d1d28973 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x95459fb9d1d2897a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830954.520200:0:7431:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8d2307c77800/0x95459fb9d1d28973 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x95459fb9d1d2897a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787830954.520206:0:7431:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8d2307c77800/0x95459fb9d1d28973 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x95459fb9d1d2897a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787830954.520211:0:7431:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787830954.520243:0:7431:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8d2307c77800/0x95459fb9d1d28973 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d2897a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830954.520254:0:7431:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1787830954.520300:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220380e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a45944b-32e3-4193-a2a5-46f84222bc14:3620:1874676443858048:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787830954.520332:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787830954.520392:0:7431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8d2307c77800/0x95459fb9d1d28973 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d2897a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830954.520400:0:7431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8d2307c77800/0x95459fb9d1d28973 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d2897a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830954.520406:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443858048 00000100:00100000:3.0:1787830954.520410:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443858048 00010000:00010000:2.0:1787830954.520415:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787830954.520417:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787830954.520418:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787830954.520431:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d233bf10600/0x95459fb9d1d2897a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d28973 expref: 21 pid: 6484 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830954.520465:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787830954.520472:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a4bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2a45944b-32e3-4193-a2a5-46f84222bc14+21:3620:x1874676443858048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787830954.520483:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787830954.520487:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d233bf10600/0x95459fb9d1d2897a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d28973 expref: 21 pid: 6484 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830954.520496:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d233bf10600/0x95459fb9d1d2897a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x95459fb9d1d28973 expref: 21 pid: 6484 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830954.520507:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d233bf10600/0x95459fb9d1d2897a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x95459fb9d1d28973 expref: 21 pid: 6484 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830954.520531:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787830954.522091:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220380e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a45944b-32e3-4193-a2a5-46f84222bc14:3620:1874676443858048:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787830954.522147:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a4bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2a45944b-32e3-4193-a2a5-46f84222bc14+20:3620:x1874676443858048:12345-0@lo:103:ldlm_bl.0 Request processed in 1671us (1809us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830954.522158:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787830954.522262:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787830954.522336:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787830954.522511:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433305088 00000100:00100000:0.0:1787830954.522518:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433305088 00000100:00100000:3.0:1787830954.522520:0:7432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433304960 00000100:00100000:3.0:1787830954.522522:0:7432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433304960 00010000:00010000:3.0:1787830954.522545:0:7432:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d233bf10e00/0x95459fb9d1d289c0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423caa expref: 14 pid: 6485 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830954.522545:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2307c76600/0x95459fb9d1d289ab lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423c6b expref: 14 pid: 6484 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830954.522575:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 44 00000100:00100000:0.0:1787830954.522582:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220380d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+14:2396:x1874676433305088:12345-192.168.203.31@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787830954.522584:0:13151:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203994b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13151:1874676443856896:192.168.203.31@tcp:104: 00000100:00100000:1.0:1787830954.522592:0:13151:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203997c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13151:1874676443857024:192.168.203.31@tcp:104: 00010000:00010000:0.0:1787830954.522607:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787830954.522612:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2307c76600/0x95459fb9d1d289ab lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423c6b expref: 14 pid: 6484 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830954.522660:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2307c76600/0x95459fb9d1d289ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423c6b expref: 14 pid: 6484 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830954.522762:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 45 00000100:00100000:3.0:1787830954.522770:0:7432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2321e77050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+14:2397:x1874676433304960:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787830954.522778:0:7432:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787830954.522782:0:7432:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d233bf10e00/0x95459fb9d1d289c0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423caa expref: 14 pid: 6485 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830954.522806:0:13151:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d233bf10400/0x95459fb9d1d289e3 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830954.525403:0:7432:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d233bf10e00/0x95459fb9d1d289c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423caa expref: 14 pid: 6485 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830954.525422:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d233bf10e00/0x95459fb9d1d289c0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423caa expref: 14 pid: 6485 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830954.525441:0:7432:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d233bf10400/0x95459fb9d1d289e3 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830954.525450:0:7432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d233bf10400/0x95459fb9d1d289e3 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830954.525473:0:7432:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d233bf10400/0x95459fb9d1d289e3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830954.525490:0:7432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d233bf10400/0x95459fb9d1d289e3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830954.525497:0:7432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d233bf10400/0x95459fb9d1d289e3 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830954.525504:0:7432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d233bf10400/0x95459fb9d1d289e3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830954.525510:0:7432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233bf10400 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:3.0:1787830954.525514:0:7432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d233bf10400/0x95459fb9d1d289e3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830954.525522:0:7432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d233bf10400/0x95459fb9d1d289e3 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830954.525596:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2307c76600/0x95459fb9d1d289ab lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423c6b expref: 13 pid: 6484 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830954.525795:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787830954.525888:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220380d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+12:2396:x1874676433305088:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 3305us (3626us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830954.525898:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 44 00010000:00010000:1.0:1787830954.526537:0:13151:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d233bf10400/0x95459fb9d1d289e3 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830954.526550:0:13151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d233bf10400/0x95459fb9d1d289e3 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830954.527483:0:7432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d233bf10400/0x95459fb9d1d289e3 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830954.527499:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d233bf10400/0x95459fb9d1d289e3 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830954.527519:0:7432:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787830954.527576:0:7432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2321e77050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+11:2397:x1874676433304960:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 4804us (5237us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830954.527586:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 45 00000100:00100000:1.0:1787830954.727464:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a7b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443858176:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787830954.727537:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830954.727719:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443858176 00000100:00100000:0.0:1787830954.727726:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443858176 00000100:00100000:0.0:1787830954.727781:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787830954.727790:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203637c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443858176:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787830954.727823:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787830954.728531:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203637c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443858176:12345-0@lo:41:osp-pre-0-1.0 Request processed in 740us (991us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830954.728540:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787830954.728791:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a7b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443858176:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787830954.982955:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787830955.751239:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a49a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1874676443858560:0@lo:400:kworker.0 00000100:00100000:0.0:1787830955.751336:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830955.751382:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3620:1874676443859072:0@lo:400:kworker.0 00000100:00100000:0.0:1787830955.751420:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830955.751450:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a4ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3620:1874676443859584:0@lo:400:kworker.0 00000100:00100000:0.0:1787830955.751482:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830955.751507:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1787830955.751512:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a49e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3620:1874676443858432:0@lo:400:kworker.0 00000100:00100000:0.0:1787830955.751534:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830955.751551:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a48b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3620:1874676443858944:0@lo:400:kworker.0 00000100:00100000:0.0:1787830955.751570:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830955.751585:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a4a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3620:1874676443859456:0@lo:400:kworker.0 00000100:00100000:0.0:1787830955.751604:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830955.751644:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443859072 00000100:00100000:0.0:1787830955.751651:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443859072 00000100:00100000:0.0:1787830955.751712:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443859584 00000100:00100000:0.0:1787830955.751715:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443859584 00000100:00100000:0.0:1787830955.751732:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443858432 00000100:00100000:0.0:1787830955.751735:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443858432 00000100:00100000:0.0:1787830955.751744:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443858944 00000100:00100000:0.0:1787830955.751746:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443858944 00000100:00100000:0.0:1787830955.751756:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443859456 00000100:00100000:0.0:1787830955.751758:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443859456 00000100:00100000:0.0:1787830955.751773:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1787830955.751780:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1874676443859072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787830955.751830:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1874676443859072:12345-0@lo:400:kworker.0 Request processed in 51us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830955.751838:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1787830955.751854:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1787830955.751860:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203b6cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1874676443859584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787830955.751882:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203b6cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1874676443859584:12345-0@lo:400:kworker.0 Request processed in 23us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830955.751897:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1787830955.751907:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1787830955.751912:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203b6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1874676443858432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787830955.751935:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203b6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1874676443858432:12345-0@lo:400:kworker.0 Request processed in 23us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830955.751939:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1787830955.751948:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1787830955.751952:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203b6c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1874676443858944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787830955.751970:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203b6c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1874676443858944:12345-0@lo:400:kworker.0 Request processed in 18us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830955.751975:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1787830955.751983:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1787830955.751987:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203b6f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1874676443859456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787830955.752004:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203b6f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1874676443859456:12345-0@lo:400:kworker.0 Request processed in 18us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830955.752009:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00080000:0.0:1787830955.752023:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787830955.752027:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787830955.752052:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a49e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3620:1874676443858432:0@lo:400:kworker.0 00000100:00100000:0.0:1787830955.752061:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a48b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3620:1874676443858944:0@lo:400:kworker.0 00000100:00100000:0.0:1787830955.752070:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a4a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3620:1874676443859456:0@lo:400:kworker.0 00010000:00080000:0.0:1787830955.752080:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2203a4b480 x1874676443859072/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830971 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787830955.752101:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3620:1874676443859072:0@lo:400:kworker.0 00010000:00080000:0.0:1787830955.752114:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2203a4ad00 x1874676443859584/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830971 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787830955.752122:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a4ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3620:1874676443859584:0@lo:400:kworker.0 00000100:00100000:1.0:1787830955.752277:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787830955.752287:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203994000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1874676443859968:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787830955.752336:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830955.755811:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443858560 00000100:00100000:1.0:1787830955.755828:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443858560 00000100:00100000:1.0:1787830955.755886:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787830955.755896:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a4b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1874676443858560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787830955.755905:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a45944b-32e3-4193-a2a5-46f84222bc14:3622:1874676443858304:0@lo:400:kworker.0 00000100:00100000:3.0:1787830955.755992:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830955.756009:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a4b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1874676443858560:12345-0@lo:400:kworker.0 Request processed in 113us (4671us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830955.756022:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787830955.756023:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220380d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1874676443860096:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787830955.756044:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a4a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676443858816:0@lo:400:kworker.0 00000100:00100000:2.0:1787830955.756067:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830955.756080:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830955.756125:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a4b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676443859328:0@lo:400:kworker.0 00000100:00100000:2.0:1787830955.756132:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a49a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1874676443858560:0@lo:400:kworker.0 00000100:00100000:3.0:1787830955.756152:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830955.756177:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443859968 00000100:00100000:2.0:1787830955.756182:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443859968 00000100:00100000:3.0:1787830955.756190:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a4bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676443859840:0@lo:400:kworker.0 00000100:00100000:3.0:1787830955.756215:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830955.756231:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443860096 00000100:00100000:2.0:1787830955.756236:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443860096 00000100:00100000:3.0:1787830955.756242:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1787830955.756252:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a48780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3622:1874676443858688:0@lo:400:kworker.0 00000100:00100000:2.0:1787830955.756256:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787830955.756263:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203997c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1874676443859968:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787830955.756280:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:2.0:1787830955.756285:0:8409:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787830955.756302:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a483c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676443859200:0@lo:400:kworker.0 00000100:00100000:1.0:1787830955.756303:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443858816 00000100:00100000:1.0:1787830955.756310:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443858816 00000100:00100000:2.0:1787830955.756331:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203997c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1874676443859968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (3993us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830955.756340:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787830955.756344:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830955.756347:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787830955.756358:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787830955.756366:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a7b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1874676443858816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787830955.756370:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a49680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676443859712:0@lo:400:kworker.0 00000100:00100000:2.0:1787830955.756371:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220380cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1874676443860096:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787830955.756388:0:8409:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787830955.756408:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830955.756422:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a7b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1874676443858816:12345-0@lo:400:kworker.0 Request processed in 59us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830955.756434:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220380cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1874676443860096:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830955.756434:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787830955.756443:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787830955.756457:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a4a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676443858816:0@lo:400:kworker.0 00000100:00080000:2.0:1787830955.756474:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787830955.756490:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443858688 00000100:00100000:3.0:1787830955.756494:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443858688 00010000:00080000:2.0:1787830955.756502:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d220380d2c0 x1874676443860096/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787830971 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787830955.756515:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220380d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1874676443860096:0@lo:13:osp-pre-1-1.0 00010000:00080000:2.0:1787830955.756523:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2203994000 x1874676443859968/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787830971 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787830955.756534:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203994000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1874676443859968:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787830955.756536:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787830955.756546:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a78f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1874676443858688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787830955.756577:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443858304 00000100:00100000:2.0:1787830955.756582:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443858304 00000100:00100000:3.0:1787830955.756587:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a78f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1874676443858688:12345-0@lo:400:kworker.0 Request processed in 43us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830955.756595:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787830955.756617:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443859328 00000100:00100000:3.0:1787830955.756620:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443859328 00000100:00100000:3.0:1787830955.756664:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443859840 00000100:00100000:3.0:1787830955.756673:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443859840 00000100:00100000:2.0:1787830955.756690:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1787830955.756692:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443859200 00000100:00100000:3.0:1787830955.756696:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443859200 00000100:00100000:2.0:1787830955.756701:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d231859cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+20:3622:x1874676443858304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787830955.756713:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443859712 00000100:00100000:3.0:1787830955.756718:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443859712 00000100:00100000:3.0:1787830955.756736:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787830955.756743:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d231859cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+20:3622:x1874676443858304:12345-0@lo:400:kworker.0 Request processed in 45us (753us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830955.756748:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1787830955.757068:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a7bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1874676443859328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787830955.757168:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a7bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1874676443859328:12345-0@lo:400:kworker.0 Request processed in 417us (1008us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830955.757175:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787830955.757188:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787830955.757195:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1874676443859840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787830955.757222:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1874676443859840:12345-0@lo:400:kworker.0 Request processed in 28us (1007us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830955.757227:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787830955.757237:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787830955.757243:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a792c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676443859200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787830955.757267:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a792c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676443859200:12345-0@lo:400:kworker.0 Request processed in 25us (930us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830955.757273:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787830955.757282:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787830955.757289:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a79680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676443859712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787830955.757318:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a79680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676443859712:12345-0@lo:400:kworker.0 Request processed in 31us (912us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830955.757324:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787830955.757365:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a48780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3622:1874676443858688:0@lo:400:kworker.0 00010000:00080000:3.0:1787830955.757545:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2203a483c0 x1874676443859200/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787830971 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787830955.757558:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a483c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676443859200:0@lo:400:kworker.0 00010000:00080000:3.0:1787830955.757572:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2203a49680 x1874676443859712/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787830971 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787830955.757580:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a49680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676443859712:0@lo:400:kworker.0 00000100:00100000:3.0:1787830955.757590:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a45944b-32e3-4193-a2a5-46f84222bc14:3622:1874676443858304:0@lo:400:kworker.0 00010000:00080000:3.0:1787830955.757599:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2203a4b840 x1874676443859328/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787830971 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787830955.757608:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a4b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676443859328:0@lo:400:kworker.0 00010000:00080000:3.0:1787830955.757617:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2203a4bc00 x1874676443859840/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787830971 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787830955.757650:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a4bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676443859840:0@lo:400:kworker.0 00000100:00080000:3.0:1787830955.757681:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 10000000:01000000:3.0:1787830955.942878:0:6487:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787830955.942884:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d2334556800 from 7 10000000:01000000:3.0:1787830955.942889:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787830955.942930:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d2307c76a00/0x95459fb9d1d289ea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830955.942942:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8d2307c76a00/0x95459fb9d1d289ea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830955.942952:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8d2307c76a00/0x95459fb9d1d289ea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830955.942988:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a7a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443860224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787830955.943059:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830955.943115:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d220375e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787830955.943198:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443860224 00000100:00100000:0.0:1787830955.943206:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443860224 00000100:00100000:0.0:1787830955.943296:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:0.0:1787830955.943307:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d231859ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+20:6487:x1874676443860224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787830955.943319:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787830955.943333:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d233bf11200/0x95459fb9d1d289f1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d289ea expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830955.943356:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d233bf11200/0x95459fb9d1d289f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d289ea expref: 21 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830955.943367:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d233bf11200/0x95459fb9d1d289f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d289ea expref: 21 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830955.943375:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233bf11200, rc 0) 00000100:00100000:0.0:1787830955.943431:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d231859ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+21:6487:x1874676443860224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830955.943438:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:3.0:1787830955.943470:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a7a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443860224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787830955.943485:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8d2307c76a00/0x95459fb9d1d289ea lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d289f1 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830955.943504:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8d2307c76a00/0x95459fb9d1d289ea lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d289f1 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830955.943557:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a7a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443860352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787830955.943581:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830955.945244:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443860352 00000100:00100000:2.0:1787830955.945254:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443860352 00000100:00100000:2.0:1787830955.945295:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:2.0:1787830955.945303:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d231859f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+21:6487:x1874676443860352:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787830955.945446:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d231859f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+21:6487:x1874676443860352:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 144us (1864us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830955.945454:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:3.0:1787830955.945607:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d220375e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787830955.945646:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a7a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443860352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787830955.945686:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a7a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443860480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787830955.945727:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830955.945756:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d220375e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787830955.945822:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443860480 00000100:00100000:0.0:1787830955.945826:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443860480 00000100:00100000:0.0:1787830955.945844:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1787830955.945850:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d231859d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+22:6487:x1874676443860480:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787830955.946069:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d231859d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+22:6487:x1874676443860480:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 218us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830955.946075:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:3.0:1787830955.946535:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a7a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443860480:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787830955.948341:0:13257:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1787830955.949116:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1787830955.949142:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787830955.949154:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d2307c76a00/0x95459fb9d1d289ea lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d289f1 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830955.949176:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8d2307c76a00/0x95459fb9d1d289ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d289f1 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787830955.949186:0:6487:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787830955.949189:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d232f6b0800 from 7 10000000:01000000:2.0:1787830955.949192:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787830955.949227:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d2301669200/0x95459fb9d1d289f8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830955.949235:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8d2301669200/0x95459fb9d1d289f8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830955.949246:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8d2301669200/0x95459fb9d1d289f8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830955.949270:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220380d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443860608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787830955.949334:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830955.949389:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2306613540 going to sleep for 11 seconds 00000100:00100000:1.0:1787830955.950710:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443860608 00000100:00100000:1.0:1787830955.950721:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443860608 00000100:00100000:2.0:1787830955.950980:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1787830955.950993:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d231859d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+21:6487:x1874676443860608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787830955.951009:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787830955.951025:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2301668600/0x95459fb9d1d289ff lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d289f8 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830955.951050:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2301668600/0x95459fb9d1d289ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d289f8 expref: 22 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830955.951070:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2301668600/0x95459fb9d1d289ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d289f8 expref: 22 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830955.951078:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2301668600, rc 0) 00000100:00100000:2.0:1787830955.951168:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d231859d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+22:6487:x1874676443860608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 179us (1835us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830955.951175:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1787830955.951185:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220380d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443860608:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787830955.951202:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8d2301669200/0x95459fb9d1d289f8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d289ff expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830955.951211:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8d2301669200/0x95459fb9d1d289f8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d289ff expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830955.951277:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203b6e580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443860736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787830955.951314:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830955.951346:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2202852300 going to sleep for 11 seconds 00000100:00100000:2.0:1787830955.951491:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443860736 00000100:00100000:2.0:1787830955.951497:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443860736 00000100:00100000:2.0:1787830955.951534:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1787830955.951542:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d231859c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+22:6487:x1874676443860736:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787830955.951783:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d231859c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+22:6487:x1874676443860736:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 242us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830955.951790:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1787830955.952561:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203b6e580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443860736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787830955.952607:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a7a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443860864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787830955.952685:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830955.952719:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d220375e240 going to sleep for 11 seconds 00000100:00100000:1.0:1787830955.953132:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443860864 00000100:00100000:1.0:1787830955.953139:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443860864 00000100:00100000:1.0:1787830955.953194:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:1.0:1787830955.953202:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d231859e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+22:6487:x1874676443860864:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787830955.953324:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d231859e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+22:6487:x1874676443860864:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 122us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830955.953332:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:3.0:1787830955.953538:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a7a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443860864:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787830955.955548:0:13264:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1787830955.955729:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1787830955.955757:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787830955.955770:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d2301669200/0x95459fb9d1d289f8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d289ff expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830955.955947:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8d2301669200/0x95459fb9d1d289f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d289ff expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787830955.955963:0:6487:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787830955.955966:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d232f730000 from 7 10000000:01000000:3.0:1787830955.955968:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787830955.956006:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d2307c76000/0x95459fb9d1d28a06 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830955.956015:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8d2307c76000/0x95459fb9d1d28a06 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830955.956025:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8d2307c76000/0x95459fb9d1d28a06 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830955.956049:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a7a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443860992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787830955.956114:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830955.956171:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d220375e240 going to sleep for 11 seconds 00000100:00100000:2.0:1787830955.956701:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443860992 00000100:00100000:2.0:1787830955.956709:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443860992 00000100:00100000:2.0:1787830955.956760:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:2.0:1787830955.956770:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d231859f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+22:6487:x1874676443860992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787830955.956783:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787830955.956797:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2301668e00/0x95459fb9d1d28a0d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d28a06 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830955.956820:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2301668e00/0x95459fb9d1d28a0d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d28a06 expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830955.956830:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2301668e00/0x95459fb9d1d28a0d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d28a06 expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830955.956846:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2301668e00, rc 0) 00000100:00100000:2.0:1787830955.956913:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d231859f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+23:6487:x1874676443860992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 145us (798us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830955.956920:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1787830955.958508:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a7a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443860992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787830955.958531:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8d2307c76000/0x95459fb9d1d28a06 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d28a0d expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830955.958543:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8d2307c76000/0x95459fb9d1d28a06 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d28a0d expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830955.958693:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a7a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443861120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787830955.958752:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830955.958906:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443861120 00000100:00100000:2.0:1787830955.958912:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443861120 00000100:00100000:2.0:1787830955.958948:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1787830955.958955:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d231859e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+23:6487:x1874676443861120:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787830955.959124:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d220375e240 going to sleep for 11 seconds 00000100:00100000:2.0:1787830955.959244:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d231859e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+23:6487:x1874676443861120:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 288us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830955.959252:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1787830955.959313:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a7a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443861120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787830955.959345:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203b6ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443861248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787830955.959387:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830955.959435:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2202852780 going to sleep for 11 seconds 00000100:00100000:2.0:1787830955.959469:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443861248 00000100:00100000:2.0:1787830955.959474:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443861248 00000100:00100000:2.0:1787830955.959532:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:2.0:1787830955.959540:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d231859f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+23:6487:x1874676443861248:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787830955.959663:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d231859f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+23:6487:x1874676443861248:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 123us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830955.959671:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:0.0:1787830955.959798:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203b6ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443861248:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787830955.960805:0:13265:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1787830955.961082:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1787830955.961105:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787830955.961114:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d2307c76000/0x95459fb9d1d28a06 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d28a0d expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830955.961125:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8d2307c76000/0x95459fb9d1d28a06 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d28a0d expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787830955.961146:0:6487:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787830955.961149:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d2303f2e000 from 7 10000000:01000000:0.0:1787830955.961152:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787830955.961191:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233bf11c00/0x95459fb9d1d28a14 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830955.961198:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8d233bf11c00/0x95459fb9d1d28a14 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830955.961207:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8d233bf11c00/0x95459fb9d1d28a14 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830955.961227:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203b6ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443861376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787830955.961273:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830955.961349:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2202852780 going to sleep for 11 seconds 00000100:00100000:2.0:1787830955.961388:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443861376 00000100:00100000:2.0:1787830955.961394:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443861376 00000100:00100000:2.0:1787830955.961465:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:2.0:1787830955.961475:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d231859fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+23:6487:x1874676443861376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787830955.961488:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787830955.961501:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2301669a00/0x95459fb9d1d28a1b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d28a14 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830955.961530:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2301669a00/0x95459fb9d1d28a1b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d28a14 expref: 24 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830955.961540:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2301669a00/0x95459fb9d1d28a1b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d28a14 expref: 24 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830955.961549:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2301669a00, rc 0) 00000100:00100000:2.0:1787830955.961684:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d231859fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+24:6487:x1874676443861376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 210us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830955.961691:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:0.0:1787830955.961769:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203b6ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443861376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787830955.961783:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8d233bf11c00/0x95459fb9d1d28a14 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d28a1b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830955.961792:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8d233bf11c00/0x95459fb9d1d28a14 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d28a1b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830955.961840:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203b6ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443861504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787830955.961879:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830955.961902:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2202852780 going to sleep for 11 seconds 00000100:00100000:2.0:1787830955.961984:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443861504 00000100:00100000:2.0:1787830955.961989:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443861504 00000100:00100000:2.0:1787830955.962048:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:2.0:1787830955.962057:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d231859c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+24:6487:x1874676443861504:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787830955.962170:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d231859c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+24:6487:x1874676443861504:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 115us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830955.962177:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1787830955.962223:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203b6ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443861504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787830955.962250:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203b6ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443861632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787830955.962293:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830955.962307:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2202852780 going to sleep for 11 seconds 00000100:00100000:0.0:1787830955.962319:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443861632 00000100:00100000:0.0:1787830955.962322:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443861632 00000100:00100000:0.0:1787830955.962340:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:0.0:1787830955.962346:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d231859c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+24:6487:x1874676443861632:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787830955.962416:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d231859c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+24:6487:x1874676443861632:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 70us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830955.962423:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:0.0:1787830955.962462:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203b6ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443861632:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787830955.965038:0:13266:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1787830955.965141:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1787830955.965170:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787830955.965185:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233bf11c00/0x95459fb9d1d28a14 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d28a1b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830955.965197:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8d233bf11c00/0x95459fb9d1d28a14 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d28a1b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830956.006864:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787830956.432864:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787830956.433202:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433305216 00000100:00100000:3.0:1787830956.433214:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433305216 00000100:00100000:3.0:1787830956.433277:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 312 00000100:00100000:3.0:1787830956.433291:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d231859dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+11:6161:x1874676433305216:12345-192.168.203.31@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787830956.433309:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787830956.433327:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2307c76200/0x95459fb9d1d28a22 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe558a92a99423cdb expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830956.433357:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2307c76200/0x95459fb9d1d28a22 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423cdb expref: 12 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830956.433370:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2307c76200/0x95459fb9d1d28a22 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423cdb expref: 12 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830956.433379:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2307c76200, rc 0) 00000100:00100000:3.0:1787830956.433445:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d231859dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+12:6161:x1874676433305216:12345-192.168.203.31@tcp:101:ll_cfg_requeue.0 Request processed in 159us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830956.433454:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 312 00000100:00100000:3.0:1787830956.441997:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787830956.443379:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433305344 00000100:00100000:0.0:1787830956.443390:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433305344 00000100:00100000:0.0:1787830956.443438:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 313 00000100:00100000:0.0:1787830956.443511:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d231859e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+12:6161:x1874676433305344:12345-192.168.203.31@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787830956.443672:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d231859e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+12:6161:x1874676433305344:12345-192.168.203.31@tcp:501:ll_cfg_requeue.0 Request processed in 226us (1685us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830956.443681:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 313 00000100:00100000:3.0:1787830956.447912:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787830956.448119:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433305472 00000100:00100000:2.0:1787830956.448128:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433305472 00000100:00100000:2.0:1787830956.448201:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 314 00000100:00100000:2.0:1787830956.448212:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d231859d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+12:6161:x1874676433305472:12345-192.168.203.31@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787830956.448349:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d231859d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+12:6161:x1874676433305472:12345-192.168.203.31@tcp:503:ll_cfg_requeue.0 Request processed in 138us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830956.448358:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 314 00000100:00100000:1.0:1787830956.455334:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787830956.455545:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433305600 00000100:00100000:2.0:1787830956.455564:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433305600 00000100:00100000:2.0:1787830956.455660:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 315 00000100:00100000:2.0:1787830956.455673:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2310886050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+12:6161:x1874676433305600:12345-192.168.203.31@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787830956.455689:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787830956.455709:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2301669600/0x95459fb9d1d28a29 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xe558a92a99423ce2 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830956.455738:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2301669600/0x95459fb9d1d28a29 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423ce2 expref: 13 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830956.455750:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2301669600/0x95459fb9d1d28a29 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423ce2 expref: 13 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830956.455759:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2301669600, rc 0) 00000100:00100000:2.0:1787830956.455842:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2310886050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+13:6161:x1874676433305600:12345-192.168.203.31@tcp:101:ll_cfg_requeue.0 Request processed in 172us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830956.455849:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 315 00000100:00100000:3.0:1787830956.458306:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787830956.458685:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433305728 00000100:00100000:1.0:1787830956.458695:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433305728 00000100:00100000:1.0:1787830956.459115:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 316 00000100:00100000:1.0:1787830956.459128:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2310884850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+13:6161:x1874676433305728:12345-192.168.203.31@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787830956.459509:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2310884850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+13:6161:x1874676433305728:12345-192.168.203.31@tcp:501:ll_cfg_requeue.0 Request processed in 383us (1210us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830956.459517:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 316 00000100:00100000:1.0:1787830956.462785:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787830956.464740:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433305856 00000100:00100000:2.0:1787830956.464753:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433305856 00000100:00100000:2.0:1787830956.464854:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 317 00000100:00100000:2.0:1787830956.464865:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2310887c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+13:6161:x1874676433305856:12345-192.168.203.31@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787830956.465005:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2310887c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+13:6161:x1874676433305856:12345-192.168.203.31@tcp:503:ll_cfg_requeue.0 Request processed in 142us (2227us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830956.465013:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 317 00000001:02000400:2.0:1787830956.734424:0:13349:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg331-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787830957.031016:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787830957.146339:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787830957.146459:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787830957.146498:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787830957.146528:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787830957.146558:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787830957.146804:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433305984 00000100:00100000:1.0:1787830957.146814:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433305984 00000100:00100000:1.0:1787830957.146863:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 318 00000100:00100000:1.0:1787830957.146873:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2310887450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+13:2394:x1874676433305984:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1787830957.146951:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2310887450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+13:2394:x1874676433305984:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 79us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830957.146960:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 318 00000100:00100000:3.0:1787830957.147010:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433306240 00000100:00100000:3.0:1787830957.147023:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433306240 00000100:00100000:3.0:1787830957.147061:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433306496 00000100:00100000:3.0:1787830957.147064:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433306496 00000100:00100000:3.0:1787830957.147084:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433306112 00000100:00100000:3.0:1787830957.147086:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433306112 00000100:00100000:3.0:1787830957.147101:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433306368 00000100:00100000:3.0:1787830957.147103:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433306368 00000100:00100000:1.0:1787830957.147119:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787830957.147124:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 133 00000100:00100000:3.0:1787830957.147133:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203b6ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:2394:x1874676433306240:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1787830957.147165:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787830957.147188:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433306624 00000100:00100000:1.0:1787830957.147192:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433306624 00000100:00100000:1.0:1787830957.147220:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433306752 00000100:00100000:1.0:1787830957.147222:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433306752 00000100:00100000:1.0:1787830957.147245:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 22 00000100:00100000:1.0:1787830957.147252:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203994b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c901c2b2-479b-44dc-8fa8-34fbacf02f07+5:2393:x1874676433306624:12345-192.168.203.31@tcp:9:kworker.0 00000020:00000080:1.0:1787830957.147274:0:8408:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x95459fb9d1d289d5 00000100:00080000:1.0:1787830957.147283:0:8408:0:(import.c:65:import_set_state_nolock()) ffff8d233f522000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787830957.147333:0:8408:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1787830957.147411:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203b6ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:2394:x1874676433306240:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 278us (950us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830957.147419:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 133 00000100:00100000:3.0:1787830957.147440:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 134 00000100:00100000:3.0:1787830957.147450:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203b6d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c901c2b2-479b-44dc-8fa8-34fbacf02f07+5:2394:x1874676433306496:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1787830957.147464:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203994b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c901c2b2-479b-44dc-8fa8-34fbacf02f07+2:2393:x1874676433306624:12345-192.168.203.31@tcp:9:kworker.0 Request processed in 211us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830957.147473:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 22 00000100:00100000:3.0:1787830957.147478:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203b6d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c901c2b2-479b-44dc-8fa8-34fbacf02f07+5:2394:x1874676433306496:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 29us (977us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830957.147483:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 134 00000100:00100000:1.0:1787830957.147495:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 23 00000100:00100000:3.0:1787830957.147499:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 135 00000100:00100000:3.0:1787830957.147508:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203b6d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+6:2394:x1874676433306112:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1787830957.147508:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203994000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c901c2b2-479b-44dc-8fa8-34fbacf02f07+5:2393:x1874676433306752:12345-192.168.203.31@tcp:9:kworker.0 00000020:00000080:1.0:1787830957.147528:0:8408:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x95459fb9d1d289dc 00000100:00100000:3.0:1787830957.147531:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203b6d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+6:2394:x1874676433306112:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 25us (1002us total) trans 0 rc 0/0 00000100:00080000:1.0:1787830957.147536:0:8408:0:(import.c:65:import_set_state_nolock()) ffff8d2203603800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1787830957.147541:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 135 00000100:00100000:3.0:1787830957.147557:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 136 00000100:00100000:3.0:1787830957.147564:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203b6cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c901c2b2-479b-44dc-8fa8-34fbacf02f07+5:2394:x1874676433306368:12345-192.168.203.31@tcp:400:kworker.0 00000001:00000004:1.0:1787830957.147567:0:8408:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1787830957.147591:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203b6cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c901c2b2-479b-44dc-8fa8-34fbacf02f07+5:2394:x1874676433306368:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 27us (1032us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830957.147667:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203994000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c901c2b2-479b-44dc-8fa8-34fbacf02f07+2:2393:x1874676433306752:12345-192.168.203.31@tcp:9:kworker.0 Request processed in 163us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830957.147680:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 23 00000100:00100000:3.0:1787830957.147685:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 136 00000100:00080000:3.0:1787830957.147711:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787830957.147715:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787830957.147718:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787830957.147719:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787830957.147721:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1787830957.147735:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787830958.055741:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787830958.825337:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787830958.825359:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203636940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676443861760:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787830958.825444:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830958.825525:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443861760 00000100:00100000:1.0:1787830958.825532:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443861760 00000100:00100000:1.0:1787830958.825583:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787830958.825594:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203635680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1874676443861760:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787830958.825616:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1787830958.825657:0:8409:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787830958.825708:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203635680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1874676443861760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830958.825715:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787830958.825973:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787830958.825985:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220380f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443861888:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787830958.826018:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830958.826056:0:11489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443861888 00000100:00100000:2.0:1787830958.826060:0:11489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443861888 00000100:00100000:2.0:1787830958.826091:0:11489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787830958.826097:0:11489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220380e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443861888:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787830958.826108:0:11489:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787830958.826161:0:11489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220380e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443861888:12345-0@lo:13:osp-pre-0-1.0 Request processed in 64us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830958.826167:0:11489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:2.0:1787830958.826186:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787830958.826210:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d220380f0c0 x1874676443861888/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787830974 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787830958.826228:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220380f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443861888:0@lo:13:osp-pre-0-1.0 00010000:00080000:0.0:1787830958.829503:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2203636940 x1874676443861760/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787830974 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787830958.829527:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203636940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676443861760:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787830959.080194:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787830959.335156:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220380f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443862016:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787830959.335241:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830959.335463:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443862016 00000100:00100000:0.0:1787830959.335470:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443862016 00000100:00100000:0.0:1787830959.335651:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787830959.335662:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203636940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676443862016:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787830959.335694:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787830959.335751:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203636940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676443862016:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830959.335759:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787830959.335831:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220380f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443862016:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787830959.849006:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787830959.849028:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a9d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443862144:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787830959.849098:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830959.849177:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443862144 00000100:00100000:1.0:1787830959.849185:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443862144 00000100:00100000:1.0:1787830959.849233:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787830959.849243:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203afe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443862144:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787830959.849277:0:7448:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787830959.849324:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203afe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443862144:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830959.849330:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787830959.849378:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a9d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443862144:0@lo:41:osp-pre-0-1.0 00000001:02000400:1.0:1787830960.027527:0:13498:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 07:42:39 (1787830959) === 00010000:00010000:3.0:1787830960.103003:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787830960.171836:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787830960.171894:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433306880 00000100:00100000:2.0:1787830960.171909:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433306880 00000100:00080000:0.0:1787830960.171996:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787830960.172006:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 2 00000100:00100000:2.0:1787830960.172016:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203afc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:47d7f0ed-283f-4b70-a741-6e74c5e52619+6:10471:x1874676433306880:12345-192.168.203.31@tcp:700:mkdir.0 00000100:00100000:2.0:1787830960.172099:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203afc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:47d7f0ed-283f-4b70-a741-6e74c5e52619+6:10471:x1874676433306880:12345-192.168.203.31@tcp:700:mkdir.0 Request processed in 84us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830960.172107:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 2 00000100:00100000:3.0:1787830960.175414:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787830960.175553:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433307136 00000100:00100000:0.0:1787830960.175563:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433307136 00000100:00100000:0.0:1787830960.175648:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 22 00000100:00100000:0.0:1787830960.175770:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+6:10471:x1874676433307136:12345-192.168.203.31@tcp:36:mkdir.0 00010000:00010000:0.0:1787830960.175828:0:6490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787830960.178428:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11000/0x95459fb9d1d288d2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423c56 expref: 6 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830960.178453:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d23119f9f00) 00010000:00010000:0.0:1787830960.178479:0:6490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787830960.178872:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10e00/0x95459fb9d1d28a30 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830960.178886:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10e00/0x95459fb9d1d28a30 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830960.178896:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10e00/0x95459fb9d1d28a30 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830960.181208:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94a00/0x95459fb9d1d28a37 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830960.181230:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94a00/0x95459fb9d1d28a37 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830960.181245:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94a00/0x95459fb9d1d28a37 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830960.181906:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95e00/0x95459fb9d1d28a3e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830960.181917:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95e00/0x95459fb9d1d28a3e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830960.181925:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95e00/0x95459fb9d1d28a3e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787830960.181941:0:6490:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006e367496 reply state 00000000f53cd93c transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95e00/0x95459fb9d1d28a3e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830960.181952:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95e00/0x95459fb9d1d28a3e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830960.181959:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d2202441500) 00010000:00010000:1.0:1787830960.181962:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787830960.181966:0:6490:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1787830960.181972:0:6490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1787830960.181980:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10e00/0x95459fb9d1d28a30 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830960.181997:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10e00/0x95459fb9d1d28a30 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830960.182004:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10e00/0x95459fb9d1d28a30 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830960.182010:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233bf10e00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:1.0:1787830960.182014:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10e00/0x95459fb9d1d28a30 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830960.182021:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10e00/0x95459fb9d1d28a30 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830960.182373:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2309e00b00) 00010000:00010000:1.0:1787830960.182377:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787830960.182383:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10e00/0x95459fb9d1d28a30 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830960.182389:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10e00/0x95459fb9d1d28a30 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787830960.182407:0:6490:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006e367496 reply state 00000000f53cd93c transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94a00/0x95459fb9d1d28a37 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830960.182416:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94a00/0x95459fb9d1d28a37 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830960.182422:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8d2202441e00) 00010000:00010000:1.0:1787830960.182424:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787830960.182426:0:6490:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1787830960.182607:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+7:10471:x1874676433307136:12345-192.168.203.31@tcp:36:mkdir.0 Request processed in 6946us (7239us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1787830960.182651:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 22 00000100:00100000:1.0:1787830960.194164:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787830960.194926:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433307264 00000100:00100000:2.0:1787830960.194935:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433307264 00000100:00100000:2.0:1787830960.194993:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 23 00000100:00100000:2.0:1787830960.195014:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203aff0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+7:10472:x1874676433307264:12345-192.168.203.31@tcp:101:chmod.0 00010000:00010000:2.0:1787830960.195044:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787830960.195069:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0800/0x95459fb9d1d28a45 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99423ce9 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830960.195140:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1200/0x95459fb9d1d28a4c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830960.195153:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1200/0x95459fb9d1d28a4c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830960.195164:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1200/0x95459fb9d1d28a4c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787830960.195206:0:6491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787830960.195209:0:6491:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787830960.195241:0:6491:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1200/0x95459fb9d1d28a4c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830960.195265:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0800/0x95459fb9d1d28a45 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423ce9 expref: 9 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830960.195283:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1200/0x95459fb9d1d28a4c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423ce9 expref: 8 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830960.195290:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2203615f00) 00010000:00010000:2.0:1787830960.195293:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787830960.195296:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22039c1200, rc 0) 00000100:00100000:2.0:1787830960.195357:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203aff0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+8:10472:x1874676433307264:12345-192.168.203.31@tcp:101:chmod.0 Request processed in 345us (1206us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830960.195373:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 23 00000100:00100000:2.0:1787830960.199547:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787830960.200190:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433307520 00000100:00100000:1.0:1787830960.200201:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433307520 00000100:00100000:1.0:1787830960.200274:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 24 00000100:00100000:1.0:1787830960.200284:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220380fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+8:10472:x1874676433307520:12345-192.168.203.31@tcp:36:chmod.0 00010000:00010000:1.0:1787830960.200344:0:8620:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787830960.200372:0:8620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1200/0x95459fb9d1d28a4c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423ce9 expref: 8 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830960.200392:0:8620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2203615f00) 00010000:00010000:1.0:1787830960.200403:0:8620:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787830960.200427:0:8620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94800/0x95459fb9d1d28a53 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830960.200445:0:8620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94800/0x95459fb9d1d28a53 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830960.200455:0:8620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94800/0x95459fb9d1d28a53 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787830960.200771:0:8620:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000068e92270 reply state 0000000055c0f401 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94800/0x95459fb9d1d28a53 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830960.200784:0:8620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94800/0x95459fb9d1d28a53 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830960.200790:0:8620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2202441c00) 00010000:00010000:1.0:1787830960.200793:0:8620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1787830960.200802:0:8620:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1787830960.200811:0:8620:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1787830960.200902:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220380fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+9:10472:x1874676433307520:12345-192.168.203.31@tcp:36:chmod.0 Request processed in 618us (1363us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1787830960.200910:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 24 00000100:00100000:3.0:1787830960.216743:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787830960.216858:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433307648 00000100:00100000:2.0:1787830960.216867:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433307648 00000100:00100000:2.0:1787830960.216926:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 25 00000100:00100000:2.0:1787830960.216935:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a7a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+9:10473:x1874676433307648:12345-192.168.203.31@tcp:101:chown.0 00010000:00010000:2.0:1787830960.216959:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787830960.216979:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0800/0x95459fb9d1d28a5a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99423cf0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830960.217039:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1800/0x95459fb9d1d28a61 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830960.217119:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1800/0x95459fb9d1d28a61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830960.217140:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1800/0x95459fb9d1d28a61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787830960.217179:0:6491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787830960.217183:0:6491:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787830960.217221:0:6491:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1800/0x95459fb9d1d28a61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830960.217247:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0800/0x95459fb9d1d28a5a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423cf0 expref: 11 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830960.217265:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1800/0x95459fb9d1d28a61 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423cf0 expref: 10 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830960.217290:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2202441c00) 00010000:00010000:2.0:1787830960.217293:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787830960.217302:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22039c1800, rc 0) 00000100:00100000:2.0:1787830960.217364:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a7a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+10:10473:x1874676433307648:12345-192.168.203.31@tcp:101:chown.0 Request processed in 429us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830960.217371:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 25 00000100:00100000:3.0:1787830960.220276:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787830960.220380:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433307776 00000100:00100000:1.0:1787830960.220389:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433307776 00000100:00100000:1.0:1787830960.220482:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 26 00000100:00100000:1.0:1787830960.220492:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a78780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+10:10473:x1874676433307776:12345-192.168.203.31@tcp:101:chown.0 00010000:00010000:1.0:1787830960.220509:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787830960.220527:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94400/0x95459fb9d1d28a68 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99423cf7 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830960.220586:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95400/0x95459fb9d1d28a6f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830960.220600:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95400/0x95459fb9d1d28a6f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830960.220610:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95400/0x95459fb9d1d28a6f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830960.220620:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94e00/0x95459fb9d1d28a76 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830960.220664:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94e00/0x95459fb9d1d28a76 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830960.220671:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94e00/0x95459fb9d1d28a76 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830960.220736:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95000/0x95459fb9d1d28a7d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830960.220758:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95000/0x95459fb9d1d28a7d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830960.220765:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95000/0x95459fb9d1d28a7d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787830960.220803:0:6490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787830960.220806:0:6490:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787830960.220826:0:6490:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95000/0x95459fb9d1d28a7d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830960.220838:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95400/0x95459fb9d1d28a6f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830960.220844:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95400/0x95459fb9d1d28a6f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830960.220851:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95400/0x95459fb9d1d28a6f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830960.220857:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233be95400 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:1.0:1787830960.220860:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95400/0x95459fb9d1d28a6f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830960.220868:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95400/0x95459fb9d1d28a6f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830960.220878:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2202441c00) 00010000:00010000:1.0:1787830960.220881:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787830960.220885:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95400/0x95459fb9d1d28a6f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830960.220901:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95400/0x95459fb9d1d28a6f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830960.220914:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94e00/0x95459fb9d1d28a76 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830960.220920:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94e00/0x95459fb9d1d28a76 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830960.220925:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94e00/0x95459fb9d1d28a76 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830960.220930:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233be94e00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:1.0:1787830960.220933:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94e00/0x95459fb9d1d28a76 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830960.220939:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94e00/0x95459fb9d1d28a76 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830960.220946:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8d2202441e00) 00010000:00010000:1.0:1787830960.220949:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787830960.220952:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94e00/0x95459fb9d1d28a76 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830960.220957:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94e00/0x95459fb9d1d28a76 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830960.220982:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94400/0x95459fb9d1d28a68 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423cf7 expref: 12 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830960.220993:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95000/0x95459fb9d1d28a7d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423cf7 expref: 11 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830960.221006:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d2202441500) 00010000:00010000:1.0:1787830960.221008:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787830960.221011:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233be95000, rc 0) 00000100:00100000:1.0:1787830960.221060:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a78780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+11:10473:x1874676433307776:12345-192.168.203.31@tcp:101:chown.0 Request processed in 570us (793us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830960.221068:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 26 00000100:00100000:1.0:1787830960.223780:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787830960.224155:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433307904 00000100:00100000:2.0:1787830960.224164:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433307904 00000100:00100000:2.0:1787830960.224316:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 6 00000100:00100000:2.0:1787830960.224327:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a9d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:47d7f0ed-283f-4b70-a741-6e74c5e52619+11:10473:x1874676433307904:12345-192.168.203.31@tcp:900:chown.0 00000100:00100000:2.0:1787830960.224406:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a9d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:47d7f0ed-283f-4b70-a741-6e74c5e52619+11:10473:x1874676433307904:12345-192.168.203.31@tcp:900:chown.0 Request processed in 82us (635us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830960.224414:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 6 00000100:00100000:0.0:1787830960.227236:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787830960.227389:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433308160 00000100:00100000:2.0:1787830960.227398:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433308160 00000100:00100000:2.0:1787830960.227492:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 27 00000100:00100000:2.0:1787830960.227501:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203b6e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+11:10473:x1874676433308160:12345-192.168.203.31@tcp:36:chown.0 00010000:00010000:2.0:1787830960.227550:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787830960.227574:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95000/0x95459fb9d1d28a7d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423cf7 expref: 11 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830960.227594:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d2202441500) 00010000:00010000:2.0:1787830960.227599:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787830960.227621:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0800/0x95459fb9d1d28a84 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830960.227676:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0800/0x95459fb9d1d28a84 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830960.227695:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0800/0x95459fb9d1d28a84 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787830960.230242:0:6469:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00000004:00010000:2.0:1787830960.230326:0:6491:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000033ad9f10 reply state 0000000010893904 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0800/0x95459fb9d1d28a84 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830960.230346:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0800/0x95459fb9d1d28a84 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830960.230355:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d2202441500) 00010000:00010000:2.0:1787830960.230358:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1787830960.230362:0:6491:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787830960.230372:0:6491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00080000:2.0:1787830960.230464:0:6491:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1787830960.230488:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203b6e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+9:10473:x1874676433308160:12345-192.168.203.31@tcp:36:chown.0 Request processed in 2985us (3264us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1787830960.230496:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 27 00010000:00010000:1.0:1787830960.230577:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94a00/0x95459fb9d1d28a37 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830960.230588:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94a00/0x95459fb9d1d28a37 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830960.230595:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94a00/0x95459fb9d1d28a37 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830960.230602:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233be94a00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:1.0:1787830960.230606:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94a00/0x95459fb9d1d28a37 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830960.230614:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94a00/0x95459fb9d1d28a37 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830960.230669:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8d2202441e00) 00010000:00010000:1.0:1787830960.230673:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787830960.230676:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94a00/0x95459fb9d1d28a37 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830960.230683:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94a00/0x95459fb9d1d28a37 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830960.230710:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95e00/0x95459fb9d1d28a3e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830960.230717:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95e00/0x95459fb9d1d28a3e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830960.230723:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95e00/0x95459fb9d1d28a3e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830960.230728:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233be95e00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:1.0:1787830960.230731:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95e00/0x95459fb9d1d28a3e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830960.230738:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95e00/0x95459fb9d1d28a3e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830960.230745:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d2202441500) 00010000:00010000:1.0:1787830960.230748:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787830960.230752:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95e00/0x95459fb9d1d28a3e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830960.230758:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95e00/0x95459fb9d1d28a3e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830960.230770:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94800/0x95459fb9d1d28a53 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830960.230778:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94800/0x95459fb9d1d28a53 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830960.230784:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94800/0x95459fb9d1d28a53 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830960.230796:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233be94800 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:1.0:1787830960.230799:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94800/0x95459fb9d1d28a53 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830960.230806:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94800/0x95459fb9d1d28a53 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830960.230815:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2202441c00) 00010000:00010000:1.0:1787830960.230817:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787830960.230821:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94800/0x95459fb9d1d28a53 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830960.231336:0:3606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0800/0x95459fb9d1d28a84 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830960.231348:0:3606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0800/0x95459fb9d1d28a84 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830960.231354:0:3606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0800/0x95459fb9d1d28a84 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830960.231359:0:3606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22039c0800 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:0.0:1787830960.231362:0:3606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0800/0x95459fb9d1d28a84 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830960.231369:0:3606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0800/0x95459fb9d1d28a84 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830960.231379:0:3606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d2202441500) 00010000:00010000:0.0:1787830960.231381:0:3606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787830960.231384:0:3606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0800/0x95459fb9d1d28a84 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830960.231393:0:3606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0800/0x95459fb9d1d28a84 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830960.231399:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94800/0x95459fb9d1d28a53 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830960.240565:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787830960.241005:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433308288 00000100:00100000:1.0:1787830960.241020:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433308288 00000100:00100000:1.0:1787830960.241262:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 28 00000100:00100000:1.0:1787830960.241276:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a79e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+6:10474:x1874676433308288:12345-192.168.203.31@tcp:101:touch.500 00010000:00010000:1.0:1787830960.241301:0:8620:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787830960.241322:0:8620:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94800/0x95459fb9d1d28a8b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99423cfe expref: -99 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787830960.242742:0:8620:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 1370us 00010000:00010000:3.0:1787830960.254288:0:8620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d28a92 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830960.254320:0:8620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d28a92 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830960.254334:0:8620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d28a92 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830960.254350:0:8620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d28a99 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830960.254356:0:8620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d28a99 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830960.254362:0:8620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d28a99 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830960.254501:0:8620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77800/0x95459fb9d1d28aa0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830960.254510:0:8620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77800/0x95459fb9d1d28aa0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830960.254518:0:8620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77800/0x95459fb9d1d28aa0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787830960.254558:0:8620:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787830960.254562:0:8620:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787830960.254603:0:8620:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77800/0x95459fb9d1d28aa0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830960.254617:0:8620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d28a92 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830960.254696:0:8620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d28a92 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830960.254704:0:8620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d28a92 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830960.254711:0:8620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2307c76400 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:3.0:1787830960.254716:0:8620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d28a92 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830960.254724:0:8620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d28a92 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830960.254738:0:8620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2202441c00) 00010000:00010000:3.0:1787830960.254746:0:8620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787830960.254752:0:8620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d28a92 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830960.254759:0:8620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d28a92 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830960.254772:0:8620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d28a99 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830960.254778:0:8620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d28a99 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830960.254784:0:8620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d28a99 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830960.254788:0:8620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2307c76600 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:3.0:1787830960.254791:0:8620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d28a99 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830960.254796:0:8620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d28a99 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830960.254802:0:8620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8d2318594f00) 00010000:00010000:3.0:1787830960.254805:0:8620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787830960.254807:0:8620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d28a99 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830960.254813:0:8620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d28a99 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830960.254853:0:8620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94800/0x95459fb9d1d28a8b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423cfe expref: 8 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830960.254881:0:8620:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77800/0x95459fb9d1d28aa0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423cfe expref: 7 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830960.254888:0:8620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d2318594b00) 00010000:00010000:3.0:1787830960.254891:0:8620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787830960.254893:0:8620:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2307c77800, rc 0) 00000100:00100000:3.0:1787830960.255018:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a79e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+7:10474:x1874676433308288:12345-192.168.203.31@tcp:101:touch.500 Request processed in 13745us (14468us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830960.255028:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 28 00000100:00100000:3.0:1787830960.258335:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787830960.258400:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433308544 00000100:00100000:1.0:1787830960.258412:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433308544 00000100:00100000:2.0:1787830960.258508:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 29 00000100:00100000:2.0:1787830960.258532:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a7b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+7:10474:x1874676433308544:12345-192.168.203.31@tcp:101:touch.500 00010000:00010000:2.0:1787830960.258559:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787830960.258587:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1c00/0x95459fb9d1d28aa7 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99423d05 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830960.258772:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1600/0x95459fb9d1d28aae lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830960.258814:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1600/0x95459fb9d1d28aae lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830960.258828:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1600/0x95459fb9d1d28aae lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830960.259008:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1e00/0x95459fb9d1d28ab5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x4eed53cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830960.259032:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1e00/0x95459fb9d1d28ab5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x4eed53cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830960.259045:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1e00/0x95459fb9d1d28ab5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x4eed53cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787830960.259457:0:6491:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:2.0:1787830960.259719:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0e00/0x95459fb9d1d28abc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830960.259729:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0e00/0x95459fb9d1d28abc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830960.259738:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0e00/0x95459fb9d1d28abc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830960.259772:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1600/0x95459fb9d1d28aae lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830960.259779:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1600/0x95459fb9d1d28aae lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830960.259786:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1600/0x95459fb9d1d28aae lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830960.259799:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22039c1600 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:2.0:1787830960.259804:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1600/0x95459fb9d1d28aae lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830960.259811:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1600/0x95459fb9d1d28aae lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830960.259824:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d2318594b00) 00010000:00010000:2.0:1787830960.259827:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787830960.259831:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1600/0x95459fb9d1d28aae lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830960.259848:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1600/0x95459fb9d1d28aae lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787830960.259861:0:6491:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bfe6d941 reply state 00000000a242f94d transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1e00/0x95459fb9d1d28ab5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x4eed53cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830960.259870:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1e00/0x95459fb9d1d28ab5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x4eed53cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830960.259876:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x4eed53cd (ffff8d2203615e00) 00010000:00010000:2.0:1787830960.259878:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787830960.259881:0:6491:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787830960.259919:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1c00/0x95459fb9d1d28aa7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423d05 expref: 10 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830960.259934:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0e00/0x95459fb9d1d28abc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423d05 expref: 9 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830960.259951:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8d2203615800) 00010000:00010000:2.0:1787830960.259953:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787830960.259956:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22039c0e00, rc 0) 00000100:00100000:2.0:1787830960.260032:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a7b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+10:10474:x1874676433308544:12345-192.168.203.31@tcp:101:touch.500 Request processed in 1514us (1707us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1787830960.260041:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 29 00000100:00100000:0.0:1787830960.264067:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787830960.264255:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433308800 00000100:00100000:3.0:1787830960.264268:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433308800 00000100:00100000:3.0:1787830960.264347:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 30 00000100:00100000:3.0:1787830960.264364:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203b6fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+10:10474:x1874676433308800:12345-192.168.203.31@tcp:36:touch.500 00010000:00010000:3.0:1787830960.264458:0:6490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787830960.264492:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0e00/0x95459fb9d1d28abc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423d05 expref: 10 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830960.264514:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8d2203615800) 00010000:00010000:3.0:1787830960.264528:0:6490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787830960.264601:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d28aca lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830960.264619:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d28aca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830960.264685:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d28aca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787830960.264848:0:6490:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000de36542a reply state 00000000411b99de transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d28aca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830960.264863:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d28aca lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830960.264870:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8d2318594f00) 00010000:00010000:3.0:1787830960.264872:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787830960.264874:0:6490:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787830960.265000:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203b6fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+11:10474:x1874676433308800:12345-192.168.203.31@tcp:36:touch.500 Request processed in 641us (946us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1787830960.265008:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 30 00000100:00100000:3.0:1787830960.267478:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787830960.267701:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433308928 00000100:00100000:1.0:1787830960.267712:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433308928 00000100:00100000:1.0:1787830960.267779:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 31 00000100:00100000:1.0:1787830960.267787:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a783c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+11:10474:x1874676433308928:12345-192.168.203.31@tcp:101:touch.500 00010000:00010000:1.0:1787830960.267828:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787830960.267850:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94a00/0x95459fb9d1d28ad1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99423d0c expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830960.267915:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94a00/0x95459fb9d1d28ad1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423d0c expref: 12 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830960.267931:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94a00/0x95459fb9d1d28ad1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423d0c expref: 12 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830960.267954:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8d2318594f00) 00010000:00010000:1.0:1787830960.267957:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787830960.267961:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233be94a00, rc 0) 00000100:00100000:1.0:1787830960.268018:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a783c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+12:10474:x1874676433308928:12345-192.168.203.31@tcp:101:touch.500 Request processed in 231us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830960.268025:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 31 00000100:00100000:1.0:1787830960.270826:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787830960.270898:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433309056 00000100:00100000:3.0:1787830960.270910:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433309056 00000100:00100000:3.0:1787830960.270965:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 24 00000100:00100000:3.0:1787830960.270974:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d232f796d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2393:x1874676433309056:12345-192.168.203.31@tcp:8:touch.500 00010000:00080000:3.0:1787830960.271020:0:8408:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 47d7f0ed-283f-4b70-a741-6e74c5e52619@192.168.203.31@tcp t0 exp 0000000000000000 cur 251 last 0 00000020:00000080:3.0:1787830960.271068:0:8408:0:(genops.c:1385:class_connect()) connect: client 47d7f0ed-283f-4b70-a741-6e74c5e52619, cookie 0x95459fb9d1d28ad8 00002000:00100000:3.0:1787830960.271083:0:8408:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 47d7f0ed-283f-4b70-a741-6e74c5e52619/ffff8d233f546800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211393d ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787830960.271106:0:8408:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type 37, return 37 00002000:00080000:3.0:1787830960.271230:0:8408:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787830960.271267:0:8408:0:(import.c:65:import_set_state_nolock()) ffff8d233f542800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787830960.271353:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d232f796d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+6:2393:x1874676433309056:12345-192.168.203.31@tcp:8:touch.500 Request processed in 379us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830960.271361:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 24 00000100:00100000:0.0:1787830960.273389:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787830960.273493:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433309184 00000100:00100000:1.0:1787830960.273502:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433309184 00000100:00100000:1.0:1787830960.273750:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 25 00000100:00100000:1.0:1787830960.273763:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203b6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+6:0:x1874676433309184:12345-192.168.203.31@tcp:2:touch.500 00000100:00080000:0.0:1787830960.274260:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:0.0:1787830960.275877:0:9484:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000001:00100000:0.0:1787830960.275891:0:9484:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 47d7f0ed-283f-4b70-a741-6e74c5e52619 00000001:00100000:0.0:1787830960.275896:0:9484:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c901c2b2-479b-44dc-8fa8-34fbacf02f07 00000020:00000080:0.0:1787830960.275900:0:9484:0:(genops.c:885:class_export_put()) final put ffff8d2203601800/c901c2b2-479b-44dc-8fa8-34fbacf02f07 00000020:00000080:3.0:1787830960.275998:0:478:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2203601800/c901c2b2-479b-44dc-8fa8-34fbacf02f07 for lustre-OST0001 00000020:00000080:3.0:1787830960.276056:0:478:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d2203603800 for lustre-OST0001 00000100:00100000:1.0:1787830960.276378:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203b6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:0:x1874676433309184:12345-192.168.203.31@tcp:2:touch.500 Request processed in 2607us (2989us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1787830960.276393:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 25 00000100:00100000:1.0:1787830960.282828:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787830960.282940:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433309440 00000100:00100000:3.0:1787830960.282964:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433309440 00000100:00100000:3.0:1787830960.283026:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 2 00000100:00100000:3.0:1787830960.283035:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d232f796940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+12:10474:x1874676433309440:12345-192.168.203.31@tcp:35:touch.500 00000100:00100000:3.0:1787830960.283360:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d232f796940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+13:10474:x1874676433309440:12345-192.168.203.31@tcp:35:touch.500 Request processed in 325us (547us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1787830960.283368:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 2 00000100:00100000:3.0:1787830960.293411:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787830960.293564:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433309568 00000100:00100000:1.0:1787830960.293764:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433309568 00000100:00100000:0.0:1787830960.293972:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 32 00000100:00100000:0.0:1787830960.293986:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a7a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+13:10475:x1874676433309568:12345-192.168.203.31@tcp:101:rm.0 00010000:00010000:0.0:1787830960.294018:0:8620:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787830960.294044:0:8620:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10600/0x95459fb9d1d28adf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99423d13 expref: -99 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830960.294144:0:8620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11000/0x95459fb9d1d28ae6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830960.294162:0:8620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11000/0x95459fb9d1d28ae6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830960.294176:0:8620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11000/0x95459fb9d1d28ae6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787830960.294237:0:8620:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787830960.294241:0:8620:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787830960.294337:0:8620:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11000/0x95459fb9d1d28ae6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830960.294371:0:8620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10600/0x95459fb9d1d28adf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423d13 expref: 15 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830960.294402:0:8620:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11000/0x95459fb9d1d28ae6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423d13 expref: 14 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830960.294413:0:8620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d2318594b00) 00010000:00010000:0.0:1787830960.294417:0:8620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787830960.294421:0:8620:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233bf11000, rc 0) 00000100:00100000:0.0:1787830960.294691:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a7a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+14:10475:x1874676433309568:12345-192.168.203.31@tcp:101:rm.0 Request processed in 707us (1294us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830960.294700:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 32 00000100:00100000:0.0:1787830960.298098:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787830960.298176:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433309824 00000100:00100000:1.0:1787830960.298189:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433309824 00000100:00100000:1.0:1787830960.298260:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 33 00000100:00100000:1.0:1787830960.298268:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203b6de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+14:10475:x1874676433309824:12345-192.168.203.31@tcp:101:rm.0 00010000:00010000:1.0:1787830960.298301:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787830960.298328:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95400/0x95459fb9d1d28aed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99423d1a expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787830960.298453:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1787830960.298679:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95400/0x95459fb9d1d28aed lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423d1a expref: 16 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830960.298697:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2202441c00) 00010000:00010000:1.0:1787830960.298701:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787830960.298707:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95400/0x95459fb9d1d28aed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423d1a expref: 16 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830960.298723:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233be95400, rc 0) 00000100:00100000:1.0:1787830960.298794:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203b6de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+15:10475:x1874676433309824:12345-192.168.203.31@tcp:101:rm.0 Request processed in 526us (712us total) trans 4294967305 rc 301/301 00000100:00100000:1.0:1787830960.298802:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 33 00000100:00100000:1.0:1787830960.304945:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787830960.305031:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433309952 00000100:00100000:2.0:1787830960.305045:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433309952 00000100:00100000:3.0:1787830960.305138:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 3 00000100:00100000:3.0:1787830960.305153:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d232f795e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+15:10475:x1874676433309952:12345-192.168.203.31@tcp:37:rm.0 00000100:00100000:2.0:1787830960.310388:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d232f795e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+15:10475:x1874676433309952:12345-192.168.203.31@tcp:37:rm.0 Request processed in 5222us (5443us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830960.310404:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 3 00000100:00100000:0.0:1787830960.313105:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787830960.313287:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433310208 00000100:00100000:2.0:1787830960.313300:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433310208 00000100:00100000:2.0:1787830960.313374:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 4 00000100:00100000:2.0:1787830960.313386:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d23066cbc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+15:10475:x1874676433310208:12345-192.168.203.31@tcp:35:rm.0 00000100:00100000:2.0:1787830960.313721:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d23066cbc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+16:10475:x1874676433310208:12345-192.168.203.31@tcp:35:rm.0 Request processed in 337us (638us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1787830960.313730:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 4 00000100:00100000:1.0:1787830960.315951:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787830960.316016:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433310464 00000100:00100000:3.0:1787830960.316027:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433310464 00000100:00100000:3.0:1787830960.316100:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 34 00000100:00100000:3.0:1787830960.316112:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d232f794000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+16:10475:x1874676433310464:12345-192.168.203.31@tcp:101:rm.0 00010000:00010000:3.0:1787830960.316151:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787830960.316179:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d28afb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99423d21 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830960.316319:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d28b02 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830960.316337:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d28b02 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830960.316351:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d28b02 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787830960.316384:0:6490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1787830960.316904:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d28afb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423d21 expref: 19 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830960.316928:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d28b02 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423d21 expref: 18 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830960.316938:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d2318594b00) 00010000:00010000:3.0:1787830960.316942:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787830960.316946:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2307c76400, rc 0) 00000100:00100000:3.0:1787830960.317056:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d232f794000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+18:10475:x1874676433310464:12345-192.168.203.31@tcp:101:rm.0 Request processed in 946us (1116us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1787830960.317065:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 34 00000100:00100000:2.0:1787830960.319817:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787830960.320030:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433310592 00000100:00100000:1.0:1787830960.320041:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433310592 00000100:00100000:1.0:1787830960.320109:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 35 00000100:00100000:1.0:1787830960.320122:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220380c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+18:10475:x1874676433310592:12345-192.168.203.31@tcp:41:rm.0 00000004:00000024:1.0:1787830960.320222:0:6492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:1.0:1787830960.320320:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220380c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+18:10475:x1874676433310592:12345-192.168.203.31@tcp:41:rm.0 Request processed in 200us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830960.320328:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 35 00000100:00100000:0.0:1787830960.322780:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787830960.322982:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433310720 00000100:00100000:3.0:1787830960.322997:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433310720 00000100:00100000:3.0:1787830960.323058:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 36 00000100:00100000:3.0:1787830960.323067:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203b6da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+18:10475:x1874676433310720:12345-192.168.203.31@tcp:101:rm.0 00010000:00010000:3.0:1787830960.323092:0:8620:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787830960.323118:0:8620:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d28b10 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99423d28 expref: -99 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830960.323223:0:8620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76c00/0x95459fb9d1d28b17 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830960.323243:0:8620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76c00/0x95459fb9d1d28b17 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830960.323279:0:8620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76c00/0x95459fb9d1d28b17 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830960.323294:0:8620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d28b1e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x4eed53cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830960.323302:0:8620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d28b1e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x4eed53cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830960.323309:0:8620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d28b1e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x4eed53cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830960.323416:0:8620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d28b25 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830960.323426:0:8620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d28b25 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830960.323433:0:8620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d28b25 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787830960.323476:0:8620:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:3.0:1787830960.323481:0:8620:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787830960.323502:0:8620:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d28b25 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830960.323515:0:8620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d28b25 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830960.323525:0:8620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76c00/0x95459fb9d1d28b17 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830960.323542:0:8620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76c00/0x95459fb9d1d28b17 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830960.323549:0:8620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76c00/0x95459fb9d1d28b17 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830960.323578:0:8620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2307c76c00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:3.0:1787830960.323583:0:8620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76c00/0x95459fb9d1d28b17 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830960.323592:0:8620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76c00/0x95459fb9d1d28b17 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830960.323617:0:8620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d2318594b00) 00010000:00010000:3.0:1787830960.323621:0:8620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787830960.323647:0:8620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76c00/0x95459fb9d1d28b17 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830960.323654:0:8620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76c00/0x95459fb9d1d28b17 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830960.323668:0:8620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d28b1e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x4eed53cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830960.323674:0:8620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d28b1e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x4eed53cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830960.323681:0:8620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d28b1e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x4eed53cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830960.323686:0:8620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2307c77600 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:3.0:1787830960.323696:0:8620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d28b1e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x4eed53cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830960.323703:0:8620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d28b1e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x4eed53cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830960.323711:0:8620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x4eed53cd (ffff8d2203615e00) 00010000:00010000:3.0:1787830960.323714:0:8620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787830960.323717:0:8620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d28b1e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x4eed53cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830960.323724:0:8620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d28b1e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x4eed53cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830960.323756:0:8620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d28b10 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423d28 expref: 20 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830960.323770:0:8620:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d28b25 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423d28 expref: 19 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830960.323778:0:8620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8d2318594f00) 00010000:00010000:3.0:1787830960.323781:0:8620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787830960.323784:0:8620:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2307c77400, rc 0) 00000100:00100000:3.0:1787830960.323859:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203b6da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+19:10475:x1874676433310720:12345-192.168.203.31@tcp:101:rm.0 Request processed in 793us (1108us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830960.323867:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 36 00000100:00100000:3.0:1787830960.325851:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787830960.325947:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433310976 00000100:00100000:2.0:1787830960.325957:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433310976 00000100:00100000:2.0:1787830960.326020:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 37 00000100:00100000:2.0:1787830960.326031:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220258d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+19:10475:x1874676433310976:12345-192.168.203.31@tcp:36:rm.0 00010000:00010000:2.0:1787830960.326095:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787830960.326137:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d28b25 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423d28 expref: 19 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830960.326179:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94a00/0x95459fb9d1d28ad1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423d0c expref: 18 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830960.326193:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8d2318594f00) 00010000:00010000:2.0:1787830960.326202:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11000/0x95459fb9d1d28ae6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423d13 expref: 17 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830960.326215:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d2318594b00) 00010000:00010000:2.0:1787830960.326219:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787830960.326243:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1600/0x95459fb9d1d28b2c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830960.326256:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1600/0x95459fb9d1d28b2c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830960.326267:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1600/0x95459fb9d1d28b2c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830960.326280:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1c00/0x95459fb9d1d28b33 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x4eed53cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830960.326287:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1c00/0x95459fb9d1d28b33 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x4eed53cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830960.326294:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1c00/0x95459fb9d1d28b33 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x4eed53cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830960.326449:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0e00/0x95459fb9d1d28b3a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830960.326469:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0e00/0x95459fb9d1d28b3a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830960.326477:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0e00/0x95459fb9d1d28b3a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787830960.326788:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1787830960.326801:0:6491:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 251327175619ns, next at 252327172672ns, rc = 0 00010000:00010000:2.0:1787830960.326854:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0800/0x95459fb9d1d28b41 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830960.326864:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0800/0x95459fb9d1d28b41 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830960.326872:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0800/0x95459fb9d1d28b41 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830960.326881:0:6491:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0800/0x95459fb9d1d28b41 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830960.326888:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0800/0x95459fb9d1d28b41 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830960.326894:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0800/0x95459fb9d1d28b41 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830960.326921:0:6491:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787830960.326943:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0e00/0x95459fb9d1d28b3a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830960.326950:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0e00/0x95459fb9d1d28b3a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830960.326965:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0e00/0x95459fb9d1d28b3a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830960.326966:0:7431:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787830960.326976:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22039c0e00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:0.0:1787830960.326978:0:7431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0800/0x95459fb9d1d28b41 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830960.326982:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0e00/0x95459fb9d1d28b3a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830960.326994:0:7431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22039c0800 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:0.0:1787830960.326999:0:7431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0800/0x95459fb9d1d28b41 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830960.327000:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0e00/0x95459fb9d1d28b3a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830960.327015:0:7431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0800/0x95459fb9d1d28b41 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40018480000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830960.327020:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8d2318594f00) 00010000:00010000:2.0:1787830960.327025:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787830960.327029:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0e00/0x95459fb9d1d28b3a lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830960.327037:0:7431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8d2318594f00) 00010000:00010000:2.0:1787830960.327038:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0e00/0x95459fb9d1d28b3a lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830960.327043:0:7431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787830960.327048:0:7431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0800/0x95459fb9d1d28b41 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830960.327061:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1600/0x95459fb9d1d28b2c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830960.327075:0:7431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0800/0x95459fb9d1d28b41 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830960.327076:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1600/0x95459fb9d1d28b2c lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830960.327092:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1600/0x95459fb9d1d28b2c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830960.327098:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22039c1600 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:0.0:1787830960.327099:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787830960.327103:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1600/0x95459fb9d1d28b2c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830960.327103:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830960.327105:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787830960.327136:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1600/0x95459fb9d1d28b2c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830960.327145:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d2318594b00) 00010000:00010000:2.0:1787830960.327148:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787830960.327151:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1600/0x95459fb9d1d28b2c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830960.327157:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1600/0x95459fb9d1d28b2c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787830960.327168:0:6491:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a145613c reply state 00000000f9230c6d transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1c00/0x95459fb9d1d28b33 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x4eed53cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830960.327180:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1c00/0x95459fb9d1d28b33 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x4eed53cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830960.327187:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x4eed53cd (ffff8d2203615e00) 00010000:00010000:2.0:1787830960.327189:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787830960.327193:0:6491:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787830960.327288:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220258d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+18:10475:x1874676433310976:12345-192.168.203.31@tcp:36:rm.0 Request processed in 1258us (1447us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1787830960.327296:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 37 00000100:00100000:2.0:1787830960.329980:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787830960.330076:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433311232 00000100:00100000:3.0:1787830960.330087:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433311232 00000100:00100000:3.0:1787830960.330167:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 5 00000100:00100000:3.0:1787830960.333199:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220380de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+18:10475:x1874676433311232:12345-192.168.203.31@tcp:35:rm.0 00000100:00100000:3.0:1787830960.333537:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220380de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+19:10475:x1874676433311232:12345-192.168.203.31@tcp:35:rm.0 Request processed in 3340us (3564us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1787830960.333548:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 5 00000100:00100000:0.0:1787830960.335902:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787830960.335974:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433311488 00000100:00100000:2.0:1787830960.335988:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433311488 00000100:00100000:2.0:1787830960.336063:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 38 00000100:00100000:2.0:1787830960.336073:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203b6c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+19:10475:x1874676433311488:12345-192.168.203.31@tcp:36:rm.0 00010000:00010000:2.0:1787830960.336161:0:6490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787830960.336211:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d28b02 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423d21 expref: 19 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830960.336237:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77800/0x95459fb9d1d28aa0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423cfe expref: 18 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830960.336250:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d2318594b00) 00010000:00010000:2.0:1787830960.336270:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1800/0x95459fb9d1d28a61 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423cf0 expref: 17 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830960.336280:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2202441c00) 00010000:00010000:2.0:1787830960.336286:0:6490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787830960.336313:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1200/0x95459fb9d1d28b48 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830960.336327:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1200/0x95459fb9d1d28b48 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830960.336339:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1200/0x95459fb9d1d28b48 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830960.336353:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0600/0x95459fb9d1d28b4f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830960.336361:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0600/0x95459fb9d1d28b4f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830960.336368:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0600/0x95459fb9d1d28b4f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830960.336486:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1400/0x95459fb9d1d28b56 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830960.336500:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1400/0x95459fb9d1d28b56 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830960.336507:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1400/0x95459fb9d1d28b56 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787830960.336982:0:6490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1787830960.337002:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1400/0x95459fb9d1d28b56 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830960.337010:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1400/0x95459fb9d1d28b56 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830960.337018:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1400/0x95459fb9d1d28b56 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830960.337026:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22039c1400 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:2.0:1787830960.337031:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1400/0x95459fb9d1d28b56 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830960.337040:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1400/0x95459fb9d1d28b56 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830960.337050:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d2203615d00) 00010000:00010000:2.0:1787830960.337053:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787830960.337057:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1400/0x95459fb9d1d28b56 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830960.337063:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1400/0x95459fb9d1d28b56 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830960.337083:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1200/0x95459fb9d1d28b48 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830960.337097:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1200/0x95459fb9d1d28b48 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830960.337103:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1200/0x95459fb9d1d28b48 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830960.337108:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22039c1200 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:2.0:1787830960.337112:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1200/0x95459fb9d1d28b48 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830960.337134:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1200/0x95459fb9d1d28b48 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830960.337143:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2203615b00) 00010000:00010000:2.0:1787830960.337146:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787830960.337149:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1200/0x95459fb9d1d28b48 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830960.337155:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1200/0x95459fb9d1d28b48 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787830960.337167:0:6490:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000521a21da reply state 000000009036132d transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0600/0x95459fb9d1d28b4f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830960.337178:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0600/0x95459fb9d1d28b4f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830960.337185:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8d2203615a00) 00010000:00010000:2.0:1787830960.337187:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787830960.337190:0:6490:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787830960.337276:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203b6c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+18:10475:x1874676433311488:12345-192.168.203.31@tcp:36:rm.0 Request processed in 1204us (1385us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1787830960.337291:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 38 00000100:00100000:2.0:1787830960.870878:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220380f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443862272:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787830960.870985:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830960.871096:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443862272 00000100:00100000:2.0:1787830960.871105:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443862272 00000100:00100000:2.0:1787830960.871191:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787830960.871203:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220380d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1874676443862272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787830960.871244:0:8409:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787830960.871313:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220380d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1874676443862272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830960.871322:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:3.0:1787830960.871354:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787830960.871474:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d220380f0c0 x1874676443862272/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787830976 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787830960.871498:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220380f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443862272:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787830960.871997:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203b6f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a45944b-32e3-4193-a2a5-46f84222bc14:3619:1874676443862528:0@lo:400:kworker.0 00000100:00100000:0.0:1787830960.872046:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830960.872074:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443863040:0@lo:400:kworker.0 00000100:00100000:0.0:1787830960.872102:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830960.872118:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a4a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443863552:0@lo:400:kworker.0 00000100:00100000:0.0:1787830960.872157:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830960.872179:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1787830960.872185:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203b6e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874676443862656:0@lo:400:kworker.0 00000100:00100000:0.0:1787830960.872209:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830960.872225:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a49680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3619:1874676443863168:0@lo:400:kworker.0 00000100:00100000:0.0:1787830960.872260:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830960.872276:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a49a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3619:1874676443863680:0@lo:400:kworker.0 00000100:00100000:0.0:1787830960.872302:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830960.872338:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443862528 00000100:00100000:0.0:1787830960.872343:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443862528 00000100:00100000:0.0:1787830960.872387:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:2.0:1787830960.872391:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443862656 00000100:00100000:0.0:1787830960.872397:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2310884450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+24:3619:x1874676443862528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787830960.872399:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443862656 00000100:00100000:2.0:1787830960.872453:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443863168 00000100:00100000:0.0:1787830960.872456:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2310884450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+24:3619:x1874676443862528:12345-0@lo:400:kworker.0 Request processed in 61us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830960.872458:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443863168 00000100:00100000:0.0:1787830960.872472:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:0.0:1787830960.872509:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443863040 00000100:00100000:0.0:1787830960.872513:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443863040 00000100:00100000:0.0:1787830960.872547:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787830960.872554:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a4a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676443863040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787830960.872593:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a4a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676443863040:12345-0@lo:400:kworker.0 Request processed in 41us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830960.872601:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787830960.872653:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443863552 00000100:00100000:0.0:1787830960.872657:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443863552 00000100:00100000:2.0:1787830960.872660:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443863680 00000100:00100000:2.0:1787830960.872666:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443863680 00000100:00100000:0.0:1787830960.872694:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787830960.872701:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a48b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676443863552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787830960.872737:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a48b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676443863552:12345-0@lo:400:kworker.0 Request processed in 37us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830960.872743:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787830960.872785:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1787830960.872794:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a49e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874676443862656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787830960.873020:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1787830960.873030:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203bb0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874676443863168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787830960.873076:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203bb0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874676443863168:12345-0@lo:400:kworker.0 Request processed in 49us (816us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830960.873084:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1787830960.873101:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1787830960.873108:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203bb30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874676443863680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787830960.873150:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203bb30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874676443863680:12345-0@lo:400:kworker.0 Request processed in 43us (847us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830960.873169:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1787830960.873206:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203b6e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676443862400:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1787830960.873231:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787830960.873239:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787830960.873257:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830960.873280:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a4bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443862784:0@lo:400:kworker.0 00000100:00100000:2.0:1787830960.873290:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a4b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3622:1874676443862912:0@lo:400:kworker.0 00000100:00100000:3.0:1787830960.873332:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830960.873335:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830960.873336:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a49e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874676443862656:12345-0@lo:400:kworker.0 Request processed in 35us (615us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830960.873347:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1787830960.873363:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443862912 00000100:00100000:0.0:1787830960.873367:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443862912 00000100:00100000:0.0:1787830960.873389:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787830960.873394:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220380ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1874676443862912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787830960.873433:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a48780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676443863424:0@lo:400:kworker.0 00000100:00100000:2.0:1787830960.873575:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830960.873597:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676443863936:0@lo:400:kworker.0 00000100:00100000:2.0:1787830960.873621:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830960.873680:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443862400 00000100:00100000:2.0:1787830960.873683:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443862400 00000100:00100000:2.0:1787830960.873718:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787830960.873725:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220380f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676443862400:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787830960.873740:0:8410:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787830960.873770:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220380f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676443862400:12345-0@lo:13:osp-pre-1-1.0 Request processed in 46us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830960.873774:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787830960.873789:0:8631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443863424 00000100:00100000:2.0:1787830960.873792:0:8631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443863424 00000100:00100000:2.0:1787830960.873808:0:8631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443863936 00000100:00100000:2.0:1787830960.873811:0:8631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443863936 00000100:00100000:2.0:1787830960.873822:0:8631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787830960.873828:0:8631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220380d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676443863424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787830960.873858:0:8631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220380d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676443863424:12345-0@lo:400:kworker.0 Request processed in 30us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830960.873876:0:8631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787830960.873889:0:8631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787830960.873895:0:8631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220380e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676443863936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787830960.873927:0:8631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220380e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676443863936:12345-0@lo:400:kworker.0 Request processed in 32us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830960.873933:0:8631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:2.0:1787830960.873975:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2203b6e940 x1874676443862400/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787830976 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787830960.873996:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203b6e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676443862400:0@lo:13:osp-pre-1-1.0 00010000:00080000:2.0:1787830960.874010:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2203a48780 x1874676443863424/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787830976 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787830960.874020:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a48780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676443863424:0@lo:400:kworker.0 00010000:00080000:2.0:1787830960.874029:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2203a4b480 x1874676443863936/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787830976 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787830960.874037:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676443863936:0@lo:400:kworker.0 00000100:00080000:2.0:1787830960.874072:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787830960.874075:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787830960.874137:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203b6e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874676443862656:0@lo:400:kworker.0 00000100:00100000:2.0:1787830960.874152:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a49680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3619:1874676443863168:0@lo:400:kworker.0 00000100:00100000:2.0:1787830960.874165:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a49a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3619:1874676443863680:0@lo:400:kworker.0 00000100:00100000:2.0:1787830960.874176:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203b6f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a45944b-32e3-4193-a2a5-46f84222bc14:3619:1874676443862528:0@lo:400:kworker.0 00000100:00100000:2.0:1787830960.874187:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443863040:0@lo:400:kworker.0 00010000:00080000:2.0:1787830960.874209:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2203a4a940 x1874676443863552/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787830976 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787830960.874281:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a4a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443863552:0@lo:400:kworker.0 00000100:00100000:2.0:1787830960.874322:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443862784 00000100:00100000:2.0:1787830960.874327:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443862784 00000100:00100000:2.0:1787830960.874355:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787830960.874362:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22039ba940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443862784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787830960.874399:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22039ba940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443862784:12345-0@lo:400:kworker.0 Request processed in 38us (1072us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830960.874405:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787830960.874536:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220380ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1874676443862912:12345-0@lo:400:kworker.0 Request processed in 1140us (1206us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830960.874552:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1787830960.874696:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a4b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3622:1874676443862912:0@lo:400:kworker.0 00000100:00100000:3.0:1787830960.875339:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a4bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443862784:0@lo:400:kworker.0 00000100:00100000:3.0:1787830960.875350:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a483c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3621:1874676443863296:0@lo:400:kworker.0 00000100:00100000:3.0:1787830960.875482:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830960.875511:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a4ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3621:1874676443863808:0@lo:400:kworker.0 00000100:00100000:3.0:1787830960.875534:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830960.875534:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443863296 00000100:00100000:2.0:1787830960.875542:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443863296 00000100:00100000:2.0:1787830960.875591:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443863808 00000100:00080000:3.0:1787830960.875596:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787830960.875596:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443863808 00000100:00100000:3.0:1787830960.875650:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1787830960.875664:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1787830960.875665:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22039b8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1874676443863296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787830960.875684:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22039bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1874676443863808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787830960.875833:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22039b8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1874676443863296:12345-0@lo:400:kworker.0 Request processed in 174us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830960.875841:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00080000:3.0:1787830960.875862:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1787830960.875889:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2203a483c0 x1874676443863296/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830976 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787830960.875900:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a483c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3621:1874676443863296:0@lo:400:kworker.0 00010000:00080000:3.0:1787830960.875909:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2203a4ad00 x1874676443863808/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830976 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787830960.875917:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a4ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3621:1874676443863808:0@lo:400:kworker.0 00000100:00100000:2.0:1787830960.875947:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22039bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1874676443863808:12345-0@lo:400:kworker.0 Request processed in 267us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830960.875955:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00010000:00010000:0.0:1787830961.127239:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787830962.152787:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787830962.256914:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787830962.257025:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787830962.257127:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433311744 00000100:00100000:0.0:1787830962.257138:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433311744 00000100:00100000:0.0:1787830962.257242:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 143 00000100:00100000:0.0:1787830962.257252:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d232f794780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+18:2395:x1874676433311744:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1787830962.257323:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d232f794780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+18:2395:x1874676433311744:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 73us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830962.257331:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 143 00000100:00100000:2.0:1787830962.258281:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433311616 00000100:00100000:2.0:1787830962.258289:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433311616 00000100:00100000:2.0:1787830962.258328:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 320 00000100:00100000:2.0:1787830962.258335:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d230888b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+13:2395:x1874676433311616:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1787830962.258385:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d230888b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+13:2395:x1874676433311616:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 50us (1481us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830962.258405:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 320 00000100:00100000:0.0:1787830962.260258:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787830962.260377:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787830962.260406:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787830962.260417:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433311872 00000100:00100000:3.0:1787830962.260427:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433311872 00000100:00100000:0.0:1787830962.260446:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787830962.260472:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433312128 00000100:00100000:0.0:1787830962.260477:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433312128 00000100:00100000:2.0:1787830962.260510:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433312256 00000100:00100000:2.0:1787830962.260515:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433312256 00000100:00080000:1.0:1787830962.260979:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787830962.260985:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787830962.261230:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 144 00000100:00100000:0.0:1787830962.261243:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203bb3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:2395:x1874676433311872:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1787830962.261364:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203bb3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:2395:x1874676433311872:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 125us (1114us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830962.261462:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 145 00000100:00100000:3.0:1787830962.261473:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203bb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c901c2b2-479b-44dc-8fa8-34fbacf02f07+5:2395:x1874676433312128:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1787830962.261505:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203bb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c901c2b2-479b-44dc-8fa8-34fbacf02f07+5:2395:x1874676433312128:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 35us (1127us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830962.261513:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 145 00000100:00100000:3.0:1787830962.261546:0:8631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433312000 00000100:00100000:3.0:1787830962.261551:0:8631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433312000 00000100:00100000:3.0:1787830962.261584:0:8631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 52 00000100:00100000:3.0:1787830962.261592:0:8631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203bb1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:2395:x1874676433312000:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1787830962.261617:0:8631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203bb1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:2395:x1874676433312000:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 27us (1211us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830962.261649:0:8631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 52 00000100:00080000:3.0:1787830962.261784:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787830962.266468:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 146 00000100:00100000:2.0:1787830962.266482:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203bb1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c901c2b2-479b-44dc-8fa8-34fbacf02f07+5:2395:x1874676433312256:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1787830962.266558:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203bb1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c901c2b2-479b-44dc-8fa8-34fbacf02f07+5:2395:x1874676433312256:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 79us (6112us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830962.266566:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 146 00000100:00100000:0.0:1787830962.267039:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 144 00000001:02000400:0.0:1787830962.840432:0:13645:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000001:00100000:3.0:1787830962.924180:0:8401:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c901c2b2-479b-44dc-8fa8-34fbacf02f07 00000020:00000080:3.0:1787830962.924194:0:8401:0:(genops.c:885:class_export_put()) final put ffff8d233f520800/c901c2b2-479b-44dc-8fa8-34fbacf02f07 00000020:00000080:2.0:1787830962.924245:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d233f520800/c901c2b2-479b-44dc-8fa8-34fbacf02f07 for lustre-OST0000 00000020:00000080:2.0:1787830962.924316:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d233f522000 for lustre-OST0000 00010000:00010000:3.0:1787830963.174898:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787830963.688981:0:13693:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff67f54260 20000000:00000080:2.0:1787830963.688997:0:13693:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d233bf62c00 uarg=0000000000000000 20000000:01000000:2.0:1787830963.689035:0:13693:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1787830963.689041:0:13693:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1787830963.689045:0:13693:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:2.0:1787830963.689460:0:13694:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:0.0:1787830963.689579:0:13693:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:0.0:1787830963.695532:0:13693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:0.0:1787830963.695572:0:13693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:0.0:1787830963.695589:0:13693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:0.0:1787830963.695606:0:13693:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787830963.695676:0:13693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d233bf10e00/0x95459fb9d1d28b5d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830963.695695:0:13693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d233bf11200/0x95459fb9d1d289f1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d289ea expref: 23 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830963.695704:0:13693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2301668600/0x95459fb9d1d289ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d289f8 expref: 23 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830963.695710:0:13693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2301668e00/0x95459fb9d1d28a0d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d28a06 expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830963.695716:0:13693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2301669a00/0x95459fb9d1d28a1b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d28a14 expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830963.695735:0:13693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2307c76200/0x95459fb9d1d28a22 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423cdb expref: 12 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830963.695743:0:13693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2301669600/0x95459fb9d1d28a29 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423ce2 expref: 12 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830963.695751:0:13693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d233bf10e00/0x95459fb9d1d28b5d lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830963.695790:0:13693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2301669600/0x95459fb9d1d28a29 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423ce2 expref: 12 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830963.695804:0:13693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d2301669600/0x95459fb9d1d28a29 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423ce2 expref: 12 pid: 6484 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830963.695820:0:13693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203bb2940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13693:1874676443864064:192.168.203.31@tcp:104: 00010000:00010000:0.0:1787830963.696053:0:13693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2307c76200/0x95459fb9d1d28a22 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423cdb expref: 12 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830963.696062:0:13693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d2307c76200/0x95459fb9d1d28a22 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423cdb expref: 12 pid: 6483 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830963.696071:0:13693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203bb0b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13693:1874676443864192:192.168.203.31@tcp:104: 00010000:00010000:0.0:1787830963.696129:0:13693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2301669a00/0x95459fb9d1d28a1b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x95459fb9d1d28a14 expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830963.696139:0:13693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d2301669a00/0x95459fb9d1d28a1b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x95459fb9d1d28a14 expref: 23 pid: 6484 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830963.696148:0:13693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203bb3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13693:1874676443864320:0@lo:104: 00000100:00100000:0.0:1787830963.696188:0:13693:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787830963.696222:0:13693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2301668e00/0x95459fb9d1d28a0d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x95459fb9d1d28a06 expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830963.696230:0:13693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d2301668e00/0x95459fb9d1d28a0d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x95459fb9d1d28a06 expref: 23 pid: 6484 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830963.696238:0:13693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203bb03c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13693:1874676443864448:0@lo:104: 00000100:00100000:3.0:1787830963.696249:0:9493:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:0.0:1787830963.696269:0:13693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2301668600/0x95459fb9d1d289ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x95459fb9d1d289f8 expref: 23 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830963.696279:0:9493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787830963.696284:0:13693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d2301668600/0x95459fb9d1d289ff lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x95459fb9d1d289f8 expref: 23 pid: 6485 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830963.696294:0:13693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203bb3840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13693:1874676443864576:0@lo:104: 00000100:00100000:3.0:1787830963.696302:0:9493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443864320 00000100:00100000:3.0:1787830963.696310:0:9493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443864320 00000100:00100000:0.0:1787830963.696331:0:13693:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830963.696351:0:9493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443864448 00000100:00100000:3.0:1787830963.696355:0:9493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443864448 00000100:00100000:0.0:1787830963.696363:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443864576 00000100:00100000:0.0:1787830963.696369:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443864576 00000100:00100000:3.0:1787830963.696372:0:9493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787830963.696383:0:9493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203961050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2a45944b-32e3-4193-a2a5-46f84222bc14+5:13693:x1874676443864320:12345-0@lo:104: 00010000:00010000:3.0:1787830963.696395:0:9493:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff8d233bf11c00/0x95459fb9d1d28a14 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d28a1b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830963.696400:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787830963.696412:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22039ba580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a45944b-32e3-4193-a2a5-46f84222bc14+5:13693:x1874676443864448:12345-0@lo:104: 00010000:00010000:0.0:1787830963.696422:0:6474:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff8d2307c76000/0x95459fb9d1d28a06 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d28a0d expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830963.696455:0:9493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787830963.696463:0:9493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203961050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2a45944b-32e3-4193-a2a5-46f84222bc14+5:13693:x1874676443864320:12345-0@lo:104: Request processed in 83us (274us total) trans 0 rc 0/0 00010000:00010000:0.0:1787830963.696470:0:6474:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787830963.696471:0:9493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787830963.696479:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22039ba580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a45944b-32e3-4193-a2a5-46f84222bc14+5:13693:x1874676443864448:12345-0@lo:104: Request processed in 68us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830963.696487:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787830963.696506:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787830963.696513:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203bb2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a45944b-32e3-4193-a2a5-46f84222bc14+3:13693:x1874676443864576:12345-0@lo:104: 00010000:00010000:0.0:1787830963.696521:0:6474:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff8d2301669200/0x95459fb9d1d289f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d289ff expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830963.696525:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787830963.696533:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8d233bf11c00/0x95459fb9d1d28a14 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d28a1b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830963.696542:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233bf11c00 already unused, calling callback (ffffffffc14f9c20) 10000000:00010000:3.0:1787830963.696546:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8d233bf11c00/0x95459fb9d1d28a14 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x95459fb9d1d28a1b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830963.696551:0:6474:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:3.0:1787830963.696555:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8d233bf11c00/0x95459fb9d1d28a14 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x95459fb9d1d28a1b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830963.696558:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203bb2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a45944b-32e3-4193-a2a5-46f84222bc14+3:13693:x1874676443864576:12345-0@lo:104: Request processed in 46us (227us total) trans 0 rc 0/0 10000000:00010000:3.0:1787830963.696573:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8d233bf11c00/0x95459fb9d1d28a14 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x95459fb9d1d28a1b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830963.696573:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 10000000:01000000:3.0:1787830963.696582:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787830963.696605:0:13693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d233bf11200/0x95459fb9d1d289f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x95459fb9d1d289ea expref: 23 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830963.696616:0:13693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d233bf11200/0x95459fb9d1d289f1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x95459fb9d1d289ea expref: 23 pid: 6483 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830963.696643:0:13693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203bb2d00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13693:1874676443864704:0@lo:104: 00010000:00010000:3.0:1787830963.696659:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8d233bf11c00/0x95459fb9d1d28a14 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d28a1b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830963.696667:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787830963.696692:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8d233bf11c00/0x95459fb9d1d28a14 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d28a1b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830963.696692:0:13693:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787830963.696702:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8d233bf11c00/0x95459fb9d1d28a14 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d28a1b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830963.696712:0:13693:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2310003180 going to sleep for 11 seconds 00010000:00010000:3.0:1787830963.696718:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787830963.696723:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8d2307c76000/0x95459fb9d1d28a06 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d28a0d expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830963.696730:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2307c76000 already unused, calling callback (ffffffffc14f9c20) 10000000:00010000:3.0:1787830963.696733:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8d2307c76000/0x95459fb9d1d28a06 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x95459fb9d1d28a0d expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830963.696736:0:13693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203bb3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13693:1874676443864320:0@lo:104: 00010000:00010000:3.0:1787830963.696743:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8d2307c76000/0x95459fb9d1d28a06 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x95459fb9d1d28a0d expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830963.696749:0:13693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203bb03c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13693:1874676443864448:0@lo:104: 10000000:00010000:3.0:1787830963.696753:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8d2307c76000/0x95459fb9d1d28a06 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x95459fb9d1d28a0d expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830963.696760:0:13693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203bb3840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13693:1874676443864576:0@lo:104: 10000000:01000000:3.0:1787830963.696761:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787830963.696790:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8d2307c76000/0x95459fb9d1d28a06 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d28a0d expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830963.696796:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787830963.696803:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8d2307c76000/0x95459fb9d1d28a06 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d28a0d expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830963.696820:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8d2307c76000/0x95459fb9d1d28a06 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d28a0d expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830963.696831:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787830963.696834:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8d2301669200/0x95459fb9d1d289f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d289ff expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830963.696839:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2301669200 already unused, calling callback (ffffffffc14f9c20) 10000000:00010000:3.0:1787830963.696841:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8d2301669200/0x95459fb9d1d289f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x95459fb9d1d289ff expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830963.696848:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8d2301669200/0x95459fb9d1d289f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x95459fb9d1d289ff expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787830963.696854:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8d2301669200/0x95459fb9d1d289f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x95459fb9d1d289ff expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787830963.696859:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787830963.696873:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8d2301669200/0x95459fb9d1d289f8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d289ff expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830963.696879:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787830963.696895:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8d2301669200/0x95459fb9d1d289f8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d289ff expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830963.696901:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8d2301669200/0x95459fb9d1d289f8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d289ff expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830963.696911:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787830963.696919:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787830963.696921:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787830963.696939:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787830963.696946:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787830963.696959:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22039bad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a45944b-32e3-4193-a2a5-46f84222bc14:3619:1874676443864832:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787830963.696988:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830963.697011:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787830963.697017:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22039b9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a45944b-32e3-4193-a2a5-46f84222bc14:3619:1874676443864960:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787830963.697037:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830963.697064:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22039b92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a45944b-32e3-4193-a2a5-46f84222bc14:3621:1874676443865088:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787830963.697084:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830963.697128:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443864832 00000100:00100000:3.0:1787830963.697132:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443864832 00010000:00010000:3.0:1787830963.697156:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2301669a00/0x95459fb9d1d28a1b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d28a14 expref: 24 pid: 6484 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830963.697178:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443864960 00000100:00100000:3.0:1787830963.697181:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443864960 00000100:00100000:0.0:1787830963.697193:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443865088 00010000:00010000:3.0:1787830963.697196:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2301668e00/0x95459fb9d1d28a0d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d28a06 expref: 25 pid: 6484 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830963.697199:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443865088 00000100:00100000:3.0:1787830963.697216:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00010000:00010000:0.0:1787830963.697220:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2301668600/0x95459fb9d1d289ff lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d289f8 expref: 26 pid: 6485 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830963.697229:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22039b8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2a45944b-32e3-4193-a2a5-46f84222bc14+26:3619:x1874676443864832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787830963.697241:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1787830963.697245:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00010000:00010000:3.0:1787830963.697250:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2301669a00/0x95459fb9d1d28a1b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d28a14 expref: 26 pid: 6484 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830963.697258:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22039bb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a45944b-32e3-4193-a2a5-46f84222bc14+26:3619:x1874676443864960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787830963.697265:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2301669a00/0x95459fb9d1d28a1b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x95459fb9d1d28a14 expref: 26 pid: 6484 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830963.697268:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787830963.697276:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2301668e00/0x95459fb9d1d28a0d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d28a06 expref: 26 pid: 6484 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830963.697299:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2301668e00/0x95459fb9d1d28a0d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x95459fb9d1d28a06 expref: 26 pid: 6484 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830963.697446:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2301669a00/0x95459fb9d1d28a1b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x95459fb9d1d28a14 expref: 26 pid: 6484 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830963.697459:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787830963.697492:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22039b8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2a45944b-32e3-4193-a2a5-46f84222bc14+25:3619:x1874676443864832:12345-0@lo:103:ldlm_bl.0 Request processed in 268us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830963.697499:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787830963.697514:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787830963.697521:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22039ba1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2a45944b-32e3-4193-a2a5-46f84222bc14+24:3621:x1874676443865088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787830963.697530:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787830963.697535:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2301668600/0x95459fb9d1d289ff lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d289f8 expref: 24 pid: 6485 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830963.697544:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2301668600/0x95459fb9d1d289ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x95459fb9d1d289f8 expref: 24 pid: 6485 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830963.697554:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2301668600/0x95459fb9d1d289ff lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x95459fb9d1d289f8 expref: 24 pid: 6485 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830963.697563:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787830963.697590:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22039ba1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2a45944b-32e3-4193-a2a5-46f84222bc14+23:3621:x1874676443865088:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830963.697596:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787830963.697660:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22039b92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a45944b-32e3-4193-a2a5-46f84222bc14:3621:1874676443865088:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787830963.697690:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22039bad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a45944b-32e3-4193-a2a5-46f84222bc14:3619:1874676443864832:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787830963.697713:0:9493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443864704 00000100:00100000:3.0:1787830963.697723:0:9493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443864704 00000100:00100000:3.0:1787830963.697757:0:9493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787830963.697764:0:9493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203bb1680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2a45944b-32e3-4193-a2a5-46f84222bc14+3:13693:x1874676443864704:12345-0@lo:104: 00010000:00010000:3.0:1787830963.697988:0:9493:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff8d2307c76a00/0x95459fb9d1d289ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d289f1 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830963.698046:0:9493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787830963.698052:0:9493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203bb1680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2a45944b-32e3-4193-a2a5-46f84222bc14+3:13693:x1874676443864704:12345-0@lo:104: Request processed in 289us (1361us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830963.698057:0:9493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:0.0:1787830963.698135:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2301668e00/0x95459fb9d1d28a0d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x95459fb9d1d28a06 expref: 22 pid: 6484 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830963.698145:0:13693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203bb2d00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13693:1874676443864704:0@lo:104: 00010000:00010000:0.0:1787830963.698146:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787830963.698182:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22039bb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a45944b-32e3-4193-a2a5-46f84222bc14+21:3619:x1874676443864960:12345-0@lo:103:ldlm_bl.0 Request processed in 929us (1144us total) trans 0 rc 0/0 00010000:00010000:1.0:1787830963.698185:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787830963.698190:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8d2307c76a00/0x95459fb9d1d289ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d289f1 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830963.698190:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00010000:1.0:1787830963.698197:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2307c76a00 already unused, calling callback (ffffffffc14f9c20) 10000000:00010000:1.0:1787830963.698200:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8d2307c76a00/0x95459fb9d1d289ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x95459fb9d1d289f1 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830963.698209:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8d2307c76a00/0x95459fb9d1d289ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x95459fb9d1d289f1 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787830963.698216:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8d2307c76a00/0x95459fb9d1d289ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x95459fb9d1d289f1 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787830963.698226:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787830963.698291:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8d2307c76a00/0x95459fb9d1d289ea lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d289f1 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830963.698297:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787830963.698323:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8d2307c76a00/0x95459fb9d1d289ea lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d289f1 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830963.698333:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22039b9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a45944b-32e3-4193-a2a5-46f84222bc14:3619:1874676443864960:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787830963.698347:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8d2307c76a00/0x95459fb9d1d289ea lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d289f1 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830963.698355:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:1.0:1787830963.698363:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787830963.698365:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d232f7952c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a45944b-32e3-4193-a2a5-46f84222bc14:3621:1874676443865216:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787830963.698367:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830963.698371:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787830963.698398:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830963.698437:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443865216 00000100:00100000:1.0:1787830963.698443:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443865216 00010000:00010000:1.0:1787830963.698465:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d233bf11200/0x95459fb9d1d289f1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d289ea expref: 21 pid: 6483 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830963.698570:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787830963.698579:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22039b9680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2a45944b-32e3-4193-a2a5-46f84222bc14+21:3621:x1874676443865216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787830963.698587:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787830963.698592:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d233bf11200/0x95459fb9d1d289f1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d289ea expref: 21 pid: 6483 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830963.698835:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d233bf11200/0x95459fb9d1d289f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x95459fb9d1d289ea expref: 21 pid: 6483 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830963.698852:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d233bf11200/0x95459fb9d1d289f1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x95459fb9d1d289ea expref: 21 pid: 6483 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830963.698863:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787830963.698910:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22039b9680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2a45944b-32e3-4193-a2a5-46f84222bc14+20:3621:x1874676443865216:12345-0@lo:103:ldlm_bl.0 Request processed in 332us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830963.698924:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787830963.699039:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d232f7952c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a45944b-32e3-4193-a2a5-46f84222bc14:3621:1874676443865216:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787830963.706801:0:13693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203bb0b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13693:1874676443864192:192.168.203.31@tcp:104: 00000100:00100000:2.0:1787830963.707885:0:13693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203bb2940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13693:1874676443864064:192.168.203.31@tcp:104: 00010000:00010000:2.0:1787830963.707928:0:13693:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d233bf10e00/0x95459fb9d1d28b5d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830963.708999:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787830963.709038:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787830963.709175:0:7432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433312384 00000100:00100000:0.0:1787830963.709195:0:7432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433312384 00010000:00010000:0.0:1787830963.709237:0:7432:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2307c76200/0x95459fb9d1d28a22 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423cdb expref: 13 pid: 6483 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830963.709277:0:7432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433312512 00000100:00100000:0.0:1787830963.709281:0:7432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433312512 00010000:00010000:0.0:1787830963.709295:0:7432:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2301669600/0x95459fb9d1d28a29 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423ce2 expref: 14 pid: 6484 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830963.709321:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 50 00000100:00100000:0.0:1787830963.709331:0:7432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22039bad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+14:2396:x1874676433312384:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787830963.709346:0:7432:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787830963.709352:0:7432:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2307c76200/0x95459fb9d1d28a22 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423cdb expref: 14 pid: 6483 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830963.709362:0:7432:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2307c76200/0x95459fb9d1d28a22 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423cdb expref: 14 pid: 6483 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830963.709378:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2307c76200/0x95459fb9d1d28a22 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423cdb expref: 14 pid: 6483 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830963.709392:0:7432:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787830963.709450:0:7432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22039bad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+13:2396:x1874676433312384:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 120us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830963.709458:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 50 00000100:00100000:0.0:1787830963.709474:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 51 00000100:00100000:0.0:1787830963.709480:0:7432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22039b92c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+12:2396:x1874676433312512:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787830963.709487:0:7432:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787830963.709492:0:7432:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2301669600/0x95459fb9d1d28a29 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423ce2 expref: 12 pid: 6484 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830963.709506:0:7432:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2301669600/0x95459fb9d1d28a29 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423ce2 expref: 12 pid: 6484 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830963.709516:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2301669600/0x95459fb9d1d28a29 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423ce2 expref: 12 pid: 6484 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830963.709527:0:7432:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d233bf10e00/0x95459fb9d1d28b5d lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830963.709536:0:7432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d233bf10e00/0x95459fb9d1d28b5d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830963.709561:0:7432:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d233bf10e00/0x95459fb9d1d28b5d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830963.709568:0:7432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d233bf10e00/0x95459fb9d1d28b5d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830963.709575:0:7432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d233bf10e00/0x95459fb9d1d28b5d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830963.709585:0:7432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d233bf10e00/0x95459fb9d1d28b5d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830963.709591:0:7432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233bf10e00 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:0.0:1787830963.709595:0:7432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d233bf10e00/0x95459fb9d1d28b5d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830963.709602:0:7432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d233bf10e00/0x95459fb9d1d28b5d lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830963.709658:0:7432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d233bf10e00/0x95459fb9d1d28b5d lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830963.709669:0:7432:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787830963.709689:0:7432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22039b92c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+11:2396:x1874676433312512:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 209us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830963.709696:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 51 00010000:00010000:2.0:1787830963.710305:0:13693:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d233bf10e00/0x95459fb9d1d28b5d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830963.710317:0:13693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d233bf10e00/0x95459fb9d1d28b5d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830963.710337:0:13693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d233bf10e00/0x95459fb9d1d28b5d lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830963.942784:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203bb12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443865344:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787830963.942863:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830963.943011:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443865344 00000100:00100000:1.0:1787830963.943019:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443865344 00000100:00100000:1.0:1787830963.943111:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787830963.943122:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22039bbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676443865344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787830963.943155:0:8409:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1787830963.943155:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787830963.943209:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22039bbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676443865344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830963.943218:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:3.0:1787830963.943334:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2203bb12c0 x1874676443865344/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787830979 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787830963.943355:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203bb12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443865344:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787830963.944649:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203bb12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1874676443865472:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787830963.944701:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830963.944975:0:11489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443865472 00000100:00100000:3.0:1787830963.944982:0:11489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443865472 00000100:00100000:3.0:1787830963.945042:0:11489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787830963.945051:0:11489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d232f796940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1874676443865472:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787830963.945067:0:11489:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787830963.945127:0:11489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d232f796940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1874676443865472:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (425us total) trans 0 rc 0/0 00000100:00080000:0.0:1787830963.945159:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787830963.945203:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2203bb12c0 x1874676443865472/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787830979 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787830963.945220:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203bb12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1874676443865472:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787830963.945546:0:11489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00010000:3.0:1787830964.198933:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787830964.322502:0:13742:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd23a284b0 20000000:00000080:0.0:1787830964.322519:0:13742:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d220385cc00 uarg=0000000000000000 20000000:01000000:0.0:1787830964.322563:0:13742:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:0.0:1787830964.322569:0:13742:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:0.0:1787830964.322574:0:13742:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:0.0:1787830964.323725:0:13743:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:2.0:1787830964.323916:0:13742:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:2.0:1787830964.323991:0:13742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:2.0:1787830964.324023:0:13742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:2.0:1787830964.324041:0:13742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:2.0:1787830964.324055:0:13742:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787830964.324074:0:13742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d22039c1a00/0x95459fb9d1d28b64 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830964.324087:0:13742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22039c1a00/0x95459fb9d1d28b64 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830964.324094:0:13742:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d22039c1a00/0x95459fb9d1d28b64 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830964.324110:0:13742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d22039c1a00/0x95459fb9d1d28b64 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830964.324120:0:13742:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d22039c1a00/0x95459fb9d1d28b64 lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830964.324127:0:13742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d22039c1a00/0x95459fb9d1d28b64 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830964.324135:0:13742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22039c1a00 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:2.0:1787830964.324139:0:13742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d22039c1a00/0x95459fb9d1d28b64 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830964.324146:0:13742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d22039c1a00/0x95459fb9d1d28b64 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830964.324168:0:13742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d22039c1a00/0x95459fb9d1d28b64 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830964.324175:0:13742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d22039c1a00/0x95459fb9d1d28b64 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830964.324181:0:13742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d22039c1a00/0x95459fb9d1d28b64 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830964.455856:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220380c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443865600:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787830964.455926:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830964.455996:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443865600 00000100:00100000:2.0:1787830964.456003:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443865600 00000100:00100000:2.0:1787830964.456044:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787830964.456052:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220380e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1874676443865600:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787830964.456084:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787830964.456138:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220380e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1874676443865600:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830964.456145:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787830964.456192:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220380c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443865600:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787830964.968600:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787830964.968846:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d232f7952c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443865728:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787830964.968921:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830964.969223:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443865728 00000100:00100000:2.0:1787830964.969232:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443865728 00000100:00100000:2.0:1787830964.969326:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787830964.969336:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22039b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443865728:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787830964.969369:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787830964.969428:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22039b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443865728:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830964.969449:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787830964.969528:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d232f7952c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443865728:0@lo:41:osp-pre-0-1.0 10000000:01000000:0.0:1787830965.094915:0:6487:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787830965.094923:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d2334556800 from 7 10000000:01000000:0.0:1787830965.094928:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787830965.094980:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233bf10e00/0x95459fb9d1d28b6b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830965.094993:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8d233bf10e00/0x95459fb9d1d28b6b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830965.095007:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8d233bf10e00/0x95459fb9d1d28b6b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830965.095054:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203bb12c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443865856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787830965.095214:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830965.095345:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d232f681480 going to sleep for 11 seconds 00000100:00100000:3.0:1787830965.096900:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443865856 00000100:00100000:3.0:1787830965.096912:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443865856 00000100:00100000:2.0:1787830965.097456:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:2.0:1787830965.097470:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d230888bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+20:6487:x1874676443865856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787830965.097487:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787830965.097507:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d22039c1a00/0x95459fb9d1d28b72 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d28b6b expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830965.097535:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22039c1a00/0x95459fb9d1d28b72 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d28b6b expref: 21 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830965.097546:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d22039c1a00/0x95459fb9d1d28b72 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d28b6b expref: 21 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830965.097556:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22039c1a00, rc 0) 00000100:00100000:2.0:1787830965.097682:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d230888bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+21:6487:x1874676443865856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 216us (2468us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830965.097691:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:0.0:1787830965.097901:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203bb12c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443865856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787830965.097920:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8d233bf10e00/0x95459fb9d1d28b6b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d28b72 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830965.097930:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8d233bf10e00/0x95459fb9d1d28b6b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d28b72 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830965.098016:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203bb12c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443865984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787830965.098050:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830965.098086:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d232f681480 going to sleep for 11 seconds 00000100:00100000:2.0:1787830965.098261:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443865984 00000100:00100000:2.0:1787830965.098266:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443865984 00000100:00100000:2.0:1787830965.098305:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:2.0:1787830965.098313:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2308888450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+21:6487:x1874676443865984:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787830965.098738:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2308888450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+21:6487:x1874676443865984:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 424us (686us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830965.098746:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:0.0:1787830965.099606:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203bb12c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443865984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787830965.099694:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203bb12c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443866112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787830965.099766:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830965.099806:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d232f681480 going to sleep for 11 seconds 00000100:00100000:2.0:1787830965.100360:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443866112 00000100:00100000:2.0:1787830965.100367:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443866112 00000100:00100000:2.0:1787830965.100417:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:2.0:1787830965.100446:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2308888850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+21:6487:x1874676443866112:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787830965.100563:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2308888850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+21:6487:x1874676443866112:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 121us (797us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830965.100570:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1787830965.100877:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203bb12c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443866112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787830965.101447:0:13755:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22039b9e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:13755:1874676443866240:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787830965.101499:0:13755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830965.101547:0:13755:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d230665ec00 going to sleep for 11 seconds 00000100:00100000:1.0:1787830965.101606:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443866240 00000100:00100000:1.0:1787830965.101611:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443866240 00000100:00100000:1.0:1787830965.101697:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:1.0:1787830965.101712:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2308889c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+21:13755:x1874676443866240:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787830965.101832:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2308889c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+21:13755:x1874676443866240:12345-0@lo:502:llog_process_th.0 Request processed in 120us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830965.101839:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:3.0:1787830965.102222:0:13755:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22039b9e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:13755:1874676443866240:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787830965.102251:0:13755:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787830965.102261:0:13755:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787830965.102264:0:13755:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787830965.102270:0:13755:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d2334556800 00000020:00000080:3.0:1787830965.102273:0:13755:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787830965.102335:0:13755:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787830965.102340:0:13755:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787830965.102341:0:13755:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787830965.102344:0:13755:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787830965.102346:0:13755:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787830965.102347:0:13755:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1787830965.102351:0:13755:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d2334556800 00000020:00000080:3.0:1787830965.102353:0:13755:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787830965.102387:0:13755:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22039b9e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:13755:1874676443866368:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787830965.102426:0:13755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830965.102464:0:13755:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d230665ec00 going to sleep for 11 seconds 00000100:00100000:2.0:1787830965.102527:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443866368 00000100:00100000:2.0:1787830965.102532:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443866368 00000100:00100000:2.0:1787830965.102569:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:2.0:1787830965.102576:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d230888a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+21:13755:x1874676443866368:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787830965.106126:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d230888a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+21:13755:x1874676443866368:12345-0@lo:502:llog_process_th.0 Request processed in 3545us (3693us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830965.106140:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1787830965.115809:0:13755:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22039b9e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:13755:1874676443866368:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787830965.115853:0:13755:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787830965.115861:0:13755:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787830965.115863:0:13755:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1787830965.115867:0:13755:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1787830965.122836:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1787830965.122878:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787830965.122893:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233bf10e00/0x95459fb9d1d28b6b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d28b72 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830965.122906:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8d233bf10e00/0x95459fb9d1d28b6b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d28b72 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787830965.122929:0:6487:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787830965.122932:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d232f6b0800 from 7 10000000:01000000:0.0:1787830965.122935:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787830965.122974:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233bf11200/0x95459fb9d1d28b79 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830965.122982:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8d233bf11200/0x95459fb9d1d28b79 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830965.122993:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8d233bf11200/0x95459fb9d1d28b79 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830965.123019:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203bb0780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443866496:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787830965.123124:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830965.123170:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d232f681480 going to sleep for 11 seconds 00000100:00100000:3.0:1787830965.124866:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443866496 00000100:00100000:3.0:1787830965.124878:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443866496 00000100:00100000:3.0:1787830965.124925:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:3.0:1787830965.124935:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2308889450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+21:6487:x1874676443866496:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787830965.124950:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787830965.124966:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2307c76000/0x95459fb9d1d28b80 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d28b79 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830965.124994:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2307c76000/0x95459fb9d1d28b80 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d28b79 expref: 22 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830965.125004:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2307c76000/0x95459fb9d1d28b80 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d28b79 expref: 22 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830965.125020:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2307c76000, rc 0) 00000100:00100000:3.0:1787830965.125083:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2308889450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+22:6487:x1874676443866496:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 149us (1990us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830965.125103:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:0.0:1787830965.125266:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203bb0780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443866496:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787830965.125284:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8d233bf11200/0x95459fb9d1d28b79 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d28b80 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830965.125293:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8d233bf11200/0x95459fb9d1d28b79 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d28b80 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830965.125368:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203bb0780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443866624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787830965.125400:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830965.125438:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d232f681480 going to sleep for 11 seconds 00000100:00100000:3.0:1787830965.125830:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443866624 00000100:00100000:3.0:1787830965.125835:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443866624 00000100:00100000:3.0:1787830965.125865:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:3.0:1787830965.125872:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2308888c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+22:6487:x1874676443866624:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787830965.125999:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2308888c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+22:6487:x1874676443866624:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 127us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830965.126005:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:0.0:1787830965.126220:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203bb0780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443866624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787830965.126250:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203bb0780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443866752:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787830965.126291:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830965.126320:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d232f681480 going to sleep for 11 seconds 00000100:00100000:2.0:1787830965.126981:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443866752 00000100:00100000:2.0:1787830965.126987:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443866752 00000100:00100000:2.0:1787830965.127018:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:2.0:1787830965.127025:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d230888ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+22:6487:x1874676443866752:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787830965.127139:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d230888ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+22:6487:x1874676443866752:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 114us (847us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830965.127146:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:2.0:1787830965.127198:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203bb0780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443866752:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787830965.127336:0:13759:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220380c780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:13759:1874676443866880:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787830965.127373:0:13759:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830965.127394:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443866880 00000100:00100000:2.0:1787830965.127398:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443866880 00000100:00100000:2.0:1787830965.127419:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:2.0:1787830965.127426:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d230888b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+22:13759:x1874676443866880:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787830965.127501:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d230888b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+22:13759:x1874676443866880:12345-0@lo:502:llog_process_th.0 Request processed in 76us (128us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830965.127508:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:2.0:1787830965.127542:0:13759:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d230879a300 going to sleep for 11 seconds 00000100:00100000:2.0:1787830965.127554:0:13759:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220380c780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:13759:1874676443866880:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787830965.127575:0:13759:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787830965.127584:0:13759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787830965.127587:0:13759:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787830965.127594:0:13759:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d232f6b0800 00000020:00000080:2.0:1787830965.127596:0:13759:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787830965.127682:0:13759:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787830965.127687:0:13759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787830965.127688:0:13759:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787830965.127691:0:13759:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787830965.127693:0:13759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787830965.127694:0:13759:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1787830965.127698:0:13759:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d232f6b0800 00000020:00000080:2.0:1787830965.127700:0:13759:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787830965.127744:0:13759:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220380c780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:13759:1874676443867008:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787830965.127778:0:13759:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830965.127797:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443867008 00000100:00100000:2.0:1787830965.127801:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443867008 00000100:00100000:2.0:1787830965.127827:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:2.0:1787830965.127834:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2308889850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+22:13759:x1874676443867008:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787830965.127892:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2308889850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+22:13759:x1874676443867008:12345-0@lo:502:llog_process_th.0 Request processed in 57us (113us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830965.127898:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:2.0:1787830965.127933:0:13759:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d233bcbc0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787830965.127945:0:13759:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220380c780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:13759:1874676443867008:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787830965.127963:0:13759:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787830965.127966:0:13759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787830965.127968:0:13759:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1787830965.127971:0:13759:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1787830965.128020:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1787830965.128039:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787830965.128048:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233bf11200/0x95459fb9d1d28b79 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d28b80 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830965.128059:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8d233bf11200/0x95459fb9d1d28b79 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d28b80 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787830965.128069:0:6487:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787830965.128071:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d232f730000 from 7 10000000:01000000:2.0:1787830965.128074:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787830965.128107:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d22039c0000/0x95459fb9d1d28b87 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830965.128115:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8d22039c0000/0x95459fb9d1d28b87 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830965.128124:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8d22039c0000/0x95459fb9d1d28b87 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830965.128136:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220380c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443867136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787830965.128162:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830965.128174:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d233bcbc0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787830965.128187:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443867136 00000100:00100000:2.0:1787830965.128196:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443867136 00000100:00100000:2.0:1787830965.128220:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:2.0:1787830965.128226:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a686850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+22:6487:x1874676443867136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787830965.128234:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787830965.128246:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d22039c1000/0x95459fb9d1d28b8e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d28b87 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830965.128265:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22039c1000/0x95459fb9d1d28b8e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d28b87 expref: 23 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830965.128274:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d22039c1000/0x95459fb9d1d28b8e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d28b87 expref: 23 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830965.128282:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22039c1000, rc 0) 00000100:00100000:2.0:1787830965.128310:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a686850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+23:6487:x1874676443867136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 85us (148us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830965.128316:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:2.0:1787830965.128348:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220380c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443867136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787830965.128359:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8d22039c0000/0x95459fb9d1d28b87 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d28b8e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830965.128366:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8d22039c0000/0x95459fb9d1d28b87 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d28b8e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830965.128403:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220380c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443867264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787830965.128426:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830965.128438:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d233bcbc0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787830965.128450:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443867264 00000100:00100000:2.0:1787830965.128458:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443867264 00000100:00100000:2.0:1787830965.128478:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:2.0:1787830965.128484:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a687050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+23:6487:x1874676443867264:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787830965.128555:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a687050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+23:6487:x1874676443867264:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 71us (128us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830965.128562:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:2.0:1787830965.128588:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220380c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443867264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787830965.128612:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220380c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443867392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787830965.128668:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830965.128680:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2338238600 going to sleep for 11 seconds 00000100:00100000:2.0:1787830965.128691:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443867392 00000100:00100000:2.0:1787830965.128694:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443867392 00000100:00100000:2.0:1787830965.128714:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:2.0:1787830965.128721:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a686450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+23:6487:x1874676443867392:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787830965.128778:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a686450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+23:6487:x1874676443867392:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 57us (110us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830965.128784:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:2.0:1787830965.128816:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220380c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443867392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787830965.129497:0:13760:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220380c780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:13760:1874676443867520:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787830965.129535:0:13760:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830965.129553:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443867520 00000100:00100000:2.0:1787830965.129557:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443867520 00000100:00100000:2.0:1787830965.129577:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:2.0:1787830965.129583:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a687850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+23:13760:x1874676443867520:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787830965.129666:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a687850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+23:13760:x1874676443867520:12345-0@lo:502:llog_process_th.0 Request processed in 83us (130us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830965.129678:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:2.0:1787830965.129704:0:13760:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d233bcbc0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787830965.129716:0:13760:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220380c780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:13760:1874676443867520:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787830965.129734:0:13760:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787830965.129740:0:13760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787830965.129743:0:13760:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787830965.129749:0:13760:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d232f730000 00000020:00000080:2.0:1787830965.129751:0:13760:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787830965.129787:0:13760:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787830965.129927:0:13760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787830965.129930:0:13760:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787830965.129933:0:13760:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787830965.129937:0:13760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787830965.129938:0:13760:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1787830965.129942:0:13760:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d232f730000 00000020:00000080:2.0:1787830965.129944:0:13760:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787830965.131085:0:13760:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d232f795e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:13760:1874676443867648:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787830965.131168:0:13760:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830965.131194:0:13760:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d23063bbc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787830965.131716:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443867648 00000100:00100000:1.0:1787830965.131734:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443867648 00000100:00100000:1.0:1787830965.131779:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:1.0:1787830965.131786:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a687c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+23:13760:x1874676443867648:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787830965.131906:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a687c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+23:13760:x1874676443867648:12345-0@lo:502:llog_process_th.0 Request processed in 120us (738us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830965.131914:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:1.0:1787830965.131967:0:13760:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d232f795e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:13760:1874676443867648:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787830965.131995:0:13760:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787830965.132002:0:13760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787830965.132004:0:13760:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1787830965.132008:0:13760:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1787830965.132142:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1787830965.132164:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787830965.132180:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d22039c0000/0x95459fb9d1d28b87 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d28b8e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830965.132189:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8d22039c0000/0x95459fb9d1d28b87 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d28b8e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787830965.132198:0:6487:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787830965.132201:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d2303f2e000 from 7 10000000:01000000:1.0:1787830965.132204:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787830965.132228:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233be94000/0x95459fb9d1d28b95 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830965.132235:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8d233be94000/0x95459fb9d1d28b95 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830965.132244:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8d233be94000/0x95459fb9d1d28b95 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830965.132258:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d232f795e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443867776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787830965.132290:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830965.132309:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d23063bbc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787830965.132323:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443867776 00000100:00100000:1.0:1787830965.132327:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443867776 00000100:00100000:1.0:1787830965.132348:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:1.0:1787830965.132353:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a684450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+23:6487:x1874676443867776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787830965.132361:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787830965.132373:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d233be95400/0x95459fb9d1d28b9c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d28b95 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830965.132392:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d233be95400/0x95459fb9d1d28b9c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d28b95 expref: 24 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830965.132408:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d233be95400/0x95459fb9d1d28b9c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d28b95 expref: 24 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830965.132416:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233be95400, rc 0) 00000100:00100000:1.0:1787830965.132443:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a684450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+24:6487:x1874676443867776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 90us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830965.132448:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:1.0:1787830965.132475:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d232f795e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443867776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787830965.132486:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8d233be94000/0x95459fb9d1d28b95 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d28b9c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830965.132493:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8d233be94000/0x95459fb9d1d28b95 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d28b9c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830965.132543:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d232f795e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443867904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787830965.132567:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830965.132580:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d23063bbc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787830965.132590:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443867904 00000100:00100000:1.0:1787830965.132593:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443867904 00000100:00100000:1.0:1787830965.132612:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:1.0:1787830965.132618:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a684850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+24:6487:x1874676443867904:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787830965.132730:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a684850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+24:6487:x1874676443867904:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 112us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830965.132736:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:1.0:1787830965.132765:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d232f795e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443867904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787830965.132799:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d232f795e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443868032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787830965.132831:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830965.132844:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d23063bbc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787830965.132854:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443868032 00000100:00100000:1.0:1787830965.132857:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443868032 00000100:00100000:1.0:1787830965.132876:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:1.0:1787830965.132882:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a685c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+24:6487:x1874676443868032:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787830965.132947:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a685c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+24:6487:x1874676443868032:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 64us (114us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830965.132953:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:1.0:1787830965.132991:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d232f795e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a45944b-32e3-4193-a2a5-46f84222bc14:6487:1874676443868032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787830965.133192:0:13761:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d232f795e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:13761:1874676443868160:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787830965.133225:0:13761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830965.133243:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443868160 00000100:00100000:1.0:1787830965.133246:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443868160 00000100:00100000:1.0:1787830965.133266:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:1.0:1787830965.133272:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a686050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+24:13761:x1874676443868160:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787830965.133333:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a686050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+24:13761:x1874676443868160:12345-0@lo:502:llog_process_th.0 Request processed in 60us (107us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830965.133339:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:1.0:1787830965.133367:0:13761:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d23063bb9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787830965.133378:0:13761:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d232f795e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:13761:1874676443868160:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787830965.133397:0:13761:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787830965.133404:0:13761:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787830965.133412:0:13761:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787830965.133420:0:13761:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d2303f2e000 00000020:00000080:1.0:1787830965.133422:0:13761:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787830965.133465:0:13761:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787830965.133469:0:13761:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787830965.133470:0:13761:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787830965.133472:0:13761:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787830965.133475:0:13761:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787830965.133476:0:13761:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1787830965.133480:0:13761:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d2303f2e000 00000020:00000080:1.0:1787830965.133482:0:13761:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787830965.133512:0:13761:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d232f795e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:13761:1874676443868288:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787830965.133545:0:13761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830965.133563:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443868288 00000100:00100000:1.0:1787830965.133566:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443868288 00000100:00100000:1.0:1787830965.133588:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:1.0:1787830965.133594:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a685450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+24:13761:x1874676443868288:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787830965.133672:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a685450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+24:13761:x1874676443868288:12345-0@lo:502:llog_process_th.0 Request processed in 77us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830965.133678:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:1.0:1787830965.133707:0:13761:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2306613cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787830965.133719:0:13761:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d232f795e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a45944b-32e3-4193-a2a5-46f84222bc14:13761:1874676443868288:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787830965.133737:0:13761:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787830965.133741:0:13761:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787830965.133742:0:13761:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1787830965.133746:0:13761:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1787830965.133786:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1787830965.133806:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787830965.133812:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233be94000/0x95459fb9d1d28b95 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d28b9c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830965.133827:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8d233be94000/0x95459fb9d1d28b95 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d28b9c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787830965.135306:0:13758:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1787830965.149230:0:13763:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787830965.222814:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787830965.392383:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787830965.394486:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433312640 00000100:00100000:1.0:1787830965.394503:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433312640 00000100:00100000:1.0:1787830965.394583:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 341 00000100:00100000:1.0:1787830965.394594:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a684c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+11:6161:x1874676433312640:12345-192.168.203.31@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787830965.394610:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787830965.394657:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d233be94e00/0x95459fb9d1d28ba3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe558a92a99423d2f expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830965.394698:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d233be94e00/0x95459fb9d1d28ba3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423d2f expref: 12 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830965.394711:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d233be94e00/0x95459fb9d1d28ba3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423d2f expref: 12 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830965.394721:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233be94e00, rc 0) 00000100:00100000:1.0:1787830965.394796:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a684c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+12:6161:x1874676433312640:12345-192.168.203.31@tcp:101:ll_cfg_requeue.0 Request processed in 204us (2487us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830965.394803:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 341 00000100:00100000:0.0:1787830965.397310:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787830965.397433:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433312768 00000100:00100000:1.0:1787830965.397442:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433312768 00000100:00100000:1.0:1787830965.397563:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 342 00000100:00100000:1.0:1787830965.397574:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a686c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+12:6161:x1874676433312768:12345-192.168.203.31@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787830965.397745:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a686c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+12:6161:x1874676433312768:12345-192.168.203.31@tcp:501:ll_cfg_requeue.0 Request processed in 173us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830965.397766:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 342 00000100:00100000:3.0:1787830965.399782:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787830965.399982:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433312896 00000100:00100000:1.0:1787830965.399991:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433312896 00000100:00100000:1.0:1787830965.400059:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 343 00000100:00100000:1.0:1787830965.400074:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a687450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+12:6161:x1874676433312896:12345-192.168.203.31@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787830965.400287:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a687450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+12:6161:x1874676433312896:12345-192.168.203.31@tcp:503:ll_cfg_requeue.0 Request processed in 214us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830965.400294:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 343 00000100:00100000:0.0:1787830965.406984:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787830965.407690:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433313024 00000100:00100000:1.0:1787830965.407701:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433313024 00000100:00100000:1.0:1787830965.407762:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 344 00000100:00100000:1.0:1787830965.407773:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a685850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+12:10759:x1874676433313024:12345-192.168.203.31@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787830965.407918:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a685850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+12:10759:x1874676433313024:12345-192.168.203.31@tcp:502:llog_process_th.0 Request processed in 146us (944us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830965.407926:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 344 00000100:00100000:0.0:1787830965.416122:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787830965.416230:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433313152 00000100:00100000:2.0:1787830965.416240:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433313152 00000100:00100000:2.0:1787830965.416298:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 345 00000100:00100000:2.0:1787830965.416308:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a685050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+12:10759:x1874676433313152:12345-192.168.203.31@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787830965.416460:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a685050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+12:10759:x1874676433313152:12345-192.168.203.31@tcp:502:llog_process_th.0 Request processed in 153us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830965.416476:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 345 00000100:00100000:3.0:1787830965.422807:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787830965.423112:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433313280 00000100:00100000:1.0:1787830965.423123:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433313280 00000100:00100000:1.0:1787830965.423179:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 346 00000100:00100000:1.0:1787830965.423189:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a684050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+12:6161:x1874676433313280:12345-192.168.203.31@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787830965.423207:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787830965.423224:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d233be94400/0x95459fb9d1d28baa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xe558a92a99423d36 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830965.423251:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d233be94400/0x95459fb9d1d28baa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423d36 expref: 13 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830965.423280:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d233be94400/0x95459fb9d1d28baa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423d36 expref: 13 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830965.423289:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233be94400, rc 0) 00000100:00100000:1.0:1787830965.423354:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a684050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+13:6161:x1874676433313280:12345-192.168.203.31@tcp:101:ll_cfg_requeue.0 Request processed in 167us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830965.423360:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 346 00000100:00100000:0.0:1787830965.426857:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787830965.427149:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433313408 00000100:00100000:1.0:1787830965.427160:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433313408 00000100:00100000:1.0:1787830965.427269:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 347 00000100:00100000:1.0:1787830965.427279:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a681050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+13:6161:x1874676433313408:12345-192.168.203.31@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787830965.427426:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a681050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+13:6161:x1874676433313408:12345-192.168.203.31@tcp:501:ll_cfg_requeue.0 Request processed in 148us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830965.427434:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 347 00000100:00100000:0.0:1787830965.436206:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787830965.436383:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433313536 00000100:00100000:2.0:1787830965.436391:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433313536 00000100:00100000:2.0:1787830965.436453:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 348 00000100:00100000:2.0:1787830965.436462:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a680050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+13:6161:x1874676433313536:12345-192.168.203.31@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787830965.436822:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a680050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+13:6161:x1874676433313536:12345-192.168.203.31@tcp:503:ll_cfg_requeue.0 Request processed in 360us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830965.436830:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 348 00000100:00100000:3.0:1787830965.446937:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787830965.447312:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433313664 00000100:00100000:1.0:1787830965.447322:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433313664 00000100:00100000:1.0:1787830965.447383:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 349 00000100:00100000:1.0:1787830965.447393:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a682850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+13:10762:x1874676433313664:12345-192.168.203.31@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787830965.447878:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a682850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+13:10762:x1874676433313664:12345-192.168.203.31@tcp:502:llog_process_th.0 Request processed in 485us (950us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830965.447888:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 349 00000100:00100000:0.0:1787830965.463196:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787830965.463346:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433313792 00000100:00100000:1.0:1787830965.463355:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433313792 00000100:00100000:1.0:1787830965.463418:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 350 00000100:00100000:1.0:1787830965.463429:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a683050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+13:10762:x1874676433313792:12345-192.168.203.31@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787830965.463596:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a683050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+13:10762:x1874676433313792:12345-192.168.203.31@tcp:502:llog_process_th.0 Request processed in 168us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830965.463605:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 350 00000100:00100000:0.0:1787830965.990990:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203bb2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443868416:0@lo:13:osp-pre-1-1.0 00000004:00080000:1.0:1787830965.991177:0:10068:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 256991551141ns, next at 257991547187ns, rc = 0 00000100:00100000:0.0:1787830965.991182:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830965.991202:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22039b9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443868672:0@lo:400:kworker.0 00000100:00100000:1.0:1787830965.991219:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22039b9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3620:1874676443868544:0@lo:400:kworker.0 00000100:00100000:0.0:1787830965.991249:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22039b83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443868928:0@lo:400:kworker.0 00000100:00100000:2.0:1787830965.991290:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22039bb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3622:1874676443868800:0@lo:400:kworker.0 00000100:00100000:3.0:1787830965.991341:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830965.991367:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830965.991370:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203affc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3621:1874676443869184:0@lo:400:kworker.0 00000100:00100000:1.0:1787830965.991397:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22039b8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3620:1874676443869056:0@lo:400:kworker.0 00000100:00100000:3.0:1787830965.991406:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830965.991436:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830965.991441:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233448a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3621:1874676443869696:0@lo:400:kworker.0 00000100:00100000:1.0:1787830965.991459:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233448b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1874676443869568:0@lo:400:kworker.0 00000100:00100000:3.0:1787830965.991472:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830965.991492:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830965.991511:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443868544 00000100:00100000:1.0:1787830965.991517:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d23344892c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1874676443870080:0@lo:400:kworker.0 00000100:00100000:3.0:1787830965.991519:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443868544 00000100:00100000:2.0:1787830965.991551:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830965.991557:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830965.991559:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443869184 00000100:00100000:3.0:1787830965.991569:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443869184 00000100:00100000:3.0:1787830965.991595:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443869056 00000100:00100000:3.0:1787830965.991598:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443869056 00000100:00100000:3.0:1787830965.991609:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443869696 00000100:00100000:3.0:1787830965.991653:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443869696 00000100:00100000:3.0:1787830965.991673:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443868800 00000100:00100000:3.0:1787830965.991677:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443868800 00000100:00100000:2.0:1787830965.991678:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203afcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676443869312:0@lo:400:kworker.0 00000100:00100000:3.0:1787830965.991699:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1787830965.991709:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d232f7952c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1874676443868544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830965.991714:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1787830965.991717:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830965.991731:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2334488f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1874676443869184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787830965.991746:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233448ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3622:1874676443869824:0@lo:400:kworker.0 00000100:00100000:3.0:1787830965.991779:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d232f7952c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1874676443868544:12345-0@lo:400:kworker.0 Request processed in 71us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830965.991786:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830965.991796:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1787830965.991797:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2334488f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1874676443869184:12345-0@lo:400:kworker.0 Request processed in 69us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830965.991809:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787830965.991818:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443869824 00000100:00100000:3.0:1787830965.991823:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443869824 00000100:00100000:2.0:1787830965.991826:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443868672 00000100:00100000:1.0:1787830965.991831:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787830965.991833:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443868672 00000100:00100000:1.0:1787830965.991842:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220395e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1874676443869056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787830965.991849:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1787830965.991858:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233448b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1874676443869696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787830965.991872:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787830965.991879:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220395e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1874676443869056:12345-0@lo:400:kworker.0 Request processed in 40us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830965.991884:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2321f2d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443868672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830965.991892:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787830965.991898:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233448b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1874676443869696:12345-0@lo:400:kworker.0 Request processed in 41us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830965.991906:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787830965.991912:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787830965.991923:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220380c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1874676443868800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787830965.991926:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787830965.991938:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220380cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1874676443869824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787830965.991938:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2321f2d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443868672:12345-0@lo:400:kworker.0 Request processed in 55us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830965.991951:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787830965.991982:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220380c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1874676443868800:12345-0@lo:400:kworker.0 Request processed in 62us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830965.991994:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1787830965.991995:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220380cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1874676443869824:12345-0@lo:400:kworker.0 Request processed in 58us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830965.992004:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787830965.992034:0:8631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443869568 00000100:00100000:3.0:1787830965.992039:0:8631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443869568 00000100:00100000:1.0:1787830965.992061:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22039b9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443868672:0@lo:400:kworker.0 00000100:00100000:3.0:1787830965.992073:0:8631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443870080 00000100:00100000:3.0:1787830965.992078:0:8631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443870080 00010000:00080000:1.0:1787830965.992083:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2203affc00 x1874676443869184/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830981 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787830965.992107:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203affc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3621:1874676443869184:0@lo:400:kworker.0 00000100:00100000:3.0:1787830965.992112:0:8631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443869312 00000100:00100000:3.0:1787830965.992122:0:8631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443869312 00000100:00100000:1.0:1787830965.992128:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233448a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3621:1874676443869696:0@lo:400:kworker.0 00000100:00100000:3.0:1787830965.992150:0:8631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787830965.992160:0:8631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220395ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3620:x1874676443869568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830965.992181:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22039b9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3620:1874676443868544:0@lo:400:kworker.0 00000100:00100000:1.0:1787830965.992200:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22039b8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3620:1874676443869056:0@lo:400:kworker.0 00000100:00100000:3.0:1787830965.992207:0:8631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220395ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3620:x1874676443869568:12345-0@lo:400:kworker.0 Request processed in 48us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830965.992217:0:8631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:1.0:1787830965.992217:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d233448b840 x1874676443869568/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787830981 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787830965.992229:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233448b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1874676443869568:0@lo:400:kworker.0 00000100:00100000:3.0:1787830965.992241:0:8631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787830965.992251:0:8631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220395cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3620:x1874676443870080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787830965.992282:0:8631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220395cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3620:x1874676443870080:12345-0@lo:400:kworker.0 Request processed in 34us (728us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830965.992287:0:8631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787830965.992300:0:8631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787830965.992305:0:8631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220380f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676443869312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787830965.992325:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22039bb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3622:1874676443868800:0@lo:400:kworker.0 00000100:00100000:3.0:1787830965.992333:0:8631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220380f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676443869312:12345-0@lo:400:kworker.0 Request processed in 27us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830965.992338:0:8631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787830965.992373:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443868416 00000100:00100000:3.0:1787830965.992377:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443868416 00000100:00100000:3.0:1787830965.992400:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787830965.992406:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203bb0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443868416:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787830965.992426:0:8409:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787830965.992456:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203bb0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443868416:12345-0@lo:13:osp-pre-1-1.0 Request processed in 51us (1278us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830965.992462:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:3.0:1787830965.992488:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787830965.992492:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787830965.992494:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787830965.992502:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1787830965.992739:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2203afcf00 x1874676443869312/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787830981 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787830965.992748:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203afcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676443869312:0@lo:400:kworker.0 00010000:00080000:2.0:1787830965.992758:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d233448ad00 x1874676443869824/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830981 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787830965.992767:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233448ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3622:1874676443869824:0@lo:400:kworker.0 00010000:00080000:1.0:1787830965.993323:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d23344892c0 x1874676443870080/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787830981 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787830965.993333:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d23344892c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1874676443870080:0@lo:400:kworker.0 00000100:00100000:0.0:1787830965.993843:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830965.993952:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d232f795e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443869440:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787830965.993990:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830965.994018:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2334489680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443869952:0@lo:400:kworker.0 00000100:00100000:0.0:1787830965.994040:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1787830965.994079:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2203bb2940 x1874676443868416/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787830981 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787830965.994182:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203bb2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443868416:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787830965.994244:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443869952 00000100:00100000:1.0:1787830965.994250:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443869952 00000100:00100000:1.0:1787830965.994306:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787830965.994315:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203bb03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443869952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787830965.994345:0:11489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443869440 00000100:00100000:3.0:1787830965.994351:0:11489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443869440 00000100:00100000:1.0:1787830965.994364:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203bb03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443869952:12345-0@lo:400:kworker.0 Request processed in 50us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830965.994380:0:11489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787830965.994388:0:11489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203bb3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676443869440:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787830965.994391:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00002000:00000024:3.0:1787830965.994503:0:11489:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00010000:00080000:0.0:1787830965.994542:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2334489680 x1874676443869952/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787830981 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787830965.994547:0:11489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203bb3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676443869440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 157us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830965.994562:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2334489680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443869952:0@lo:400:kworker.0 00000100:00100000:3.0:1787830965.994563:0:11489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:0.0:1787830965.994594:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d232f795e00 x1874676443869440/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787830981 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787830965.994607:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d232f795e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443869440:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787830965.995308:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443868928 00000100:00100000:2.0:1787830965.995315:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443868928 00000100:00100000:2.0:1787830965.995360:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787830965.995367:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203bb2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676443868928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787830965.995434:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203bb2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676443868928:12345-0@lo:400:kworker.0 Request processed in 68us (1593us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830965.995441:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787830965.995574:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22039b83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443868928:0@lo:400:kworker.0 00000001:00080000:2.0:1787830965.997960:0:6469:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00080000:2.0:1787830965.997986:0:6469:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:0.0:1787830965.998177:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787830965.998199:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203bb2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676443870208:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787830965.998264:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830965.998359:0:8631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443870208 00000100:00100000:1.0:1787830965.998372:0:8631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443870208 00010000:00010000:3.0:1787830965.998406:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1e00/0x95459fb9d1d28ab5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x4eed53cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830965.998419:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1e00/0x95459fb9d1d28ab5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x4eed53cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830965.998428:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1e00/0x95459fb9d1d28ab5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x4eed53cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830965.998434:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22039c1e00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:3.0:1787830965.998438:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1e00/0x95459fb9d1d28ab5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x4eed53cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830965.998446:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1e00/0x95459fb9d1d28ab5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x4eed53cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830965.998462:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x4eed53cd (ffff8d2203615e00) 00010000:00010000:3.0:1787830965.998465:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787830965.998471:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1e00/0x95459fb9d1d28ab5 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x4eed53cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830965.998477:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1e00/0x95459fb9d1d28ab5 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x4eed53cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830965.998507:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d28aca lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830965.998513:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d28aca lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830965.998519:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d28aca lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830965.998524:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2307c77a00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:3.0:1787830965.998527:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d28aca lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830965.998533:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d28aca lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830965.998540:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8d2318594f00) 00010000:00010000:3.0:1787830965.998543:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787830965.998546:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d28aca lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830965.998551:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d28aca lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830965.998567:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1c00/0x95459fb9d1d28b33 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x4eed53cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830965.998572:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1c00/0x95459fb9d1d28b33 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x4eed53cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830965.998578:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1c00/0x95459fb9d1d28b33 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x4eed53cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830965.998588:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22039c1c00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:3.0:1787830965.998593:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1c00/0x95459fb9d1d28b33 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x4eed53cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830965.998599:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1c00/0x95459fb9d1d28b33 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x4eed53cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830965.998609:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x4eed53cd (ffff8d2203615e00) 00010000:00010000:3.0:1787830965.998611:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787830965.998614:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1c00/0x95459fb9d1d28b33 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x4eed53cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830965.998620:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1c00/0x95459fb9d1d28b33 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x4eed53cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830965.998671:0:8631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787830965.998685:0:8631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203bb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3622:x1874676443870208:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1787830965.998724:0:8631:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00002000:00010000:1.0:1787830965.998769:0:8631:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x6a9022b0, atime: 0x6a9022b0, ctime: 0x6a9022b0, blocks: 0x0 00010000:00010000:1.0:1787830965.998778:0:8631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084b8f1cf/0x95459fb9d1d28bb1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830965.998804:0:8631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=256s v=(0 0) 00010000:00010000:1.0:1787830965.998809:0:8631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787830965.998818:0:8631:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000084b8f1cf/0x95459fb9d1d28bb1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830965.998841:0:8631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000084b8f1cf/0x95459fb9d1d28bb1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830965.998853:0:8631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084b8f1cf/0x95459fb9d1d28bb1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830965.998861:0:8631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000084b8f1cf/0x95459fb9d1d28bb1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830965.998884:0:8631:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787830965.999176:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0600/0x95459fb9d1d28b4f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830965.999185:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0600/0x95459fb9d1d28b4f lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830965.999190:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0600/0x95459fb9d1d28b4f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830965.999195:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22039c0600 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:3.0:1787830965.999198:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0600/0x95459fb9d1d28b4f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830965.999204:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0600/0x95459fb9d1d28b4f lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830965.999225:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8d2203615a00) 00010000:00010000:3.0:1787830965.999227:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787830965.999230:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0600/0x95459fb9d1d28b4f lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830965.999236:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0600/0x95459fb9d1d28b4f lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830965.999274:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787830965.999280:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000084b8f1cf/0x95459fb9d1d28bb1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830965.999295:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233be95e00 already unused, calling callback (ffffffffc0ed6420) 00000100:00100000:1.0:1787830966.000764:0:8631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203bb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3622:x1874676443870208:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2071us (2488us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1787830966.000801:0:8631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000004:00080000:0.0:1787830966.000849:0:3622:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d2203bb2940/2, rc 0, transno 4294967301 00000100:00100000:0.0:1787830966.000863:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203bb2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676443870208:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1787830966.001451:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000084b8f1cf/0x95459fb9d1d28bb1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830966.001468:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000084b8f1cf/0x95459fb9d1d28bb1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830966.001495:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000084b8f1cf/0x95459fb9d1d28bb1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830966.001503:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000084b8f1cf/0x95459fb9d1d28bb1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830966.001528:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787830966.001530:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787830966.001543:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787830966.184535:0:13763:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1787830966.184760:0:13758:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787830966.248386:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787830967.270986:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787830967.376568:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787830967.376729:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787830967.376749:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787830967.376807:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433314304 00000100:00100000:2.0:1787830967.376816:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433314304 00000100:00080000:3.0:1787830967.376873:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787830967.376881:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 57 00000100:00100000:2.0:1787830967.376892:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203bb0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:2394:x1874676433314304:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1787830967.376970:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203bb0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:2394:x1874676433314304:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 81us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830967.376978:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 57 00000100:00100000:1.0:1787830967.377163:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433314048 00000100:00100000:1.0:1787830967.377168:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433314048 00000100:00100000:1.0:1787830967.377205:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433314560 00000100:00100000:1.0:1787830967.377208:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433314560 00000100:00100000:1.0:1787830967.377228:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 153 00000100:00100000:1.0:1787830967.377236:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203bb21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:2394:x1874676433314048:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1787830967.377289:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 154 00000100:00100000:2.0:1787830967.377308:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203bb12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c901c2b2-479b-44dc-8fa8-34fbacf02f07+5:2394:x1874676433314560:12345-192.168.203.31@tcp:400:kworker.0 00000100:00080000:3.0:1787830967.377333:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787830967.377337:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787830967.377363:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787830967.377395:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433313920 00000100:00100000:3.0:1787830967.377400:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433313920 00000100:00100000:0.0:1787830967.377408:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787830967.377435:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 351 00000100:00100000:3.0:1787830967.377446:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a682450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+13:2394:x1874676433313920:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1787830967.377455:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787830967.377490:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a682450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+13:2394:x1874676433313920:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 46us (128us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830967.377498:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 351 00000100:00100000:3.0:1787830967.377542:0:8620:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1787830967.377550:0:8620:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:3.0:1787830967.377663:0:6491:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1787830967.377733:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433314176 00000100:00100000:3.0:1787830967.377737:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433314176 00000100:00100000:3.0:1787830967.377762:0:6491:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1787830967.377767:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433314432 00000100:00100000:3.0:1787830967.377770:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433314432 00000100:00080000:0.0:1787830967.377773:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787830967.377778:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787830967.377787:0:6491:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1787830967.377797:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 155 00000100:00100000:1.0:1787830967.377876:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203bb21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:2394:x1874676433314048:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 639us (1316us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830967.377924:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203bb12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c901c2b2-479b-44dc-8fa8-34fbacf02f07+5:2394:x1874676433314560:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 618us (1172us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830967.378790:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203997840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:2394:x1874676433314176:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1787830967.378797:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 153 00000100:00100000:1.0:1787830967.378821:0:6492:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1787830967.378832:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 156 00000100:00100000:1.0:1787830967.378843:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22039961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c901c2b2-479b-44dc-8fa8-34fbacf02f07+5:2394:x1874676433314432:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1787830967.378863:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203997840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:2394:x1874676433314176:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 80us (1454us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830967.378878:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22039961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c901c2b2-479b-44dc-8fa8-34fbacf02f07+5:2394:x1874676433314432:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 37us (1426us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830967.379194:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 155 00000100:00100000:2.0:1787830967.379203:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 154 00000100:00100000:1.0:1787830967.380588:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 156 00010000:00010000:3.0:1787830968.295708:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787830969.062891:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a9e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676443870336:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787830969.062969:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830969.063750:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443870336 00000100:00100000:3.0:1787830969.063759:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443870336 00000100:00100000:3.0:1787830969.063838:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787830969.063849:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220380e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676443870336:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787830969.063877:0:8410:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1787830969.063920:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787830969.063944:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220380e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676443870336:12345-0@lo:13:osp-pre-0-1.0 Request processed in 97us (974us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830969.063951:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00080000:2.0:1787830969.063994:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2203a9e580 x1874676443870336/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787830985 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787830969.064036:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a9e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676443870336:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787830969.064542:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a9c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443870464:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787830969.064586:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830969.064860:0:11489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443870464 00000100:00100000:3.0:1787830969.064866:0:11489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443870464 00000100:00080000:1.0:1787830969.064921:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787830969.064926:0:11489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787830969.064936:0:11489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220380c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676443870464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787830969.064951:0:11489:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787830969.065000:0:11489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220380c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676443870464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830969.065007:0:11489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:2.0:1787830969.065044:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2203a9c3c0 x1874676443870464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787830985 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787830969.065058:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a9c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443870464:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787830969.318920:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787830969.575003:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220380f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1874676443870592:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787830969.575098:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830969.575234:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443870592 00000100:00100000:3.0:1787830969.575241:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443870592 00000100:00100000:2.0:1787830969.575584:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787830969.575597:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220395c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1874676443870592:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787830969.575660:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787830969.575721:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220395c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1874676443870592:12345-0@lo:41:osp-pre-1-0.0 Request processed in 128us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830969.575727:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787830969.575831:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220380f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1874676443870592:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787830970.087449:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787830970.087473:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220395f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676443870720:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787830970.087547:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830970.087652:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443870720 00000100:00100000:3.0:1787830970.087661:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443870720 00000100:00100000:3.0:1787830970.087713:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787830970.087722:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676443870720:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787830970.087759:0:7448:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787830970.087880:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676443870720:12345-0@lo:41:osp-pre-0-1.0 Request processed in 159us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830970.087888:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787830970.088816:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220395f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676443870720:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787830970.343718:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787830971.111079:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a9ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676443870848:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787830971.111162:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830971.111668:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443870848 00000100:00100000:0.0:1787830971.111686:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443870848 00000100:00100000:0.0:1787830971.111754:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787830971.111777:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233c0ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676443870848:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787830971.111806:0:8410:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787830971.111858:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233c0ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676443870848:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (696us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830971.111867:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787830971.112198:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a9ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676443870848:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787830971.112450:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220380f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3622:1874676443871360:0@lo:400:kworker.0 00000100:00100000:2.0:1787830971.112484:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830971.112502:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2314ed6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676443871872:0@lo:400:kworker.0 00000100:00100000:2.0:1787830971.112521:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830971.112543:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2309cfa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676443872384:0@lo:400:kworker.0 00000100:00100000:2.0:1787830971.112563:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830971.112594:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1787830971.112600:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220380d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676443871232:0@lo:400:kworker.0 00000100:00100000:2.0:1787830971.112658:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830971.112683:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220380f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3622:1874676443871744:0@lo:400:kworker.0 00000100:00100000:2.0:1787830971.112704:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830971.112723:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2309cfb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3622:1874676443872256:0@lo:400:kworker.0 00000100:00100000:2.0:1787830971.112741:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830971.112767:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443871872 00000100:00100000:2.0:1787830971.112772:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443871872 00000100:00100000:2.0:1787830971.112799:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443872384 00000100:00100000:2.0:1787830971.112802:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443872384 00000100:00100000:2.0:1787830971.112823:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787830971.112830:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2309cf8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676443871872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787830971.112870:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2309cf8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676443871872:12345-0@lo:400:kworker.0 Request processed in 41us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830971.112876:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787830971.112891:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787830971.112897:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2309cf8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3622:x1874676443872384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787830971.112922:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2309cf8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3622:x1874676443872384:12345-0@lo:400:kworker.0 Request processed in 26us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830971.112927:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787830971.112943:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443871232 00000100:00100000:2.0:1787830971.112946:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443871232 00000100:00100000:2.0:1787830971.112969:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787830971.112975:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2309cf9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676443871232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787830971.113005:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2309cf9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676443871232:12345-0@lo:400:kworker.0 Request processed in 30us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830971.113010:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787830971.113033:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443871360 00000100:00100000:2.0:1787830971.113036:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443871360 00000100:00080000:3.0:1787830971.114086:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787830971.114093:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787830971.114146:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220380cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a45944b-32e3-4193-a2a5-46f84222bc14:3619:1874676443870976:0@lo:400:kworker.0 00000100:00100000:0.0:1787830971.114195:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830971.114230:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220380e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443871488:0@lo:400:kworker.0 00000100:00100000:0.0:1787830971.114254:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830971.114271:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2314ed4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443872000:0@lo:400:kworker.0 00000100:00100000:0.0:1787830971.114289:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830971.114310:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1787830971.114316:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220380e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874676443871104:0@lo:400:kworker.0 00000100:00100000:0.0:1787830971.114337:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830971.114851:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787830971.114861:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220395de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1874676443872512:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787830971.114894:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830971.114936:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443872000 00000100:00100000:1.0:1787830971.114952:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443872000 00000100:00100000:1.0:1787830971.114997:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787830971.115005:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676443872000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830971.115048:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676443872000:12345-0@lo:400:kworker.0 Request processed in 44us (757us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830971.115563:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:1.0:1787830971.115602:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787830971.116863:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220380c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3619:1874676443871616:0@lo:400:kworker.0 00000100:00100000:0.0:1787830971.116915:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830971.116958:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443871744 00000100:00100000:2.0:1787830971.116965:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443871744 00000100:00100000:2.0:1787830971.117013:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443872256 00000100:00100000:2.0:1787830971.117017:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443872256 00000100:00100000:2.0:1787830971.117032:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443871104 00000100:00100000:2.0:1787830971.117035:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443871104 00000100:00100000:2.0:1787830971.117064:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787830971.117073:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2309cf83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1874676443871360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787830971.117124:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2309cf83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1874676443871360:12345-0@lo:400:kworker.0 Request processed in 53us (4639us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830971.117131:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787830971.117147:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787830971.117153:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d232f795680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1874676443871744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787830971.117180:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d232f795680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1874676443871744:12345-0@lo:400:kworker.0 Request processed in 28us (4476us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830971.117185:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787830971.117203:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787830971.117209:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d232f796940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1874676443872256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830971.117233:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1787830971.117240:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d232f796940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1874676443872256:12345-0@lo:400:kworker.0 Request processed in 31us (4496us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830971.117248:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00080000:1.0:1787830971.117249:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787830971.117265:0:13771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a9e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874676443871104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787830971.117277:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443870976 00000100:00100000:2.0:1787830971.117281:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443870976 00000100:00100000:2.0:1787830971.117311:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:2.0:1787830971.117319:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a683850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+24:3619:x1874676443870976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830971.117325:0:13771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a9e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874676443871104:12345-0@lo:400:kworker.0 Request processed in 81us (2983us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830971.117334:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1787830971.117362:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a683850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+24:3619:x1874676443870976:12345-0@lo:400:kworker.0 Request processed in 44us (3166us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830971.117382:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:1.0:1787830971.117406:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443871488 00000100:00100000:1.0:1787830971.117412:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443871488 00000100:00100000:2.0:1787830971.117436:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787830971.117445:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a9ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676443871488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830971.117475:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220380d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676443871232:0@lo:400:kworker.0 00000100:00100000:2.0:1787830971.117484:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a9ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676443871488:12345-0@lo:400:kworker.0 Request processed in 39us (3227us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830971.117492:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00010000:00080000:1.0:1787830971.117496:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d220380f0c0 x1874676443871744/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830987 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787830971.117509:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220380f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3622:1874676443871744:0@lo:400:kworker.0 00010000:00080000:1.0:1787830971.117524:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2309cfb0c0 x1874676443872256/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830987 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787830971.117526:0:11489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443872512 00000100:00100000:2.0:1787830971.117532:0:11489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443872512 00000100:00100000:1.0:1787830971.117540:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2309cfb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3622:1874676443872256:0@lo:400:kworker.0 00000100:00100000:1.0:1787830971.117556:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220380f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3622:1874676443871360:0@lo:400:kworker.0 00000100:00100000:2.0:1787830971.117564:0:11489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00010000:00080000:1.0:1787830971.117572:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2314ed6580 x1874676443871872/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787830987 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787830971.117574:0:11489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220395f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3620:x1874676443872512:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787830971.117600:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2314ed6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676443871872:0@lo:400:kworker.0 00000100:00100000:1.0:1787830971.117616:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2309cfa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676443872384:0@lo:400:kworker.0 00002000:00000024:2.0:1787830971.118273:0:11489:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787830971.118319:0:11489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220395f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3620:x1874676443872512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 747us (3424us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830971.118327:0:11489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787830971.118366:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220395de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1874676443872512:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787830971.119505:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2314ed5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3619:1874676443872128:0@lo:400:kworker.0 00000100:00100000:0.0:1787830971.119549:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830971.119838:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220380cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a45944b-32e3-4193-a2a5-46f84222bc14:3619:1874676443870976:0@lo:400:kworker.0 00000100:00100000:0.0:1787830971.119854:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220380e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443871488:0@lo:400:kworker.0 00010000:00080000:0.0:1787830971.119868:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2314ed4780 x1874676443872000/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787830987 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787830971.119897:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2314ed4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443872000:0@lo:400:kworker.0 00000100:00100000:0.0:1787830971.119926:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220380e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874676443871104:0@lo:400:kworker.0 00000100:00100000:2.0:1787830971.119966:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443871616 00000100:00100000:2.0:1787830971.119973:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443871616 00000100:00100000:1.0:1787830971.120007:0:13771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443872128 00000100:00100000:1.0:1787830971.120012:0:13771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443872128 00000100:00080000:3.0:1787830971.121295:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787830971.121901:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1787830971.121917:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a9c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874676443871616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787830971.122013:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a9c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874676443871616:12345-0@lo:400:kworker.0 Request processed in 102us (5097us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830971.122019:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1787830971.122039:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1787830971.122046:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a9e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874676443872128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787830971.122088:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a9e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874676443872128:12345-0@lo:400:kworker.0 Request processed in 43us (2539us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830971.122106:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1787830971.122192:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220380c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3619:1874676443871616:0@lo:400:kworker.0 00000100:00100000:3.0:1787830971.122205:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2314ed5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3619:1874676443872128:0@lo:400:kworker.0 00010000:00010000:3.0:1787830971.368250:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787830972.136819:0:6469:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:2.0:1787830972.138590:0:9484:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00010000:00010000:3.0:1787830972.392647:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787830972.498356:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787830972.498404:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787830972.498498:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787830972.498549:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433314688 00000100:00100000:3.0:1787830972.498559:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433314688 00000100:00100000:0.0:1787830972.498570:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787830972.498666:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 353 00000100:00100000:3.0:1787830972.498677:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a683c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+13:2395:x1874676433314688:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1787830972.498753:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a683c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+13:2395:x1874676433314688:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 78us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830972.498761:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 353 00000100:00100000:1.0:1787830972.498776:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433314944 00000100:00100000:1.0:1787830972.498782:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433314944 00000100:00100000:1.0:1787830972.498833:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433315200 00000100:00100000:1.0:1787830972.498837:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433315200 00000100:00100000:1.0:1787830972.498862:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 163 00000100:00100000:1.0:1787830972.498872:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22039943c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:2395:x1874676433314944:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1787830972.498915:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22039943c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:2395:x1874676433314944:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 45us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830972.498923:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 163 00000100:00100000:1.0:1787830972.498943:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 164 00000100:00100000:1.0:1787830972.498950:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203995680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c901c2b2-479b-44dc-8fa8-34fbacf02f07+5:2395:x1874676433315200:12345-192.168.203.31@tcp:400:kworker.0 00000100:00080000:3.0:1787830972.498967:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787830972.498972:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787830972.498987:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203995680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c901c2b2-479b-44dc-8fa8-34fbacf02f07+5:2395:x1874676433315200:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 37us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830972.498995:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 164 00000100:00100000:0.0:1787830972.502035:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787830972.502154:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433314816 00000100:00100000:3.0:1787830972.502165:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433314816 00000100:00100000:3.0:1787830972.502226:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 165 00000100:00100000:3.0:1787830972.502236:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203996940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:2395:x1874676433314816:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1787830972.502309:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203996940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:2395:x1874676433314816:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 74us (3739us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830972.502317:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 165 00000100:00080000:3.0:1787830972.502340:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787830972.502873:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787830972.502957:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433315072 00000100:00100000:1.0:1787830972.502962:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433315072 00000100:00100000:1.0:1787830972.503019:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 61 00000100:00100000:1.0:1787830972.503027:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203997c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:2395:x1874676433315072:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1787830972.503087:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203997c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:2395:x1874676433315072:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 61us (1061us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830972.503105:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 61 00000100:00100000:2.0:1787830972.503271:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433315328 00000100:00100000:2.0:1787830972.503276:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433315328 00000100:00100000:2.0:1787830972.503315:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 166 00000100:00100000:2.0:1787830972.503322:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203bb0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c901c2b2-479b-44dc-8fa8-34fbacf02f07+5:2395:x1874676433315328:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1787830972.503356:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203bb0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c901c2b2-479b-44dc-8fa8-34fbacf02f07+5:2395:x1874676433315328:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 34us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830972.503363:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 166 00000100:00080000:0.0:1787830972.503715:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787830972.503720:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787830973.416403:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787830974.183132:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787830974.183144:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d232f795e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443872768:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787830974.183151:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233448a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443872640:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787830974.183228:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830974.183293:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830974.183336:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443872768 00000100:00100000:2.0:1787830974.183344:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443872768 00000100:00100000:3.0:1787830974.183353:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443872640 00000100:00100000:3.0:1787830974.183359:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443872640 00000100:00100000:2.0:1787830974.183399:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787830974.183408:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d232f794f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1874676443872768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787830974.183436:0:8410:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787830974.183479:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d232f794f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1874676443872768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830974.183486:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:0.0:1787830974.183792:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787830974.184112:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d232f795e00 x1874676443872768/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787830990 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787830974.184134:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d232f795e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443872768:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787830974.185742:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787830974.185764:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233448bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443872640:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787830974.185799:0:8409:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787830974.185883:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233448bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443872640:12345-0@lo:13:osp-pre-0-1.0 Request processed in 131us (2591us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830974.185891:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00080000:1.0:1787830974.185976:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d233448a1c0 x1874676443872640/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787830990 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787830974.185995:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233448a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443872640:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1787830974.438991:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787830974.695467:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220395f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676443872896:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787830974.695540:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830974.695617:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443872896 00000100:00100000:1.0:1787830974.695716:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443872896 00000100:00100000:1.0:1787830974.695827:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787830974.695839:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220395f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1874676443872896:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787830974.695874:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787830974.695922:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220395f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1874676443872896:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830974.695929:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787830974.695976:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220395f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676443872896:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787830975.207818:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220395f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443873024:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787830975.207896:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830975.207945:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443873024 00000100:00100000:2.0:1787830975.207953:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443873024 00000100:00100000:2.0:1787830975.208010:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787830975.208020:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2334488000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443873024:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787830975.208068:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787830975.208142:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2334488000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443873024:12345-0@lo:41:osp-pre-0-1.0 Request processed in 124us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830975.208165:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787830975.208258:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220395f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443873024:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787830975.463796:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787830976.231213:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2334488780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443873536:0@lo:400:kworker.0 00000100:00100000:3.0:1787830976.231295:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830976.231357:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d23344883c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3619:1874676443874048:0@lo:400:kworker.0 00000100:00100000:3.0:1787830976.231382:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830976.231407:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233448b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3619:1874676443874560:0@lo:400:kworker.0 00000100:00100000:3.0:1787830976.231428:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830976.231451:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1787830976.231457:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203bb3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443873152:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787830976.231479:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830976.231495:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233448a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874676443873664:0@lo:400:kworker.0 00000100:00100000:3.0:1787830976.231516:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830976.231539:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2334489e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a45944b-32e3-4193-a2a5-46f84222bc14:3621:1874676443873280:0@lo:400:kworker.0 00000100:00100000:3.0:1787830976.231550:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233448a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443874176:0@lo:400:kworker.0 00000100:00100000:1.0:1787830976.231584:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830976.231591:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830976.231621:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2334488b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443873792:0@lo:400:kworker.0 00000100:00100000:3.0:1787830976.231641:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233448ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443874688:0@lo:400:kworker.0 00000100:00100000:3.0:1787830976.231665:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830976.231685:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830976.231699:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443874048 00000100:00100000:3.0:1787830976.231707:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443874048 00000100:00100000:1.0:1787830976.231710:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2334489680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443874304:0@lo:400:kworker.0 00000100:00100000:1.0:1787830976.231746:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830976.231762:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443874560 00000100:00100000:3.0:1787830976.231767:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443874560 00000100:00100000:1.0:1787830976.231770:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233448a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443874816:0@lo:400:kworker.0 00000100:00100000:3.0:1787830976.231795:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443873664 00000100:00100000:1.0:1787830976.231795:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830976.231800:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443873664 00000100:00100000:1.0:1787830976.231818:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1787830976.231823:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1787830976.231826:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2334489a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3621:1874676443873408:0@lo:400:kworker.0 00000100:00100000:3.0:1787830976.231835:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220258f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874676443874048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830976.231852:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830976.231866:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233448b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3621:1874676443873920:0@lo:400:kworker.0 00000100:00100000:1.0:1787830976.231897:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830976.231909:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220258f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874676443874048:12345-0@lo:400:kworker.0 Request processed in 62us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830976.231910:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d23344892c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3621:1874676443874432:0@lo:400:kworker.0 00000100:00100000:3.0:1787830976.231924:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1787830976.231939:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830976.231943:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443873408 00000100:00100000:3.0:1787830976.231947:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443873408 00000100:00100000:1.0:1787830976.231954:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220395d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443874944:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787830976.231963:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443873920 00000100:00100000:3.0:1787830976.231967:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443873920 00000100:00100000:1.0:1787830976.231979:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830976.231984:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443874432 00000100:00100000:3.0:1787830976.231987:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443874432 00000100:00100000:3.0:1787830976.232007:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1787830976.232026:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220258c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874676443874560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830976.232030:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443873536 00000100:00100000:1.0:1787830976.232035:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443873536 00000100:00100000:3.0:1787830976.232063:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220258c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874676443874560:12345-0@lo:400:kworker.0 Request processed in 49us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830976.232069:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443873792 00000100:00100000:3.0:1787830976.232072:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1787830976.232074:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443873792 00000100:00100000:3.0:1787830976.232090:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1787830976.232098:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787830976.232099:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220258e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874676443873664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830976.232111:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220258c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443873536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787830976.232151:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220258e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874676443873664:12345-0@lo:400:kworker.0 Request processed in 54us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830976.232161:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1787830976.232161:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220258c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443873536:12345-0@lo:400:kworker.0 Request processed in 53us (865us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830976.232173:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787830976.232179:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1787830976.232187:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2314ed5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1874676443873408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830976.232192:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787830976.232201:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220395f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1874676443873792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787830976.232228:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2314ed5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1874676443873408:12345-0@lo:400:kworker.0 Request processed in 42us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830976.232235:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1787830976.232243:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220395f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1874676443873792:12345-0@lo:400:kworker.0 Request processed in 42us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830976.232251:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1787830976.232252:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787830976.232262:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2314ed4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1874676443873920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830976.232283:0:8631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443874176 00000100:00100000:1.0:1787830976.232288:0:8631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443874176 00000100:00100000:3.0:1787830976.232297:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2314ed4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1874676443873920:12345-0@lo:400:kworker.0 Request processed in 38us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830976.232304:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1787830976.232311:0:8631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443874688 00000100:00100000:1.0:1787830976.232315:0:8631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443874688 00000100:00100000:3.0:1787830976.232322:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1787830976.232331:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2314ed6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1874676443874432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830976.232332:0:8631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443874304 00000100:00100000:1.0:1787830976.232337:0:8631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443874304 00000100:00100000:3.0:1787830976.232362:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2314ed6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1874676443874432:12345-0@lo:400:kworker.0 Request processed in 34us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830976.232368:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1787830976.232391:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443873152 00000100:00100000:3.0:1787830976.232395:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443873152 00000100:00100000:3.0:1787830976.232415:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443874944 00000100:00100000:3.0:1787830976.232418:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443874944 00000100:00100000:3.0:1787830976.232432:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787830976.232438:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220258ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3619:x1874676443873152:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787830976.232458:0:8409:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787830976.232489:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220258ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3619:x1874676443873152:12345-0@lo:13:osp-pre-1-1.0 Request processed in 52us (1009us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830976.232502:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787830976.232513:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787830976.232519:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2309cfbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1874676443874944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787830976.232528:0:8409:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787830976.232552:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2309cfbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1874676443874944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 34us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830976.232558:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787830976.232601:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203bb3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443873152:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787830976.232612:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233448a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874676443873664:0@lo:400:kworker.0 00000100:00100000:3.0:1787830976.232622:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2334488780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443873536:0@lo:400:kworker.0 00010000:00080000:3.0:1787830976.232661:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d23344883c0 x1874676443874048/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830992 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787830976.232670:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d23344883c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3619:1874676443874048:0@lo:400:kworker.0 00010000:00080000:3.0:1787830976.232679:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d233448b840 x1874676443874560/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830992 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787830976.232687:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233448b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3619:1874676443874560:0@lo:400:kworker.0 00000100:00100000:3.0:1787830976.232732:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443874816 00000100:00100000:3.0:1787830976.232735:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443874816 00000100:00100000:3.0:1787830976.232753:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787830976.232760:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2336bfe1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443874176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787830976.232792:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2336bfe1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443874176:12345-0@lo:400:kworker.0 Request processed in 34us (1202us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830976.232806:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787830976.232818:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787830976.232824:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2336bfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443874688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787830976.232850:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2336bfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443874688:12345-0@lo:400:kworker.0 Request processed in 26us (1185us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830976.232855:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787830976.232865:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787830976.232870:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220395de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1874676443874816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787830976.232894:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220395de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1874676443874816:12345-0@lo:400:kworker.0 Request processed in 24us (1100us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830976.232900:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00080000:3.0:1787830976.232930:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d233448a1c0 x1874676443874176/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787830992 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787830976.232939:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233448a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443874176:0@lo:400:kworker.0 00000100:00100000:3.0:1787830976.232950:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233448ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443874688:0@lo:400:kworker.0 00000100:00100000:3.0:1787830976.232990:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2334489a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3621:1874676443873408:0@lo:400:kworker.0 00000100:00100000:3.0:1787830976.233000:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233448b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3621:1874676443873920:0@lo:400:kworker.0 00000100:00100000:3.0:1787830976.233009:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d23344892c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3621:1874676443874432:0@lo:400:kworker.0 00000100:00080000:0.0:1787830976.233327:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787830976.233343:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787830976.233346:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787830976.233349:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787830976.233565:0:8631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787830976.233573:0:8631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220395e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3621:x1874676443874304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787830976.233591:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443873280 00000100:00100000:2.0:1787830976.233598:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443873280 00000100:00100000:1.0:1787830976.233641:0:8631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220395e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3621:x1874676443874304:12345-0@lo:400:kworker.0 Request processed in 53us (1878us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830976.233649:0:8631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787830976.233653:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:2.0:1787830976.233662:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a680450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+24:3621:x1874676443873280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787830976.233712:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a680450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+24:3621:x1874676443873280:12345-0@lo:400:kworker.0 Request processed in 51us (2127us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830976.233718:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00080000:0.0:1787830976.233839:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787830976.234068:0:3621:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:3.0:1787830976.234074:0:3621:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d2203bb2940, transno 4294967301 00000100:00100000:3.0:1787830976.234142:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220395d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443874944:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787830976.234158:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2334489e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a45944b-32e3-4193-a2a5-46f84222bc14:3621:1874676443873280:0@lo:400:kworker.0 00000100:00100000:3.0:1787830976.234183:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2334488b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443873792:0@lo:400:kworker.0 00010000:00080000:3.0:1787830976.234197:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2334489680 x1874676443874304/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787830992 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787830976.234206:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2334489680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443874304:0@lo:400:kworker.0 00000100:00100000:3.0:1787830976.234216:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233448a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443874816:0@lo:400:kworker.0 00000040:00080000:0.0:1787830976.425396:0:13763:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1787830976.426088:0:13758:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787830976.487036:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787830977.511392:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787830977.618883:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787830977.618932:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787830977.618969:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787830977.619017:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787830977.619049:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433315584 00000100:00100000:2.0:1787830977.619072:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433315584 00000100:00100000:1.0:1787830977.619074:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433315840 00000100:00100000:1.0:1787830977.619079:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433315840 00000100:00100000:3.0:1787830977.619106:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433315456 00000100:00100000:3.0:1787830977.619113:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433315456 00000100:00100000:2.0:1787830977.619139:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433316096 00000100:00100000:1.0:1787830977.619144:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 66 00000100:00100000:2.0:1787830977.619145:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433316096 00000100:00100000:1.0:1787830977.619154:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203bb3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:2397:x1874676433315840:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1787830977.619160:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 355 00000100:00100000:3.0:1787830977.619173:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a680850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+13:2397:x1874676433315456:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1787830977.619179:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 173 00000100:00100000:2.0:1787830977.619191:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203bb2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:2397:x1874676433315584:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1787830977.619224:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203bb3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:2397:x1874676433315840:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 71us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830977.619231:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 66 00000100:00100000:3.0:1787830977.621571:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a680850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+13:2397:x1874676433315456:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 2389us (2539us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830977.621585:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 355 00000100:00100000:3.0:1787830977.621666:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 174 00000100:00100000:3.0:1787830977.621676:0:13771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220390f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c901c2b2-479b-44dc-8fa8-34fbacf02f07+5:2397:x1874676433316096:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1787830977.621725:0:13771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220390f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c901c2b2-479b-44dc-8fa8-34fbacf02f07+5:2397:x1874676433316096:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 53us (2757us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830977.621729:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 174 00000100:00080000:3.0:1787830977.621768:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787830977.621773:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787830977.621775:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787830977.622990:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203bb2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:2397:x1874676433315584:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 3794us (4111us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830977.623001:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 173 00000100:00100000:0.0:1787830977.623329:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787830977.623387:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787830977.623414:0:13771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433315712 00000100:00100000:0.0:1787830977.623422:0:13771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433315712 00000100:00100000:0.0:1787830977.623466:0:13771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433315968 00000100:00100000:0.0:1787830977.623469:0:13771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433315968 00000100:00100000:0.0:1787830977.623494:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 175 00000100:00100000:0.0:1787830977.623517:0:13771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220390c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:2397:x1874676433315712:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1787830977.623561:0:13771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220390c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:2397:x1874676433315712:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 46us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830977.623568:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 175 00000100:00100000:0.0:1787830977.623582:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 176 00000100:00100000:0.0:1787830977.623588:0:13771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220390de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c901c2b2-479b-44dc-8fa8-34fbacf02f07+5:2397:x1874676433315968:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1787830977.623613:0:13771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220390de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c901c2b2-479b-44dc-8fa8-34fbacf02f07+5:2397:x1874676433315968:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 25us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830977.623619:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 176 00000100:00080000:3.0:1787830977.624207:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787830977.624221:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1787830978.535123:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787830979.303886:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2336bfda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443875072:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787830979.303965:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830979.304153:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443875072 00000100:00100000:3.0:1787830979.304160:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443875072 00000100:00100000:3.0:1787830979.304225:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787830979.304236:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220390cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443875072:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787830979.304265:0:8409:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787830979.304310:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220390cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443875072:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830979.304317:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:0.0:1787830979.304421:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787830979.304461:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2336bfda40 x1874676443875072/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787830995 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787830979.304480:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2336bfda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443875072:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787830979.305321:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d232f797c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1874676443875200:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787830979.305372:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830979.305724:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443875200 00000100:00100000:2.0:1787830979.305730:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443875200 00000100:00100000:2.0:1787830979.305785:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787830979.305793:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2309cfa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1874676443875200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787830979.305809:0:8410:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787830979.305859:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2309cfa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1874676443875200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830979.305864:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:3.0:1787830979.305977:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787830979.306043:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d232f797c00 x1874676443875200/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787830995 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787830979.306070:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d232f797c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1874676443875200:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787830979.558888:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787830979.814851:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2309cfb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443875328:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787830979.814928:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830979.815658:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443875328 00000100:00100000:1.0:1787830979.815666:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443875328 00000100:00100000:1.0:1787830979.815721:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787830979.815730:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2336bff840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1874676443875328:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787830979.815778:0:7448:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787830979.815852:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2336bff840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1874676443875328:12345-0@lo:41:osp-pre-1-0.0 Request processed in 123us (923us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830979.815859:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787830979.816032:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2309cfb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443875328:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787830980.327049:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787830980.327074:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2309cfb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443875456:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787830980.327150:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830980.327265:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443875456 00000100:00100000:1.0:1787830980.327273:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443875456 00000100:00100000:1.0:1787830980.327328:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787830980.327337:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2336bfc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443875456:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787830980.327369:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787830980.327416:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2336bfc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443875456:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830980.327423:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787830980.327579:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2309cfb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443875456:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787830980.582940:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787830981.350915:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2336bff0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443875840:0@lo:400:kworker.0 00000100:00100000:2.0:1787830981.350915:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2336bffc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a45944b-32e3-4193-a2a5-46f84222bc14:3619:1874676443875584:0@lo:400:kworker.0 00000100:00100000:1.0:1787830981.351074:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2336bff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3620:1874676443875712:0@lo:400:kworker.0 00000100:00100000:0.0:1787830981.351230:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2336bfed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3622:1874676443875968:0@lo:400:kworker.0 00000100:00100000:3.0:1787830981.351782:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830981.351844:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830981.351895:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443875584 00000100:00100000:2.0:1787830981.351902:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443875584 00000100:00100000:2.0:1787830981.351953:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:2.0:1787830981.351961:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a681c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+24:3619:x1874676443875584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787830981.352025:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a681c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+24:3619:x1874676443875584:12345-0@lo:400:kworker.0 Request processed in 64us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830981.352032:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:2.0:1787830981.352081:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443875840 00000100:00100000:2.0:1787830981.352085:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443875840 00000100:00100000:2.0:1787830981.352111:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1787830981.352117:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233448ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443875840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787830981.352164:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233448ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443875840:12345-0@lo:400:kworker.0 Request processed in 47us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830981.352170:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787830981.352422:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2336bff0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443875840:0@lo:400:kworker.0 00000100:00100000:2.0:1787830981.352498:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2336bffc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a45944b-32e3-4193-a2a5-46f84222bc14:3619:1874676443875584:0@lo:400:kworker.0 00000100:00100000:2.0:1787830981.352508:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2336bfda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443876096:0@lo:400:kworker.0 00000100:00100000:2.0:1787830981.352535:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830981.352569:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2334488b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443876608:0@lo:400:kworker.0 00000100:00100000:2.0:1787830981.352593:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830981.352613:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2334489a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443877120:0@lo:400:kworker.0 00000100:00100000:2.0:1787830981.352654:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830981.352711:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443876096 00000100:00100000:2.0:1787830981.352716:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443876096 00000100:00100000:3.0:1787830981.352729:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233448a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3621:1874676443876352:0@lo:400:kworker.0 00000100:00100000:2.0:1787830981.352744:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787830981.352753:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d232f797c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676443876096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787830981.352766:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830981.352794:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d23344892c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3621:1874676443876864:0@lo:400:kworker.0 00000100:00100000:2.0:1787830981.352815:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d232f797c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676443876096:12345-0@lo:400:kworker.0 Request processed in 62us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830981.352826:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830981.352827:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787830981.352848:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443876608 00000100:00100000:2.0:1787830981.352851:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443876608 00000100:00100000:2.0:1787830981.352882:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443877120 00000100:00100000:2.0:1787830981.352885:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443877120 00000100:00100000:2.0:1787830981.352904:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787830981.352911:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d232f795e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676443876608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787830981.352942:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d232f795e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676443876608:12345-0@lo:400:kworker.0 Request processed in 32us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830981.352948:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787830981.352959:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787830981.352967:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2318d57840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676443877120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787830981.353010:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2318d57840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676443877120:12345-0@lo:400:kworker.0 Request processed in 44us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830981.353016:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787830981.353036:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443876352 00000100:00100000:2.0:1787830981.353039:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443876352 00000100:00100000:2.0:1787830981.353062:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443876864 00000100:00100000:2.0:1787830981.353065:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443876864 00000100:00100000:2.0:1787830981.353083:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1787830981.353089:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233448a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1874676443876352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787830981.353119:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233448a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1874676443876352:12345-0@lo:400:kworker.0 Request processed in 31us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830981.353125:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1787830981.353147:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1787830981.353160:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233448b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1874676443876864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787830981.353190:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233448b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1874676443876864:12345-0@lo:400:kworker.0 Request processed in 32us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830981.353196:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00080000:2.0:1787830981.353213:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787830981.353216:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787830981.353219:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787830981.353242:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2336bfda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443876096:0@lo:400:kworker.0 00010000:00080000:2.0:1787830981.353254:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2334488b40 x1874676443876608/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787830997 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787830981.353263:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2334488b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443876608:0@lo:400:kworker.0 00000100:00100000:2.0:1787830981.353273:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2334489a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443877120:0@lo:400:kworker.0 00000100:00100000:3.0:1787830981.353293:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220390e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443877376:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787830981.353329:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1787830981.353361:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d233448a580 x1874676443876352/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830997 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787830981.353366:0:11489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443877376 00000100:00100000:2.0:1787830981.353371:0:11489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443877376 00000100:00100000:3.0:1787830981.353373:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233448a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3621:1874676443876352:0@lo:400:kworker.0 00010000:00080000:3.0:1787830981.353387:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d23344892c0 x1874676443876864/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830997 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787830981.353395:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d23344892c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3621:1874676443876864:0@lo:400:kworker.0 00000100:00100000:2.0:1787830981.353524:0:11489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787830981.353529:0:11489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d23344883c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443877376:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787830981.353548:0:11489:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787830981.353587:0:11489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d23344883c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443877376:12345-0@lo:13:osp-pre-1-1.0 Request processed in 55us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830981.353593:0:11489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:2.0:1787830981.353608:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787830981.353747:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220390e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443877376:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787830981.355101:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830981.355147:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220395d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3620:1874676443876224:0@lo:400:kworker.0 00000100:00100000:1.0:1787830981.355180:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830981.355195:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2334489e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3620:1874676443876736:0@lo:400:kworker.0 00000100:00100000:1.0:1787830981.355227:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830981.355248:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2309cfb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1874676443877248:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787830981.355269:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830981.355307:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443877248 00000100:00100000:1.0:1787830981.355314:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443877248 00000100:00100000:2.0:1787830981.355341:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443875712 00000100:00100000:2.0:1787830981.355347:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443875712 00000100:00100000:1.0:1787830981.355359:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787830981.355370:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220380cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1874676443877248:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787830981.355379:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443876224 00000100:00100000:2.0:1787830981.355384:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443876224 00002000:00000024:1.0:1787830981.355389:0:8409:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787830981.355407:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443876736 00000100:00100000:2.0:1787830981.355411:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443876736 00000100:00100000:2.0:1787830981.355440:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1787830981.355448:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220380c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1874676443875712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830981.355463:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220380cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1874676443877248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830981.355471:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787830981.355496:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1787830981.355502:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220380c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1874676443875712:12345-0@lo:400:kworker.0 Request processed in 54us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830981.355507:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220380e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1874676443876224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787830981.355513:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1787830981.355530:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1787830981.355538:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220380e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1874676443876736:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1787830981.355884:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787830981.356048:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220380e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1874676443876224:12345-0@lo:400:kworker.0 Request processed in 544us (865us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830981.356055:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1787830981.356097:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2336bff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3620:1874676443875712:0@lo:400:kworker.0 00000100:00100000:1.0:1787830981.356110:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220395d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3620:1874676443876224:0@lo:400:kworker.0 00000100:00100000:1.0:1787830981.356127:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2334489e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3620:1874676443876736:0@lo:400:kworker.0 00000100:00100000:2.0:1787830981.356129:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220380e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1874676443876736:12345-0@lo:400:kworker.0 Request processed in 590us (899us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830981.356144:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2309cfb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1874676443877248:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787830981.356285:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1787830981.361496:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830981.361671:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443875968 00000100:00100000:3.0:1787830981.361681:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443875968 00000100:00100000:3.0:1787830981.361744:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1787830981.361753:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220390e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1874676443875968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787830981.361830:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220390e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1874676443875968:12345-0@lo:400:kworker.0 Request processed in 79us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830981.361847:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1787830981.364066:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2336bfed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3622:1874676443875968:0@lo:400:kworker.0 00000100:00100000:0.0:1787830981.364081:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2334489680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676443876480:0@lo:400:kworker.0 00000100:00100000:0.0:1787830981.364144:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830981.364179:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233448b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676443876992:0@lo:400:kworker.0 00000100:00100000:0.0:1787830981.364230:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830981.364444:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443876480 00000100:00100000:2.0:1787830981.364451:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443876480 00000100:00100000:2.0:1787830981.364522:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443876992 00000100:00100000:2.0:1787830981.364526:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443876992 00000100:00100000:2.0:1787830981.364560:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787830981.364571:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203765a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676443876480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787830981.364663:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203765a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676443876480:12345-0@lo:400:kworker.0 Request processed in 94us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830981.364671:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787830981.364703:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787830981.364709:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203766d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676443876992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787830981.364739:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203766d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676443876992:12345-0@lo:400:kworker.0 Request processed in 30us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830981.364744:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:3.0:1787830981.364946:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787830981.365098:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2334489680 x1874676443876480/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787830997 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787830981.365112:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2334489680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676443876480:0@lo:400:kworker.0 00000100:00100000:0.0:1787830981.365125:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233448b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676443876992:0@lo:400:kworker.0 00010000:00010000:3.0:1787830981.607071:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787830982.631432:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787830982.740867:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787830982.740921:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787830982.740993:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433316224 00000100:00100000:1.0:1787830982.741008:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433316224 00000100:00100000:1.0:1787830982.741145:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 357 00000100:00100000:1.0:1787830982.741156:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a682050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+13:2395:x1874676433316224:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1787830982.741272:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433316480 00000100:00100000:2.0:1787830982.741281:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433316480 00000100:00100000:2.0:1787830982.742521:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 183 00000100:00100000:2.0:1787830982.742556:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d23344892c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:2395:x1874676433316480:12345-192.168.203.31@tcp:400:kworker.0 00000100:00080000:0.0:1787830982.744095:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787830982.744240:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a682050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+13:2395:x1874676433316224:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 3078us (3380us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830982.744255:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 357 00000100:00100000:3.0:1787830982.752913:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787830982.753018:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433316352 00000100:00100000:0.0:1787830982.753033:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433316352 00000100:00100000:0.0:1787830982.753127:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 184 00000100:00100000:0.0:1787830982.753141:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233448a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:2395:x1874676433316352:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1787830982.753222:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233448a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:2395:x1874676433316352:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 86us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830982.753230:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 184 00000100:00080000:1.0:1787830982.753328:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787830982.755395:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d23344892c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:2395:x1874676433316480:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 12827us (14455us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830982.755413:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 183 00000100:00100000:0.0:1787830982.768098:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787830982.768149:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787830982.768265:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787830982.768283:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433316736 00000100:00100000:1.0:1787830982.768299:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433316736 00000100:00100000:1.0:1787830982.768396:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433316864 00000100:00100000:1.0:1787830982.768400:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433316864 00000100:00100000:1.0:1787830982.768433:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 185 00000100:00100000:1.0:1787830982.768456:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22037670c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c901c2b2-479b-44dc-8fa8-34fbacf02f07+5:2395:x1874676433316736:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1787830982.768539:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22037670c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c901c2b2-479b-44dc-8fa8-34fbacf02f07+5:2395:x1874676433316736:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 85us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830982.768546:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 185 00000100:00100000:1.0:1787830982.768563:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 186 00000100:00100000:1.0:1787830982.768570:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22037652c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c901c2b2-479b-44dc-8fa8-34fbacf02f07+5:2395:x1874676433316864:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1787830982.768595:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22037652c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c901c2b2-479b-44dc-8fa8-34fbacf02f07+5:2395:x1874676433316864:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 26us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830982.768601:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 186 00000100:00080000:0.0:1787830982.768840:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787830982.768846:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787830982.769190:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433316608 00000100:00100000:2.0:1787830982.769201:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433316608 00000100:00100000:2.0:1787830982.769483:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 27 00000100:00100000:2.0:1787830982.769495:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a20f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:2393:x1874676433316608:12345-192.168.203.31@tcp:9:kworker.0 00000020:00000080:2.0:1787830982.769529:0:8407:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x95459fb9d1d28ad8 00000100:00080000:2.0:1787830982.769540:0:8407:0:(import.c:65:import_set_state_nolock()) ffff8d233f542800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787830982.769621:0:8407:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967301 00010000:00010000:1.0:1787830982.769939:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787830982.770033:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a20f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+2:2393:x1874676433316608:12345-192.168.203.31@tcp:9:kworker.0 Request processed in 538us (1768us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830982.770044:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 27 00000100:00080000:0.0:1787830982.771303:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787830983.658622:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787830984.423010:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2318d543c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676443877504:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787830984.423258:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830984.423391:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443877504 00000100:00100000:1.0:1787830984.423400:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443877504 00000100:00100000:1.0:1787830984.423475:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00080000:0.0:1787830984.423479:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787830984.423490:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2334488780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1874676443877504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787830984.423528:0:8410:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787830984.423669:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787830984.423683:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1874676443877632:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787830984.423833:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830984.426703:0:11489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443877632 00000100:00100000:2.0:1787830984.426724:0:11489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443877632 00000100:00100000:2.0:1787830984.426840:0:11489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787830984.426851:0:11489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a21e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1874676443877632:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787830984.426899:0:11489:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787830984.427056:0:11489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a21e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1874676443877632:12345-0@lo:13:osp-pre-0-1.0 Request processed in 206us (3221us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830984.427064:0:11489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00080000:2.0:1787830984.427129:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2203a20000 x1874676443877632/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787831000 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787830984.427155:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1874676443877632:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1787830984.428455:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787830984.428934:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2334488780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1874676443877504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 5442us (5669us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830984.428948:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00010000:00080000:3.0:1787830984.430243:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2318d543c0 x1874676443877504/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787831000 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787830984.430276:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2318d543c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676443877504:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787830984.678921:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787830984.938930:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787830984.943895:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220380f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443877760:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787830984.943989:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830984.946197:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443877760 00000100:00100000:2.0:1787830984.946210:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443877760 00000100:00100000:2.0:1787830984.946341:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787830984.946351:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676443877760:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787830984.946387:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787830984.946479:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676443877760:12345-0@lo:41:osp-pre-1-0.0 Request processed in 130us (2490us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830984.946487:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787830984.946559:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220380f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443877760:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787830985.447833:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220380f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443877888:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787830985.447916:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830985.448127:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443877888 00000100:00100000:0.0:1787830985.448135:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443877888 00000100:00100000:1.0:1787830985.449739:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787830985.449754:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233448a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443877888:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787830985.449790:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787830985.449986:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220380f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443877888:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787830985.450029:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233448a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443877888:12345-0@lo:41:osp-pre-0-1.0 Request processed in 125us (1957us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830985.450036:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00010000:00010000:3.0:1787830985.702845:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787830986.472214:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220380d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676443878016:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787830986.472286:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830986.472411:0:11489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443878016 00000100:00100000:1.0:1787830986.472424:0:11489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443878016 00000100:00100000:1.0:1787830986.472489:0:11489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787830986.472510:0:11489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2318d543c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1874676443878016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787830986.472539:0:11489:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787830986.472589:0:11489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2318d543c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1874676443878016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830986.472596:0:11489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787830986.472661:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220380d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676443878016:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1787830986.472826:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787830986.475476:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220380f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3620:1874676443878272:0@lo:400:kworker.0 00000100:00100000:1.0:1787830986.475552:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830986.475592:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203791a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3620:1874676443878784:0@lo:400:kworker.0 00000100:00100000:1.0:1787830986.475614:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830986.475652:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203791e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3620:1874676443879296:0@lo:400:kworker.0 00000100:00100000:1.0:1787830986.475673:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830986.475694:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1787830986.475700:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220380d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a45944b-32e3-4193-a2a5-46f84222bc14:3620:1874676443878144:0@lo:400:kworker.0 00000100:00100000:1.0:1787830986.475728:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830986.475748:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220395d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1874676443878656:0@lo:400:kworker.0 00000100:00100000:1.0:1787830986.475771:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830986.475788:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22037921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1874676443879168:0@lo:400:kworker.0 00000100:00100000:1.0:1787830986.475809:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830986.475839:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443878272 00000100:00100000:1.0:1787830986.475845:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443878272 00000100:00100000:1.0:1787830986.475881:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443878784 00000100:00100000:1.0:1787830986.475883:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443878784 00000100:00100000:1.0:1787830986.475905:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443879296 00000100:00100000:1.0:1787830986.475917:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443879296 00000100:00100000:1.0:1787830986.475955:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1787830986.475964:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22037903c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1874676443878272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830986.476013:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22037903c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1874676443878272:12345-0@lo:400:kworker.0 Request processed in 50us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830986.476019:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1787830986.476033:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1787830986.476038:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203792940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1874676443878784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830986.476062:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203792940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1874676443878784:12345-0@lo:400:kworker.0 Request processed in 24us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830986.476067:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1787830986.476077:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1787830986.476083:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203790780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1874676443879296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830986.476107:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203790780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1874676443879296:12345-0@lo:400:kworker.0 Request processed in 25us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830986.476112:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1787830986.476133:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443878144 00000100:00100000:1.0:1787830986.476136:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443878144 00000100:00100000:1.0:1787830986.476159:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:1.0:1787830986.476166:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a681450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+24:3620:x1874676443878144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830986.476194:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a681450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+24:3620:x1874676443878144:12345-0@lo:400:kworker.0 Request processed in 29us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830986.476200:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:1.0:1787830986.476225:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443878656 00000100:00100000:1.0:1787830986.476229:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443878656 00000100:00100000:1.0:1787830986.476251:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787830986.476257:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220390a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1874676443878656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830986.476293:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220390a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1874676443878656:12345-0@lo:400:kworker.0 Request processed in 36us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830986.476299:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787830986.476318:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443879168 00000100:00100000:1.0:1787830986.476321:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443879168 00000100:00100000:1.0:1787830986.476345:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787830986.476352:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220390b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1874676443879168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830986.476382:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220390b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1874676443879168:12345-0@lo:400:kworker.0 Request processed in 31us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830986.476388:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787830986.476415:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220380f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443878400:0@lo:400:kworker.0 00000100:00100000:1.0:1787830986.476437:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830986.476456:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203793480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3621:1874676443878912:0@lo:400:kworker.0 00000100:00100000:1.0:1787830986.476476:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830986.476489:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203792580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3621:1874676443879424:0@lo:400:kworker.0 00000100:00100000:1.0:1787830986.476506:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830986.476522:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1787830986.476528:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2309cfb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3621:1874676443878528:0@lo:400:kworker.0 00000100:00100000:1.0:1787830986.476547:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830986.476563:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203793840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443879040:0@lo:400:kworker.0 00000100:00100000:1.0:1787830986.476581:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830986.476597:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203791680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443879552:0@lo:400:kworker.0 00000100:00100000:1.0:1787830986.476616:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830986.476666:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443878400 00000100:00100000:1.0:1787830986.476670:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443878400 00000100:00100000:1.0:1787830986.476700:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787830986.476706:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220390bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443878400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830986.476744:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220390bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443878400:12345-0@lo:400:kworker.0 Request processed in 39us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830986.476750:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787830986.476765:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443879040 00000100:00100000:1.0:1787830986.476769:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443879040 00000100:00100000:1.0:1787830986.476787:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443879552 00000100:00100000:1.0:1787830986.476790:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443879552 00000100:00100000:1.0:1787830986.476806:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787830986.476811:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203908000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443879040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830986.476837:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203908000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443879040:12345-0@lo:400:kworker.0 Request processed in 26us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830986.476842:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787830986.476854:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787830986.476859:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203908f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443879552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830986.476882:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203908f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443879552:12345-0@lo:400:kworker.0 Request processed in 23us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830986.476887:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787830986.476906:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443878912 00000100:00100000:1.0:1787830986.476909:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443878912 00000100:00100000:1.0:1787830986.476924:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443879424 00000100:00100000:1.0:1787830986.476928:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443879424 00000100:00100000:1.0:1787830986.476937:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443878528 00000100:00100000:1.0:1787830986.476939:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443878528 00000100:00100000:1.0:1787830986.476962:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1787830986.476968:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22039083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1874676443878912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830986.476994:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22039083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1874676443878912:12345-0@lo:400:kworker.0 Request processed in 27us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830986.477006:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1787830986.477018:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1787830986.477023:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220390b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1874676443879424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830986.477049:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220390b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1874676443879424:12345-0@lo:400:kworker.0 Request processed in 26us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830986.477054:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1787830986.477065:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1787830986.477071:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22039092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1874676443878528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830986.477097:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22039092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1874676443878528:12345-0@lo:400:kworker.0 Request processed in 27us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830986.477104:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00080000:1.0:1787830986.477123:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787830986.477129:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787830986.477131:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787830986.477132:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787830986.477170:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2309cfb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3621:1874676443878528:0@lo:400:kworker.0 00010000:00080000:1.0:1787830986.477183:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2203793840 x1874676443879040/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787831002 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787830986.477193:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203793840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443879040:0@lo:400:kworker.0 00000100:00100000:1.0:1787830986.477200:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203791680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443879552:0@lo:400:kworker.0 00000100:00100000:1.0:1787830986.477208:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220380f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443878400:0@lo:400:kworker.0 00010000:00080000:1.0:1787830986.477215:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2203793480 x1874676443878912/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787831002 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787830986.477223:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203793480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3621:1874676443878912:0@lo:400:kworker.0 00010000:00080000:1.0:1787830986.477240:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2203792580 x1874676443879424/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787831002 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787830986.477248:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203792580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3621:1874676443879424:0@lo:400:kworker.0 00000100:00100000:1.0:1787830986.477286:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220380d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a45944b-32e3-4193-a2a5-46f84222bc14:3620:1874676443878144:0@lo:400:kworker.0 00000100:00100000:1.0:1787830986.477295:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220395d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1874676443878656:0@lo:400:kworker.0 00010000:00080000:1.0:1787830986.477304:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d22037921c0 x1874676443879168/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787831002 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787830986.477313:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22037921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1874676443879168:0@lo:400:kworker.0 00000100:00100000:1.0:1787830986.477323:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220380f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3620:1874676443878272:0@lo:400:kworker.0 00000100:00100000:1.0:1787830986.477333:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203791a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3620:1874676443878784:0@lo:400:kworker.0 00000100:00100000:1.0:1787830986.477341:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203791e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3620:1874676443879296:0@lo:400:kworker.0 00000100:00100000:0.0:1787830986.478165:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2336bfed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443879680:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787830986.478209:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830986.480138:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443879680 00000100:00100000:1.0:1787830986.480148:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443879680 00000100:00100000:1.0:1787830986.480209:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787830986.480219:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a22d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443879680:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787830986.480242:0:8410:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787830986.482895:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a22d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443879680:12345-0@lo:13:osp-pre-1-1.0 Request processed in 2672us (4678us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830986.482908:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787830986.483204:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2336bfed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443879680:0@lo:13:osp-pre-1-1.0 00000040:00080000:1.0:1787830986.663237:0:13758:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1787830986.664269:0:13763:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787830986.729068:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787830987.751854:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787830987.856722:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787830987.856773:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787830987.856819:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787830987.856843:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433316992 00000100:00100000:3.0:1787830987.856862:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433316992 00000100:00100000:2.0:1787830987.856944:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433317120 00000100:00100000:3.0:1787830987.856945:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 359 00000100:00100000:0.0:1787830987.856949:0:13771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433317248 00000100:00100000:2.0:1787830987.856952:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433317120 00000100:00100000:3.0:1787830987.856961:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a680c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+13:2396:x1874676433316992:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1787830987.857003:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 193 00000100:00100000:0.0:1787830987.857007:0:13771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433317248 00000100:00100000:2.0:1787830987.857015:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203909680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:2397:x1874676433317120:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1787830987.857061:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 194 00000100:00100000:2.0:1787830987.857074:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203909680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:2397:x1874676433317120:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 61us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830987.857077:0:13771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220390a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:2396:x1874676433317248:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1787830987.857087:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 193 00000100:00100000:3.0:1787830987.857284:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a680c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+13:2396:x1874676433316992:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 326us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830987.857431:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 359 00000100:00100000:0.0:1787830987.858080:0:13771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220390a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:2396:x1874676433317248:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 1006us (1257us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830987.858091:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 194 00000100:00080000:0.0:1787830987.858145:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787830987.858150:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787830987.859161:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787830987.859209:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787830987.859287:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433317504 00000100:00100000:0.0:1787830987.859296:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433317504 00000100:00100000:0.0:1787830987.859358:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433317376 00000100:00100000:0.0:1787830987.859360:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433317376 00000100:00100000:0.0:1787830987.859388:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 195 00000100:00100000:0.0:1787830987.859397:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203908b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c901c2b2-479b-44dc-8fa8-34fbacf02f07+5:2396:x1874676433317504:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1787830987.859468:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203908b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c901c2b2-479b-44dc-8fa8-34fbacf02f07+5:2396:x1874676433317504:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 72us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830987.859489:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 195 00000100:00100000:0.0:1787830987.859504:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 196 00000100:00100000:0.0:1787830987.859510:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203908780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c901c2b2-479b-44dc-8fa8-34fbacf02f07+5:2397:x1874676433317376:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1787830987.859541:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203908780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c901c2b2-479b-44dc-8fa8-34fbacf02f07+5:2397:x1874676433317376:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 30us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830987.859547:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 196 00000100:00080000:1.0:1787830987.859698:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787830987.859702:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1787830988.774823:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787830989.035097:0:9484:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 47d7f0ed-283f-4b70-a741-6e74c5e52619 00000020:00000080:2.0:1787830989.035107:0:9484:0:(genops.c:885:class_export_put()) final put ffff8d233f546800/47d7f0ed-283f-4b70-a741-6e74c5e52619 00000020:00000080:1.0:1787830989.035257:0:478:0:(genops.c:844:class_export_destroy()) destroying export ffff8d233f546800/47d7f0ed-283f-4b70-a741-6e74c5e52619 for lustre-OST0001 00000020:00000080:1.0:1787830989.036820:0:478:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d233f542800 for lustre-OST0001 00000001:02000400:0.0:1787830989.210422:0:14024:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 07:43:08 (1787830988) 00000100:00100000:1.0:1787830989.544112:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2336bfda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1874676443879808:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787830989.544205:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830989.544989:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443879808 00000100:00100000:2.0:1787830989.545003:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443879808 00000100:00100000:2.0:1787830989.545092:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787830989.545105:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220395d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1874676443879808:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787830989.545143:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1787830989.545157:0:8409:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787830989.545221:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220380f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443879936:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787830989.545260:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830989.545445:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220395d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1874676443879808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 343us (1238us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830989.545454:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787830989.545476:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443879936 00000100:00100000:2.0:1787830989.545480:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443879936 00000100:00100000:2.0:1787830989.545506:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787830989.545513:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a22580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443879936:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787830989.545525:0:8409:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1787830989.545531:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787830989.545569:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a22580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443879936:12345-0@lo:13:osp-pre-0-1.0 Request processed in 56us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830989.545576:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00080000:0.0:1787830989.545680:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2336bfda40 x1874676443879808/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787831005 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787830989.545703:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2336bfda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1874676443879808:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1787830989.546534:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d220380f0c0 x1874676443879936/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787831005 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787830989.546552:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220380f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443879936:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1787830989.798877:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787830990.056961:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220380f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676443880064:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787830990.057065:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830990.057270:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443880064 00000100:00100000:3.0:1787830990.057280:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443880064 00000100:00100000:3.0:1787830990.057351:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787830990.057362:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2336bff0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1874676443880064:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787830990.057414:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787830990.057982:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2336bff0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1874676443880064:12345-0@lo:41:osp-pre-1-0.0 Request processed in 620us (924us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830990.057993:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787830990.058371:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220380f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676443880064:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787830990.242061:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787830990.243139:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433317632 00000100:00100000:1.0:1787830990.243155:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433317632 00000100:00080000:2.0:1787830990.243240:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787830990.244079:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 39 00000100:00100000:0.0:1787830990.244100:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a23840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:11052:x1874676433317632:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787830990.244143:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787830990.244177:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11400/0x95459fb9d1d28bb8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99423d3d expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830990.245211:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10400/0x95459fb9d1d28bbf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830990.245246:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10400/0x95459fb9d1d28bbf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830990.245280:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10400/0x95459fb9d1d28bbf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787830990.245363:0:6490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787830990.245368:0:6490:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787830990.245425:0:6490:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10400/0x95459fb9d1d28bbf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830990.245461:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11400/0x95459fb9d1d28bb8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423d3d expref: 7 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830990.245486:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10400/0x95459fb9d1d28bbf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423d3d expref: 6 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830990.245496:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2309e00200) 00010000:00010000:0.0:1787830990.245499:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787830990.245504:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233bf10400, rc 0) 00000100:00100000:0.0:1787830990.245607:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a23840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+6:11052:x1874676433317632:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 1514us (3672us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830990.245616:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 39 00000100:00100000:0.0:1787830990.256374:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787830990.256516:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433317760 00000100:00100000:2.0:1787830990.256528:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433317760 00000100:00100000:2.0:1787830990.256606:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 40 00000100:00100000:2.0:1787830990.256618:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a230c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+6:11053:x1874676433317760:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787830990.256685:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787830990.256713:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1c00/0x95459fb9d1d28bc6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99423d44 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830990.256804:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1e00/0x95459fb9d1d28bcd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830990.256821:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1e00/0x95459fb9d1d28bcd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830990.256853:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1e00/0x95459fb9d1d28bcd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830990.256871:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0200/0x95459fb9d1d28bd4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830990.256884:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0200/0x95459fb9d1d28bd4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830990.256891:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0200/0x95459fb9d1d28bd4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830990.256990:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0600/0x95459fb9d1d28bdb lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830990.256999:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0600/0x95459fb9d1d28bdb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830990.257007:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0600/0x95459fb9d1d28bdb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787830990.257061:0:6491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787830990.257066:0:6491:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787830990.257098:0:6491:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0600/0x95459fb9d1d28bdb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830990.257111:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1e00/0x95459fb9d1d28bcd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830990.257117:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1e00/0x95459fb9d1d28bcd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830990.257139:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1e00/0x95459fb9d1d28bcd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830990.257146:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22039c1e00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:2.0:1787830990.257151:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1e00/0x95459fb9d1d28bcd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830990.257161:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1e00/0x95459fb9d1d28bcd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830990.257175:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2309e00200) 00010000:00010000:2.0:1787830990.257178:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787830990.257183:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1e00/0x95459fb9d1d28bcd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830990.257189:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1e00/0x95459fb9d1d28bcd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830990.257206:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0200/0x95459fb9d1d28bd4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830990.257877:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0200/0x95459fb9d1d28bd4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830990.257889:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0200/0x95459fb9d1d28bd4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830990.257895:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22039c0200 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:2.0:1787830990.257898:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0200/0x95459fb9d1d28bd4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830990.257927:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0200/0x95459fb9d1d28bd4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830990.257940:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8d2203615900) 00010000:00010000:2.0:1787830990.257943:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787830990.257947:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0200/0x95459fb9d1d28bd4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830990.257955:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0200/0x95459fb9d1d28bd4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830990.258009:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1c00/0x95459fb9d1d28bc6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423d44 expref: 8 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830990.258025:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0600/0x95459fb9d1d28bdb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423d44 expref: 7 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830990.258033:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8d2203615100) 00010000:00010000:2.0:1787830990.258036:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787830990.258039:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22039c0600, rc 0) 00000100:00100000:2.0:1787830990.258118:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a230c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+7:11053:x1874676433317760:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 1503us (1758us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830990.258126:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 40 00000100:00100000:1.0:1787830990.263193:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787830990.263280:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433317888 00000100:00100000:2.0:1787830990.263294:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433317888 00000100:00100000:2.0:1787830990.263377:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 7 00000100:00100000:2.0:1787830990.263391:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220380d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:47d7f0ed-283f-4b70-a741-6e74c5e52619+7:11053:x1874676433317888:12345-192.168.203.31@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1787830990.263522:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220380d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:47d7f0ed-283f-4b70-a741-6e74c5e52619+7:11053:x1874676433317888:12345-192.168.203.31@tcp:900:lhsmtool_posix.0 Request processed in 133us (822us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830990.263531:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 7 00000100:00100000:0.0:1787830990.269526:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787830990.269665:0:13771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433318144 00000100:00100000:3.0:1787830990.269677:0:13771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433318144 00000100:00100000:3.0:1787830990.269753:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 41 00000100:00100000:3.0:1787830990.269765:0:13771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a212c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47d7f0ed-283f-4b70-a741-6e74c5e52619+7:11053:x1874676433318144:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787830990.269813:0:13771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787830990.269838:0:13771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d28be2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99423d4b expref: -99 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830990.269944:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d28be9 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830990.269962:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d28be9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830990.269976:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d28be9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830990.270426:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d28bf0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830990.270448:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d28bf0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830990.270460:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d28bf0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830990.270574:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76c00/0x95459fb9d1d28bf7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830990.270583:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76c00/0x95459fb9d1d28bf7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830990.270590:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76c00/0x95459fb9d1d28bf7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787830990.270601:0:13771:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:3.0:1787830990.270763:0:13771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d28be9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830990.270770:0:13771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d28be9 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830990.270777:0:13771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d28be9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830990.270783:0:13771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2307c77600 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:3.0:1787830990.270787:0:13771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d28be9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830990.270795:0:13771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d28be9 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830990.270809:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8d2203615100) 00010000:00010000:3.0:1787830990.270812:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787830990.270817:0:13771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d28be9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830990.270823:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d28be9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830990.270837:0:13771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d28bf0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830990.270843:0:13771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d28bf0 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830990.270849:0:13771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d28bf0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830990.270865:0:13771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2307c76600 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:3.0:1787830990.270868:0:13771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d28bf0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830990.270874:0:13771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d28bf0 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830990.270882:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8d2318594d00) 00010000:00010000:3.0:1787830990.270885:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787830990.270888:0:13771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d28bf0 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830990.270894:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d28bf0 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830990.271160:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d28be2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423d4b expref: 10 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830990.271174:0:13771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76c00/0x95459fb9d1d28bf7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423d4b expref: 9 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830990.271182:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d2318594400) 00010000:00010000:3.0:1787830990.271184:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787830990.271186:0:13771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2307c76c00, rc 0) 00000100:00100000:3.0:1787830990.271257:0:13771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a212c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47d7f0ed-283f-4b70-a741-6e74c5e52619+9:11053:x1874676433318144:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 1494us (1744us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1787830990.271266:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 41 00000100:00100000:0.0:1787830990.274975:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787830990.275103:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433318272 00000100:00100000:2.0:1787830990.275126:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433318272 00000100:00100000:2.0:1787830990.275201:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 42 00000100:00100000:2.0:1787830990.275212:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a23c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+9:11053:x1874676433318272:12345-192.168.203.31@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1787830990.275358:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a23c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+9:11053:x1874676433318272:12345-192.168.203.31@tcp:59:lhsmtool_posix.0 Request processed in 147us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830990.275365:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 42 00000100:00100000:1.0:1787830990.277181:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787830990.277563:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433318400 00000100:00100000:2.0:1787830990.277576:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433318400 00000100:00080000:1.0:1787830990.277758:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787830990.278145:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 43 00000100:00100000:2.0:1787830990.278162:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220380f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:11053:x1874676433318400:12345-192.168.203.31@tcp:59:lhsmtool_posix.0 00000004:00080000:0.0:1787830990.279513:0:6491:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 820us 00000100:00100000:0.0:1787830990.294781:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220380f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:11053:x1874676433318400:12345-192.168.203.31@tcp:59:lhsmtool_posix.0 Request processed in 16611us (17595us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830990.294795:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 43 00000100:00100000:3.0:1787830990.568693:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787830990.568724:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220380f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1874676443880192:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787830990.568807:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830990.569125:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443880192 00000100:00100000:1.0:1787830990.569133:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443880192 00000100:00100000:1.0:1787830990.569195:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1787830990.569203:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2334489e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1874676443880192:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787830990.569238:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787830990.569298:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2334489e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1874676443880192:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830990.569305:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1787830990.569571:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220380f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1874676443880192:0@lo:41:osp-pre-0-1.0 00000040:00080000:0.0:1787830990.760072:0:13763:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1787830990.760465:0:13758:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787830990.828981:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787830991.590843:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220380f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1874676443880320:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787830991.590936:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830991.591006:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443880320 00000100:00100000:1.0:1787830991.591014:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443880320 00000100:00100000:1.0:1787830991.591062:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787830991.591072:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203791e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1874676443880320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787830991.591100:0:8410:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787830991.591144:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203791e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1874676443880320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830991.591151:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:1.0:1787830991.591170:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787830991.591204:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220380f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1874676443880320:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787830991.591580:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443880704:0@lo:400:kworker.0 00000100:00100000:0.0:1787830991.591658:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830991.591680:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a79a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3619:1874676443881216:0@lo:400:kworker.0 00000100:00100000:0.0:1787830991.591705:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830991.591738:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203affc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3619:1874676443881728:0@lo:400:kworker.0 00000100:00100000:0.0:1787830991.591761:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830991.591782:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1787830991.591787:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a21a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874676443880832:0@lo:400:kworker.0 00000100:00100000:0.0:1787830991.591810:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830991.591828:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a7b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443881344:0@lo:400:kworker.0 00000100:00100000:0.0:1787830991.591849:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830991.591873:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203afda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443881856:0@lo:400:kworker.0 00000100:00100000:0.0:1787830991.591894:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830991.591959:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443880704 00000100:00100000:0.0:1787830991.591963:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443880704 00000100:00100000:0.0:1787830991.591997:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787830991.592005:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203aff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443880704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787830991.592048:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203aff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443880704:12345-0@lo:400:kworker.0 Request processed in 45us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830991.592055:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787830991.592076:0:13771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443881216 00000100:00100000:0.0:1787830991.592080:0:13771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443881216 00000100:00100000:0.0:1787830991.592114:0:13771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443881728 00000100:00100000:0.0:1787830991.592116:0:13771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443881728 00000100:00100000:0.0:1787830991.592133:0:13771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443880832 00000100:00100000:0.0:1787830991.592135:0:13771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443880832 00000100:00100000:0.0:1787830991.592169:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1787830991.592174:0:13771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203afd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874676443881216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787830991.592206:0:13771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203afd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874676443881216:12345-0@lo:400:kworker.0 Request processed in 32us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830991.592212:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1787830991.592224:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1787830991.592230:0:13771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203afe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874676443881728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787830991.592255:0:13771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203afe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874676443881728:12345-0@lo:400:kworker.0 Request processed in 26us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830991.592261:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1787830991.592272:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1787830991.592277:0:13771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22039bbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874676443880832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787830991.592301:0:13771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22039bbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874676443880832:12345-0@lo:400:kworker.0 Request processed in 25us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830991.592307:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1787830991.592331:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443881344 00000100:00100000:0.0:1787830991.592335:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443881344 00000100:00100000:0.0:1787830991.592503:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443881856 00000100:00100000:0.0:1787830991.592507:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443881856 00000100:00100000:0.0:1787830991.592531:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787830991.592537:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22039b83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443881344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787830991.592572:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22039b83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443881344:12345-0@lo:400:kworker.0 Request processed in 35us (722us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830991.592578:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787830991.592589:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787830991.592595:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22039b8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443881856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787830991.592657:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22039b8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443881856:12345-0@lo:400:kworker.0 Request processed in 62us (762us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830991.592664:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:0.0:1787830991.592696:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787830991.592700:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787830991.592702:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787830991.592732:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a21a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874676443880832:0@lo:400:kworker.0 00010000:00080000:0.0:1787830991.592744:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2203a7b0c0 x1874676443881344/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787831007 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787830991.592754:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a7b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443881344:0@lo:400:kworker.0 00000100:00100000:0.0:1787830991.592763:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203afda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443881856:0@lo:400:kworker.0 00000100:00100000:0.0:1787830991.592772:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443880704:0@lo:400:kworker.0 00010000:00080000:0.0:1787830991.592781:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2203a79a40 x1874676443881216/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787831007 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787830991.592789:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a79a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3619:1874676443881216:0@lo:400:kworker.0 00010000:00080000:0.0:1787830991.592798:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2203affc00 x1874676443881728/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787831007 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787830991.592805:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203affc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3619:1874676443881728:0@lo:400:kworker.0 00000100:00100000:1.0:1787830991.593114:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a22940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a45944b-32e3-4193-a2a5-46f84222bc14:3621:1874676443880448:0@lo:400:kworker.0 00000100:00100000:1.0:1787830991.593153:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830991.593178:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a78b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443880960:0@lo:400:kworker.0 00000100:00100000:1.0:1787830991.593200:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830991.593220:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203afde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443881472:0@lo:400:kworker.0 00000100:00100000:1.0:1787830991.593241:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830991.593257:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22039b9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443881984:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787830991.593278:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830991.593302:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1787830991.593308:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a203c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3621:1874676443880576:0@lo:400:kworker.0 00000100:00100000:1.0:1787830991.593331:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830991.593349:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a7ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3621:1874676443881088:0@lo:400:kworker.0 00000100:00100000:0.0:1787830991.593855:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443880448 00000100:00100000:0.0:1787830991.593862:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443880448 00000100:00100000:1.0:1787830991.594023:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830991.594044:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203afcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3621:1874676443881600:0@lo:400:kworker.0 00000100:00100000:1.0:1787830991.594059:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830991.594084:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443881472 00000100:00100000:1.0:1787830991.594087:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443881472 00000100:00100000:1.0:1787830991.594119:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787830991.594125:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22037921c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1874676443881472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830991.594170:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22037921c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1874676443881472:12345-0@lo:400:kworker.0 Request processed in 45us (928us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830991.594179:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787830991.594200:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443880960 00000100:00100000:1.0:1787830991.594203:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443880960 00000100:00100000:1.0:1787830991.594222:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1787830991.594227:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203791a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1874676443880960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830991.594254:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203791a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1874676443880960:12345-0@lo:400:kworker.0 Request processed in 27us (1054us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830991.594260:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1787830991.594274:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443881984 00000100:00100000:1.0:1787830991.594277:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443881984 00000100:00100000:1.0:1787830991.594295:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787830991.594301:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203792580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443881984:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787830991.594314:0:8409:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787830991.594339:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203792580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443881984:12345-0@lo:13:osp-pre-1-1.0 Request processed in 38us (1060us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830991.594344:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787830991.594419:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:0.0:1787830991.594429:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a682c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+24:3621:x1874676443880448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787830991.594458:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a682c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+24:3621:x1874676443880448:12345-0@lo:400:kworker.0 Request processed in 32us (1305us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830991.594472:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:0.0:1787830991.594522:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443880576 00000100:00100000:0.0:1787830991.594525:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443880576 00000100:00100000:0.0:1787830991.594543:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443881088 00000100:00100000:0.0:1787830991.594546:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443881088 00000100:00100000:0.0:1787830991.594558:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443881600 00000100:00100000:0.0:1787830991.594560:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443881600 00000100:00100000:0.0:1787830991.594571:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1787830991.594576:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203793480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1874676443880576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787830991.594601:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203793480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1874676443880576:12345-0@lo:400:kworker.0 Request processed in 25us (1270us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830991.594607:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1787830991.594616:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1787830991.594620:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203791680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1874676443881088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787830991.594659:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203791680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1874676443881088:12345-0@lo:400:kworker.0 Request processed in 38us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830991.594664:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1787830991.594674:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1787830991.594679:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203793840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1874676443881600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787830991.594697:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203793840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1874676443881600:12345-0@lo:400:kworker.0 Request processed in 19us (637us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830991.594702:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00080000:0.0:1787830991.594721:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787830991.594725:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787830991.595503:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a203c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3621:1874676443880576:0@lo:400:kworker.0 00000100:00100000:0.0:1787830991.595519:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a7ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3621:1874676443881088:0@lo:400:kworker.0 00000100:00100000:0.0:1787830991.595540:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203afcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3621:1874676443881600:0@lo:400:kworker.0 00000100:00100000:0.0:1787830991.595549:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a22940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a45944b-32e3-4193-a2a5-46f84222bc14:3621:1874676443880448:0@lo:400:kworker.0 00000100:00100000:0.0:1787830991.595559:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a78b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443880960:0@lo:400:kworker.0 00010000:00080000:0.0:1787830991.595571:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2203afde00 x1874676443881472/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787831007 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787830991.595581:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203afde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443881472:0@lo:400:kworker.0 00000100:00100000:0.0:1787830991.595602:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22039b9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443881984:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1787830991.848754:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787830992.096089:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787830992.096125:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433318528 00000100:00100000:3.0:1787830992.096134:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433318528 00000100:00100000:3.0:1787830992.096195:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 44 00000100:00100000:3.0:1787830992.096205:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2334488b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+9:11095:x1874676433318528:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:3.0:1787830992.096224:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787830992.096243:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d28c05 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99423d52 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.096308:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d28c0c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.096323:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d28c0c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.096337:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d28c0c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.096350:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d28c13 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.096358:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d28c13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.096364:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d28c13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.096410:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d28c0c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.096418:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d28c0c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.096424:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d28c0c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.096431:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2307c76600 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:3.0:1787830992.096436:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d28c0c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.096443:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d28c0c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.096457:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2309e00200) 00010000:00010000:3.0:1787830992.096460:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787830992.096465:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d28c0c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.096472:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d28c0c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.096482:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d28c13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.096488:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d28c13 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.096493:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d28c13 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.096505:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2307c77600 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:3.0:1787830992.096508:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d28c13 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.096515:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d28c13 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.096523:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8d2318594d00) 00010000:00010000:3.0:1787830992.096526:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787830992.096529:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d28c13 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.096535:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d28c13 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.096565:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d28c05 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423d52 expref: 10 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.096576:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2309e00200) 00010000:00010000:3.0:1787830992.096578:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787830992.096582:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d28c05 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423d52 expref: 10 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.096591:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2307c77a00, rc 0) 00000100:00100000:3.0:1787830992.096672:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2334488b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+9:11095:x1874676433318528:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 468us (592us total) trans 0 rc 301/301 00000100:00100000:3.0:1787830992.096680:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 44 00000100:00080000:3.0:1787830992.096703:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787830992.108773:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787830992.110225:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433318784 00000100:00100000:2.0:1787830992.110237:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433318784 00000100:00100000:2.0:1787830992.110307:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 45 00000100:00100000:2.0:1787830992.110317:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220380f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+9:11095:x1874676433318784:12345-192.168.203.31@tcp:36:lfs.0 00010000:00010000:2.0:1787830992.110369:0:8620:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787830992.110395:0:8620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10400/0x95459fb9d1d28bbf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423d3d expref: 9 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830992.110414:0:8620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2309e00200) 00010000:00010000:2.0:1787830992.110425:0:8620:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787830992.110481:0:8620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d28c1a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830992.110504:0:8620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d28c1a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830992.110513:0:8620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d28c1a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830992.110527:0:8620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0400/0x95459fb9d1d28c21 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830992.110534:0:8620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0400/0x95459fb9d1d28c21 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830992.110541:0:8620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0400/0x95459fb9d1d28c21 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830992.112497:0:8620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0c00/0x95459fb9d1d28c28 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830992.112516:0:8620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0c00/0x95459fb9d1d28c28 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830992.112527:0:8620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0c00/0x95459fb9d1d28c28 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787830992.112544:0:8620:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003e04edff reply state 0000000066f481b5 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0c00/0x95459fb9d1d28c28 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830992.112555:0:8620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0c00/0x95459fb9d1d28c28 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830992.112561:0:8620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d2203615700) 00010000:00010000:2.0:1787830992.112571:0:8620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787830992.112575:0:8620:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787830992.112580:0:8620:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1787830992.112589:0:8620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d28c1a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830992.112595:0:8620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d28c1a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830992.112607:0:8620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d28c1a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830992.112613:0:8620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22039c0a00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:2.0:1787830992.112618:0:8620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d28c1a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830992.114485:0:8620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d28c1a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830992.114510:0:8620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2203615200) 00010000:00010000:2.0:1787830992.114513:0:8620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787830992.114518:0:8620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d28c1a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830992.114527:0:8620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d28c1a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787830992.114548:0:8620:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003e04edff reply state 0000000066f481b5 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0400/0x95459fb9d1d28c21 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830992.114559:0:8620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0400/0x95459fb9d1d28c21 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830992.114581:0:8620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8d2203615600) 00010000:00010000:2.0:1787830992.114584:0:8620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787830992.114587:0:8620:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1787830992.115973:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220380f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+10:11095:x1874676433318784:12345-192.168.203.31@tcp:36:lfs.0 Request processed in 5648us (7198us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1787830992.115984:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 45 00000100:00100000:3.0:1787830992.220405:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787830992.223166:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433318912 00000100:00100000:1.0:1787830992.223197:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433318912 00000100:00100000:1.0:1787830992.223275:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 46 00000100:00100000:1.0:1787830992.223285:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2334489a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+10:11103:x1874676433318912:12345-192.168.203.31@tcp:101:lctl.0 00010000:00010000:1.0:1787830992.223309:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787830992.223331:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95000/0x95459fb9d1d28c2f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99423d59 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830992.223395:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94800/0x95459fb9d1d28c36 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830992.223409:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94800/0x95459fb9d1d28c36 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830992.223421:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94800/0x95459fb9d1d28c36 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787830992.223463:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787830992.223467:0:6492:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787830992.223506:0:6492:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94800/0x95459fb9d1d28c36 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830992.223543:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95000/0x95459fb9d1d28c2f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423d59 expref: 12 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830992.223562:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94800/0x95459fb9d1d28c36 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423d59 expref: 11 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830992.223571:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d233a6f7300) 00010000:00010000:1.0:1787830992.223574:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787830992.223577:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233be94800, rc 0) 00000100:00100000:1.0:1787830992.223715:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2334489a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+11:11103:x1874676433318912:12345-192.168.203.31@tcp:101:lctl.0 Request processed in 431us (3319us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830992.223722:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 46 00000100:00100000:1.0:1787830992.290244:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787830992.290380:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433319040 00000100:00100000:3.0:1787830992.290390:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433319040 00000100:00100000:3.0:1787830992.290500:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 47 00000100:00100000:3.0:1787830992.290511:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2309cfb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+11:11109:x1874676433319040:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:3.0:1787830992.290532:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787830992.290553:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d28c3d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99423d60 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.290616:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d28c44 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.290667:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d28c44 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.290678:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d28c44 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.290688:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d28c4b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.290695:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d28c4b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.290701:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d28c4b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.290780:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76200/0x95459fb9d1d28c52 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.290790:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76200/0x95459fb9d1d28c52 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.290816:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76200/0x95459fb9d1d28c52 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787830992.290850:0:6491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1787830992.290854:0:6491:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787830992.290894:0:6491:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76200/0x95459fb9d1d28c52 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.290918:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d28c44 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.290925:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d28c44 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.290931:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d28c44 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.290937:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2307c77600 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:3.0:1787830992.290942:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d28c44 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.290949:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d28c44 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.290960:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d233a6f7300) 00010000:00010000:3.0:1787830992.290963:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787830992.290968:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d28c44 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.290974:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d28c44 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.290999:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d28c4b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.291006:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d28c4b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.291013:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d28c4b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.291018:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2307c76600 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:3.0:1787830992.291021:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d28c4b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.291028:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d28c4b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.291036:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8d2203615600) 00010000:00010000:3.0:1787830992.291038:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787830992.291041:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d28c4b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.291047:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d28c4b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.291074:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d28c3d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423d60 expref: 13 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.291088:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76200/0x95459fb9d1d28c52 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423d60 expref: 12 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.291106:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d2203615700) 00010000:00010000:3.0:1787830992.291108:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787830992.291111:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2307c76200, rc 0) 00000100:00100000:3.0:1787830992.291189:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2309cfb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+12:11109:x1874676433319040:12345-192.168.203.31@tcp:101:bash.0 Request processed in 679us (1076us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830992.291196:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 47 00000100:00100000:2.0:1787830992.305675:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787830992.306248:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433319296 00000100:00100000:3.0:1787830992.306268:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433319296 00000100:00100000:3.0:1787830992.306333:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 48 00000100:00100000:3.0:1787830992.306344:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2336bfda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+12:11109:x1874676433319296:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:3.0:1787830992.306363:0:8620:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787830992.306384:0:8620:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76a00/0x95459fb9d1d28c59 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99423d67 expref: -99 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.306497:0:8620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77800/0x95459fb9d1d28c60 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.306512:0:8620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77800/0x95459fb9d1d28c60 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.306524:0:8620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77800/0x95459fb9d1d28c60 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.306540:0:8620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d28c67 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.306548:0:8620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d28c67 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.306573:0:8620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d28c67 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787830992.307771:0:8620:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:3.0:1787830992.308173:0:8620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d28c6e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.308187:0:8620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d28c6e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.308196:0:8620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d28c6e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.308613:0:8620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77800/0x95459fb9d1d28c60 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.308646:0:8620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77800/0x95459fb9d1d28c60 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.308654:0:8620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77800/0x95459fb9d1d28c60 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.308661:0:8620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2307c77800 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:3.0:1787830992.308665:0:8620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77800/0x95459fb9d1d28c60 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.308673:0:8620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77800/0x95459fb9d1d28c60 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.308688:0:8620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d2203615700) 00010000:00010000:3.0:1787830992.308691:0:8620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787830992.308709:0:8620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77800/0x95459fb9d1d28c60 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.308716:0:8620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77800/0x95459fb9d1d28c60 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787830992.308732:0:8620:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009e2f260c reply state 00000000545f2ae4 transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d28c67 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.308744:0:8620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d28c67 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.308751:0:8620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8d2318594d00) 00010000:00010000:3.0:1787830992.308753:0:8620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787830992.308757:0:8620:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787830992.308792:0:8620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76a00/0x95459fb9d1d28c59 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423d67 expref: 15 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.308807:0:8620:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d28c6e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423d67 expref: 14 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.308814:0:8620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d2318594f00) 00010000:00010000:3.0:1787830992.308817:0:8620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787830992.308819:0:8620:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2307c77400, rc 0) 00000100:00100000:3.0:1787830992.308964:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2336bfda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+15:11109:x1874676433319296:12345-192.168.203.31@tcp:101:bash.0 Request processed in 2621us (3298us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1787830992.308973:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 48 00000100:00100000:1.0:1787830992.315846:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787830992.315916:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433319424 00000100:00100000:0.0:1787830992.315926:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433319424 00000100:00100000:0.0:1787830992.315971:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 28 00000100:00100000:0.0:1787830992.315979:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d232f6c8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2393:x1874676433319424:12345-192.168.203.31@tcp:8:bash.0 00010000:00080000:0.0:1787830992.316010:0:8406:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 47d7f0ed-283f-4b70-a741-6e74c5e52619@192.168.203.31@tcp t0 exp 0000000000000000 cur 283 last 0 00000020:00000080:0.0:1787830992.316038:0:8406:0:(genops.c:1385:class_connect()) connect: client 47d7f0ed-283f-4b70-a741-6e74c5e52619, cookie 0x95459fb9d1d28c7c 00002000:00100000:0.0:1787830992.316051:0:8406:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 47d7f0ed-283f-4b70-a741-6e74c5e52619/ffff8d233bda0000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211393d ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787830992.316069:0:8406:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type 37, return 37 00002000:00080000:0.0:1787830992.316140:0:8406:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787830992.316170:0:8406:0:(import.c:65:import_set_state_nolock()) ffff8d233bda4000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787830992.316247:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d232f6c8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+6:2393:x1874676433319424:12345-192.168.203.31@tcp:8:bash.0 Request processed in 266us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830992.316255:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 28 00000100:00100000:1.0:1787830992.321729:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787830992.321893:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433319552 00000100:00100000:0.0:1787830992.321915:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433319552 00000100:00100000:0.0:1787830992.322012:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 29 00000100:00100000:0.0:1787830992.322038:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d232f6c83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+6:0:x1874676433319552:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:0.0:1787830992.322057:0:8407:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787830992.322127:0:8407:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e6e95077/0x95459fb9d1d28c83 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99423d6e expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787830992.322154:0:8407:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787830992.322174:0:8407:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=283s v=(0 0) 00010000:00010000:0.0:1787830992.322179:0:8407:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787830992.322188:0:8407:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6e95077/0x95459fb9d1d28c83 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423d6e expref: 7 pid: 8407 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830992.322208:0:8407:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e6e95077/0x95459fb9d1d28c83 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423d6e expref: 7 pid: 8407 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830992.322222:0:8407:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233bf11000, rc 0) 00000100:00100000:0.0:1787830992.322284:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d232f6c83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+7:0:x1874676433319552:12345-192.168.203.31@tcp:101:bash.0 Request processed in 249us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830992.322291:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 29 00000100:00080000:3.0:1787830992.322364:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787830992.328210:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787830992.331267:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433319680 00000100:00100000:0.0:1787830992.331281:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433319680 00000100:00100000:0.0:1787830992.331358:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 30 00000100:00100000:0.0:1787830992.331368:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2336bff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+7:11109:x1874676433319680:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:0.0:1787830992.331385:0:8406:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787830992.331403:0:8406:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e4a63826/0x95459fb9d1d28c8a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99423d75 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830992.331462:0:8406:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e6e95077/0x95459fb9d1d28c83 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423d6e expref: 8 pid: 8407 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830992.331472:0:8406:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787830992.331483:0:8406:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787830992.331489:0:8406:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4a63826/0x95459fb9d1d28c8a lrc: 4/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423d75 expref: 8 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830992.331531:0:8406:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e6e95077/0x95459fb9d1d28c83 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423d6e expref: 8 pid: 8407 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830992.331545:0:8406:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e6e95077/0x95459fb9d1d28c83 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423d6e expref: 8 pid: 8407 timeout: 383 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830992.331558:0:8406:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22039b9a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8406:1874676443882112:192.168.203.31@tcp:104: 00000100:00100000:0.0:1787830992.332083:0:8406:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2307d75840 going to sleep for 11 seconds 00000100:00100000:2.0:1787830992.337739:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787830992.337797:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433319808 00000100:00100000:3.0:1787830992.337806:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433319808 00000100:00100000:0.0:1787830992.337860:0:8406:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22039b9a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8406:1874676443882112:192.168.203.31@tcp:104: 00010000:00010000:0.0:1787830992.337894:0:8406:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e4a63826/0x95459fb9d1d28c8a lrc: 3/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423d75 expref: 9 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830992.337927:0:8406:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233bf11c00, rc 0) 00010000:00010000:2.0:1787830992.338077:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e6e95077/0x95459fb9d1d28c83 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423d6e expref: 9 pid: 8407 timeout: 383 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830992.338112:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 52 00000100:00100000:2.0:1787830992.338122:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2321e76450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+9:2397:x1874676433319808:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787830992.338136:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787830992.338157:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e6e95077/0x95459fb9d1d28c83 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423d6e expref: 9 pid: 8407 timeout: 383 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830992.338170:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e6e95077/0x95459fb9d1d28c83 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423d6e expref: 9 pid: 8407 timeout: 383 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830992.338193:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6e95077/0x95459fb9d1d28c83 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423d6e expref: 9 pid: 8407 timeout: 383 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830992.338210:0:6476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787830992.338227:0:6476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787830992.338236:0:6476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e4a63826/0x95459fb9d1d28c8a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423d75 expref: 8 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830992.338246:0:6476:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4a63826/0x95459fb9d1d28c8a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423d75 expref: 8 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830992.338279:0:6476:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000e4a63826/0x95459fb9d1d28c8a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423d75 expref: 8 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830992.338294:0:6476:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2336bfed00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6476:1874676443882240:192.168.203.31@tcp:105: 00000100:00100000:0.0:1787830992.338353:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2336bff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+8:11109:x1874676433319680:12345-192.168.203.31@tcp:101:bash.0 Request processed in 6985us (10151us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830992.338362:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 30 00000100:00100000:2.0:1787830992.343387:0:6476:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d23100b7600 going to sleep for 11 seconds 00000100:00100000:2.0:1787830992.347271:0:6476:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2336bfed00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6476:1874676443882240:192.168.203.31@tcp:105: 00010000:00010000:2.0:1787830992.347305:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787830992.347954:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2321e76450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+7:2397:x1874676433319808:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 9828us (10217us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830992.347969:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 52 00000100:00100000:1.0:1787830992.349682:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787830992.349742:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433320064 00000100:00100000:3.0:1787830992.349782:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433320064 00000100:00100000:3.0:1787830992.349840:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 6 00000100:00100000:3.0:1787830992.349850:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d232f6c92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+15:11109:x1874676433320064:12345-192.168.203.31@tcp:35:bash.0 00000100:00100000:3.0:1787830992.350269:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d232f6c92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+16:11109:x1874676433320064:12345-192.168.203.31@tcp:35:bash.0 Request processed in 418us (594us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1787830992.350278:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 6 00000100:00100000:1.0:1787830992.402720:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787830992.402964:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433320320 00000100:00100000:3.0:1787830992.402975:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433320320 00000100:00100000:0.0:1787830992.403308:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 49 00000100:00100000:0.0:1787830992.403320:0:13771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d232f6cb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47d7f0ed-283f-4b70-a741-6e74c5e52619+16:11119:x1874676433320320:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:0.0:1787830992.403343:0:13771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787830992.403364:0:13771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10600/0x95459fb9d1d28c91 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99423d7c expref: -99 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787830992.403472:0:13771:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1787830992.403589:0:13771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10600/0x95459fb9d1d28c91 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423d7c expref: 18 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830992.403618:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d233a6f7300) 00010000:00010000:0.0:1787830992.403621:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787830992.403865:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10600/0x95459fb9d1d28c91 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423d7c expref: 18 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830992.403882:0:13771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233bf10600, rc 0) 00000100:00100000:0.0:1787830992.403963:0:13771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d232f6cb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47d7f0ed-283f-4b70-a741-6e74c5e52619+17:11119:x1874676433320320:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 646us (1263us total) trans 4294967315 rc 301/301 00000100:00100000:0.0:1787830992.403971:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 49 00000100:00100000:1.0:1787830992.416146:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787830992.416250:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433320576 00000100:00100000:2.0:1787830992.416260:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433320576 00000100:00100000:2.0:1787830992.416319:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 7 00000100:00100000:2.0:1787830992.416329:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d232f6cbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+17:11119:x1874676433320576:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:2.0:1787830992.416577:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d232f6cbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+18:11119:x1874676433320576:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 248us (441us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1787830992.416584:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 7 00000100:00100000:1.0:1787830992.531741:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787830992.531847:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433320704 00000100:00100000:3.0:1787830992.531857:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433320704 00000100:00100000:3.0:1787830992.531926:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 50 00000100:00100000:3.0:1787830992.531936:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d232f6ca1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+18:11125:x1874676433320704:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:3.0:1787830992.531960:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787830992.531980:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76a00/0x95459fb9d1d28c9f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99423d83 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.532044:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77800/0x95459fb9d1d28ca6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.532058:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77800/0x95459fb9d1d28ca6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.532069:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77800/0x95459fb9d1d28ca6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787830992.532113:0:6491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1787830992.532117:0:6491:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787830992.532139:0:6491:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77800/0x95459fb9d1d28ca6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.532183:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76a00/0x95459fb9d1d28c9f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423d83 expref: 20 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.532202:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77800/0x95459fb9d1d28ca6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423d83 expref: 19 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.532210:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d2203615700) 00010000:00010000:3.0:1787830992.532213:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787830992.532216:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2307c77800, rc 0) 00000100:00100000:3.0:1787830992.532286:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d232f6ca1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+19:11125:x1874676433320704:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 350us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830992.532294:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 50 00000100:00100000:1.0:1787830992.538257:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787830992.538360:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433320960 00000100:00100000:3.0:1787830992.538371:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433320960 00000100:00100000:3.0:1787830992.538432:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 51 00000100:00100000:3.0:1787830992.538442:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d232f6c8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+19:11125:x1874676433320960:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:3.0:1787830992.538462:0:8620:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787830992.538482:0:8620:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d28cad lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99423d8a expref: -99 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.538618:0:8620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d28cb4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.538660:0:8620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d28cb4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.538672:0:8620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d28cb4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787830992.538738:0:8620:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1787830992.538850:0:8620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d28cad lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423d8a expref: 22 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.538873:0:8620:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d28cb4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423d8a expref: 21 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.538882:0:8620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d2318594f00) 00010000:00010000:3.0:1787830992.538884:0:8620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787830992.538888:0:8620:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2307c76600, rc 0) 00000100:00100000:3.0:1787830992.538963:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d232f6c8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+21:11125:x1874676433320960:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 519us (713us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1787830992.538973:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 51 00000100:00100000:2.0:1787830992.544178:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787830992.544265:0:13771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433321216 00000100:00100000:3.0:1787830992.544275:0:13771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433321216 00000100:00100000:3.0:1787830992.544339:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 52 00000100:00100000:3.0:1787830992.544350:0:13771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2336bfed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47d7f0ed-283f-4b70-a741-6e74c5e52619+21:11125:x1874676433321216:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:3.0:1787830992.544373:0:13771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787830992.544394:0:13771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76a00/0x95459fb9d1d28cc2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99423d91 expref: -99 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.544501:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d28cc9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.544516:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d28cc9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.544546:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d28cc9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787830992.544560:0:13771:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1787830992.544695:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76a00/0x95459fb9d1d28cc2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423d91 expref: 24 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.544712:0:13771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d28cc9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423d91 expref: 23 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.544720:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d2318594f00) 00010000:00010000:3.0:1787830992.544724:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787830992.544727:0:13771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2307c77600, rc 0) 00000100:00100000:3.0:1787830992.544785:0:13771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2336bfed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47d7f0ed-283f-4b70-a741-6e74c5e52619+23:11125:x1874676433321216:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 437us (617us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1787830992.544792:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 52 00000100:00100000:1.0:1787830992.556575:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787830992.556666:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433321344 00000100:00100000:0.0:1787830992.556675:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433321344 00000100:00100000:0.0:1787830992.556740:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 3 00000100:00100000:0.0:1787830992.556750:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d232f6cb840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+23:2395:x1874676433321344:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787830992.556767:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787830992.556792:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d28cb4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423d8a expref: 23 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830992.556830:0:6475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d2318594f00) 00010000:00010000:0.0:1787830992.556835:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787830992.556907:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d232f6cb840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+22:2395:x1874676433321344:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 151us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830992.556916:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 3 00000100:00100000:1.0:1787830992.564729:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787830992.564833:0:8631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433321472 00000100:00100000:0.0:1787830992.564843:0:8631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433321472 00000100:00100000:0.0:1787830992.564912:0:8631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 31 00000100:00100000:0.0:1787830992.564923:0:8631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d232f6ca940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+7:2396:x1874676433321472:12345-192.168.203.31@tcp:1:lfs.0 00010000:00010000:0.0:1787830992.564972:0:8631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a8e188d/0x95459fb9d1d28cd7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830992.564992:0:8631:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e4a63826/0x95459fb9d1d28c8a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423d75 expref: 7 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830992.565000:0:8631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787830992.565004:0:8631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787830992.565009:0:8631:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a8e188d/0x95459fb9d1d28cd7 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830992.565044:0:8631:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e4a63826/0x95459fb9d1d28c8a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423d75 expref: 7 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830992.565058:0:8631:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e4a63826/0x95459fb9d1d28c8a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423d75 expref: 7 pid: 8406 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830992.565093:0:8631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22039b9a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8631:1874676443882368:192.168.203.31@tcp:104: 00000100:00100000:0.0:1787830992.565203:0:8631:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2307d75c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787830992.571252:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787830992.571689:0:8631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22039b9a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8631:1874676443882368:192.168.203.31@tcp:104: 00010000:00010000:0.0:1787830992.571717:0:8631:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005a8e188d/0x95459fb9d1d28cd7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830992.571809:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433321600 00000100:00100000:1.0:1787830992.571817:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433321600 00002000:00100000:1.0:1787830992.571865:0:8411:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x2:0x0] (0->12) req@ffff8d2336bffc00 x1874676433321600/t0(0) o4->47d7f0ed-283f-4b70-a741-6e74c5e52619@192.168.203.31@tcp:63/0 lens 504/0 e 0 to 0 dl 1787831003 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787830992.571875:0:8411:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d2336bffc00 with x1874676433321600 ext(0->12) 00010000:00010000:1.0:1787830992.571883:0:8411:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000e4a63826/0x95459fb9d1d28c8a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423d75 expref: 8 pid: 8406 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830992.571899:0:8411:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000e4a63826/0x95459fb9d1d28c8a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423d75 expref: 8 pid: 8406 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787830992.571919:0:8411:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8d2336bffc00 00000100:00100000:1.0:1787830992.571951:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 0 00000100:00100000:1.0:1787830992.571961:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2336bffc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+8:2397:x1874676433321600:12345-192.168.203.31@tcp:4:lfs.0 00000001:00100000:3.0:1787830992.580182:0:8401:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 47d7f0ed-283f-4b70-a741-6e74c5e52619 00000100:00100000:1.0:1787830992.585860:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2336bffc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+9:2397:x1874676433321600:12345-192.168.203.31@tcp:4:lfs.0 Request processed in 13889us (14606us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1787830992.585874:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 0 00002000:00100000:1.0:1787830992.585887:0:8411:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x2:0x0] (0->12) req@ffff8d2336bffc00 x1874676433321600/t4294967300(0) o4->47d7f0ed-283f-4b70-a741-6e74c5e52619@192.168.203.31@tcp:63/0 lens 504/448 e 0 to 0 dl 1787831003 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787830992.585898:0:8411:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d2336bffc00 with x1874676433321600 ext(0->12) 00010000:00010000:1.0:1787830992.585917:0:8411:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000e4a63826/0x95459fb9d1d28c8a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423d75 expref: 9 pid: 8406 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830992.585937:0:8411:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000e4a63826/0x95459fb9d1d28c8a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423d75 expref: 9 pid: 8406 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787830992.585946:0:8411:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8d2336bffc00 00000100:00100000:3.0:1787830992.598752:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787830992.601150:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433321728 00000100:00100000:2.0:1787830992.601165:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433321728 00010000:00010000:2.0:1787830992.601216:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e4a63826/0x95459fb9d1d28c8a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423d75 expref: 9 pid: 8406 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830992.601266:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 53 00000100:00100000:2.0:1787830992.601276:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2334489680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+9:2395:x1874676433321728:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787830992.601294:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1787830992.601313:0:6477:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1787830992.601316:0:6477:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1787830992 00002000:00010000:2.0:1787830992.601318:0:6477:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb atime from disk: 0 -> 1787830993 00002000:00010000:2.0:1787830992.601320:0:6477:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1787830992 00002000:00010000:2.0:1787830992.601322:0:6477:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1787830992.601329:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e4a63826/0x95459fb9d1d28c8a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423d75 expref: 9 pid: 8406 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830992.601343:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e4a63826/0x95459fb9d1d28c8a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423d75 expref: 9 pid: 8406 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830992.601366:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e4a63826/0x95459fb9d1d28c8a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423d75 expref: 9 pid: 8406 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830992.601388:0:6477:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787830992.601392:0:6477:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787830992.601397:0:6477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005a8e188d/0x95459fb9d1d28cd7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830992.601426:0:6477:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a8e188d/0x95459fb9d1d28cd7 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830992.601462:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787830992.601532:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2334489680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+8:2395:x1874676433321728:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 255us (2789us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830992.601540:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 53 00010000:00010000:1.0:1787830992.601835:0:8631:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005a8e188d/0x95459fb9d1d28cd7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830992.601847:0:8631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005a8e188d/0x95459fb9d1d28cd7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830992.601868:0:8631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a8e188d/0x95459fb9d1d28cd7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830992.601875:0:8631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005a8e188d/0x95459fb9d1d28cd7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830992.601896:0:8631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005a8e188d/0x95459fb9d1d28cd7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830992.601915:0:8631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233bf10600 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:1.0:1787830992.601919:0:8631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005a8e188d/0x95459fb9d1d28cd7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830992.601929:0:8631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005a8e188d/0x95459fb9d1d28cd7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830992.601945:0:8631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005a8e188d/0x95459fb9d1d28cd7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830992.601952:0:8631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005a8e188d/0x95459fb9d1d28cd7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830992.602016:0:8631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d232f6ca940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+7:2396:x1874676433321472:12345-192.168.203.31@tcp:1:lfs.0 Request processed in 37094us (37297us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830992.602025:0:8631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 31 00000100:00100000:2.0:1787830992.607887:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787830992.608098:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433321984 00000100:00100000:1.0:1787830992.608109:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433321984 00000100:00100000:1.0:1787830992.608167:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 8 00000100:00100000:1.0:1787830992.608177:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220390a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+22:11125:x1874676433321984:12345-192.168.203.31@tcp:35:lfs.0 00000004:00010000:1.0:1787830992.608246:0:6494:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d28cc9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423d91 expref: 22 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787830992.608485:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:1.0:1787830992.608534:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:1.0:1787830992.608950:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00010000:00010000:1.0:1787830992.608990:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94c00/0x95459fb9d1d28cde lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830992.609005:0:6494:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d28c6e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423d67 expref: 26 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830992.609014:0:6494:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94c00/0x95459fb9d1d28cde lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830992.609046:0:6494:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d28c6e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423d67 expref: 26 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830992.609059:0:6494:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d28c6e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423d67 expref: 26 pid: 8620 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830992.609073:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2309d09e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6494:1874676443882496:192.168.203.31@tcp:104: 00000100:00100000:1.0:1787830992.609167:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d232f727600 going to sleep for 11 seconds 00000100:00100000:2.0:1787830992.612404:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787830992.612507:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2309d09e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6494:1874676443882496:192.168.203.31@tcp:104: 00010000:00010000:1.0:1787830992.612537:0:6494:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94c00/0x95459fb9d1d28cde lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830992.613965:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433322112 00000100:00100000:0.0:1787830992.613976:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433322112 00010000:00010000:0.0:1787830992.614033:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d28c6e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423d67 expref: 27 pid: 8620 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830992.614074:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 54 00000100:00100000:0.0:1787830992.614085:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2201def840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+27:2397:x1874676433322112:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787830992.614100:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787830992.614106:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d28c6e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423d67 expref: 27 pid: 8620 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830992.614120:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d28c6e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423d67 expref: 27 pid: 8620 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830992.614152:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d28c6e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423d67 expref: 27 pid: 8620 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830992.614168:0:6475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d2318594f00) 00010000:00010000:0.0:1787830992.614186:0:6475:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94c00/0x95459fb9d1d28cde lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830992.614194:0:6475:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94c00/0x95459fb9d1d28cde lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830992.614201:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94c00/0x95459fb9d1d28cde lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830992.614269:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787830992.614336:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2201def840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+26:2397:x1874676433322112:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 252us (1940us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830992.614345:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 54 00010000:00010000:1.0:1787830992.626870:0:6494:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94c00/0x95459fb9d1d28cde lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830992.626888:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94c00/0x95459fb9d1d28cde lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787830992.627024:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000001:00080000:1.0:1787830992.627123:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:1.0:1787830992.627222:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2309d09e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6494:1874676443882624:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787830992.627286:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830992.627321:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d232f727b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787830992.627389:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443882624 00000100:00100000:0.0:1787830992.627395:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443882624 00000100:00100000:0.0:1787830992.627441:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1787830992.627449:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2309d0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6494:x1874676443882624:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787830992.627530:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2309d0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6494:x1874676443882624:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 82us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830992.627537:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1787830992.628068:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2309d09e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6494:1874676443882624:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1787830992.628352:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:3.0:1787830992.628442:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a4b0c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6494:1874676443882752:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787830992.628512:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830992.628558:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2202713e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787830992.634098:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443882752 00000100:00100000:1.0:1787830992.634113:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443882752 00000100:00100000:1.0:1787830992.634180:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1787830992.634189:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a4a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6494:x1874676443882752:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787830992.634397:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a4a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6494:x1874676443882752:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 208us (5885us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1787830992.634405:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1787830992.634759:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a4b0c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6494:1874676443882752:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1787830992.634870:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:3.0:1787830992.634970:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94c00/0x95459fb9d1d28cde lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.634983:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94c00/0x95459fb9d1d28cde lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.634991:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94c00/0x95459fb9d1d28cde lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.634999:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233be94c00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:3.0:1787830992.635004:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94c00/0x95459fb9d1d28cde lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.635014:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94c00/0x95459fb9d1d28cde lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.635033:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d2318594f00) 00010000:00010000:3.0:1787830992.635037:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787830992.635043:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94c00/0x95459fb9d1d28cde lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.635051:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94c00/0x95459fb9d1d28cde lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787830992.635204:0:6494:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1787830992.635292:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:3.0:1787830992.635305:0:6494:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 283635679742ns, next at 284635677663ns, rc = 0 00000001:00080000:3.0:1787830992.635312:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:3.0:1787830992.635344:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d2318594f00) 00010000:00010000:3.0:1787830992.635348:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787830992.635356:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d28cc9 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423d91 expref: 30 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830992.635570:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220390a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+29:11125:x1874676433321984:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 27393us (27691us total) trans 4294967327 rc 0/0 00000100:00100000:3.0:1787830992.635581:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 8 00000020:00080000:3.0:1787830992.635587:0:6494:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1787830992.640095:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787830992.640170:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433322240 00000100:00100000:1.0:1787830992.640180:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433322240 00000100:00100000:1.0:1787830992.640243:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 53 00000100:00100000:1.0:1787830992.640255:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2201defc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+29:11125:x1874676433322240:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:1.0:1787830992.640279:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787830992.640305:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95000/0x95459fb9d1d28ce5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99423d98 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830992.640365:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95000/0x95459fb9d1d28ce5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423d98 expref: 30 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830992.640379:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95000/0x95459fb9d1d28ce5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423d98 expref: 30 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830992.640417:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d233a6f7d00) 00010000:00010000:1.0:1787830992.640421:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787830992.640425:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233be95000, rc 0) 00000100:00100000:1.0:1787830992.640486:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2201defc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+30:11125:x1874676433322240:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 235us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830992.640493:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 53 00000100:00100000:2.0:1787830992.646526:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787830992.646809:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433322496 00000100:00100000:3.0:1787830992.646823:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433322496 00000100:00100000:3.0:1787830992.646898:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 9 00000100:00100000:3.0:1787830992.646918:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d23066c8450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+30:11125:x1874676433322496:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:3.0:1787830992.647255:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d23066c8450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+31:11125:x1874676433322496:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 339us (743us total) trans 4294967328 rc 0/0 00000100:00100000:3.0:1787830992.647264:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 9 00000100:00100000:2.0:1787830992.699378:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787830992.699743:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433322752 00000100:00100000:0.0:1787830992.699755:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433322752 00000100:00100000:0.0:1787830992.699831:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 54 00000100:00100000:0.0:1787830992.699842:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2201ded2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+31:11135:x1874676433322752:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:0.0:1787830992.699874:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787830992.699913:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10600/0x95459fb9d1d28cec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99423d9f expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787830992.700048:0:6490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1787830992.701750:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10600/0x95459fb9d1d28cec lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423d9f expref: 33 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830992.701775:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d233a6f7300) 00010000:00010000:0.0:1787830992.701779:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787830992.701785:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10600/0x95459fb9d1d28cec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423d9f expref: 33 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830992.701805:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233bf10600, rc 0) 00000100:00100000:0.0:1787830992.701913:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2201ded2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+32:11135:x1874676433322752:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 2062us (2538us total) trans 4294967329 rc 301/301 00000100:00100000:0.0:1787830992.701923:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 54 00000100:00100000:2.0:1787830992.707475:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787830992.707576:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433322880 00000100:00100000:3.0:1787830992.707588:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433322880 00000100:00100000:3.0:1787830992.707790:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 55 00000100:00100000:3.0:1787830992.707802:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2201dec780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+32:11135:x1874676433322880:12345-192.168.203.31@tcp:34:lfs.0 00010000:00010000:3.0:1787830992.707894:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d28cfa lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.707924:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d28cfa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.707939:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d28cfa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.707951:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76a00/0x95459fb9d1d28d01 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.707979:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76a00/0x95459fb9d1d28d01 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.707986:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76a00/0x95459fb9d1d28d01 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.708076:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d28d08 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.708084:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d28d08 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.708090:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d28d08 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787830992.708146:0:6491:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d28d08 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.708262:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d28cfa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.708271:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d28cfa lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.708278:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d28cfa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.708284:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2307c77600 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:3.0:1787830992.708288:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d28cfa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.708297:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d28cfa lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.708317:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d2203615700) 00010000:00010000:3.0:1787830992.708320:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787830992.708326:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d28cfa lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.708333:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d28cfa lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.708346:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76a00/0x95459fb9d1d28d01 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.708351:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76a00/0x95459fb9d1d28d01 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.708357:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76a00/0x95459fb9d1d28d01 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.708363:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2307c76a00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:3.0:1787830992.708366:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76a00/0x95459fb9d1d28d01 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.708371:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76a00/0x95459fb9d1d28d01 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.708376:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8d2318594d00) 00010000:00010000:3.0:1787830992.708378:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787830992.708381:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76a00/0x95459fb9d1d28d01 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.708387:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76a00/0x95459fb9d1d28d01 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.708404:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d28d08 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.708410:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d28d08 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.708416:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d28d08 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.708421:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2307c77a00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:3.0:1787830992.708423:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d28d08 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.708429:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d28d08 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.708435:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d233a6f7d00) 00010000:00010000:3.0:1787830992.708437:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787830992.708439:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d28d08 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.708445:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d28d08 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830992.708524:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2201dec780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+32:11135:x1874676433322880:12345-192.168.203.31@tcp:34:lfs.0 Request processed in 723us (1064us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830992.708531:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 55 00000100:00100000:2.0:1787830992.711270:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787830992.713756:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433323136 00000100:00100000:1.0:1787830992.713775:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433323136 00000100:00100000:1.0:1787830992.715793:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 10 00000100:00100000:1.0:1787830992.715834:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2201dede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+32:11135:x1874676433323136:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:1.0:1787830992.716557:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2201dede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+33:11135:x1874676433323136:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 746us (5295us total) trans 4294967330 rc 0/0 00000100:00100000:1.0:1787830992.716568:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 10 00000100:00100000:2.0:1787830992.759709:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787830992.759822:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433323392 00000100:00100000:1.0:1787830992.759835:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433323392 00000100:00100000:1.0:1787830992.759917:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 56 00000100:00100000:1.0:1787830992.759928:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2201def0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+33:11138:x1874676433323392:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:1.0:1787830992.759961:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787830992.760000:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95e00/0x95459fb9d1d28d0f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99423da6 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830992.760091:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94a00/0x95459fb9d1d28d16 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830992.760108:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94a00/0x95459fb9d1d28d16 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830992.760139:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94a00/0x95459fb9d1d28d16 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830992.760151:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94200/0x95459fb9d1d28d1d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830992.760159:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94200/0x95459fb9d1d28d1d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830992.760165:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94200/0x95459fb9d1d28d1d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830992.760416:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94c00/0x95459fb9d1d28d24 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830992.760425:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94c00/0x95459fb9d1d28d24 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830992.760431:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94c00/0x95459fb9d1d28d24 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787830992.760442:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1787830992.760591:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94a00/0x95459fb9d1d28d16 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830992.760600:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94a00/0x95459fb9d1d28d16 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830992.760607:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94a00/0x95459fb9d1d28d16 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830992.760614:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233be94a00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:1.0:1787830992.760808:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94a00/0x95459fb9d1d28d16 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830992.760820:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94a00/0x95459fb9d1d28d16 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830992.760835:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d2203615700) 00010000:00010000:1.0:1787830992.760838:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787830992.760843:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94a00/0x95459fb9d1d28d16 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830992.760851:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94a00/0x95459fb9d1d28d16 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830992.760867:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94200/0x95459fb9d1d28d1d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830992.760874:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94200/0x95459fb9d1d28d1d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830992.760881:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94200/0x95459fb9d1d28d1d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830992.760885:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233be94200 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:1.0:1787830992.760888:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94200/0x95459fb9d1d28d1d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830992.760894:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94200/0x95459fb9d1d28d1d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830992.760911:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8d2318594d00) 00010000:00010000:1.0:1787830992.760913:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787830992.760924:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94200/0x95459fb9d1d28d1d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830992.760931:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94200/0x95459fb9d1d28d1d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830992.761537:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95e00/0x95459fb9d1d28d0f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423da6 expref: 36 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830992.761558:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94c00/0x95459fb9d1d28d24 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423da6 expref: 35 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830992.761566:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d233a6f7d00) 00010000:00010000:1.0:1787830992.761569:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787830992.761571:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233be94c00, rc 0) 00000100:00100000:2.0:1787830992.762160:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2201def0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+35:11138:x1874676433323392:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 2231us (2465us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1787830992.762171:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 56 00000100:00100000:2.0:1787830992.767419:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787830992.767488:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433323520 00000100:00100000:3.0:1787830992.767502:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433323520 00000100:00100000:3.0:1787830992.767586:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 57 00000100:00100000:3.0:1787830992.767618:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233be74f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+35:11138:x1874676433323520:12345-192.168.203.31@tcp:54:lfs.0 00010000:00010000:3.0:1787830992.768031:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d28d32 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.768054:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d28d32 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.768069:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d28d32 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.768112:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d28d32 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.768121:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d28d32 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.768128:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d28d32 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.768135:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2307c77a00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:3.0:1787830992.768139:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d28d32 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.768147:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d28d32 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.768161:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d233a6f7d00) 00010000:00010000:3.0:1787830992.768164:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787830992.768170:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d28d32 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.768176:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d28d32 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830992.768332:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233be74f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+35:11138:x1874676433323520:12345-192.168.203.31@tcp:54:lfs.0 Request processed in 717us (925us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830992.768340:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 57 00000100:00100000:3.0:1787830992.770545:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787830992.770667:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433323776 00000100:00100000:2.0:1787830992.770677:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433323776 00000100:00100000:2.0:1787830992.770737:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 11 00000100:00100000:2.0:1787830992.770749:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a48f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+35:11138:x1874676433323776:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:2.0:1787830992.771051:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a48f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+36:11138:x1874676433323776:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 303us (514us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1787830992.771076:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 11 00010000:00010000:0.0:1787830992.871037:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787830992.945559:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787830992.946029:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433324032 00000100:00100000:3.0:1787830992.946043:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433324032 00000100:00100000:3.0:1787830992.946125:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 58 00000100:00100000:3.0:1787830992.946138:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233be752c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+36:11169:x1874676433324032:12345-192.168.203.31@tcp:101:cat.0 00010000:00010000:3.0:1787830992.946171:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787830992.946200:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76a00/0x95459fb9d1d28d39 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99423dad expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.946363:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d28d40 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.946382:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d28d40 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.946396:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d28d40 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787830992.946411:0:6491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1787830992.946576:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76a00/0x95459fb9d1d28d39 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423dad expref: 39 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.946597:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d28d40 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423dad expref: 38 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830992.946680:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d233a6f7d00) 00010000:00010000:3.0:1787830992.946683:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787830992.946687:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2307c77a00, rc 0) 00000100:00100000:3.0:1787830992.946775:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233be752c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+38:11169:x1874676433324032:12345-192.168.203.31@tcp:101:cat.0 Request processed in 641us (1232us total) trans 4294967333 rc 0/0 00000100:00100000:3.0:1787830992.946783:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 58 00000100:00100000:3.0:1787830992.951697:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787830992.951812:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433324288 00000100:00100000:1.0:1787830992.951825:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433324288 00000100:00100000:1.0:1787830992.951887:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 12 00000100:00100000:1.0:1787830992.951896:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a4a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+38:11169:x1874676433324288:12345-192.168.203.31@tcp:35:cat.0 00000100:00100000:1.0:1787830992.952295:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a4a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+39:11169:x1874676433324288:12345-192.168.203.31@tcp:35:cat.0 Request processed in 398us (611us total) trans 4294967334 rc 0/0 00000100:00100000:1.0:1787830992.952304:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 12 00000100:00100000:3.0:1787830992.954349:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787830992.954803:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433324416 00000100:00100000:0.0:1787830992.954815:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433324416 00000100:00100000:0.0:1787830992.954892:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 4 00000100:00100000:0.0:1787830992.954913:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a4ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+39:2394:x1874676433324416:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787830992.954937:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787830992.954970:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d28d40 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423dad expref: 39 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830992.954997:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d233a6f7d00) 00010000:00010000:0.0:1787830992.955027:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787830992.955155:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a4ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+38:2394:x1874676433324416:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 253us (815us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830992.955164:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 4 00000100:00100000:3.0:1787830992.980550:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787830992.980607:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787830992.980819:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787830992.980850:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787830992.983740:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433324544 00000100:00100000:1.0:1787830992.983762:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433324544 00000100:00100000:1.0:1787830992.983860:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 361 00000100:00100000:1.0:1787830992.983873:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a683450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+13:2395:x1874676433324544:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1787830992.983986:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a683450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+13:2395:x1874676433324544:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 116us (3167us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830992.984015:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 361 00000100:00100000:3.0:1787830992.995426:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787830992.995426:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433324672 00000100:00100000:0.0:1787830992.995460:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433324672 00000100:00100000:3.0:1787830992.995489:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433324800 00000100:00100000:3.0:1787830992.995495:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433324800 00000100:00100000:3.0:1787830992.995550:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 77 00000100:00100000:3.0:1787830992.995561:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a4a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+7:2395:x1874676433324800:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1787830992.995680:0:13771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433324928 00000100:00100000:3.0:1787830992.995684:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a4a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+7:2395:x1874676433324800:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 123us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830992.995686:0:13771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433324928 00000100:00100000:3.0:1787830992.995698:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 77 00000100:00100000:0.0:1787830992.995725:0:13771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433325056 00000100:00080000:3.0:1787830992.995728:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787830992.995730:0:13771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433325056 00000100:00080000:3.0:1787830992.995733:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787830992.995752:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 203 00000100:00100000:3.0:1787830992.995762:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a483c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:2394:x1874676433324672:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1787830992.995770:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 204 00000100:00100000:0.0:1787830992.995781:0:13771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a4bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c901c2b2-479b-44dc-8fa8-34fbacf02f07+5:2394:x1874676433324928:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1787830992.995799:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a483c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:2394:x1874676433324672:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 38us (15266us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830992.995822:0:13771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a4bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c901c2b2-479b-44dc-8fa8-34fbacf02f07+5:2394:x1874676433324928:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 43us (15213us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830992.995830:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 204 00000100:00100000:0.0:1787830992.995844:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 205 00000100:00100000:0.0:1787830992.995851:0:13771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a4b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c901c2b2-479b-44dc-8fa8-34fbacf02f07+5:2394:x1874676433325056:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1787830992.995867:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 203 00000100:00100000:0.0:1787830992.995877:0:13771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a4b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c901c2b2-479b-44dc-8fa8-34fbacf02f07+5:2394:x1874676433325056:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 26us (15026us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830992.995886:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 205 00000100:00100000:1.0:1787830993.001789:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787830993.001855:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433325312 00000100:00100000:3.0:1787830993.001867:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433325312 00000100:00100000:3.0:1787830993.001953:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 59 00000100:00100000:3.0:1787830993.001965:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2309d08f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+38:11175:x1874676433325312:12345-192.168.203.31@tcp:101:dd.0 00010000:00010000:3.0:1787830993.001995:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787830993.001999:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787830993.002037:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77800/0x95459fb9d1d28ca6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423d83 expref: 38 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830993.002060:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d2203615700) 00010000:00010000:3.0:1787830993.002067:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787830993.002084:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76a00/0x95459fb9d1d28d4e lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99423db4 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830993.002254:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d28d55 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830993.002269:0:6491:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94c00/0x95459fb9d1d28d24 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423da6 expref: 38 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830993.002279:0:6491:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d28d55 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830993.002317:0:6491:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94c00/0x95459fb9d1d28d24 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423da6 expref: 38 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830993.002332:0:6491:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94c00/0x95459fb9d1d28d24 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423da6 expref: 38 pid: 6492 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830993.002468:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a48000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6491:1874676443882880:192.168.203.31@tcp:104: 00000100:00100000:3.0:1787830993.002577:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2202713f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787830993.004831:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787830993.004909:0:7432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433325440 00000100:00100000:1.0:1787830993.004921:0:7432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433325440 00010000:00010000:1.0:1787830993.004970:0:7432:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94c00/0x95459fb9d1d28d24 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423da6 expref: 39 pid: 6492 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830993.005020:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 55 00000100:00100000:1.0:1787830993.005033:0:7432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a49a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+39:2397:x1874676433325440:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787830993.005052:0:7432:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787830993.005062:0:7432:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94c00/0x95459fb9d1d28d24 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423da6 expref: 39 pid: 6492 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830993.005073:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a48000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6491:1874676443882880:192.168.203.31@tcp:104: 00010000:00010000:1.0:1787830993.005080:0:7432:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94c00/0x95459fb9d1d28d24 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423da6 expref: 39 pid: 6492 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.005108:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94c00/0x95459fb9d1d28d24 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423da6 expref: 39 pid: 6492 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830993.005112:0:6491:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d28d55 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.005131:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d233a6f7d00) 00010000:00010000:1.0:1787830993.005138:0:7432:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d28d55 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.005150:0:7432:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d28d55 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.005160:0:7432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d28d55 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.005205:0:7432:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787830993.005260:0:6491:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d28d55 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830993.005268:0:7432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a49a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+38:2397:x1874676433325440:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 237us (447us total) trans 0 rc 0/0 00010000:00010000:0.0:1787830993.005273:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d28d55 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830993.005283:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 55 00000004:00200000:0.0:1787830993.005298:0:6491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1787830993.005490:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76a00/0x95459fb9d1d28d4e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423db4 expref: 39 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830993.005519:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d28d55 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423db4 expref: 38 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830993.005527:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d233a6f7d00) 00010000:00010000:0.0:1787830993.005530:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787830993.005532:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2307c77600, rc 0) 00000100:00100000:0.0:1787830993.005566:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2309d08f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+38:11175:x1874676433325312:12345-192.168.203.31@tcp:101:dd.0 Request processed in 3605us (3793us total) trans 4294967335 rc 0/0 00000100:00100000:0.0:1787830993.005574:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 59 00000100:00100000:3.0:1787830993.007794:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787830993.008058:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433325568 00000100:00100000:0.0:1787830993.008070:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433325568 00000100:00100000:0.0:1787830993.008137:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 60 00000100:00100000:0.0:1787830993.008147:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a49680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+38:11175:x1874676433325568:12345-192.168.203.31@tcp:101:dd.0 00010000:00010000:0.0:1787830993.008176:0:8620:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787830993.008201:0:8620:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10600/0x95459fb9d1d28d63 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99423dbb expref: -99 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830993.008240:0:8620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11c00/0x95459fb9d1d28d6a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830993.008255:0:8620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11c00/0x95459fb9d1d28d6a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830993.008268:0:8620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11c00/0x95459fb9d1d28d6a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830993.009566:0:8620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10600/0x95459fb9d1d28d63 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423dbb expref: 40 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830993.009615:0:8620:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11c00/0x95459fb9d1d28d6a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423dbb expref: 39 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830993.009636:0:8620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d233a6f7d00) 00010000:00010000:0.0:1787830993.009640:0:8620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787830993.009644:0:8620:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233bf11c00, rc 0) 00000100:00100000:0.0:1787830993.009724:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a49680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+39:11175:x1874676433325568:12345-192.168.203.31@tcp:101:dd.0 Request processed in 1578us (1941us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830993.009734:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 60 00000100:00100000:2.0:1787830993.013025:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787830993.014569:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433325824 00000100:00100000:0.0:1787830993.014589:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433325824 00000100:00100000:1.0:1787830993.017041:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 61 00000100:00100000:1.0:1787830993.017067:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233be74780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+39:11175:x1874676433325824:12345-192.168.203.31@tcp:36:dd.0 00010000:00010000:1.0:1787830993.017535:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94200/0x95459fb9d1d28d71 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.017557:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94200/0x95459fb9d1d28d71 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.017571:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94200/0x95459fb9d1d28d71 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787830993.018269:0:6492:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967336 00000004:00010000:1.0:1787830993.018319:0:6492:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f2aed047 reply state 0000000038bca37a transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94200/0x95459fb9d1d28d71 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.018336:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94200/0x95459fb9d1d28d71 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.018345:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d233a6f7d00) 00010000:00010000:1.0:1787830993.018348:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787830993.018353:0:6492:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787830993.018491:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233be74780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+42:11175:x1874676433325824:12345-192.168.203.31@tcp:36:dd.0 Request processed in 1432us (5479us total) trans 4294967337 rc 0/0 00000100:00100000:1.0:1787830993.018500:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 61 00000020:00080000:1.0:1787830993.018505:0:6492:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787830993.246478:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787830993.246589:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433325952 00000100:00100000:0.0:1787830993.246601:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433325952 00000100:00100000:0.0:1787830993.246702:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 62 00000100:00100000:0.0:1787830993.246713:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233be770c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+42:11189:x1874676433325952:12345-192.168.203.31@tcp:101:stat.0 00010000:00010000:0.0:1787830993.246744:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787830993.246769:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10600/0x95459fb9d1d28d78 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99423dc2 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830993.246851:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11000/0x95459fb9d1d28d7f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830993.246868:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11000/0x95459fb9d1d28d7f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830993.246883:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11000/0x95459fb9d1d28d7f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830993.246931:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10400/0x95459fb9d1d28d86 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830993.246940:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10400/0x95459fb9d1d28d86 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830993.246947:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10400/0x95459fb9d1d28d86 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830993.247049:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11400/0x95459fb9d1d28d8d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830993.247061:0:6491:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d28d55 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423db4 expref: 43 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830993.247070:0:6491:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11400/0x95459fb9d1d28d8d lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830993.247110:0:6491:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d28d55 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423db4 expref: 43 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830993.247124:0:6491:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d28d55 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423db4 expref: 43 pid: 6491 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830993.247139:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22039b9a40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6491:1874676443883008:192.168.203.31@tcp:104: 00000100:00100000:0.0:1787830993.247265:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2307d75b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787830993.253337:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787830993.253504:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433326208 00000100:00100000:1.0:1787830993.253516:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433326208 00000100:00100000:0.0:1787830993.253685:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22039b9a40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6491:1874676443883008:192.168.203.31@tcp:104: 00010000:00010000:0.0:1787830993.253723:0:6491:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11400/0x95459fb9d1d28d8d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830993.253860:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 13 00000100:00100000:1.0:1787830993.253872:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+44:6159:x1874676433326208:12345-192.168.203.31@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787830993.254262:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+45:6159:x1874676433326208:12345-192.168.203.31@tcp:35:ldlm_bl.0 Request processed in 391us (938us total) trans 4294967338 rc 0/0 00000100:00100000:1.0:1787830993.254270:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 13 00000100:00100000:3.0:1787830993.259750:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787830993.259956:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433326336 00000100:00100000:0.0:1787830993.259969:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433326336 00010000:00010000:0.0:1787830993.260023:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d28d55 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423db4 expref: 45 pid: 6491 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830993.260073:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 56 00000100:00100000:0.0:1787830993.260084:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a48780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+45:2397:x1874676433326336:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787830993.260103:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787830993.260110:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d28d55 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423db4 expref: 45 pid: 6491 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830993.260125:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d28d55 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423db4 expref: 45 pid: 6491 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830993.260151:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d28d55 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423db4 expref: 45 pid: 6491 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830993.260171:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d233a6f7d00) 00010000:00010000:0.0:1787830993.260178:0:6477:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11400/0x95459fb9d1d28d8d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830993.260189:0:6477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11400/0x95459fb9d1d28d8d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830993.260198:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11400/0x95459fb9d1d28d8d lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830993.260237:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787830993.260309:0:6491:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11400/0x95459fb9d1d28d8d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830993.260321:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11400/0x95459fb9d1d28d8d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830993.260342:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a48780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+44:2397:x1874676433326336:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 259us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830993.260352:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 56 00000004:00200000:3.0:1787830993.260398:0:6491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1787830993.260404:0:6491:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787830993.260455:0:6491:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11400/0x95459fb9d1d28d8d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830993.260469:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11400/0x95459fb9d1d28d8d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830993.260480:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11000/0x95459fb9d1d28d7f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830993.260488:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11000/0x95459fb9d1d28d7f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830993.260495:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11000/0x95459fb9d1d28d7f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830993.260501:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233bf11000 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:3.0:1787830993.260513:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11000/0x95459fb9d1d28d7f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830993.260523:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11000/0x95459fb9d1d28d7f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830993.260534:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d2203615700) 00010000:00010000:3.0:1787830993.260538:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787830993.260543:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11000/0x95459fb9d1d28d7f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830993.260550:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11000/0x95459fb9d1d28d7f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830993.260563:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10400/0x95459fb9d1d28d86 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830993.260570:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10400/0x95459fb9d1d28d86 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830993.260575:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10400/0x95459fb9d1d28d86 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830993.260581:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233bf10400 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:3.0:1787830993.260583:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10400/0x95459fb9d1d28d86 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830993.260590:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10400/0x95459fb9d1d28d86 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830993.260598:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8d2318594d00) 00010000:00010000:3.0:1787830993.260600:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787830993.260609:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10400/0x95459fb9d1d28d86 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830993.260615:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10400/0x95459fb9d1d28d86 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830993.260696:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10600/0x95459fb9d1d28d78 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423dc2 expref: 44 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830993.260762:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11400/0x95459fb9d1d28d8d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423dc2 expref: 43 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830993.260771:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d233a6f7d00) 00010000:00010000:3.0:1787830993.260773:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787830993.260776:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233bf11400, rc 0) 00000100:00100000:3.0:1787830993.260812:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233be770c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+43:11189:x1874676433325952:12345-192.168.203.31@tcp:101:stat.0 Request processed in 14101us (14349us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830993.260820:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 62 00000100:00100000:3.0:1787830993.321060:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787830993.321147:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433326592 00000100:00100000:1.0:1787830993.321160:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433326592 00000100:00100000:1.0:1787830993.321230:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 63 00000100:00100000:1.0:1787830993.321242:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+43:11195:x1874676433326592:12345-192.168.203.31@tcp:36:truncate.0 00010000:00010000:1.0:1787830993.321316:0:6490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787830993.321352:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11400/0x95459fb9d1d28d8d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423dc2 expref: 43 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.321379:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d233a6f7d00) 00010000:00010000:1.0:1787830993.321385:0:6490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787830993.321599:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94c00/0x95459fb9d1d28d94 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.321615:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94c00/0x95459fb9d1d28d94 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.321674:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94c00/0x95459fb9d1d28d94 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787830993.321729:0:6490:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967339 00000004:00010000:1.0:1787830993.321749:0:6490:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006c53833d reply state 0000000096fd2641 transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94c00/0x95459fb9d1d28d94 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.321782:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94c00/0x95459fb9d1d28d94 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.321789:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d233a6f7d00) 00010000:00010000:1.0:1787830993.321792:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787830993.321794:0:6490:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787830993.322089:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+45:11195:x1874676433326592:12345-192.168.203.31@tcp:36:truncate.0 Request processed in 848us (1053us total) trans 4294967340 rc 0/0 00000100:00100000:1.0:1787830993.322098:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 63 00000020:00080000:1.0:1787830993.322104:0:6490:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787830993.400764:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787830993.400989:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433326720 00000100:00100000:1.0:1787830993.401001:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433326720 00000100:00100000:1.0:1787830993.401131:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 64 00000100:00100000:1.0:1787830993.401143:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233be74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+45:11209:x1874676433326720:12345-192.168.203.31@tcp:101:stat.0 00010000:00010000:1.0:1787830993.401175:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787830993.401201:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94a00/0x95459fb9d1d28d9b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99423dc9 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.401299:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95e00/0x95459fb9d1d28da2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.401318:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95e00/0x95459fb9d1d28da2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.401332:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95e00/0x95459fb9d1d28da2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.401373:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6e00/0x95459fb9d1d28da9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.401403:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6e00/0x95459fb9d1d28da9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.401412:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6e00/0x95459fb9d1d28da9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.401522:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7a00/0x95459fb9d1d28db0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.401532:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7a00/0x95459fb9d1d28db0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.401539:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7a00/0x95459fb9d1d28db0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787830993.401586:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:1.0:1787830993.401592:0:6492:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787830993.401618:0:6492:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7a00/0x95459fb9d1d28db0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.401663:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7a00/0x95459fb9d1d28db0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.401672:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95e00/0x95459fb9d1d28da2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.401677:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95e00/0x95459fb9d1d28da2 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.401681:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95e00/0x95459fb9d1d28da2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.401694:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233be95e00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:1.0:1787830993.401698:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95e00/0x95459fb9d1d28da2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.401707:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95e00/0x95459fb9d1d28da2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.401721:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d2203615700) 00010000:00010000:1.0:1787830993.401725:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787830993.401731:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95e00/0x95459fb9d1d28da2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.401737:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95e00/0x95459fb9d1d28da2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.401753:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6e00/0x95459fb9d1d28da9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.401759:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6e00/0x95459fb9d1d28da9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.401766:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6e00/0x95459fb9d1d28da9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.401771:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d23344b6e00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:1.0:1787830993.401774:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6e00/0x95459fb9d1d28da9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.401779:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6e00/0x95459fb9d1d28da9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.401800:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8d2318594d00) 00010000:00010000:1.0:1787830993.401803:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787830993.401806:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6e00/0x95459fb9d1d28da9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.401811:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6e00/0x95459fb9d1d28da9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.401853:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94a00/0x95459fb9d1d28d9b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423dc9 expref: 47 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.401870:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7a00/0x95459fb9d1d28db0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423dc9 expref: 46 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.401877:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d233a6f7d00) 00010000:00010000:1.0:1787830993.401880:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787830993.401882:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d23344b7a00, rc 0) 00000100:00100000:1.0:1787830993.401969:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233be74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+46:11209:x1874676433326720:12345-192.168.203.31@tcp:101:stat.0 Request processed in 829us (1220us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830993.401978:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 64 00000100:00100000:2.0:1787830993.436941:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787830993.437056:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433326976 00000100:00100000:3.0:1787830993.437068:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433326976 00000100:00100000:3.0:1787830993.437148:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 65 00000100:00100000:3.0:1787830993.437160:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233be77840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+46:11219:x1874676433326976:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:3.0:1787830993.437193:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787830993.437222:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77800/0x95459fb9d1d28db7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99423dd0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787830993.437358:0:6491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1787830993.437483:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77800/0x95459fb9d1d28db7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423dd0 expref: 48 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830993.437721:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d233a6f7300) 00010000:00010000:3.0:1787830993.437725:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787830993.437732:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77800/0x95459fb9d1d28db7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423dd0 expref: 48 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830993.437750:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2307c77800, rc 0) 00000100:00100000:3.0:1787830993.437825:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233be77840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+47:11219:x1874676433326976:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 667us (898us total) trans 4294967341 rc 301/301 00000100:00100000:3.0:1787830993.437833:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 65 00000100:00100000:3.0:1787830993.441681:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787830993.441760:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433327232 00000100:00100000:2.0:1787830993.441773:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433327232 00000100:00100000:2.0:1787830993.441918:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 14 00000100:00100000:2.0:1787830993.441932:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220380de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+47:11219:x1874676433327232:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:2.0:1787830993.442227:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220380de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+48:11219:x1874676433327232:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 298us (559us total) trans 4294967342 rc 0/0 00000100:00100000:2.0:1787830993.442237:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 14 00000100:00100000:2.0:1787830993.490868:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787830993.490961:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433327488 00000100:00100000:1.0:1787830993.490975:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433327488 00000100:00100000:1.0:1787830993.491049:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 66 00000100:00100000:1.0:1787830993.491060:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233be76d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+48:11225:x1874676433327488:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:1.0:1787830993.491100:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787830993.491128:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6e00/0x95459fb9d1d28dc5 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99423dd7 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.491285:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6000/0x95459fb9d1d28dcc lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.491303:0:6490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7a00/0x95459fb9d1d28db0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423dc9 expref: 49 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.491314:0:6490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6000/0x95459fb9d1d28dcc lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.491353:0:6490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7a00/0x95459fb9d1d28db0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423dc9 expref: 49 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.491369:0:6490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7a00/0x95459fb9d1d28db0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423dc9 expref: 49 pid: 6492 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830993.491384:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2309d0a1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6490:1874676443883136:192.168.203.31@tcp:104: 00000100:00100000:1.0:1787830993.491495:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d232f727600 going to sleep for 11 seconds 00000100:00100000:3.0:1787830993.493868:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787830993.494003:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433327616 00000100:00100000:2.0:1787830993.494010:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433327616 00000100:00100000:1.0:1787830993.494024:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2309d0a1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6490:1874676443883136:192.168.203.31@tcp:104: 00010000:00010000:1.0:1787830993.494055:0:6490:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6000/0x95459fb9d1d28dcc lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830993.494056:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7a00/0x95459fb9d1d28db0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423dc9 expref: 50 pid: 6492 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830993.494096:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 57 00000100:00100000:2.0:1787830993.494167:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2321e77850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+50:2396:x1874676433327616:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787830993.494187:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787830993.494285:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7a00/0x95459fb9d1d28db0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423dc9 expref: 50 pid: 6492 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830993.494301:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7a00/0x95459fb9d1d28db0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423dc9 expref: 50 pid: 6492 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830993.494343:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7a00/0x95459fb9d1d28db0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423dc9 expref: 50 pid: 6492 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830993.494361:0:6475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d233a6f7d00) 00010000:00010000:2.0:1787830993.494366:0:6475:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6000/0x95459fb9d1d28dcc lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830993.494374:0:6475:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6000/0x95459fb9d1d28dcc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830993.494393:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6000/0x95459fb9d1d28dcc lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830993.494421:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787830993.494485:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2321e77850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+49:2396:x1874676433327616:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 380us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830993.494495:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 57 00010000:00010000:1.0:1787830993.494680:0:6490:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6000/0x95459fb9d1d28dcc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.494688:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6000/0x95459fb9d1d28dcc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787830993.494711:0:6490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:1.0:1787830993.495057:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6e00/0x95459fb9d1d28dc5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423dd7 expref: 50 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.495076:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6000/0x95459fb9d1d28dcc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423dd7 expref: 49 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.495084:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d233a6f7d00) 00010000:00010000:1.0:1787830993.495088:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787830993.495090:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d23344b6000, rc 0) 00000100:00100000:1.0:1787830993.495169:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233be76d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+49:11225:x1874676433327488:12345-192.168.203.31@tcp:101:bash.0 Request processed in 4110us (4316us total) trans 4294967343 rc 0/0 00000100:00100000:1.0:1787830993.495177:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 66 00000100:00100000:3.0:1787830993.496967:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787830993.497078:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433327872 00000100:00100000:1.0:1787830993.497088:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433327872 00000100:00100000:1.0:1787830993.497153:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 67 00000100:00100000:1.0:1787830993.497162:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d232f6cb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+49:11225:x1874676433327872:12345-192.168.203.31@tcp:36:bash.0 00010000:00010000:1.0:1787830993.497400:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7000/0x95459fb9d1d28dda lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.497419:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7000/0x95459fb9d1d28dda lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.497430:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7000/0x95459fb9d1d28dda lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787830993.497489:0:6492:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967344 00000004:00010000:1.0:1787830993.497512:0:6492:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002be3ac33 reply state 00000000f03c68cd transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7000/0x95459fb9d1d28dda lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.497525:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7000/0x95459fb9d1d28dda lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.497548:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d233a6f7d00) 00010000:00010000:1.0:1787830993.497551:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787830993.497554:0:6492:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787830993.497659:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d232f6cb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+52:11225:x1874676433327872:12345-192.168.203.31@tcp:36:bash.0 Request processed in 498us (701us total) trans 4294967345 rc 0/0 00000100:00100000:1.0:1787830993.497665:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 67 00000020:00080000:1.0:1787830993.497670:0:6492:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787830993.502396:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787830993.502648:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433328000 00000100:00100000:0.0:1787830993.502666:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433328000 00000100:00100000:0.0:1787830993.502735:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 68 00000100:00100000:0.0:1787830993.502746:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d232f6c92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+52:11225:x1874676433328000:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:0.0:1787830993.502778:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787830993.502806:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11400/0x95459fb9d1d28de1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99423dde expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830993.502937:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10600/0x95459fb9d1d28de8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830993.502956:0:6491:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6000/0x95459fb9d1d28dcc lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423dd7 expref: 53 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830993.502966:0:6491:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10600/0x95459fb9d1d28de8 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830993.503008:0:6491:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6000/0x95459fb9d1d28dcc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423dd7 expref: 53 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830993.503023:0:6491:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6000/0x95459fb9d1d28dcc lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423dd7 expref: 53 pid: 6490 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830993.503038:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22039b9a40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6491:1874676443883264:192.168.203.31@tcp:104: 00000100:00100000:0.0:1787830993.503131:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2307d75b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787830993.506429:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787830993.506455:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22039b9a40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6491:1874676443883264:192.168.203.31@tcp:104: 00010000:00010000:0.0:1787830993.506492:0:6491:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10600/0x95459fb9d1d28de8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830993.506572:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433328128 00000100:00100000:1.0:1787830993.506581:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433328128 00010000:00010000:1.0:1787830993.506656:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6000/0x95459fb9d1d28dcc lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423dd7 expref: 54 pid: 6490 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830993.506700:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 58 00000100:00100000:1.0:1787830993.506710:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d232f6cbc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+54:2397:x1874676433328128:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787830993.506728:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787830993.506735:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6000/0x95459fb9d1d28dcc lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423dd7 expref: 54 pid: 6490 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.506749:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6000/0x95459fb9d1d28dcc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423dd7 expref: 54 pid: 6490 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.506776:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6000/0x95459fb9d1d28dcc lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423dd7 expref: 54 pid: 6490 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.506792:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d233a6f7d00) 00010000:00010000:1.0:1787830993.506797:0:6476:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10600/0x95459fb9d1d28de8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.506841:0:6476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10600/0x95459fb9d1d28de8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.506850:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10600/0x95459fb9d1d28de8 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.506967:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787830993.507029:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d232f6cbc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+53:2397:x1874676433328128:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 319us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830993.507039:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 58 00010000:00010000:3.0:1787830993.507184:0:6491:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10600/0x95459fb9d1d28de8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830993.507192:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10600/0x95459fb9d1d28de8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787830993.507314:0:6491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1787830993.507320:0:6491:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787830993.507346:0:6491:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10600/0x95459fb9d1d28de8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830993.507384:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11400/0x95459fb9d1d28de1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423dde expref: 53 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830993.507415:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10600/0x95459fb9d1d28de8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423dde expref: 52 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830993.507424:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d233a6f7d00) 00010000:00010000:3.0:1787830993.507427:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787830993.507429:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233bf10600, rc 0) 00000100:00100000:3.0:1787830993.507471:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d232f6c92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+52:11225:x1874676433328000:12345-192.168.203.31@tcp:101:bash.0 Request processed in 4727us (5090us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830993.507480:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 68 00000100:00100000:3.0:1787830993.509713:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787830993.509775:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433328384 00000100:00100000:1.0:1787830993.509787:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433328384 00000100:00100000:1.0:1787830993.509923:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 15 00000100:00100000:1.0:1787830993.509934:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d23066c8850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+52:11225:x1874676433328384:12345-192.168.203.31@tcp:35:bash.0 00000100:00100000:1.0:1787830993.510243:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d23066c8850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+53:11225:x1874676433328384:12345-192.168.203.31@tcp:35:bash.0 Request processed in 310us (539us total) trans 4294967346 rc 0/0 00000100:00100000:1.0:1787830993.510251:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 15 00000100:00100000:2.0:1787830993.553164:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787830993.553457:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433328640 00000100:00100000:1.0:1787830993.553470:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433328640 00000100:00100000:1.0:1787830993.553545:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 69 00000100:00100000:1.0:1787830993.553556:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233be77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+53:11236:x1874676433328640:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:1.0:1787830993.553586:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787830993.553612:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6000/0x95459fb9d1d28def lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99423de5 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787830993.553769:0:6490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1787830993.553915:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6000/0x95459fb9d1d28def lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423de5 expref: 55 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.553951:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d233a6f7300) 00010000:00010000:1.0:1787830993.553955:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787830993.553962:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6000/0x95459fb9d1d28def lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423de5 expref: 55 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.553979:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d23344b6000, rc 0) 00000100:00100000:1.0:1787830993.554049:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233be77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+54:11236:x1874676433328640:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 496us (902us total) trans 4294967347 rc 301/301 00000100:00100000:1.0:1787830993.554058:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 69 00000100:00100000:2.0:1787830993.556529:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787830993.556687:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433328768 00000100:00100000:1.0:1787830993.556697:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433328768 00000100:00100000:1.0:1787830993.556759:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 70 00000100:00100000:1.0:1787830993.556769:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233be75e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+54:11236:x1874676433328768:12345-192.168.203.31@tcp:34:lfs.0 00010000:00010000:1.0:1787830993.556856:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6e00/0x95459fb9d1d28dfd lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.556877:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6e00/0x95459fb9d1d28dfd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.556892:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6e00/0x95459fb9d1d28dfd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.556918:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6200/0x95459fb9d1d28e04 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.556926:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6200/0x95459fb9d1d28e04 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.556952:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6200/0x95459fb9d1d28e04 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.557041:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6a00/0x95459fb9d1d28e0b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.557052:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6a00/0x95459fb9d1d28e0b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.557060:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6a00/0x95459fb9d1d28e0b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787830993.557121:0:6492:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6a00/0x95459fb9d1d28e0b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.557136:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6e00/0x95459fb9d1d28dfd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.557143:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6e00/0x95459fb9d1d28dfd lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.557151:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6e00/0x95459fb9d1d28dfd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.557158:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d23344b6e00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:1.0:1787830993.557163:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6e00/0x95459fb9d1d28dfd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.557172:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6e00/0x95459fb9d1d28dfd lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.557185:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d2203615700) 00010000:00010000:1.0:1787830993.557197:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787830993.557203:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6e00/0x95459fb9d1d28dfd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.557210:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6e00/0x95459fb9d1d28dfd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.557226:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6200/0x95459fb9d1d28e04 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.557232:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6200/0x95459fb9d1d28e04 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.557238:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6200/0x95459fb9d1d28e04 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.557244:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d23344b6200 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:1.0:1787830993.557247:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6200/0x95459fb9d1d28e04 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.557253:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6200/0x95459fb9d1d28e04 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.557261:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8d2318594d00) 00010000:00010000:1.0:1787830993.557264:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787830993.557267:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6200/0x95459fb9d1d28e04 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.557273:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6200/0x95459fb9d1d28e04 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.557282:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6a00/0x95459fb9d1d28e0b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.557294:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6a00/0x95459fb9d1d28e0b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.557300:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6a00/0x95459fb9d1d28e0b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.557305:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d23344b6a00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:1.0:1787830993.557308:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6a00/0x95459fb9d1d28e0b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.557314:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6a00/0x95459fb9d1d28e0b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.557321:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d233a6f7d00) 00010000:00010000:1.0:1787830993.557323:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787830993.557326:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6a00/0x95459fb9d1d28e0b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.557332:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6a00/0x95459fb9d1d28e0b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830993.557420:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233be75e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+54:11236:x1874676433328768:12345-192.168.203.31@tcp:34:lfs.0 Request processed in 652us (901us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830993.557429:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 70 00000100:00100000:3.0:1787830993.559173:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787830993.559301:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433329024 00000100:00100000:2.0:1787830993.559311:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433329024 00000100:00100000:2.0:1787830993.559377:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 16 00000100:00100000:2.0:1787830993.559388:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220390a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+54:11236:x1874676433329024:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:2.0:1787830993.563014:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220390a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+55:11236:x1874676433329024:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 3614us (3835us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1787830993.563030:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 16 00000100:00100000:2.0:1787830993.596246:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787830993.596403:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433329280 00000100:00100000:3.0:1787830993.596416:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433329280 00000100:00100000:3.0:1787830993.596491:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 71 00000100:00100000:3.0:1787830993.596504:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233be76940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+55:11239:x1874676433329280:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:3.0:1787830993.596548:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787830993.596582:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77800/0x95459fb9d1d28e12 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99423dec expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830993.596733:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d28e19 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830993.596750:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d28e19 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830993.596763:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d28e19 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830993.596786:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76a00/0x95459fb9d1d28e20 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830993.596794:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76a00/0x95459fb9d1d28e20 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830993.596801:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76a00/0x95459fb9d1d28e20 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830993.596952:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d28e27 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830993.596963:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d28e27 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830993.596970:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d28e27 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787830993.596986:0:6491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1787830993.597096:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d28e19 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830993.597105:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d28e19 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830993.597113:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d28e19 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830993.597121:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2307c77600 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:3.0:1787830993.597126:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d28e19 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830993.597145:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d28e19 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830993.597169:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d2203615700) 00010000:00010000:3.0:1787830993.597173:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787830993.597179:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d28e19 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830993.597187:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d28e19 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830993.597209:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76a00/0x95459fb9d1d28e20 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830993.597216:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76a00/0x95459fb9d1d28e20 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830993.597228:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76a00/0x95459fb9d1d28e20 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830993.597234:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2307c76a00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:3.0:1787830993.597237:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76a00/0x95459fb9d1d28e20 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830993.597244:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76a00/0x95459fb9d1d28e20 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830993.597251:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8d2318594d00) 00010000:00010000:3.0:1787830993.597253:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787830993.597256:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76a00/0x95459fb9d1d28e20 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830993.597279:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76a00/0x95459fb9d1d28e20 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830993.597338:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77800/0x95459fb9d1d28e12 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423dec expref: 58 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830993.597355:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d28e27 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423dec expref: 57 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830993.597368:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d233a6f7d00) 00010000:00010000:3.0:1787830993.597371:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787830993.597374:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2307c77a00, rc 0) 00000100:00100000:3.0:1787830993.597468:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233be76940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+57:11239:x1874676433329280:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 967us (1244us total) trans 4294967349 rc 0/0 00000100:00100000:3.0:1787830993.597476:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 71 00000100:00100000:3.0:1787830993.601453:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787830993.601508:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787830993.601564:0:13771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433329408 00000100:00100000:1.0:1787830993.601577:0:13771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433329408 00000100:00100000:1.0:1787830993.601839:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 72 00000100:00100000:1.0:1787830993.601855:0:13771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203b6f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47d7f0ed-283f-4b70-a741-6e74c5e52619+57:11239:x1874676433329408:12345-192.168.203.31@tcp:54:lfs.0 00010000:00010000:1.0:1787830993.602014:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6a00/0x95459fb9d1d28e35 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.602044:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6a00/0x95459fb9d1d28e35 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.602057:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6a00/0x95459fb9d1d28e35 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.602095:0:13771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6a00/0x95459fb9d1d28e35 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.602102:0:13771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6a00/0x95459fb9d1d28e35 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.602109:0:13771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6a00/0x95459fb9d1d28e35 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.602114:0:13771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d23344b6a00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:1.0:1787830993.602119:0:13771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6a00/0x95459fb9d1d28e35 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.602126:0:13771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6a00/0x95459fb9d1d28e35 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.602137:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d233a6f7d00) 00010000:00010000:1.0:1787830993.602141:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787830993.602145:0:13771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6a00/0x95459fb9d1d28e35 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.602150:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6a00/0x95459fb9d1d28e35 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830993.602238:0:13771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203b6f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47d7f0ed-283f-4b70-a741-6e74c5e52619+57:11239:x1874676433329408:12345-192.168.203.31@tcp:54:lfs.0 Request processed in 389us (797us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830993.602252:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 72 00000100:00100000:2.0:1787830993.603683:0:7432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433329536 00000100:00100000:2.0:1787830993.603698:0:7432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433329536 00000100:00100000:2.0:1787830993.603781:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 5 00000100:00100000:2.0:1787830993.603793:0:7432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203b6e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+57:2395:x1874676433329536:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787830993.603941:0:7432:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787830993.603973:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d28e27 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423dec expref: 57 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830993.603997:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d233a6f7d00) 00010000:00010000:2.0:1787830993.604003:0:7432:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787830993.604066:0:7432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203b6e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+56:2395:x1874676433329536:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 276us (2557us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830993.604075:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 5 00000100:00100000:2.0:1787830993.607134:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787830993.607212:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433329792 00000100:00100000:1.0:1787830993.607226:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433329792 00000100:00100000:1.0:1787830993.607297:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 17 00000100:00100000:1.0:1787830993.607307:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233be74b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+56:11239:x1874676433329792:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:1.0:1787830993.607526:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233be74b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+57:11239:x1874676433329792:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 220us (405us total) trans 4294967350 rc 0/0 00000100:00100000:1.0:1787830993.607533:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 17 00000100:00100000:3.0:1787830993.716260:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787830993.716569:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433330048 00000100:00100000:1.0:1787830993.716582:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433330048 00000100:00100000:1.0:1787830993.716726:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 73 00000100:00100000:1.0:1787830993.716738:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203b6e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+57:11257:x1874676433330048:12345-192.168.203.31@tcp:101:cat.0 00010000:00010000:1.0:1787830993.716771:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787830993.716796:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6a00/0x95459fb9d1d28e3c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99423df3 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.716961:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6200/0x95459fb9d1d28e43 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.716988:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6200/0x95459fb9d1d28e43 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.717003:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6200/0x95459fb9d1d28e43 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787830993.717015:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:1.0:1787830993.717146:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6a00/0x95459fb9d1d28e3c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423df3 expref: 60 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.717180:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6200/0x95459fb9d1d28e43 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423df3 expref: 59 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.717191:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d233a6f7d00) 00010000:00010000:1.0:1787830993.717195:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787830993.717199:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d23344b6200, rc 0) 00000100:00100000:1.0:1787830993.717281:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203b6e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+59:11257:x1874676433330048:12345-192.168.203.31@tcp:101:cat.0 Request processed in 545us (1048us total) trans 4294967351 rc 0/0 00000100:00100000:1.0:1787830993.717289:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 73 00000100:00100000:3.0:1787830993.738163:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787830993.738491:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433330176 00000100:00100000:0.0:1787830993.738503:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433330176 00000100:00100000:0.0:1787830993.738576:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 74 00000100:00100000:0.0:1787830993.738587:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203634780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+59:11258:x1874676433330176:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:0.0:1787830993.738660:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787830993.738686:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10400/0x95459fb9d1d28e51 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99423dfa expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830993.738769:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11000/0x95459fb9d1d28e58 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830993.738786:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11000/0x95459fb9d1d28e58 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830993.738799:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11000/0x95459fb9d1d28e58 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787830993.738852:0:6491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1787830993.738856:0:6491:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787830993.738876:0:6491:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11000/0x95459fb9d1d28e58 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830993.738922:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10400/0x95459fb9d1d28e51 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423dfa expref: 61 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830993.738944:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11000/0x95459fb9d1d28e58 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423dfa expref: 60 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830993.738971:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d2203615700) 00010000:00010000:0.0:1787830993.738974:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787830993.738978:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233bf11000, rc 0) 00000100:00100000:0.0:1787830993.739261:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203634780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+60:11258:x1874676433330176:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 675us (1111us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830993.739270:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 74 00000100:00100000:2.0:1787830993.744863:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787830993.744966:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433330560 00000100:00100000:1.0:1787830993.744978:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433330560 00000100:00100000:1.0:1787830993.745049:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 18 00000100:00100000:1.0:1787830993.745060:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2334489680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+60:11258:x1874676433330560:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:1.0:1787830993.745479:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2334489680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+61:11258:x1874676433330560:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 420us (629us total) trans 4294967352 rc 0/0 00000100:00100000:1.0:1787830993.745489:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 18 00000100:00100000:2.0:1787830993.747745:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787830993.747842:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433330688 00000100:00100000:0.0:1787830993.747852:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433330688 00000100:00100000:0.0:1787830993.747992:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 6 00000100:00100000:0.0:1787830993.748003:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2201dede00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+61:11258:x1874676433330688:12345-192.168.203.31@tcp:103:lfs.0 00010000:00010000:0.0:1787830993.748022:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787830993.748053:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10600/0x95459fb9d1d28de8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423dde expref: 61 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830993.748082:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6200/0x95459fb9d1d28e43 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423df3 expref: 60 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830993.748096:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95000/0x95459fb9d1d28ce5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423d98 expref: 59 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830993.748109:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d233a6f7d00) 00010000:00010000:0.0:1787830993.748115:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787830993.748189:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2201dede00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+58:11258:x1874676433330688:12345-192.168.203.31@tcp:103:lfs.0 Request processed in 188us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830993.748198:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 6 00000100:00100000:3.0:1787830993.750453:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787830993.750582:0:13771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433330816 00000100:00100000:1.0:1787830993.750593:0:13771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433330816 00000100:00100000:1.0:1787830993.750695:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 75 00000100:00100000:1.0:1787830993.750706:0:13771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203637480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47d7f0ed-283f-4b70-a741-6e74c5e52619+58:11258:x1874676433330816:12345-192.168.203.31@tcp:58:lfs.0 00010000:00010000:1.0:1787830993.750860:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6a00/0x95459fb9d1d28e5f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.750880:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6a00/0x95459fb9d1d28e5f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.750918:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6a00/0x95459fb9d1d28e5f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787830993.751271:0:13771:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787830993.751685:0:13771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:1.0:1787830993.751779:0:13771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:1.0:1787830993.751878:0:13771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203637480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47d7f0ed-283f-4b70-a741-6e74c5e52619+58:11258:x1874676433330816:12345-192.168.203.31@tcp:58:lfs.0 Request processed in 1173us (1435us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830993.751889:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 75 00000100:00100000:2.0:1787830993.774428:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787830993.774548:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433330944 00000100:00100000:1.0:1787830993.774561:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433330944 00000100:00100000:1.0:1787830993.774731:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 76 00000100:00100000:1.0:1787830993.774748:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2201def840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+58:11260:x1874676433330944:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:1.0:1787830993.774774:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787830993.774805:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6e00/0x95459fb9d1d28e66 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99423e01 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.774889:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6000/0x95459fb9d1d28e6d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.774924:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6000/0x95459fb9d1d28e6d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.774937:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6000/0x95459fb9d1d28e6d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.774961:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6400/0x95459fb9d1d28e74 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.774991:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6400/0x95459fb9d1d28e74 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.774999:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6400/0x95459fb9d1d28e74 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.775112:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6c00/0x95459fb9d1d28e7b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.775121:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6c00/0x95459fb9d1d28e7b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.775132:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6c00/0x95459fb9d1d28e7b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787830993.775187:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:1.0:1787830993.775191:0:6492:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787830993.775209:0:6492:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6c00/0x95459fb9d1d28e7b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.775222:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6c00/0x95459fb9d1d28e7b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.775237:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6000/0x95459fb9d1d28e6d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.775244:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6000/0x95459fb9d1d28e6d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.775250:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6000/0x95459fb9d1d28e6d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.775270:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d23344b6000 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:1.0:1787830993.775275:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6000/0x95459fb9d1d28e6d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.775283:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6000/0x95459fb9d1d28e6d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.775301:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d2203615700) 00010000:00010000:1.0:1787830993.775305:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787830993.775310:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6000/0x95459fb9d1d28e6d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.775315:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6000/0x95459fb9d1d28e6d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.775335:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6400/0x95459fb9d1d28e74 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.775340:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6400/0x95459fb9d1d28e74 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.775345:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6400/0x95459fb9d1d28e74 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.775349:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d23344b6400 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:1.0:1787830993.775352:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6400/0x95459fb9d1d28e74 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.775362:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6400/0x95459fb9d1d28e74 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.775379:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8d2318594d00) 00010000:00010000:1.0:1787830993.775381:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787830993.775384:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6400/0x95459fb9d1d28e74 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.775396:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6400/0x95459fb9d1d28e74 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.775429:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6e00/0x95459fb9d1d28e66 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e01 expref: 60 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.775447:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6c00/0x95459fb9d1d28e7b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e01 expref: 59 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.775466:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d233a6f7d00) 00010000:00010000:1.0:1787830993.775468:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787830993.775471:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d23344b6c00, rc 0) 00000100:00100000:1.0:1787830993.775570:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2201def840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+59:11260:x1874676433330944:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 824us (1157us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830993.775578:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 76 00000040:00080000:0.0:1787830993.830959:0:13758:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787830993.830973:0:13758:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787830993.831066:0:13758:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1787830993.831078:0:13758:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787830993.831260:0:13758:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22039b9a40 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13758:1874676443883392:192.168.203.31@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787830993.832305:0:13758:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2307d753c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787830993.840975:0:13758:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22039b9a40 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13758:1874676443883392:192.168.203.31@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787830993.842375:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787830993.843740:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433331072 00000100:00100000:0.0:1787830993.843755:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433331072 00000100:00100000:0.0:1787830993.843850:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 77 00000100:00100000:0.0:1787830993.843862:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22036343c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+59:11267:x1874676433331072:12345-192.168.203.31@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787830993.843913:0:6491:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787830993.844234:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22036343c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+59:11267:x1874676433331072:12345-192.168.203.31@tcp:53:lhsmtool_posix.0 Request processed in 373us (1863us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830993.844243:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 77 00000100:00100000:2.0:1787830993.853254:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787830993.853484:0:13771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433331200 00000100:00100000:1.0:1787830993.853497:0:13771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433331200 00000100:00100000:1.0:1787830993.853658:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 78 00000100:00100000:1.0:1787830993.853672:0:13771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a48f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47d7f0ed-283f-4b70-a741-6e74c5e52619+59:11267:x1874676433331200:12345-192.168.203.31@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787830993.853782:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6e00/0x95459fb9d1d28e82 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.853816:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6e00/0x95459fb9d1d28e82 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.853851:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6e00/0x95459fb9d1d28e82 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.854078:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6400/0x95459fb9d1d28e89 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.854101:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6400/0x95459fb9d1d28e89 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.854113:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6400/0x95459fb9d1d28e89 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.854148:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6000/0x95459fb9d1d28e90 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.854157:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6000/0x95459fb9d1d28e90 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.854165:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6000/0x95459fb9d1d28e90 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787830993.854213:0:13771:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:1.0:1787830993.854217:0:13771:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787830993.854233:0:13771:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6000/0x95459fb9d1d28e90 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.854245:0:13771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6e00/0x95459fb9d1d28e82 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.854251:0:13771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6e00/0x95459fb9d1d28e82 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.854273:0:13771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6e00/0x95459fb9d1d28e82 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.854279:0:13771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d23344b6e00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:1.0:1787830993.854283:0:13771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6e00/0x95459fb9d1d28e82 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.854290:0:13771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6e00/0x95459fb9d1d28e82 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.854302:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d2318594400) 00010000:00010000:1.0:1787830993.854305:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787830993.854309:0:13771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6e00/0x95459fb9d1d28e82 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.854315:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6e00/0x95459fb9d1d28e82 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.854331:0:13771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6400/0x95459fb9d1d28e89 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.854337:0:13771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6400/0x95459fb9d1d28e89 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.854343:0:13771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6400/0x95459fb9d1d28e89 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.854348:0:13771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d23344b6400 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:1.0:1787830993.854351:0:13771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6400/0x95459fb9d1d28e89 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.854367:0:13771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6400/0x95459fb9d1d28e89 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.854375:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff8d233a6f7400) 00010000:00010000:1.0:1787830993.854378:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787830993.854381:0:13771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6400/0x95459fb9d1d28e89 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.854387:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6400/0x95459fb9d1d28e89 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.854402:0:13771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6000/0x95459fb9d1d28e90 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.854408:0:13771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6000/0x95459fb9d1d28e90 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.854413:0:13771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6000/0x95459fb9d1d28e90 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.854418:0:13771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d23344b6000 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:1.0:1787830993.854421:0:13771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6000/0x95459fb9d1d28e90 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.854426:0:13771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6000/0x95459fb9d1d28e90 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.854433:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d233a6f7d00) 00010000:00010000:1.0:1787830993.854435:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787830993.854438:0:13771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6000/0x95459fb9d1d28e90 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.854468:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6000/0x95459fb9d1d28e90 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830993.854561:0:13771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a48f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47d7f0ed-283f-4b70-a741-6e74c5e52619+59:11267:x1874676433331200:12345-192.168.203.31@tcp:34:lhsmtool_posix.0 Request processed in 890us (1319us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830993.854571:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 78 00000100:00100000:2.0:1787830993.866824:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787830993.870038:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433331456 00000100:00100000:1.0:1787830993.870055:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433331456 00000100:00100000:1.0:1787830993.870129:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 79 00000100:00100000:1.0:1787830993.870140:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a4a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+59:11267:x1874676433331456:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787830993.870159:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787830993.870179:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6000/0x95459fb9d1d28e97 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99423e08 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.870271:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6400/0x95459fb9d1d28e9e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.870286:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6400/0x95459fb9d1d28e9e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.870298:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6400/0x95459fb9d1d28e9e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787830993.870309:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:1.0:1787830993.870378:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6400/0x95459fb9d1d28e9e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.870386:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6400/0x95459fb9d1d28e9e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.870410:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6400/0x95459fb9d1d28e9e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.870415:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d23344b6400 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:1.0:1787830993.870419:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6400/0x95459fb9d1d28e9e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.870428:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6400/0x95459fb9d1d28e9e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.870439:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d233a6f7d00) 00010000:00010000:1.0:1787830993.870442:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787830993.870447:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6400/0x95459fb9d1d28e9e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.870454:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6400/0x95459fb9d1d28e9e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.870488:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6000/0x95459fb9d1d28e97 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e08 expref: 61 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.870496:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d2318594400) 00010000:00010000:1.0:1787830993.870498:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787830993.870502:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6000/0x95459fb9d1d28e97 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e08 expref: 61 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.870510:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d23344b6000, rc 0) 00000100:00100000:1.0:1787830993.870580:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a4a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+60:11267:x1874676433331456:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 441us (3771us total) trans 4294967353 rc 301/301 00000100:00100000:1.0:1787830993.870595:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 79 00000100:00100000:3.0:1787830993.877189:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787830993.877288:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433331584 00000100:00100000:0.0:1787830993.877305:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433331584 00000100:00100000:0.0:1787830993.877399:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 80 00000100:00100000:0.0:1787830993.877411:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203636580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+60:11267:x1874676433331584:12345-192.168.203.31@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787830993.877454:0:6491:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787830993.877667:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203636580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+60:11267:x1874676433331584:12345-192.168.203.31@tcp:53:lhsmtool_posix.0 Request processed in 215us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830993.877677:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 80 00000100:00100000:2.0:1787830993.889690:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787830993.891184:0:13771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433331840 00000100:00100000:1.0:1787830993.891196:0:13771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433331840 00000100:00100000:1.0:1787830993.891262:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 81 00000100:00100000:1.0:1787830993.891273:0:13771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47d7f0ed-283f-4b70-a741-6e74c5e52619+60:11267:x1874676433331840:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787830993.891295:0:13771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787830993.891299:0:13771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787830993.891331:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11000/0x95459fb9d1d28e58 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423dfa expref: 60 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.891352:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d2203615700) 00010000:00010000:1.0:1787830993.891357:0:13771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787830993.891383:0:13771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6000/0x95459fb9d1d28eac lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99423e0f expref: -99 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787830993.891768:0:13771:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:1.0:1787830993.891909:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6400/0x95459fb9d1d28eb3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.891922:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6400/0x95459fb9d1d28eb3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.891933:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6400/0x95459fb9d1d28eb3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.891979:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6000/0x95459fb9d1d28eac lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e0f expref: 62 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.892007:0:13771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6400/0x95459fb9d1d28eb3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e0f expref: 61 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.892015:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8d233a6f7400) 00010000:00010000:1.0:1787830993.892017:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787830993.892020:0:13771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d23344b6400, rc 0) 00000100:00100000:1.0:1787830993.892081:0:13771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47d7f0ed-283f-4b70-a741-6e74c5e52619+61:11267:x1874676433331840:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 810us (2400us total) trans 4294967354 rc 0/0 00000100:00100000:1.0:1787830993.892089:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 81 00000100:00100000:3.0:1787830993.895807:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787830993.895879:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433332096 00000100:00100000:0.0:1787830993.895901:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433332096 00000100:00100000:0.0:1787830993.895990:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 82 00000100:00100000:0.0:1787830993.896018:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203635680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+61:11267:x1874676433332096:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787830993.896096:0:6490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787830993.896131:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6400/0x95459fb9d1d28eb3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e0f expref: 61 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830993.896153:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8d233a6f7400) 00010000:00010000:0.0:1787830993.896169:0:6490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787830993.896204:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10600/0x95459fb9d1d28ec1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830993.896221:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10600/0x95459fb9d1d28ec1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830993.896235:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10600/0x95459fb9d1d28ec1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830993.896254:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10400/0x95459fb9d1d28ec8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x4c372abe bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830993.896262:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10400/0x95459fb9d1d28ec8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x4c372abe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830993.896270:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10400/0x95459fb9d1d28ec8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x4c372abe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830993.896324:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10600/0x95459fb9d1d28ec1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830993.896331:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10600/0x95459fb9d1d28ec1 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830993.896350:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10600/0x95459fb9d1d28ec1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830993.896368:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233bf10600 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:0.0:1787830993.896373:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10600/0x95459fb9d1d28ec1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830993.896383:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10600/0x95459fb9d1d28ec1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830993.896392:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d2203615700) 00010000:00010000:0.0:1787830993.896396:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787830993.896401:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10600/0x95459fb9d1d28ec1 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830993.896407:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10600/0x95459fb9d1d28ec1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830993.896420:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10400/0x95459fb9d1d28ec8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x4c372abe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830993.896426:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10400/0x95459fb9d1d28ec8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x4c372abe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830993.896431:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10400/0x95459fb9d1d28ec8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x4c372abe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830993.896437:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233bf10400 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:0.0:1787830993.896440:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10400/0x95459fb9d1d28ec8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x4c372abe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830993.896456:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10400/0x95459fb9d1d28ec8 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x4c372abe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830993.896468:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x4c372abe (ffff8d2309e00c00) 00010000:00010000:0.0:1787830993.896470:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787830993.896473:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10400/0x95459fb9d1d28ec8 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x4c372abe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830993.896478:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10400/0x95459fb9d1d28ec8 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x4c372abe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830993.896579:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203635680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+60:11267:x1874676433332096:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 Request processed in 564us (1095us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787830993.896589:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 82 00010000:00010000:2.0:1787830993.896610:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787830993.898985:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787830993.899247:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433332224 00000100:00100000:2.0:1787830993.899258:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433332224 00000100:00100000:2.0:1787830993.899365:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 83 00000100:00100000:2.0:1787830993.899377:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203637840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+60:11267:x1874676433332224:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787830993.899418:0:8620:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787830993.899444:0:8620:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0200/0x95459fb9d1d28ecf lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99423e16 expref: -99 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830993.899498:0:8620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1e00/0x95459fb9d1d28ed6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830993.899514:0:8620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1e00/0x95459fb9d1d28ed6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830993.899525:0:8620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1e00/0x95459fb9d1d28ed6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830993.899678:0:8620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0200/0x95459fb9d1d28ecf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e16 expref: 62 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830993.899699:0:8620:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1e00/0x95459fb9d1d28ed6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e16 expref: 61 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830993.899709:0:8620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8d2203615900) 00010000:00010000:2.0:1787830993.899712:0:8620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787830993.899716:0:8620:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22039c1e00, rc 0) 00000100:00100000:2.0:1787830993.899795:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203637840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+61:11267:x1874676433332224:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 420us (887us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830993.899802:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 83 00000100:00100000:3.0:1787830993.904037:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787830993.904310:0:13771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433332480 00000100:00100000:2.0:1787830993.904322:0:13771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433332480 00000100:00100000:2.0:1787830993.904464:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 84 00000100:00100000:2.0:1787830993.904475:0:13771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22036361c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47d7f0ed-283f-4b70-a741-6e74c5e52619+61:11267:x1874676433332480:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787830993.904586:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d28edd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830993.904647:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d28edd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830993.904661:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d28edd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787830993.905325:0:13771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:2.0:1787830993.905532:0:13771:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 284905906219ns, next at 285905902809ns, rc = 0 00000004:00010000:2.0:1787830993.905660:0:13771:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004a724a09 reply state 000000002fd4e5f6 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d28edd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830993.905687:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d28edd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830993.905702:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8d2203615900) 00010000:00010000:2.0:1787830993.905706:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1787830993.905711:0:13771:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787830993.906653:0:13771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22036361c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47d7f0ed-283f-4b70-a741-6e74c5e52619+63:11267:x1874676433332480:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 Request processed in 1436us (1885us total) trans 4294967355 rc 0/0 00000100:00100000:2.0:1787830993.906665:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 84 00000100:00100000:0.0:1787830993.908172:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787830993.908243:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433332608 00000100:00100000:3.0:1787830993.908257:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433332608 00000100:00100000:3.0:1787830993.908338:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 85 00000100:00100000:3.0:1787830993.908352:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22039b9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+63:11267:x1874676433332608:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787830993.908389:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787830993.908413:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d28ee4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99423e1d expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830993.908498:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d28ee4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e1d expref: 64 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830993.908517:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d28ee4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e1d expref: 64 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830993.908538:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8d2203615900) 00010000:00010000:3.0:1787830993.908542:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787830993.908545:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2307c77400, rc 0) 00000100:00100000:3.0:1787830993.908662:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22039b9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+64:11267:x1874676433332608:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 314us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830993.908670:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 85 00000100:00100000:3.0:1787830993.912337:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787830993.914092:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433332736 00000100:00100000:0.0:1787830993.914844:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433332736 00000100:00100000:2.0:1787830993.916091:0:8631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 32 00000100:00100000:2.0:1787830993.916105:0:8631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2335781c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2393:x1874676433332736:12345-192.168.203.31@tcp:8:lhsmtool_posix.0 00010000:00080000:2.0:1787830993.916154:0:8631:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 47d7f0ed-283f-4b70-a741-6e74c5e52619@192.168.203.31@tcp t0 exp 0000000000000000 cur 284 last 0 00000020:00000080:2.0:1787830993.916199:0:8631:0:(genops.c:1385:class_connect()) connect: client 47d7f0ed-283f-4b70-a741-6e74c5e52619, cookie 0x95459fb9d1d28eeb 00002000:00100000:2.0:1787830993.916216:0:8631:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 47d7f0ed-283f-4b70-a741-6e74c5e52619/ffff8d232029c000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211393d ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787830993.916239:0:8631:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type 37, return 37 00002000:00080000:2.0:1787830993.916362:0:8631:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787830993.916424:0:8631:0:(import.c:65:import_set_state_nolock()) ffff8d232029f800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787830993.916531:0:8631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2335781c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+6:2393:x1874676433332736:12345-192.168.203.31@tcp:8:lhsmtool_posix.0 Request processed in 426us (4207us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830993.916542:0:8631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 32 00000100:00100000:2.0:1787830993.926989:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787830993.927075:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433332864 00000100:00100000:3.0:1787830993.927090:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433332864 00000100:00100000:3.0:1787830993.927164:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 33 00000100:00100000:3.0:1787830993.927173:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a48b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+6:0:x1874676433332864:12345-192.168.203.31@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1787830993.927448:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:3.0:1787830993.929666:0:9484:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00100000:3.0:1787830993.929680:0:9484:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 47d7f0ed-283f-4b70-a741-6e74c5e52619 00000100:00100000:2.0:1787830993.929972:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a48b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:0:x1874676433332864:12345-192.168.203.31@tcp:2:lhsmtool_posix.0 Request processed in 2789us (2988us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1787830993.929989:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 33 00000100:00100000:0.0:1787830993.935920:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787830993.936020:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433333120 00000100:00100000:2.0:1787830993.936030:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433333120 00000100:00100000:2.0:1787830993.936090:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 19 00000100:00100000:2.0:1787830993.936100:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22039bb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+64:11267:x1874676433333120:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787830993.937364:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22039bb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+65:11267:x1874676433333120:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 Request processed in 1260us (1449us total) trans 4294967356 rc 0/0 00000100:00100000:2.0:1787830993.937376:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 19 00000100:00100000:2.0:1787830993.955173:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787830993.956530:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433333376 00000100:00100000:0.0:1787830993.956543:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433333376 00000100:00100000:0.0:1787830993.956605:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 86 00000100:00100000:0.0:1787830993.956614:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a4a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+65:11267:x1874676433333376:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787830993.956732:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a4a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+65:11267:x1874676433333376:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 Request processed in 118us (1567us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830993.956740:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 86 00000100:00100000:2.0:1787830993.966597:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787830993.972098:0:13771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433333504 00000100:00100000:1.0:1787830993.972112:0:13771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433333504 00000100:00100000:0.0:1787830993.972271:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 87 00000100:00100000:0.0:1787830993.972282:0:13771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a4ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47d7f0ed-283f-4b70-a741-6e74c5e52619+65:11267:x1874676433333504:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787830993.972315:0:13771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787830993.972338:0:13771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11400/0x95459fb9d1d28ef2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99423e24 expref: -99 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830993.974090:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10600/0x95459fb9d1d28ef9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830993.974111:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10600/0x95459fb9d1d28ef9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830993.974123:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10600/0x95459fb9d1d28ef9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787830993.974166:0:13771:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787830993.974185:0:13771:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10600/0x95459fb9d1d28ef9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830993.974213:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11400/0x95459fb9d1d28ef2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e24 expref: 67 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830993.974231:0:13771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10600/0x95459fb9d1d28ef9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e24 expref: 66 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830993.974239:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8d2203615900) 00010000:00010000:0.0:1787830993.974243:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787830993.974246:0:13771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233bf10600, rc 0) 00000100:00100000:0.0:1787830993.974318:0:13771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a4ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47d7f0ed-283f-4b70-a741-6e74c5e52619+66:11267:x1874676433333504:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 2037us (7730us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830993.974326:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 87 00000100:00100000:3.0:1787830993.977989:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787830993.978062:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433333632 00000100:00100000:1.0:1787830993.978071:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433333632 00000100:00100000:1.0:1787830993.978123:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 34 00000100:00100000:1.0:1787830993.978132:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203637c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:2397:x1874676433333632:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787830993.978149:0:8407:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787830993.978167:0:8407:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bc618567/0x95459fb9d1d28f00 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99423e2b expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787830993.978192:0:8407:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9022d2, blocks: 0x0 00010000:00010000:1.0:1787830993.978208:0:8407:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=284s v=(0 0) 00010000:00010000:1.0:1787830993.978212:0:8407:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787830993.978222:0:8407:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bc618567/0x95459fb9d1d28f00 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e2b expref: 6 pid: 8407 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.978253:0:8407:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bc618567/0x95459fb9d1d28f00 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e2b expref: 6 pid: 8407 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.978266:0:8407:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d23344b6e00, rc 0) 00000100:00100000:1.0:1787830993.978325:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203637c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+6:2397:x1874676433333632:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 194us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830993.978332:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 34 00000100:00100000:2.0:1787830993.983205:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787830993.983276:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433333888 00000100:00100000:3.0:1787830993.983291:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433333888 00000100:00100000:3.0:1787830993.983348:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 88 00000100:00100000:3.0:1787830993.983359:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a49a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+66:11267:x1874676433333888:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787830993.983455:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a49a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+66:11267:x1874676433333888:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 Request processed in 97us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830993.983461:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 88 00000100:00100000:3.0:1787830993.989965:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787830993.990031:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433334016 00000100:00100000:0.0:1787830993.990040:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433334016 00000100:00100000:0.0:1787830993.990097:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 35 00000100:00100000:0.0:1787830993.990107:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203636940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+6:11267:x1874676433334016:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787830993.990125:0:8406:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787830993.990146:0:8406:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003859dea3/0x95459fb9d1d28f07 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99423e32 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830993.990175:0:8406:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bc618567/0x95459fb9d1d28f00 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e2b expref: 7 pid: 8407 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830993.990184:0:8406:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787830993.990188:0:8406:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787830993.990194:0:8406:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003859dea3/0x95459fb9d1d28f07 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e32 expref: 7 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830993.990228:0:8406:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bc618567/0x95459fb9d1d28f00 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e2b expref: 7 pid: 8407 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830993.990242:0:8406:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bc618567/0x95459fb9d1d28f00 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e2b expref: 7 pid: 8407 timeout: 384 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830993.990257:0:8406:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22039b9e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8406:1874676443883520:192.168.203.31@tcp:104: 00000100:00100000:0.0:1787830993.990349:0:8406:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2307d75c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787830993.992711:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787830993.992742:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433334144 00000100:00100000:1.0:1787830993.992748:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433334144 00010000:00010000:1.0:1787830993.992781:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bc618567/0x95459fb9d1d28f00 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e2b expref: 8 pid: 8407 timeout: 384 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830993.992812:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 59 00000100:00100000:1.0:1787830993.992819:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2309d08780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+8:2397:x1874676433334144:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787830993.992832:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787830993.992851:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bc618567/0x95459fb9d1d28f00 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e2b expref: 8 pid: 8407 timeout: 384 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.992864:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bc618567/0x95459fb9d1d28f00 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e2b expref: 8 pid: 8407 timeout: 384 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.992885:0:6475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787830993.992899:0:6475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787830993.992914:0:6475:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003859dea3/0x95459fb9d1d28f07 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e32 expref: 8 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.992925:0:6475:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003859dea3/0x95459fb9d1d28f07 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e32 expref: 8 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830993.992957:0:6475:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003859dea3/0x95459fb9d1d28f07 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e32 expref: 8 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830993.992971:0:6475:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2309d092c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6475:1874676443883648:192.168.203.31@tcp:105: 00000100:00100000:1.0:1787830993.993033:0:6475:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d232f727600 going to sleep for 11 seconds 00010000:00010000:0.0:1787830993.993167:0:8406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bc618567/0x95459fb9d1d28f00 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e2b expref: 8 pid: 8407 timeout: 384 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830993.993191:0:8406:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22039b9e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8406:1874676443883520:192.168.203.31@tcp:104: 00010000:00010000:0.0:1787830993.993211:0:8406:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003859dea3/0x95459fb9d1d28f07 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e32 expref: 7 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830993.993221:0:8406:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233bf11400, rc 0) 00000100:00100000:0.0:1787830993.993253:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203636940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+7:11267:x1874676433334016:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 3149us (3299us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830993.993260:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 35 00000100:00100000:0.0:1787830993.996414:0:6475:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2309d092c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6475:1874676443883648:192.168.203.31@tcp:105: 00010000:00010000:0.0:1787830993.996438:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787830993.996493:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2309d08780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+6:2397:x1874676433334144:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 3673us (3787us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830993.996504:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 59 00000100:00100000:1.0:1787830993.998069:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787830994.000801:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433334272 00000100:00100000:0.0:1787830994.000813:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433334272 00002000:00100000:0.0:1787830994.000862:0:8413:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff8d2309d0b0c0 x1874676433334272/t0(0) o4->47d7f0ed-283f-4b70-a741-6e74c5e52619@192.168.203.31@tcp:64/0 lens 504/0 e 0 to 0 dl 1787831004 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787830994.000874:0:8413:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d2309d0b0c0 with x1874676433334272 ext(0->8) 00002000:00010000:0.0:1787830994.000880:0:8413:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d2309d0b0c0 00000100:00100000:0.0:1787830994.001039:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 0 00000100:00100000:0.0:1787830994.001050:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2309d0b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+6:2396:x1874676433334272:12345-192.168.203.31@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1787830994.002172:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2309d0b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+8:2396:x1874676433334272:12345-192.168.203.31@tcp:4:lhsmtool_posix.0 Request processed in 1119us (4104us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1787830994.002190:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 0 00002000:00100000:0.0:1787830994.002200:0:8413:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff8d2309d0b0c0 x1874676433334272/t4294967303(0) o4->47d7f0ed-283f-4b70-a741-6e74c5e52619@192.168.203.31@tcp:64/0 lens 504/448 e 0 to 0 dl 1787831004 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787830994.002208:0:8413:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d2309d0b0c0 with x1874676433334272 ext(0->8) 00002000:00010000:0.0:1787830994.002212:0:8413:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d2309d0b0c0 00000100:00100000:1.0:1787830994.006034:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787830994.006109:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433334400 00000100:00100000:3.0:1787830994.006119:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433334400 00000100:00100000:3.0:1787830994.006183:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 89 00000100:00100000:3.0:1787830994.006193:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2309d0bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+66:11267:x1874676433334400:12345-192.168.203.31@tcp:44:lhsmtool_posix.0 00000100:00080000:1.0:1787830994.006422:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:1.0:1787830994.011019:0:6469:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967356 is committed 00000004:00080000:1.0:1787830994.011247:0:6469:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000004:00080000:1.0:1787830994.011304:0:6469:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:1.0:1787830994.011318:0:6469:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d23073c0180 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:1.0:1787830994.011322:0:6469:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d2203a88f00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d23073c0e40 00000020:00080000:1.0:1787830994.011325:0:6469:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d2203a88400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d23202c6e00 00000100:00100000:1.0:1787830994.011464:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2309d092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676443883776:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1787830994.011531:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830994.011588:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443883776 00000100:00100000:1.0:1787830994.011595:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443883776 00000100:00100000:1.0:1787830994.011661:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787830994.011670:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2309d09e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1874676443883776:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1787830994.011801:0:8407:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1787830994.011805:0:8407:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1787830994 00002000:00010000:1.0:1787830994.011807:0:8407:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787830994.011809:0:8407:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1787830994 -> 1787830994 00002000:00010000:1.0:1787830994.011812:0:8407:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1787830994.011852:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2309d09e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3622:x1874676443883776:12345-0@lo:2:osp-syn-1-0.0 Request processed in 183us (320us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1787830994.011860:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:1.0:1787830994.011881:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1787830994.011924:0:3622:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d2309d092c0/2, rc 0, transno 4294967304 00000100:00100000:1.0:1787830994.011930:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2309d092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676443883776:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1787830994.011997:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787830994.012006:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203634000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1874676443883904:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787830994.012038:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830994.012064:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443883904 00000100:00100000:3.0:1787830994.012068:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443883904 00000100:00100000:3.0:1787830994.012099:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787830994.012105:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220392cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3620:x1874676443883904:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1787830994.012120:0:8408:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00002000:00010000:3.0:1787830994.012145:0:8408:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 13, mtime: 0x6a9022d0, atime: 0x6a9022d1, ctime: 0x6a9022d0, blocks: 0x8 00010000:00010000:3.0:1787830994.012153:0:8408:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000023de687f/0x95459fb9d1d28f0e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830994.012168:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=285s v=(0 0) 00010000:00010000:3.0:1787830994.012174:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787830994.012181:0:8408:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000023de687f/0x95459fb9d1d28f0e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830994.012205:0:8408:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000023de687f/0x95459fb9d1d28f0e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830994.012216:0:8408:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000023de687f/0x95459fb9d1d28f0e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830994.012224:0:8408:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000023de687f/0x95459fb9d1d28f0e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830994.012239:0:8408:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787830994.012252:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787830994.012258:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000023de687f/0x95459fb9d1d28f0e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830994.012266:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2307c77800 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:1.0:1787830994.012270:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000023de687f/0x95459fb9d1d28f0e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830994.012278:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000023de687f/0x95459fb9d1d28f0e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830994.012294:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000023de687f/0x95459fb9d1d28f0e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830994.012302:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000023de687f/0x95459fb9d1d28f0e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830994.012324:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830994.012326:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830994.012328:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787830994.012334:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220392cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3620:x1874676443883904:12345-0@lo:6:osp-syn-0-0.0 Request processed in 229us (295us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1787830994.012341:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:3.0:1787830994.012359:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1787830994.012375:0:3620:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d2203634000/2, rc 0, transno 4294967302 00000100:00100000:3.0:1787830994.012379:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203634000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1874676443883904:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787830994.012464:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2309d0bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+20:11267:x1874676433334400:12345-192.168.203.31@tcp:44:lhsmtool_posix.0 Request processed in 6271us (6437us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830994.012471:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 89 00000020:00080000:3.0:1787830994.012745:0:6522:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:3.0:1787830994.012872:0:6522:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00010000:00010000:2.0:1787830994.013742:0:3606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0400/0x95459fb9d1d28c21 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830994.013754:0:3606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0400/0x95459fb9d1d28c21 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830994.013760:0:3606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0400/0x95459fb9d1d28c21 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830994.013776:0:3606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22039c0400 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:2.0:1787830994.013780:0:3606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0400/0x95459fb9d1d28c21 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830994.013786:0:3606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0400/0x95459fb9d1d28c21 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830994.013802:0:3606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8d2203615600) 00010000:00010000:2.0:1787830994.013805:0:3606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787830994.013809:0:3606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0400/0x95459fb9d1d28c21 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830994.013816:0:3606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0400/0x95459fb9d1d28c21 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830994.013829:0:3606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0c00/0x95459fb9d1d28c28 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830994.013835:0:3606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0c00/0x95459fb9d1d28c28 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830994.013841:0:3606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0c00/0x95459fb9d1d28c28 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830994.013846:0:3606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22039c0c00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:2.0:1787830994.013849:0:3606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0c00/0x95459fb9d1d28c28 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830994.013855:0:3606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0c00/0x95459fb9d1d28c28 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830994.013871:0:3606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d2203615700) 00010000:00010000:2.0:1787830994.013874:0:3606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787830994.013877:0:3606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0c00/0x95459fb9d1d28c28 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830994.013882:0:3606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0c00/0x95459fb9d1d28c28 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830994.013917:0:3606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d28c67 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830994.013923:0:3606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d28c67 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830994.013929:0:3606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d28c67 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830994.013935:0:3606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2307c76400 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:2.0:1787830994.013938:0:3606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d28c67 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830994.013944:0:3606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d28c67 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830994.013952:0:3606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8d2318594d00) 00010000:00010000:2.0:1787830994.013954:0:3606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787830994.013957:0:3606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d28c67 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830994.013962:0:3606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d28c67 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830994.013986:0:3606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94200/0x95459fb9d1d28d71 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830994.013993:0:3606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94200/0x95459fb9d1d28d71 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830994.013999:0:3606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94200/0x95459fb9d1d28d71 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830994.014004:0:3606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233be94200 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:2.0:1787830994.014007:0:3606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94200/0x95459fb9d1d28d71 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830994.014013:0:3606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94200/0x95459fb9d1d28d71 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830994.014021:0:3606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d233a6f7d00) 00010000:00010000:2.0:1787830994.014151:0:3606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787830994.014156:0:3606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94200/0x95459fb9d1d28d71 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830994.014162:0:3606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94200/0x95459fb9d1d28d71 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830994.014175:0:3606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94c00/0x95459fb9d1d28d94 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830994.014180:0:3606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94c00/0x95459fb9d1d28d94 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830994.014185:0:3606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94c00/0x95459fb9d1d28d94 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830994.014195:0:3606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233be94c00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:2.0:1787830994.014198:0:3606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94c00/0x95459fb9d1d28d94 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830994.014204:0:3606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94c00/0x95459fb9d1d28d94 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830994.014213:0:3606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d233a6f7d00) 00010000:00010000:2.0:1787830994.014215:0:3606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787830994.014218:0:3606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94c00/0x95459fb9d1d28d94 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830994.014224:0:3606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94c00/0x95459fb9d1d28d94 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830994.014235:0:3606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7000/0x95459fb9d1d28dda lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830994.014241:0:3606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7000/0x95459fb9d1d28dda lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830994.014246:0:3606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7000/0x95459fb9d1d28dda lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830994.014251:0:3606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d23344b7000 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:2.0:1787830994.014254:0:3606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7000/0x95459fb9d1d28dda lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830994.014260:0:3606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7000/0x95459fb9d1d28dda lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830994.014278:0:3606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d233a6f7d00) 00010000:00010000:2.0:1787830994.014281:0:3606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787830994.014283:0:3606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7000/0x95459fb9d1d28dda lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830994.014289:0:3606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7000/0x95459fb9d1d28dda lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830994.014300:0:3606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d28edd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830994.014305:0:3606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d28edd lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830994.014310:0:3606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d28edd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830994.014314:0:3606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22039c0a00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:2.0:1787830994.014316:0:3606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d28edd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830994.014321:0:3606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d28edd lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830994.014328:0:3606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8d2203615900) 00010000:00010000:2.0:1787830994.014330:0:3606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787830994.014332:0:3606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d28edd lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830994.014342:0:3606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d28edd lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830994.014450:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787830994.014477:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433334528 00000100:00100000:0.0:1787830994.014485:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433334528 00000100:00100000:0.0:1787830994.014520:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 38 00000100:00100000:0.0:1787830994.014532:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22039b9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+8:2396:x1874676433334528:12345-192.168.203.31@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1787830994.017621:0:9484:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:1.0:1787830994.017748:0:9484:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:0.0:1787830994.017959:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22039b9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+6:2396:x1874676433334528:12345-192.168.203.31@tcp:16:lhsmtool_posix.0 Request processed in 3426us (3510us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830994.017970:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 38 00000100:00100000:1.0:1787830994.019977:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787830994.020071:0:13771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433334784 00000100:00100000:0.0:1787830994.020080:0:13771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433334784 00000100:00100000:0.0:1787830994.020200:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 90 00000100:00100000:0.0:1787830994.020210:0:13771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220380da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47d7f0ed-283f-4b70-a741-6e74c5e52619+14:11267:x1874676433334784:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787830994.020261:0:13771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787830994.020286:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10600/0x95459fb9d1d28ef9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e24 expref: 14 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830994.020303:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8d2203615900) 00010000:00010000:0.0:1787830994.020308:0:13771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787830994.020429:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10400/0x95459fb9d1d28f15 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830994.020449:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10400/0x95459fb9d1d28f15 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830994.020460:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10400/0x95459fb9d1d28f15 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787830994.020567:0:13771:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000013b5e39 reply state 0000000074c740bd transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10400/0x95459fb9d1d28f15 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830994.020579:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10400/0x95459fb9d1d28f15 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830994.020586:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8d2203615900) 00010000:00010000:0.0:1787830994.020589:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787830994.020592:0:13771:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787830994.020867:0:13771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220380da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47d7f0ed-283f-4b70-a741-6e74c5e52619+15:11267:x1874676433334784:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 Request processed in 658us (896us total) trans 4294967357 rc 0/0 00000100:00100000:0.0:1787830994.020875:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 90 00000100:00100000:1.0:1787830994.023014:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787830994.023150:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433334912 00000100:00100000:3.0:1787830994.023157:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433334912 00000100:00100000:3.0:1787830994.023212:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 39 00000100:00100000:3.0:1787830994.023221:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220380d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+6:2395:x1874676433334912:12345-192.168.203.31@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787830994.023385:0:8408:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1787830994.023389:0:8408:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 1787830994 -> 1787830993 00002000:00010000:3.0:1787830994.023391:0:8408:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1787830993 00002000:00010000:3.0:1787830994.023394:0:8408:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1787830994 -> 1787830993 00002000:00010000:3.0:1787830994.023396:0:8408:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1787830994.023458:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220380d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+7:2395:x1874676433334912:12345-192.168.203.31@tcp:2:lhsmtool_posix.0 Request processed in 238us (450us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1787830994.023466:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 39 00000100:00100000:3.0:1787830994.026914:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787830994.026984:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433335168 00000100:00100000:2.0:1787830994.026993:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433335168 00000100:00100000:2.0:1787830994.027077:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 91 00000100:00100000:2.0:1787830994.027087:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220392de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+15:11267:x1874676433335168:12345-192.168.203.31@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1787830994.027157:0:8620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d28f1c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830994.027173:0:8620:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1e00/0x95459fb9d1d28ed6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e16 expref: 15 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830994.027183:0:8620:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d28f1c lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830994.027215:0:8620:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1e00/0x95459fb9d1d28ed6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e16 expref: 15 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830994.027228:0:8620:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1e00/0x95459fb9d1d28ed6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e16 expref: 15 pid: 8620 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830994.027242:0:8620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a48780 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8620:1874676443884032:192.168.203.31@tcp:104: 00000100:00100000:2.0:1787830994.027324:0:8620:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d23100b7240 going to sleep for 11 seconds 00000100:00100000:3.0:1787830994.033248:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787830994.033470:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433335296 00000100:00100000:1.0:1787830994.033479:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433335296 00010000:00010000:1.0:1787830994.033519:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1e00/0x95459fb9d1d28ed6 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e16 expref: 16 pid: 8620 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830994.033555:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 60 00000100:00100000:1.0:1787830994.033565:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220392cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+16:2397:x1874676433335296:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787830994.033579:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787830994.033586:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1e00/0x95459fb9d1d28ed6 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e16 expref: 16 pid: 8620 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830994.033600:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1e00/0x95459fb9d1d28ed6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e16 expref: 16 pid: 8620 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830994.033642:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8d2203615900) 00010000:00010000:1.0:1787830994.033648:0:6476:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d28f1c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830994.033657:0:6476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d28f1c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830994.033678:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d28f1c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830994.033697:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787830994.033762:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220392cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+16:2397:x1874676433335296:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 198us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830994.033770:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 60 00010000:00010000:1.0:1787830994.033819:0:8620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1e00/0x95459fb9d1d28ed6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e16 expref: 15 pid: 8620 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830994.033834:0:8620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a48780 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8620:1874676443884032:192.168.203.31@tcp:104: 00010000:00010000:1.0:1787830994.033852:0:8620:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d28f1c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830994.033862:0:8620:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d28f1c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830994.033868:0:8620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d28f1c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830994.033921:0:8620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d28f1c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830994.033929:0:8620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d28f1c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830994.033935:0:8620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d28f1c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830994.033941:0:8620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22039c0a00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:1.0:1787830994.033951:0:8620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d28f1c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830994.033959:0:8620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d28f1c lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830994.033967:0:8620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8d2203615900) 00010000:00010000:1.0:1787830994.033970:0:8620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787830994.033973:0:8620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d28f1c lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830994.033978:0:8620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d28f1c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830994.034015:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220392de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+14:11267:x1874676433335168:12345-192.168.203.31@tcp:55:lhsmtool_posix.0 Request processed in 6930us (7109us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787830994.034023:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 91 00000100:00100000:1.0:1787830994.035616:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787830994.035708:0:8631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433335424 00000100:00100000:3.0:1787830994.035714:0:8631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433335424 00000100:00100000:3.0:1787830994.035762:0:8631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 40 00000100:00100000:3.0:1787830994.035771:0:8631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220380e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+7:2397:x1874676433335424:12345-192.168.203.31@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787830994.035808:0:8631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008f7c0c50/0x95459fb9d1d28f23 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830994.035827:0:8631:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003859dea3/0x95459fb9d1d28f07 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e32 expref: 7 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830994.035836:0:8631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1787830994.035840:0:8631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787830994.035845:0:8631:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f7c0c50/0x95459fb9d1d28f23 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830994.035876:0:8631:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003859dea3/0x95459fb9d1d28f07 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e32 expref: 7 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830994.035915:0:8631:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003859dea3/0x95459fb9d1d28f07 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e32 expref: 7 pid: 8406 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830994.035930:0:8631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220392e940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8631:1874676443884160:192.168.203.31@tcp:104: 00000100:00100000:3.0:1787830994.035996:0:8631:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2202713180 going to sleep for 11 seconds 00000100:00100000:3.0:1787830994.037670:0:8631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220392e940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8631:1874676443884160:192.168.203.31@tcp:104: 00010000:00010000:3.0:1787830994.037699:0:8631:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008f7c0c50/0x95459fb9d1d28f23 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830994.039755:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787830994.040295:0:7432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433335552 00000100:00100000:2.0:1787830994.040304:0:7432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433335552 00010000:00010000:2.0:1787830994.040352:0:7432:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003859dea3/0x95459fb9d1d28f07 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e32 expref: 8 pid: 8406 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830994.040391:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 61 00000100:00100000:2.0:1787830994.040409:0:7432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220380f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+8:2397:x1874676433335552:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787830994.040424:0:7432:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787830994.040443:0:7432:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003859dea3/0x95459fb9d1d28f07 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e32 expref: 8 pid: 8406 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830994.040457:0:7432:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003859dea3/0x95459fb9d1d28f07 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e32 expref: 8 pid: 8406 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830994.040481:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003859dea3/0x95459fb9d1d28f07 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e32 expref: 8 pid: 8406 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830994.040499:0:7432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787830994.040503:0:7432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787830994.040508:0:7432:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008f7c0c50/0x95459fb9d1d28f23 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830994.040517:0:7432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f7c0c50/0x95459fb9d1d28f23 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830994.040542:0:7432:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787830994.040599:0:7432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220380f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+7:2397:x1874676433335552:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 192us (852us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830994.040607:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 61 00010000:00010000:3.0:1787830994.040852:0:8631:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008f7c0c50/0x95459fb9d1d28f23 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830994.040862:0:8631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008f7c0c50/0x95459fb9d1d28f23 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830994.040881:0:8631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008f7c0c50/0x95459fb9d1d28f23 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830994.040889:0:8631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008f7c0c50/0x95459fb9d1d28f23 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830994.040908:0:8631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008f7c0c50/0x95459fb9d1d28f23 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830994.040927:0:8631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2307c76a00 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:3.0:1787830994.040931:0:8631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008f7c0c50/0x95459fb9d1d28f23 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830994.040941:0:8631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008f7c0c50/0x95459fb9d1d28f23 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830994.040952:0:8631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008f7c0c50/0x95459fb9d1d28f23 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830994.040959:0:8631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008f7c0c50/0x95459fb9d1d28f23 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830994.041007:0:8631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220380e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+6:2397:x1874676433335424:12345-192.168.203.31@tcp:1:lhsmtool_posix.0 Request processed in 5237us (5396us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830994.041015:0:8631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 40 00000100:00100000:1.0:1787830994.045451:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787830994.045542:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433335808 00000100:00100000:3.0:1787830994.045551:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433335808 00000100:00100000:3.0:1787830994.045611:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 92 00000100:00100000:3.0:1787830994.045621:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220380de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+14:11267:x1874676433335808:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787830994.045728:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d28f2a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830994.045746:0:6491:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11c00/0x95459fb9d1d28d6a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423dbb expref: 14 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830994.045773:0:6491:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d28f2a lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830994.045807:0:6491:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11c00/0x95459fb9d1d28d6a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423dbb expref: 14 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830994.045820:0:6491:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11c00/0x95459fb9d1d28d6a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423dbb expref: 14 pid: 8620 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830994.045834:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220392e940 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6491:1874676443884288:192.168.203.31@tcp:104: 00000100:00100000:3.0:1787830994.045911:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2202713180 going to sleep for 11 seconds 00000100:00100000:1.0:1787830994.049330:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787830994.051378:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433335936 00000100:00100000:2.0:1787830994.051391:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433335936 00010000:00010000:2.0:1787830994.051441:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11c00/0x95459fb9d1d28d6a lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423dbb expref: 15 pid: 8620 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830994.051497:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 62 00000100:00100000:2.0:1787830994.051506:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2321e77c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+15:2397:x1874676433335936:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787830994.051520:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787830994.051526:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11c00/0x95459fb9d1d28d6a lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423dbb expref: 15 pid: 8620 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830994.051540:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11c00/0x95459fb9d1d28d6a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423dbb expref: 15 pid: 8620 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830994.051561:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d233a6f7d00) 00010000:00010000:2.0:1787830994.051567:0:6476:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d28f2a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830994.051576:0:6476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d28f2a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830994.051584:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d28f2a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830994.051603:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787830994.051672:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2321e77c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+15:2397:x1874676433335936:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 167us (2350us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830994.051679:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 62 00010000:00010000:3.0:1787830994.052722:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11c00/0x95459fb9d1d28d6a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423dbb expref: 14 pid: 8620 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830994.052741:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220392e940 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6491:1874676443884288:192.168.203.31@tcp:104: 00010000:00010000:3.0:1787830994.052760:0:6491:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d28f2a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830994.052768:0:6491:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d28f2a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830994.052773:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d28f2a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830994.052941:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d28f31 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830994.052954:0:6491:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d28ee4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e1d expref: 14 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830994.052969:0:6491:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d28f31 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830994.052997:0:6491:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d28ee4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e1d expref: 14 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830994.053008:0:6491:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d28ee4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e1d expref: 14 pid: 6490 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830994.053021:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220392e940 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6491:1874676443884416:192.168.203.31@tcp:104: 00000100:00100000:3.0:1787830994.053079:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2202713900 going to sleep for 11 seconds 00000100:00100000:3.0:1787830994.056043:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220392e940 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6491:1874676443884416:192.168.203.31@tcp:104: 00010000:00010000:3.0:1787830994.056086:0:6491:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d28f31 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830994.057162:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787830994.057238:0:7432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433336064 00000100:00100000:2.0:1787830994.057252:0:7432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433336064 00010000:00010000:2.0:1787830994.057299:0:7432:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d28ee4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e1d expref: 15 pid: 6490 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830994.057371:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 63 00000100:00100000:2.0:1787830994.057381:0:7432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220380f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+15:2396:x1874676433336064:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787830994.057395:0:7432:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787830994.057402:0:7432:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d28ee4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e1d expref: 15 pid: 6490 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830994.057415:0:7432:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d28ee4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e1d expref: 15 pid: 6490 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830994.057450:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d28ee4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e1d expref: 15 pid: 6490 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830994.057472:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8d2203615900) 00010000:00010000:2.0:1787830994.057477:0:7432:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d28f31 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830994.057487:0:7432:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d28f31 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830994.057496:0:7432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d28f31 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830994.057524:0:7432:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787830994.057585:0:7432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220380f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+14:2396:x1874676433336064:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 205us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830994.057593:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 63 00010000:00010000:3.0:1787830994.057756:0:6491:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d28f31 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830994.057769:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d28f31 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787830994.059140:0:6491:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:3.0:1787830994.059840:0:6491:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:3.0:1787830994.059907:0:6491:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:3.0:1787830994.060011:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220392e940 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6491:1874676443884544:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787830994.060088:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830994.060130:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2202713f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787830994.062948:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443884544 00000100:00100000:1.0:1787830994.062961:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443884544 00000100:00100000:1.0:1787830994.063036:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1787830994.063047:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220392f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6491:x1874676443884544:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787830994.063193:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220392f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6491:x1874676443884544:12345-0@lo:1000:mdt00_001.0 Request processed in 148us (3104us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830994.063201:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1787830994.063258:0:6491:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:3.0:1787830994.063271:0:6491:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d2309d092c0, transno 4294967304 00000100:00100000:3.0:1787830994.063307:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220392e940 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6491:1874676443884544:0@lo:1000:mdt00_001.0 00000001:00080000:1.0:1787830994.077411:0:6491:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:1.0:1787830994.077513:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220394f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6491:1874676443884672:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787830994.077580:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830994.077616:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d232f727780 going to sleep for 11 seconds 00000100:00100000:3.0:1787830994.077694:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443884672 00000100:00100000:3.0:1787830994.077709:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443884672 00000100:00100000:3.0:1787830994.077791:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1787830994.077803:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220394c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6491:x1874676443884672:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787830994.078058:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220394c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6491:x1874676443884672:12345-0@lo:1000:mdt00_001.0 Request processed in 257us (476us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1787830994.078068:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1787830994.078255:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220394f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6491:1874676443884672:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1787830994.078302:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d28f31 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830994.078312:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d28f31 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830994.078319:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d28f31 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830994.078325:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2307c76600 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:0.0:1787830994.078329:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d28f31 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830994.078349:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d28f31 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830994.078364:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8d2203615900) 00010000:00010000:0.0:1787830994.078367:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787830994.078371:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d28f31 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830994.078377:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d28f31 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830994.078408:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6a00/0x95459fb9d1d28e5f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830994.078414:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6a00/0x95459fb9d1d28e5f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830994.078420:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6a00/0x95459fb9d1d28e5f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830994.078425:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d23344b6a00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:0.0:1787830994.078428:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6a00/0x95459fb9d1d28e5f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830994.078433:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6a00/0x95459fb9d1d28e5f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830994.078441:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d233a6f7d00) 00010000:00010000:0.0:1787830994.078443:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787830994.078446:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6a00/0x95459fb9d1d28e5f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830994.078462:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6a00/0x95459fb9d1d28e5f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830994.078485:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11400/0x95459fb9d1d28f38 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830994.078499:0:6491:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6c00/0x95459fb9d1d28e7b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e01 expref: 17 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830994.078508:0:6491:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11400/0x95459fb9d1d28f38 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830994.078533:0:6491:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6c00/0x95459fb9d1d28e7b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e01 expref: 17 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830994.078548:0:6491:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6c00/0x95459fb9d1d28e7b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e01 expref: 17 pid: 6492 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830994.078559:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22039ba940 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6491:1874676443884800:192.168.203.31@tcp:104: 00000100:00100000:0.0:1787830994.078648:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2307d75840 going to sleep for 11 seconds 00000100:00100000:0.0:1787830994.082120:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22039ba940 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6491:1874676443884800:192.168.203.31@tcp:104: 00010000:00010000:0.0:1787830994.082150:0:6491:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11400/0x95459fb9d1d28f38 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830994.083831:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787830994.083911:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433336192 00000100:00100000:2.0:1787830994.083930:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433336192 00010000:00010000:2.0:1787830994.083977:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6c00/0x95459fb9d1d28e7b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e01 expref: 18 pid: 6492 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830994.084018:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 64 00000100:00100000:2.0:1787830994.084027:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22039ba940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+18:2397:x1874676433336192:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787830994.084042:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787830994.084058:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6c00/0x95459fb9d1d28e7b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e01 expref: 18 pid: 6492 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830994.084071:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6c00/0x95459fb9d1d28e7b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e01 expref: 18 pid: 6492 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830994.084092:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6c00/0x95459fb9d1d28e7b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e01 expref: 18 pid: 6492 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830994.084117:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d233a6f7d00) 00010000:00010000:2.0:1787830994.084123:0:6476:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11400/0x95459fb9d1d28f38 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830994.084132:0:6476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11400/0x95459fb9d1d28f38 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830994.084139:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11400/0x95459fb9d1d28f38 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830994.084170:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787830994.084218:0:6491:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11400/0x95459fb9d1d28f38 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830994.084223:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22039ba940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+17:2397:x1874676433336192:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 195us (397us total) trans 0 rc 0/0 00010000:00010000:3.0:1787830994.084246:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11400/0x95459fb9d1d28f38 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830994.084259:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 64 00010000:00010000:3.0:1787830994.084269:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11400/0x95459fb9d1d28f38 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830994.084348:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11400/0x95459fb9d1d28f38 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830994.084357:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11400/0x95459fb9d1d28f38 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830994.084364:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233bf11400 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:3.0:1787830994.084370:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11400/0x95459fb9d1d28f38 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830994.084379:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11400/0x95459fb9d1d28f38 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830994.084412:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d233a6f7d00) 00010000:00010000:3.0:1787830994.084415:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787830994.084420:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11400/0x95459fb9d1d28f38 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830994.084427:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11400/0x95459fb9d1d28f38 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830994.084445:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d28f2a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830994.084452:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d28f2a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830994.084458:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d28f2a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830994.084463:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2307c77600 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:3.0:1787830994.084466:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d28f2a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830994.084472:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d28f2a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830994.084480:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d233a6f7d00) 00010000:00010000:3.0:1787830994.084483:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787830994.084486:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d28f2a lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830994.084492:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d28f2a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830994.085543:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220380de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+16:11267:x1874676433335808:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 Request processed in 39916us (40094us total) trans 4294967362 rc 0/0 00000100:00100000:3.0:1787830994.085556:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 92 00000020:00080000:3.0:1787830994.085563:0:6491:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1787830994.087096:0:13758:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787830994.087106:0:13758:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787830994.087128:0:13758:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1787830994.087150:0:13758:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787830994.090195:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787830994.090265:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433336448 00000100:00100000:3.0:1787830994.090279:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433336448 00000100:00100000:3.0:1787830994.090351:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 20 00000100:00100000:3.0:1787830994.090361:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22039b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+16:11267:x1874676433336448:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787830994.090613:0:6494:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787830994.090682:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967363 00010000:00010000:3.0:1787830994.090716:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76a00/0x95459fb9d1d28f3f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830994.090732:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76a00/0x95459fb9d1d28f3f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830994.090743:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76a00/0x95459fb9d1d28f3f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830994.090751:0:6494:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76a00/0x95459fb9d1d28f3f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830994.090758:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76a00/0x95459fb9d1d28f3f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830994.090764:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76a00/0x95459fb9d1d28f3f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830994.090785:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787830994.090842:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787830994.090853:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76a00/0x95459fb9d1d28f3f lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830994.090864:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2307c76a00 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:0.0:1787830994.090868:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76a00/0x95459fb9d1d28f3f lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830994.090881:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76a00/0x95459fb9d1d28f3f lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830994.090915:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8d2203615900) 00010000:00010000:0.0:1787830994.090919:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787830994.090925:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76a00/0x95459fb9d1d28f3f lrc: 3/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830994.090935:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830994.090937:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830994.090938:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787830994.091920:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76a00/0x95459fb9d1d28f3f lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830994.092287:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22039b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+18:11267:x1874676433336448:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 Request processed in 1924us (2102us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1787830994.092298:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 20 00000020:00080000:3.0:1787830994.092302:0:6494:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:0.0:1787830994.533234:0:14171:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787830994.533243:0:14171:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787830994.533267:0:14171:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1787830994.533273:0:14171:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787830994.621405:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787830994.621525:0:13771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433336704 00000100:00100000:3.0:1787830994.621534:0:13771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433336704 00000100:00100000:3.0:1787830994.621595:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 93 00000100:00100000:3.0:1787830994.621606:0:13771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a48780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47d7f0ed-283f-4b70-a741-6e74c5e52619+18:11281:x1874676433336704:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:3.0:1787830994.621653:0:13771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787830994.621677:0:13771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d28f46 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99423e39 expref: -99 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830994.621793:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76a00/0x95459fb9d1d28f4d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830994.621809:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76a00/0x95459fb9d1d28f4d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830994.621820:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76a00/0x95459fb9d1d28f4d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787830994.621831:0:13771:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1787830994.621941:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d28f46 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e39 expref: 21 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830994.621958:0:13771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76a00/0x95459fb9d1d28f4d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e39 expref: 20 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830994.621980:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d2203615700) 00010000:00010000:3.0:1787830994.621984:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787830994.621988:0:13771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2307c76a00, rc 0) 00000100:00100000:3.0:1787830994.622061:0:13771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a48780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47d7f0ed-283f-4b70-a741-6e74c5e52619+20:11281:x1874676433336704:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 457us (665us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1787830994.622068:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 93 00000100:00100000:3.0:1787830994.625441:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787830994.625519:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433336832 00000100:00100000:1.0:1787830994.625528:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433336832 00000100:00100000:1.0:1787830994.625588:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 94 00000100:00100000:1.0:1787830994.625598:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220392e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+20:11281:x1874676433336832:12345-192.168.203.31@tcp:34:lfs.0 00010000:00010000:1.0:1787830994.625700:0:8620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7400/0x95459fb9d1d28f5b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830994.625717:0:8620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7400/0x95459fb9d1d28f5b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830994.625728:0:8620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7400/0x95459fb9d1d28f5b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830994.625744:0:8620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6000/0x95459fb9d1d28f62 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830994.625751:0:8620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6000/0x95459fb9d1d28f62 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830994.625758:0:8620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6000/0x95459fb9d1d28f62 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830994.625837:0:8620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6400/0x95459fb9d1d28f69 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830994.625845:0:8620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6400/0x95459fb9d1d28f69 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830994.625867:0:8620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6400/0x95459fb9d1d28f69 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787830994.625925:0:8620:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6400/0x95459fb9d1d28f69 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830994.625938:0:8620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7400/0x95459fb9d1d28f5b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830994.625944:0:8620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7400/0x95459fb9d1d28f5b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830994.625956:0:8620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7400/0x95459fb9d1d28f5b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830994.625962:0:8620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d23344b7400 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:1.0:1787830994.625966:0:8620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7400/0x95459fb9d1d28f5b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830994.625973:0:8620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7400/0x95459fb9d1d28f5b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830994.625984:0:8620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d2203615700) 00010000:00010000:1.0:1787830994.625987:0:8620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787830994.625992:0:8620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7400/0x95459fb9d1d28f5b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830994.625998:0:8620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7400/0x95459fb9d1d28f5b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830994.626011:0:8620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6000/0x95459fb9d1d28f62 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830994.626205:0:8620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6000/0x95459fb9d1d28f62 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830994.626215:0:8620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6000/0x95459fb9d1d28f62 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830994.626220:0:8620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d23344b6000 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:1.0:1787830994.626223:0:8620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6000/0x95459fb9d1d28f62 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830994.626229:0:8620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6000/0x95459fb9d1d28f62 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830994.626236:0:8620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8d232b9c6d00) 00010000:00010000:1.0:1787830994.626239:0:8620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787830994.626242:0:8620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6000/0x95459fb9d1d28f62 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830994.626247:0:8620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6000/0x95459fb9d1d28f62 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830994.626260:0:8620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6400/0x95459fb9d1d28f69 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830994.626266:0:8620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6400/0x95459fb9d1d28f69 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830994.626273:0:8620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6400/0x95459fb9d1d28f69 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830994.626278:0:8620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d23344b6400 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:1.0:1787830994.626286:0:8620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6400/0x95459fb9d1d28f69 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830994.626292:0:8620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6400/0x95459fb9d1d28f69 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830994.626299:0:8620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d232b9c6a00) 00010000:00010000:1.0:1787830994.626302:0:8620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787830994.626304:0:8620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6400/0x95459fb9d1d28f69 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830994.626309:0:8620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6400/0x95459fb9d1d28f69 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830994.626414:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220392e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+20:11281:x1874676433336832:12345-192.168.203.31@tcp:34:lfs.0 Request processed in 817us (982us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830994.626421:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 94 00000100:00100000:0.0:1787830994.665986:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787830994.666016:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2309d092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443884928:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787830994.666097:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830994.667002:0:11489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443884928 00000100:00100000:2.0:1787830994.667012:0:11489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443884928 00000100:00100000:2.0:1787830994.667081:0:11489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787830994.667091:0:11489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22039b8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3619:x1874676443884928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787830994.667123:0:11489:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787830994.667188:0:11489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22039b8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3619:x1874676443884928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (1090us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830994.667194:0:11489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787830994.667313:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2309d092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443884928:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787830994.668148:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220392f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443885056:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787830994.668196:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830994.668286:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443885056 00000100:00100000:3.0:1787830994.668292:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443885056 00000100:00100000:3.0:1787830994.668338:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787830994.668345:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22039b8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443885056:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787830994.668360:0:8410:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787830994.668397:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22039b8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443885056:12345-0@lo:13:osp-pre-0-1.0 Request processed in 54us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830994.668403:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:3.0:1787830994.668420:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787830994.668445:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220392f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443885056:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787830994.687036:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787830994.687330:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433337088 00000100:00100000:3.0:1787830994.687339:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433337088 00000100:00100000:3.0:1787830994.687435:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 95 00000100:00100000:3.0:1787830994.687445:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22039ba1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+20:11284:x1874676433337088:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:3.0:1787830994.687464:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787830994.687486:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d28f70 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99423e40 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830994.687565:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d28f77 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830994.687578:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d28f77 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830994.687588:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d28f77 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830994.687601:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d28f7e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830994.687607:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d28f7e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830994.687644:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d28f7e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830994.687748:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d28f85 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830994.687756:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d28f85 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830994.687763:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d28f85 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787830994.687771:0:6491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:3.0:1787830994.687845:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d28f77 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830994.687852:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d28f77 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830994.687866:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d28f77 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830994.687872:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2307c76600 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:3.0:1787830994.687876:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d28f77 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830994.687883:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d28f77 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830994.687904:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d2203615700) 00010000:00010000:3.0:1787830994.687907:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787830994.687911:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d28f77 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830994.687917:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d28f77 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830994.687927:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d28f7e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830994.687933:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d28f7e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830994.687940:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d28f7e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830994.687945:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2307c77400 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:3.0:1787830994.687948:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d28f7e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830994.687963:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d28f7e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830994.687971:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8d2318594500) 00010000:00010000:3.0:1787830994.687974:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787830994.687977:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d28f7e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830994.687983:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d28f7e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830994.688020:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d28f70 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e40 expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830994.688033:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d28f85 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e40 expref: 22 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830994.688040:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d2318594000) 00010000:00010000:3.0:1787830994.688042:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787830994.688044:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2307c76400, rc 0) 00000100:00100000:3.0:1787830994.688096:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22039ba1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+22:11284:x1874676433337088:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 652us (1075us total) trans 4294967366 rc 0/0 00000100:00100000:3.0:1787830994.688103:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 95 00000100:00100000:1.0:1787830994.696035:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787830994.696118:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433337216 00000100:00100000:0.0:1787830994.696127:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433337216 00000100:00100000:0.0:1787830994.696188:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 96 00000100:00100000:0.0:1787830994.696198:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220394e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+22:11284:x1874676433337216:12345-192.168.203.31@tcp:54:lfs.0 00010000:00010000:0.0:1787830994.696502:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11000/0x95459fb9d1d28f93 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830994.696519:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11000/0x95459fb9d1d28f93 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830994.696531:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11000/0x95459fb9d1d28f93 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830994.696566:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11000/0x95459fb9d1d28f93 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830994.696573:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11000/0x95459fb9d1d28f93 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830994.696580:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11000/0x95459fb9d1d28f93 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830994.696586:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233bf11000 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:0.0:1787830994.696590:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11000/0x95459fb9d1d28f93 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830994.696598:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11000/0x95459fb9d1d28f93 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830994.696608:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d2318594000) 00010000:00010000:0.0:1787830994.696621:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787830994.696652:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11000/0x95459fb9d1d28f93 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830994.696659:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11000/0x95459fb9d1d28f93 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830994.696727:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220394e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+22:11284:x1874676433337216:12345-192.168.203.31@tcp:54:lfs.0 Request processed in 530us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830994.696735:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 96 00000100:00100000:2.0:1787830994.702187:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787830994.702389:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433337472 00000100:00100000:3.0:1787830994.702398:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433337472 00000100:00100000:3.0:1787830994.702460:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 21 00000100:00100000:3.0:1787830994.702471:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d23066c9c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+22:11284:x1874676433337472:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:3.0:1787830994.702733:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d23066c9c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+23:11284:x1874676433337472:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 263us (554us total) trans 4294967367 rc 0/0 00000100:00100000:3.0:1787830994.702741:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 21 00000100:00100000:1.0:1787830994.723162:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787830994.723198:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433337728 00000100:00100000:1.0:1787830994.723206:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433337728 00000100:00100000:1.0:1787830994.723251:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 97 00000100:00100000:1.0:1787830994.723272:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220394cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+23:10810:x1874676433337728:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:1.0:1787830994.723295:0:8620:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787830994.723314:0:8620:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6400/0x95459fb9d1d28f9a lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99423e47 expref: -99 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830994.723416:0:8620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6000/0x95459fb9d1d28fa1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830994.723442:0:8620:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d28f85 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e40 expref: 24 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830994.723452:0:8620:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6000/0x95459fb9d1d28fa1 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830994.723484:0:8620:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d28f85 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e40 expref: 24 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830994.723499:0:8620:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d28f85 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e40 expref: 24 pid: 6491 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830994.723512:0:8620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220394f0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8620:1874676443885184:192.168.203.31@tcp:104: 00000100:00100000:1.0:1787830994.723595:0:8620:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d232f727b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787830994.728265:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787830994.728294:0:7432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433337856 00000100:00100000:2.0:1787830994.728300:0:7432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433337856 00010000:00010000:2.0:1787830994.728340:0:7432:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d28f85 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e40 expref: 25 pid: 6491 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830994.728375:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 65 00000100:00100000:2.0:1787830994.728384:0:7432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2309d08780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+25:2397:x1874676433337856:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787830994.728398:0:7432:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787830994.728406:0:7432:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d28f85 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e40 expref: 25 pid: 6491 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830994.728419:0:7432:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d28f85 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e40 expref: 25 pid: 6491 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830994.728456:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d28f85 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e40 expref: 25 pid: 6491 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830994.728469:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d2318594000) 00010000:00010000:2.0:1787830994.728474:0:7432:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6000/0x95459fb9d1d28fa1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830994.728476:0:8620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220394f0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8620:1874676443885184:192.168.203.31@tcp:104: 00010000:00010000:2.0:1787830994.728482:0:7432:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6000/0x95459fb9d1d28fa1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50290000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830994.728489:0:7432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6000/0x95459fb9d1d28fa1 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50290000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830994.728500:0:8620:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6000/0x95459fb9d1d28fa1 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830994.728506:0:7432:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787830994.728509:0:8620:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6000/0x95459fb9d1d28fa1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830994.728514:0:8620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6000/0x95459fb9d1d28fa1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787830994.728531:0:8620:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00000100:00100000:2.0:1787830994.728551:0:7432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2309d08780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+24:2397:x1874676433337856:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 168us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830994.728559:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 65 00010000:00010000:1.0:1787830994.728807:0:8620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6400/0x95459fb9d1d28f9a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e47 expref: 25 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830994.728832:0:8620:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6000/0x95459fb9d1d28fa1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e47 expref: 24 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830994.728839:0:8620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d2318594000) 00010000:00010000:1.0:1787830994.728842:0:8620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787830994.728844:0:8620:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d23344b6000, rc 0) 00000100:00100000:1.0:1787830994.728869:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220394cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+24:10810:x1874676433337728:12345-192.168.203.31@tcp:101:bash.0 Request processed in 5610us (5718us total) trans 4294967368 rc 0/0 00000100:00100000:1.0:1787830994.728877:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 97 00000100:00100000:0.0:1787830994.734565:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787830994.735437:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433337984 00000100:00100000:3.0:1787830994.735446:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433337984 00000100:00100000:3.0:1787830994.735504:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 98 00000100:00100000:3.0:1787830994.735514:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22039bb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+24:10810:x1874676433337984:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:3.0:1787830994.735535:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787830994.735553:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d28faf lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99423e4e expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830994.735584:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d28fb6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830994.735598:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d28fb6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830994.735608:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d28fb6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830994.735799:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d28faf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e4e expref: 26 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830994.735816:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d28fb6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e4e expref: 25 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830994.735825:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d2318594000) 00010000:00010000:3.0:1787830994.735828:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787830994.735836:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2307c77400, rc 0) 00000100:00100000:3.0:1787830994.735903:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22039bb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+25:10810:x1874676433337984:12345-192.168.203.31@tcp:101:bash.0 Request processed in 390us (1349us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830994.735910:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 98 00000100:00100000:2.0:1787830994.740753:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787830994.740824:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433338240 00000100:00100000:3.0:1787830994.740834:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433338240 00000100:00100000:3.0:1787830994.740902:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 99 00000100:00100000:3.0:1787830994.740912:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2309d092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+25:10810:x1874676433338240:12345-192.168.203.31@tcp:36:bash.0 00010000:00010000:3.0:1787830994.741122:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d28fbd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830994.741219:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d28fbd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830994.741231:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d28fbd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787830994.741288:0:6490:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000004:00010000:3.0:1787830994.741310:0:6490:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000a75d294 reply state 00000000f9258696 transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d28fbd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830994.741322:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d28fbd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830994.741329:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d2318594000) 00010000:00010000:3.0:1787830994.741393:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787830994.741398:0:6490:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1787830994.741441:0:6490:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000100:00100000:3.0:1787830994.741540:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2309d092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+29:10810:x1874676433338240:12345-192.168.203.31@tcp:36:bash.0 Request processed in 629us (796us total) trans 4294967371 rc 0/0 00000100:00100000:3.0:1787830994.741548:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 99 00000020:00080000:3.0:1787830994.741565:0:6490:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1787830994.752676:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787830994.752991:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433338368 00000100:00100000:1.0:1787830994.753002:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433338368 00000100:00100000:1.0:1787830994.753102:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 100 00000100:00100000:1.0:1787830994.753112:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220258d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+29:10810:x1874676433338368:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:1.0:1787830994.753145:0:8620:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787830994.753164:0:8620:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6400/0x95459fb9d1d28fc4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99423e55 expref: -99 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830994.753220:0:8620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6400/0x95459fb9d1d28fc4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e55 expref: 30 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830994.753234:0:8620:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6400/0x95459fb9d1d28fc4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e55 expref: 30 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830994.753251:0:8620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d2318594000) 00010000:00010000:1.0:1787830994.753254:0:8620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787830994.753279:0:8620:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d23344b6400, rc 0) 00000100:00100000:1.0:1787830994.753345:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220258d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+30:10810:x1874676433338368:12345-192.168.203.31@tcp:101:bash.0 Request processed in 233us (677us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830994.753352:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 100 00000100:00100000:0.0:1787830994.760848:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787830994.760928:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433338496 00000100:00100000:3.0:1787830994.760938:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433338496 00000100:00100000:3.0:1787830994.761043:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 41 00000100:00100000:3.0:1787830994.761054:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22039b9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+6:10810:x1874676433338496:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:3.0:1787830994.761071:0:8408:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787830994.761088:0:8408:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d7a8e00e/0x95459fb9d1d28fcb lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99423e5c expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787830994.761110:0:8408:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a9022d1, atime: 0x6a9022d1, ctime: 0x6a9022d1, blocks: 0x8 00010000:00010000:3.0:1787830994.761129:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=285s v=(0 0) 00010000:00010000:3.0:1787830994.761134:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787830994.761142:0:8408:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d7a8e00e/0x95459fb9d1d28fcb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e5c expref: 7 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830994.761157:0:8408:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d7a8e00e/0x95459fb9d1d28fcb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e5c expref: 7 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830994.761169:0:8408:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2307c77600, rc 0) 00000100:00100000:3.0:1787830994.761215:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22039b9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+7:10810:x1874676433338496:12345-192.168.203.31@tcp:101:bash.0 Request processed in 164us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830994.761222:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 41 00000100:00100000:3.0:1787830994.768093:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787830994.768222:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433338624 00000100:00100000:1.0:1787830994.768232:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433338624 00002000:00010000:1.0:1787830994.768278:0:8411:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/3 (0->18446744073709551615) 00002000:00100000:1.0:1787830994.768284:0:8411:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d220392f0c0 with x1874676433338624 ext(0->18446744073709551615) 00002000:00010000:1.0:1787830994.768296:0:8411:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d220392f0c0. 00000100:00100000:1.0:1787830994.768330:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 1 00000100:00100000:1.0:1787830994.768340:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220392f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+7:2396:x1874676433338624:12345-192.168.203.31@tcp:10:bash.0 00002000:00010000:1.0:1787830994.768595:0:8411:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1787830994.768599:0:8411:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 1787830993 -> 1787830995 00002000:00010000:1.0:1787830994.768602:0:8411:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 1787830993 -> 1787830993 00002000:00010000:1.0:1787830994.768604:0:8411:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1787830993 -> 1787830995 00002000:00010000:1.0:1787830994.768606:0:8411:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:1.0:1787830994.768688:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220392f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+8:2396:x1874676433338624:12345-192.168.203.31@tcp:10:bash.0 Request processed in 349us (604us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1787830994.768697:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 1 00002000:00010000:1.0:1787830994.768700:0:8411:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/3 (0->18446744073709551615) 00002000:00100000:1.0:1787830994.768703:0:8411:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d220392f0c0 with x1874676433338624 ext(0->18446744073709551615) 00002000:00010000:1.0:1787830994.768708:0:8411:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d220392f0c0. 00000100:00100000:0.0:1787830994.840264:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787830994.841668:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433338752 00000100:00100000:1.0:1787830994.841680:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433338752 00000100:00100000:1.0:1787830994.841734:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 101 00000100:00100000:1.0:1787830994.841743:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22039bad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+30:11298:x1874676433338752:12345-192.168.203.31@tcp:34:lfs.0 00010000:00010000:1.0:1787830994.841824:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7a00/0x95459fb9d1d28fd2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830994.841841:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7a00/0x95459fb9d1d28fd2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830994.841852:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7a00/0x95459fb9d1d28fd2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830994.841866:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6200/0x95459fb9d1d28fd9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830994.841872:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6200/0x95459fb9d1d28fd9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830994.841878:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6200/0x95459fb9d1d28fd9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830994.841961:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7400/0x95459fb9d1d28fe0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830994.841970:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7400/0x95459fb9d1d28fe0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830994.841977:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7400/0x95459fb9d1d28fe0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787830994.842020:0:6492:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7400/0x95459fb9d1d28fe0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830994.842031:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7a00/0x95459fb9d1d28fd2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830994.842047:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7a00/0x95459fb9d1d28fd2 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830994.842053:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7a00/0x95459fb9d1d28fd2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830994.842059:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d23344b7a00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:1.0:1787830994.842064:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7a00/0x95459fb9d1d28fd2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830994.842071:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7a00/0x95459fb9d1d28fd2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830994.842083:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d2203615700) 00010000:00010000:1.0:1787830994.842087:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787830994.842091:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7a00/0x95459fb9d1d28fd2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830994.842097:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7a00/0x95459fb9d1d28fd2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830994.842112:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6200/0x95459fb9d1d28fd9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830994.842118:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6200/0x95459fb9d1d28fd9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830994.842124:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6200/0x95459fb9d1d28fd9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830994.842128:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d23344b6200 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:1.0:1787830994.842137:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6200/0x95459fb9d1d28fd9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830994.842143:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6200/0x95459fb9d1d28fd9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830994.842151:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8d232b9c6a00) 00010000:00010000:1.0:1787830994.842154:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787830994.842157:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6200/0x95459fb9d1d28fd9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830994.842162:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6200/0x95459fb9d1d28fd9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830994.842175:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7400/0x95459fb9d1d28fe0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830994.842181:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7400/0x95459fb9d1d28fe0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830994.842187:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7400/0x95459fb9d1d28fe0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830994.842192:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d23344b7400 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:1.0:1787830994.842194:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7400/0x95459fb9d1d28fe0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830994.842200:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7400/0x95459fb9d1d28fe0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830994.842208:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d2318594000) 00010000:00010000:1.0:1787830994.842210:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787830994.842219:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7400/0x95459fb9d1d28fe0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830994.842225:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7400/0x95459fb9d1d28fe0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830994.842309:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22039bad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+30:11298:x1874676433338752:12345-192.168.203.31@tcp:34:lfs.0 Request processed in 565us (2054us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830994.842384:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 101 00000100:00100000:0.0:1787830994.881120:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787830994.881208:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433339008 00000100:00100000:3.0:1787830994.881217:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433339008 00000100:00100000:3.0:1787830994.881275:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 102 00000100:00100000:3.0:1787830994.881284:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22039b92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+30:11301:x1874676433339008:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:3.0:1787830994.881316:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787830994.881573:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77800/0x95459fb9d1d28fe7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99423e63 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830994.881669:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d28fee lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830994.881684:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d28fee lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830994.881695:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d28fee lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830994.881711:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d28ff5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830994.881719:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d28ff5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830994.881726:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d28ff5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830994.881824:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669600/0x95459fb9d1d28ffc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830994.881834:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669600/0x95459fb9d1d28ffc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830994.881841:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669600/0x95459fb9d1d28ffc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787830994.881850:0:6490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1787830994.881945:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d28fee lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830994.881952:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d28fee lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830994.881959:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d28fee lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830994.881965:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2307c77a00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:3.0:1787830994.881969:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d28fee lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830994.881976:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d28fee lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830994.881988:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d2203615700) 00010000:00010000:3.0:1787830994.881992:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787830994.881996:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d28fee lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830994.882002:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d28fee lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830994.882014:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d28ff5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830994.882031:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d28ff5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830994.882037:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d28ff5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830994.882042:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2307c76400 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:3.0:1787830994.882051:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d28ff5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830994.882058:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d28ff5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830994.882066:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8d2318594100) 00010000:00010000:3.0:1787830994.882069:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787830994.882072:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d28ff5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830994.882077:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d28ff5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830994.882115:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77800/0x95459fb9d1d28fe7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e63 expref: 33 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830994.882129:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669600/0x95459fb9d1d28ffc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e63 expref: 32 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830994.882137:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d2318594000) 00010000:00010000:3.0:1787830994.882139:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787830994.882141:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2301669600, rc 0) 00000100:00100000:3.0:1787830994.882206:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22039b92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+32:11301:x1874676433339008:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 923us (1096us total) trans 4294967372 rc 0/0 00000100:00100000:3.0:1787830994.882213:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 102 00000100:00100000:3.0:1787830994.884591:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787830994.884774:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433339136 00000100:00100000:1.0:1787830994.884783:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433339136 00000100:00100000:1.0:1787830994.884842:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 103 00000100:00100000:1.0:1787830994.884852:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220392fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+32:11301:x1874676433339136:12345-192.168.203.31@tcp:54:lfs.0 00010000:00010000:0.0:1787830994.886058:0:8620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10600/0x95459fb9d1d2900a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830994.886079:0:8620:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6000/0x95459fb9d1d28fa1 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e47 expref: 32 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830994.886088:0:8620:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10600/0x95459fb9d1d2900a lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830994.886124:0:8620:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6000/0x95459fb9d1d28fa1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e47 expref: 32 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830994.886139:0:8620:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6000/0x95459fb9d1d28fa1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e47 expref: 32 pid: 8620 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830994.886154:0:8620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22039bb840 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8620:1874676443885312:192.168.203.31@tcp:104: 00000100:00100000:0.0:1787830994.886269:0:8620:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2307d75840 going to sleep for 11 seconds 00000100:00100000:1.0:1787830994.889264:0:8620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22039bb840 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8620:1874676443885312:192.168.203.31@tcp:104: 00000100:00100000:3.0:1787830994.889271:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00010000:00010000:1.0:1787830994.889294:0:8620:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10600/0x95459fb9d1d2900a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830994.889932:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433339392 00000100:00100000:2.0:1787830994.889940:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433339392 00000100:00100000:2.0:1787830994.889995:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 22 00000100:00100000:2.0:1787830994.890003:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220392cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+33:6158:x1874676433339392:12345-192.168.203.31@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787830994.890279:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220392cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+34:6158:x1874676433339392:12345-192.168.203.31@tcp:35:ldlm_bl.0 Request processed in 276us (1012us total) trans 4294967373 rc 0/0 00000100:00100000:2.0:1787830994.890287:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 22 00000100:00100000:0.0:1787830994.893140:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787830994.893294:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433339520 00000100:00100000:2.0:1787830994.893317:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433339520 00010000:00010000:2.0:1787830994.893422:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6000/0x95459fb9d1d28fa1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e47 expref: 34 pid: 8620 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830994.893495:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 66 00000100:00100000:2.0:1787830994.893504:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22039b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+34:2397:x1874676433339520:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787830994.893518:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787830994.893525:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6000/0x95459fb9d1d28fa1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e47 expref: 34 pid: 8620 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830994.893538:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6000/0x95459fb9d1d28fa1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e47 expref: 34 pid: 8620 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830994.893559:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6000/0x95459fb9d1d28fa1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e47 expref: 34 pid: 8620 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830994.893574:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d2318594000) 00010000:00010000:2.0:1787830994.893580:0:6476:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10600/0x95459fb9d1d2900a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830994.893589:0:6476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10600/0x95459fb9d1d2900a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830994.893596:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10600/0x95459fb9d1d2900a lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830994.893672:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787830994.893724:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22039b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+33:2397:x1874676433339520:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 222us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830994.893741:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 66 00010000:00010000:1.0:1787830994.894064:0:8620:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10600/0x95459fb9d1d2900a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830994.894073:0:8620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10600/0x95459fb9d1d2900a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830994.894107:0:8620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10600/0x95459fb9d1d2900a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830994.894112:0:8620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10600/0x95459fb9d1d2900a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830994.894118:0:8620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10600/0x95459fb9d1d2900a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830994.894133:0:8620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233bf10600 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:1.0:1787830994.894137:0:8620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10600/0x95459fb9d1d2900a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830994.894144:0:8620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10600/0x95459fb9d1d2900a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830994.894164:0:8620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d2318594000) 00010000:00010000:1.0:1787830994.894166:0:8620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787830994.894169:0:8620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10600/0x95459fb9d1d2900a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830994.894176:0:8620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10600/0x95459fb9d1d2900a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830994.894227:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220392fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+32:11301:x1874676433339136:12345-192.168.203.31@tcp:54:lfs.0 Request processed in 9376us (9641us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830994.894234:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 103 00000100:00100000:0.0:1787830994.897200:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787830994.897266:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433339776 00000100:00100000:2.0:1787830994.897274:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433339776 00000100:00100000:2.0:1787830994.897320:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 23 00000100:00100000:2.0:1787830994.897329:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22039b83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+32:11301:x1874676433339776:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:2.0:1787830994.897535:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22039b83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+33:11301:x1874676433339776:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 207us (342us total) trans 4294967374 rc 0/0 00000100:00100000:2.0:1787830994.897543:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 23 00010000:00010000:2.0:1787830994.918761:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787830995.017042:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787830995.021073:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433340032 00000100:00100000:1.0:1787830995.021088:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433340032 00000100:00100000:1.0:1787830995.021165:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 104 00000100:00100000:1.0:1787830995.021176:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233be74b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+33:11312:x1874676433340032:12345-192.168.203.31@tcp:101:cat.0 00010000:00010000:1.0:1787830995.021199:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787830995.021220:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6200/0x95459fb9d1d29011 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99423e6a expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830995.021295:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7a00/0x95459fb9d1d29018 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830995.021327:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7a00/0x95459fb9d1d29018 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830995.021339:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7a00/0x95459fb9d1d29018 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830995.021355:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6600/0x95459fb9d1d2901f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830995.021371:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6600/0x95459fb9d1d2901f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830995.021378:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6600/0x95459fb9d1d2901f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830995.021483:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6c00/0x95459fb9d1d29026 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830995.021493:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6c00/0x95459fb9d1d29026 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830995.021501:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6c00/0x95459fb9d1d29026 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787830995.021509:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:1.0:1787830995.021584:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7a00/0x95459fb9d1d29018 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830995.021590:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7a00/0x95459fb9d1d29018 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830995.021596:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7a00/0x95459fb9d1d29018 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830995.021607:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d23344b7a00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:1.0:1787830995.021611:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7a00/0x95459fb9d1d29018 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830995.021669:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7a00/0x95459fb9d1d29018 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830995.021683:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d2203615700) 00010000:00010000:1.0:1787830995.021686:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787830995.021691:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7a00/0x95459fb9d1d29018 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830995.021697:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7a00/0x95459fb9d1d29018 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830995.021710:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6600/0x95459fb9d1d2901f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830995.021716:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6600/0x95459fb9d1d2901f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830995.021722:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6600/0x95459fb9d1d2901f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830995.021727:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d23344b6600 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:1.0:1787830995.021730:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6600/0x95459fb9d1d2901f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830995.021735:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6600/0x95459fb9d1d2901f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830995.021753:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8d232b9c6a00) 00010000:00010000:1.0:1787830995.021755:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787830995.021758:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6600/0x95459fb9d1d2901f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830995.021765:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6600/0x95459fb9d1d2901f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830995.021810:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6200/0x95459fb9d1d29011 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e6a expref: 36 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830995.021823:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6c00/0x95459fb9d1d29026 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e6a expref: 35 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830995.021830:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d2318594000) 00010000:00010000:1.0:1787830995.021833:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787830995.021835:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d23344b6c00, rc 0) 00000100:00100000:1.0:1787830995.021916:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233be74b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+35:11312:x1874676433340032:12345-192.168.203.31@tcp:101:cat.0 Request processed in 743us (4884us total) trans 4294967375 rc 0/0 00000100:00100000:1.0:1787830995.021923:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 104 00000100:00100000:3.0:1787830995.036225:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787830995.036348:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433340288 00000100:00100000:2.0:1787830995.036357:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433340288 00000100:00100000:2.0:1787830995.036413:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 24 00000100:00100000:2.0:1787830995.036422:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2334489680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+35:11312:x1874676433340288:12345-192.168.203.31@tcp:35:cat.0 00000100:00100000:2.0:1787830995.036707:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2334489680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+36:11312:x1874676433340288:12345-192.168.203.31@tcp:35:cat.0 Request processed in 285us (493us total) trans 4294967376 rc 0/0 00000100:00100000:2.0:1787830995.036714:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 24 00000100:00100000:0.0:1787830995.074343:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787830995.074860:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433340544 00000100:00100000:3.0:1787830995.074870:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433340544 00000100:00100000:3.0:1787830995.074938:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 105 00000100:00100000:3.0:1787830995.074948:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22039bb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+36:11313:x1874676433340544:12345-192.168.203.31@tcp:36:rm.0 00010000:00010000:3.0:1787830995.075002:0:6490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1787830995.075029:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6400/0x95459fb9d1d28fc4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e55 expref: 36 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830995.075050:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6c00/0x95459fb9d1d29026 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e6a expref: 35 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830995.075061:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669600/0x95459fb9d1d28ffc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e63 expref: 34 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830995.075074:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d28fb6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e4e expref: 33 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830995.075086:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d2318594000) 00010000:00010000:3.0:1787830995.075091:0:6490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787830995.075111:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668600/0x95459fb9d1d29034 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830995.075123:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668600/0x95459fb9d1d29034 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830995.075137:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668600/0x95459fb9d1d29034 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830995.075152:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668e00/0x95459fb9d1d2903b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830995.075173:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668e00/0x95459fb9d1d2903b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830995.075181:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668e00/0x95459fb9d1d2903b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830995.075252:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669a00/0x95459fb9d1d29042 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830995.075261:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669a00/0x95459fb9d1d29042 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830995.075268:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669a00/0x95459fb9d1d29042 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787830995.076010:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:3.0:1787830995.076022:0:6490:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 286076396157ns, next at 287076393623ns, rc = 0 00010000:00010000:3.0:1787830995.076065:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669200/0x95459fb9d1d29049 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830995.076075:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669200/0x95459fb9d1d29049 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830995.076084:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669200/0x95459fb9d1d29049 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830995.076091:0:6490:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669200/0x95459fb9d1d29049 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830995.076097:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669200/0x95459fb9d1d29049 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830995.076115:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669200/0x95459fb9d1d29049 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830995.076145:0:6490:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787830995.076165:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669a00/0x95459fb9d1d29042 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830995.076172:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669a00/0x95459fb9d1d29042 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830995.076178:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669a00/0x95459fb9d1d29042 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830995.076183:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2301669a00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:3.0:1787830995.076187:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669a00/0x95459fb9d1d29042 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830995.076194:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669a00/0x95459fb9d1d29042 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830995.076203:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d2318594000) 00010000:00010000:3.0:1787830995.076206:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787830995.076210:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669a00/0x95459fb9d1d29042 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830995.076216:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669a00/0x95459fb9d1d29042 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830995.076233:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668600/0x95459fb9d1d29034 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830995.076240:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668600/0x95459fb9d1d29034 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830995.076251:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668600/0x95459fb9d1d29034 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830995.076257:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2301668600 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:3.0:1787830995.076260:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668600/0x95459fb9d1d29034 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830995.076265:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668600/0x95459fb9d1d29034 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830995.076273:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d2203615700) 00010000:00010000:3.0:1787830995.076276:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787830995.076279:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668600/0x95459fb9d1d29034 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830995.076285:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668600/0x95459fb9d1d29034 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787830995.076296:0:6490:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000758a3591 reply state 000000008460bb6f transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668e00/0x95459fb9d1d2903b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830995.076307:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668e00/0x95459fb9d1d2903b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830995.076313:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8d2318594100) 00010000:00010000:3.0:1787830995.076316:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787830995.076318:0:6490:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787830995.076558:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22039bb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+34:11313:x1874676433340544:12345-192.168.203.31@tcp:36:rm.0 Request processed in 1609us (2230us total) trans 4294967377 rc 0/0 00000100:00100000:3.0:1787830995.076566:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 105 00010000:00010000:0.0:1787830995.077581:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787830995.077591:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669200/0x95459fb9d1d29049 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830995.077600:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2301669200 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:0.0:1787830995.077604:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669200/0x95459fb9d1d29049 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830995.077612:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669200/0x95459fb9d1d29049 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830995.077661:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d2318594000) 00010000:00010000:0.0:1787830995.077664:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787830995.077668:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669200/0x95459fb9d1d29049 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830995.077675:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669200/0x95459fb9d1d29049 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830995.077690:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830995.077692:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830995.077694:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787830995.123289:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787830995.123390:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433340800 00000100:00100000:1.0:1787830995.123399:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433340800 00000100:00100000:1.0:1787830995.123473:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 106 00000100:00100000:1.0:1787830995.123483:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203b6e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+34:11319:x1874676433340800:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:1.0:1787830995.123508:0:8620:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787830995.123527:0:8620:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6200/0x95459fb9d1d29050 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99423e71 expref: -99 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830995.123685:0:8620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6600/0x95459fb9d1d29057 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830995.123700:0:8620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6600/0x95459fb9d1d29057 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830995.123712:0:8620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6600/0x95459fb9d1d29057 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830995.123724:0:8620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7a00/0x95459fb9d1d2905e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830995.123731:0:8620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7a00/0x95459fb9d1d2905e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830995.123737:0:8620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7a00/0x95459fb9d1d2905e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787830995.124225:0:8620:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:1.0:1787830995.124411:0:8620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6a00/0x95459fb9d1d29065 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830995.124421:0:8620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6a00/0x95459fb9d1d29065 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830995.124430:0:8620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6a00/0x95459fb9d1d29065 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830995.124462:0:8620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6600/0x95459fb9d1d29057 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830995.124481:0:8620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6600/0x95459fb9d1d29057 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830995.124487:0:8620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6600/0x95459fb9d1d29057 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830995.124492:0:8620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d23344b6600 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:1.0:1787830995.124496:0:8620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6600/0x95459fb9d1d29057 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830995.124504:0:8620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6600/0x95459fb9d1d29057 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830995.124517:0:8620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d2203615700) 00010000:00010000:1.0:1787830995.124520:0:8620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787830995.124526:0:8620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6600/0x95459fb9d1d29057 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830995.124533:0:8620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6600/0x95459fb9d1d29057 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787830995.124547:0:8620:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cb972118 reply state 00000000b44b63be transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7a00/0x95459fb9d1d2905e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830995.124558:0:8620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7a00/0x95459fb9d1d2905e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830995.124564:0:8620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8d2318594100) 00010000:00010000:1.0:1787830995.124566:0:8620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787830995.124569:0:8620:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787830995.124595:0:8620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6200/0x95459fb9d1d29050 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e71 expref: 37 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830995.124617:0:8620:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6a00/0x95459fb9d1d29065 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e71 expref: 36 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830995.124716:0:8620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d232b9c6a00) 00010000:00010000:1.0:1787830995.124719:0:8620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787830995.124722:0:8620:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d23344b6a00, rc 0) 00000100:00100000:1.0:1787830995.124793:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203b6e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+37:11319:x1874676433340800:12345-192.168.203.31@tcp:101:bash.0 Request processed in 1312us (1512us total) trans 4294967378 rc 0/0 00000100:00100000:1.0:1787830995.124801:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 106 00000100:00100000:2.0:1787830995.128390:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787830995.128441:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433340928 00000100:00100000:1.0:1787830995.128452:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433340928 00000100:00100000:1.0:1787830995.128527:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 42 00000100:00100000:1.0:1787830995.128537:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2309d0a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+7:2396:x1874676433340928:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:1.0:1787830995.128554:0:8407:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787830995.128571:0:8407:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ec511f7c/0x95459fb9d1d29073 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99423e78 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787830995.128595:0:8407:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787830995.128612:0:8407:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=286s v=(0 0) 00010000:00010000:1.0:1787830995.128616:0:8407:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787830995.128645:0:8407:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ec511f7c/0x95459fb9d1d29073 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e78 expref: 8 pid: 8407 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830995.128664:0:8407:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ec511f7c/0x95459fb9d1d29073 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e78 expref: 8 pid: 8407 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830995.128696:0:8407:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d23344b6800, rc 0) 00000100:00100000:1.0:1787830995.128758:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2309d0a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+8:2396:x1874676433340928:12345-192.168.203.31@tcp:101:bash.0 Request processed in 223us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830995.128766:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 42 00000100:00080000:3.0:1787830995.128822:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787830995.131816:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787830995.131941:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433341056 00000100:00100000:2.0:1787830995.131949:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433341056 00000100:00100000:2.0:1787830995.131998:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 43 00000100:00100000:2.0:1787830995.132007:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203afc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+8:11319:x1874676433341056:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:2.0:1787830995.132023:0:8406:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787830995.132038:0:8406:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004501f9c4/0x95459fb9d1d2907a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99423e7f expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830995.132084:0:8406:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ec511f7c/0x95459fb9d1d29073 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e78 expref: 9 pid: 8407 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830995.132093:0:8406:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787830995.132097:0:8406:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787830995.132102:0:8406:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004501f9c4/0x95459fb9d1d2907a lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e7f expref: 9 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830995.132134:0:8406:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ec511f7c/0x95459fb9d1d29073 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e78 expref: 9 pid: 8407 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830995.132149:0:8406:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ec511f7c/0x95459fb9d1d29073 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e78 expref: 9 pid: 8407 timeout: 386 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830995.132164:0:8406:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2201dede00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8406:1874676443885440:192.168.203.31@tcp:104: 00000100:00100000:2.0:1787830995.132376:0:8406:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d233be68f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787830995.135575:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787830995.135737:0:7432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433341184 00000100:00100000:3.0:1787830995.135745:0:7432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433341184 00010000:00010000:3.0:1787830995.135782:0:7432:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ec511f7c/0x95459fb9d1d29073 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e78 expref: 10 pid: 8407 timeout: 386 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830995.135826:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 67 00000100:00100000:3.0:1787830995.135834:0:7432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203afcb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+10:2397:x1874676433341184:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787830995.135848:0:7432:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787830995.135870:0:7432:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ec511f7c/0x95459fb9d1d29073 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e78 expref: 10 pid: 8407 timeout: 386 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830995.135900:0:7432:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ec511f7c/0x95459fb9d1d29073 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e78 expref: 10 pid: 8407 timeout: 386 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830995.135924:0:7432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787830995.135928:0:7432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787830995.135936:0:7432:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004501f9c4/0x95459fb9d1d2907a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e7f expref: 10 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830995.135947:0:7432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004501f9c4/0x95459fb9d1d2907a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e7f expref: 10 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830995.135980:0:7432:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000004501f9c4/0x95459fb9d1d2907a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e7f expref: 10 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830995.136012:0:7432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203b6c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7432:1874676443885568:192.168.203.31@tcp:105: 00000100:00100000:3.0:1787830995.136089:0:7432:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d23063bb600 going to sleep for 11 seconds 00010000:00010000:2.0:1787830995.136673:0:8406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ec511f7c/0x95459fb9d1d29073 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e78 expref: 10 pid: 8407 timeout: 386 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830995.136690:0:8406:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2201dede00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8406:1874676443885440:192.168.203.31@tcp:104: 00010000:00010000:2.0:1787830995.136712:0:8406:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004501f9c4/0x95459fb9d1d2907a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e7f expref: 9 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830995.136723:0:8406:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22039c1e00, rc 0) 00000100:00100000:2.0:1787830995.136807:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203afc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+9:11319:x1874676433341056:12345-192.168.203.31@tcp:101:bash.0 Request processed in 4801us (4998us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830995.136814:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 43 00000100:00100000:3.0:1787830995.141218:0:7432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203b6c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7432:1874676443885568:192.168.203.31@tcp:105: 00010000:00010000:3.0:1787830995.141245:0:7432:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787830995.141438:0:7432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203afcb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+8:2397:x1874676433341184:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 5602us (5871us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830995.141450:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 67 00000100:00100000:0.0:1787830995.142041:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787830995.142252:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433341440 00000100:00100000:3.0:1787830995.142311:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433341440 00000100:00100000:3.0:1787830995.142442:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 25 00000100:00100000:3.0:1787830995.142452:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203afde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+37:11319:x1874676433341440:12345-192.168.203.31@tcp:35:bash.0 00000100:00100000:3.0:1787830995.142729:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203afde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+38:11319:x1874676433341440:12345-192.168.203.31@tcp:35:bash.0 Request processed in 278us (689us total) trans 4294967379 rc 0/0 00000100:00100000:3.0:1787830995.142736:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 25 00000100:00100000:2.0:1787830995.174921:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220394f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676443885696:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787830995.174991:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830995.175146:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443885696 00000100:00100000:0.0:1787830995.175153:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443885696 00000100:00100000:0.0:1787830995.175214:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1787830995.175222:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2201dede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1874676443885696:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787830995.175253:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787830995.175843:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2201dede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1874676443885696:12345-0@lo:41:osp-pre-1-0.0 Request processed in 620us (850us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830995.175852:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1787830995.178441:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220394f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676443885696:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787830995.272734:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787830995.272844:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433341568 00000100:00100000:2.0:1787830995.272853:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433341568 00000100:00100000:2.0:1787830995.272917:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 107 00000100:00100000:2.0:1787830995.272927:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203afcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+38:11335:x1874676433341568:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:2.0:1787830995.272960:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787830995.272978:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1600/0x95459fb9d1d29081 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99423e86 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830995.273033:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0200/0x95459fb9d1d29088 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830995.273047:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0200/0x95459fb9d1d29088 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830995.273057:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0200/0x95459fb9d1d29088 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787830995.273095:0:6491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1787830995.273098:0:6491:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787830995.273114:0:6491:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0200/0x95459fb9d1d29088 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830995.273137:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1600/0x95459fb9d1d29081 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e86 expref: 40 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830995.273167:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0200/0x95459fb9d1d29088 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e86 expref: 39 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830995.273176:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d2203615700) 00010000:00010000:2.0:1787830995.273179:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787830995.273182:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22039c0200, rc 0) 00000100:00100000:2.0:1787830995.273333:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203afcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+39:11335:x1874676433341568:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 407us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830995.273341:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 107 00000100:00100000:2.0:1787830995.276312:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787830995.276488:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433341824 00000100:00100000:3.0:1787830995.276497:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433341824 00000100:00100000:3.0:1787830995.276759:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 108 00000100:00100000:3.0:1787830995.276770:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2201ded680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+39:11335:x1874676433341824:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:3.0:1787830995.276790:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787830995.276810:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668600/0x95459fb9d1d2908f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99423e8d expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830995.276923:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669a00/0x95459fb9d1d29096 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830995.276952:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669a00/0x95459fb9d1d29096 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830995.276963:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669a00/0x95459fb9d1d29096 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787830995.276975:0:6490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:3.0:1787830995.277078:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668600/0x95459fb9d1d2908f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e8d expref: 42 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830995.277095:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669a00/0x95459fb9d1d29096 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e8d expref: 41 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830995.277103:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d232b9c6a00) 00010000:00010000:3.0:1787830995.277106:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787830995.277109:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2301669a00, rc 0) 00000100:00100000:3.0:1787830995.277164:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2201ded680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+41:11335:x1874676433341824:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 396us (860us total) trans 4294967380 rc 0/0 00000100:00100000:3.0:1787830995.277172:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 108 00000100:00100000:1.0:1787830995.285441:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787830995.285757:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433342080 00000100:00100000:0.0:1787830995.285766:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433342080 00000100:00100000:0.0:1787830995.285853:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 109 00000100:00100000:0.0:1787830995.285863:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220394d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+41:11335:x1874676433342080:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:0.0:1787830995.285894:0:8620:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787830995.285914:0:8620:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11c00/0x95459fb9d1d290a4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99423e94 expref: -99 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830995.286010:0:8620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11000/0x95459fb9d1d290ab lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830995.286024:0:8620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11000/0x95459fb9d1d290ab lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830995.286035:0:8620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11000/0x95459fb9d1d290ab lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787830995.286046:0:8620:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1787830995.286139:0:8620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11c00/0x95459fb9d1d290a4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e94 expref: 44 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830995.286157:0:8620:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11000/0x95459fb9d1d290ab lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e94 expref: 43 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830995.286179:0:8620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d232b9c6a00) 00010000:00010000:0.0:1787830995.286182:0:8620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787830995.286185:0:8620:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233bf11000, rc 0) 00000100:00100000:0.0:1787830995.286262:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220394d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+43:11335:x1874676433342080:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 400us (828us total) trans 4294967381 rc 0/0 00000100:00100000:0.0:1787830995.286269:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 109 00000100:00100000:1.0:1787830995.287791:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787830995.287865:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433342208 00000100:00100000:0.0:1787830995.287872:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433342208 00000100:00100000:0.0:1787830995.287934:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 7 00000100:00100000:0.0:1787830995.287943:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220394e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+43:2396:x1874676433342208:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787830995.287955:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787830995.287976:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669a00/0x95459fb9d1d29096 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e8d expref: 43 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830995.287991:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d232b9c6a00) 00010000:00010000:0.0:1787830995.287996:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787830995.288039:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220394e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+42:2396:x1874676433342208:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 97us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830995.288047:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 7 00000100:00100000:2.0:1787830995.302526:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787830995.302658:0:8631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433342336 00000100:00100000:0.0:1787830995.302668:0:8631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433342336 00000100:00100000:0.0:1787830995.302715:0:8631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 44 00000100:00100000:0.0:1787830995.302725:0:8631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220395ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+8:2397:x1874676433342336:12345-192.168.203.31@tcp:1:lfs.0 00010000:00010000:0.0:1787830995.302770:0:8631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4a63826/0x95459fb9d1d290b9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830995.302805:0:8631:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004501f9c4/0x95459fb9d1d2907a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e7f expref: 8 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830995.302812:0:8631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787830995.302816:0:8631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787830995.302820:0:8631:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4a63826/0x95459fb9d1d290b9 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830995.302849:0:8631:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004501f9c4/0x95459fb9d1d2907a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e7f expref: 8 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830995.302862:0:8631:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004501f9c4/0x95459fb9d1d2907a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e7f expref: 8 pid: 8406 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830995.302876:0:8631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203affc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8631:1874676443885824:192.168.203.31@tcp:104: 00000100:00100000:0.0:1787830995.302980:0:8631:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2307d75c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787830995.307115:0:8631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203affc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8631:1874676443885824:192.168.203.31@tcp:104: 00010000:00010000:0.0:1787830995.307152:0:8631:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e4a63826/0x95459fb9d1d290b9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830995.308012:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787830995.308195:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433342464 00000100:00100000:0.0:1787830995.308202:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433342464 00002000:00100000:0.0:1787830995.308248:0:8413:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff8d220395cb40 x1874676433342464/t0(0) o4->47d7f0ed-283f-4b70-a741-6e74c5e52619@192.168.203.31@tcp:66/0 lens 504/0 e 0 to 0 dl 1787831006 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787830995.308276:0:8413:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d220395cb40 with x1874676433342464 ext(0->8) 00010000:00010000:0.0:1787830995.308284:0:8413:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000004501f9c4/0x95459fb9d1d2907a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e7f expref: 9 pid: 8406 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830995.308296:0:8413:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000004501f9c4/0x95459fb9d1d2907a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e7f expref: 9 pid: 8406 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787830995.308303:0:8413:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8d220395cb40 00000100:00100000:0.0:1787830995.308344:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 1 00000100:00100000:0.0:1787830995.308354:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220395cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+9:2396:x1874676433342464:12345-192.168.203.31@tcp:4:lfs.0 00000100:00100000:0.0:1787830995.310162:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220395cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+11:2396:x1874676433342464:12345-192.168.203.31@tcp:4:lfs.0 Request processed in 1802us (2145us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1787830995.310173:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 1 00002000:00100000:0.0:1787830995.310193:0:8413:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff8d220395cb40 x1874676433342464/t4294967303(0) o4->47d7f0ed-283f-4b70-a741-6e74c5e52619@192.168.203.31@tcp:66/0 lens 504/448 e 0 to 0 dl 1787831006 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787830995.310203:0:8413:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d220395cb40 with x1874676433342464 ext(0->8) 00010000:00010000:0.0:1787830995.310211:0:8413:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000004501f9c4/0x95459fb9d1d2907a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e7f expref: 11 pid: 8406 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830995.310227:0:8413:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000004501f9c4/0x95459fb9d1d2907a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e7f expref: 11 pid: 8406 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787830995.310235:0:8413:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8d220395cb40 00000100:00100000:1.0:1787830995.314038:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787830995.314150:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433342592 00000100:00100000:2.0:1787830995.314159:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433342592 00010000:00010000:2.0:1787830995.314209:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004501f9c4/0x95459fb9d1d2907a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e7f expref: 11 pid: 8406 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830995.314251:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 68 00000100:00100000:2.0:1787830995.314260:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2321e74450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+11:2397:x1874676433342592:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787830995.314275:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1787830995.314291:0:6475:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1787830995.314294:0:6475:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1787830995 00002000:00010000:2.0:1787830995.314296:0:6475:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1787830995 00002000:00010000:2.0:1787830995.314298:0:6475:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1787830995 00002000:00010000:2.0:1787830995.314300:0:6475:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1787830995.314319:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004501f9c4/0x95459fb9d1d2907a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e7f expref: 11 pid: 8406 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830995.314794:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004501f9c4/0x95459fb9d1d2907a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e7f expref: 11 pid: 8406 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830995.314820:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004501f9c4/0x95459fb9d1d2907a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e7f expref: 11 pid: 8406 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830995.314836:0:6475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787830995.314841:0:6475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787830995.314846:0:6475:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e4a63826/0x95459fb9d1d290b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830995.314856:0:6475:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4a63826/0x95459fb9d1d290b9 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830995.314897:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787830995.314956:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2321e74450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+10:2397:x1874676433342592:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 696us (928us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830995.314965:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 68 00010000:00010000:0.0:1787830995.315577:0:8631:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e4a63826/0x95459fb9d1d290b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830995.315597:0:8631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e4a63826/0x95459fb9d1d290b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830995.315654:0:8631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4a63826/0x95459fb9d1d290b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830995.315664:0:8631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e4a63826/0x95459fb9d1d290b9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830995.315672:0:8631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e4a63826/0x95459fb9d1d290b9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830995.315679:0:8631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233bf11c00 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:0.0:1787830995.315684:0:8631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4a63826/0x95459fb9d1d290b9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830995.315692:0:8631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4a63826/0x95459fb9d1d290b9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830995.315705:0:8631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e4a63826/0x95459fb9d1d290b9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830995.315712:0:8631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e4a63826/0x95459fb9d1d290b9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830995.315784:0:8631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220395ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+9:2397:x1874676433342336:12345-192.168.203.31@tcp:1:lfs.0 Request processed in 13059us (13266us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830995.315793:0:8631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 44 00000100:00100000:1.0:1787830995.322077:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787830995.322160:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433342848 00000100:00100000:3.0:1787830995.322170:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433342848 00000100:00100000:3.0:1787830995.322323:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 26 00000100:00100000:3.0:1787830995.322343:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d23066ca050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+42:11335:x1874676433342848:12345-192.168.203.31@tcp:35:lfs.0 00000004:00010000:3.0:1787830995.322405:0:6494:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11000/0x95459fb9d1d290ab lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e94 expref: 42 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787830995.322684:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:3.0:1787830995.322733:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:3.0:1787830995.323066:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00010000:00010000:3.0:1787830995.323106:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668600/0x95459fb9d1d290c0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830995.323123:0:6494:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6a00/0x95459fb9d1d29065 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e71 expref: 46 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830995.323133:0:6494:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668600/0x95459fb9d1d290c0 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830995.323167:0:6494:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6a00/0x95459fb9d1d29065 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e71 expref: 46 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830995.323253:0:6494:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6a00/0x95459fb9d1d29065 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e71 expref: 46 pid: 8620 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830995.323269:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203b6c000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6494:1874676443885952:192.168.203.31@tcp:104: 00000100:00100000:3.0:1787830995.323426:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d23063bb600 going to sleep for 11 seconds 00000100:00100000:2.0:1787830995.330057:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787830995.330067:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203b6c000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6494:1874676443885952:192.168.203.31@tcp:104: 00010000:00010000:3.0:1787830995.330110:0:6494:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668600/0x95459fb9d1d290c0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830995.330509:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433342976 00000100:00100000:0.0:1787830995.330519:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433342976 00010000:00010000:0.0:1787830995.330564:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6a00/0x95459fb9d1d29065 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e71 expref: 47 pid: 8620 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830995.330732:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 69 00000100:00100000:2.0:1787830995.330748:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220395de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+47:2397:x1874676433342976:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787830995.330767:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787830995.330775:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6a00/0x95459fb9d1d29065 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e71 expref: 47 pid: 8620 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830995.330873:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6a00/0x95459fb9d1d29065 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e71 expref: 47 pid: 8620 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830995.330914:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6a00/0x95459fb9d1d29065 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e71 expref: 47 pid: 8620 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830995.330997:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d232b9c6a00) 00010000:00010000:2.0:1787830995.331004:0:6476:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668600/0x95459fb9d1d290c0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830995.331015:0:6476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668600/0x95459fb9d1d290c0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830995.331023:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668600/0x95459fb9d1d290c0 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830995.331056:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787830995.331111:0:6494:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668600/0x95459fb9d1d290c0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830995.331124:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668600/0x95459fb9d1d290c0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830995.331180:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220395de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+46:2397:x1874676433342976:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 384us (1079us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830995.331191:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 69 00000001:00080000:3.0:1787830995.331691:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000001:00080000:3.0:1787830995.331898:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:3.0:1787830995.332024:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203b6c000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6494:1874676443886080:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787830995.332099:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830995.332217:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d23063bbe40 going to sleep for 11 seconds 00000100:00100000:1.0:1787830995.334284:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443886080 00000100:00100000:1.0:1787830995.334302:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443886080 00000100:00100000:1.0:1787830995.334414:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1787830995.334429:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22039970c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6494:x1874676443886080:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787830995.334620:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22039970c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6494:x1874676443886080:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 195us (2519us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830995.334701:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203b6c000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6494:1874676443886080:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787830995.334769:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000001:00080000:3.0:1787830995.334925:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:3.0:1787830995.335043:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203994b40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6494:1874676443886208:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787830995.335087:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830995.335170:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2202852540 going to sleep for 11 seconds 00000100:00100000:0.0:1787830995.335261:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443886208 00000100:00100000:0.0:1787830995.335266:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443886208 00000100:00100000:0.0:1787830995.335295:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1787830995.335303:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203994000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6494:x1874676443886208:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787830995.335431:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203994000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:6494:x1874676443886208:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 128us (343us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1787830995.335438:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1787830995.335516:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203994b40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6494:1874676443886208:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1787830995.335560:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:3.0:1787830995.335596:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668600/0x95459fb9d1d290c0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830995.335608:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668600/0x95459fb9d1d290c0 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830995.335615:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668600/0x95459fb9d1d290c0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830995.335648:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2301668600 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:3.0:1787830995.335654:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668600/0x95459fb9d1d290c0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830995.335664:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668600/0x95459fb9d1d290c0 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830995.335683:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d232b9c6a00) 00010000:00010000:3.0:1787830995.335687:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787830995.335701:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668600/0x95459fb9d1d290c0 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830995.335709:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668600/0x95459fb9d1d290c0 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787830995.335819:0:6494:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1787830995.335912:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:3.0:1787830995.335926:0:6494:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 286336300579ns, next at 287336297639ns, rc = 0 00000001:00080000:3.0:1787830995.335933:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:3.0:1787830995.335957:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d232b9c6a00) 00010000:00010000:3.0:1787830995.335960:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787830995.335968:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11000/0x95459fb9d1d290ab lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e94 expref: 50 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830995.336089:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d23066ca050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+49:11335:x1874676433342848:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 13757us (14022us total) trans 4294967390 rc 0/0 00000100:00100000:3.0:1787830995.336098:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 26 00000020:00080000:3.0:1787830995.336103:0:6494:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1787830995.339739:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787830995.339836:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433343104 00000100:00100000:3.0:1787830995.339846:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433343104 00000100:00100000:3.0:1787830995.339925:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 110 00000100:00100000:3.0:1787830995.339937:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220395e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+49:11335:x1874676433343104:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:3.0:1787830995.339968:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787830995.340001:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669600/0x95459fb9d1d290c7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99423e9b expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830995.340071:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669600/0x95459fb9d1d290c7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e9b expref: 50 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830995.340103:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669600/0x95459fb9d1d290c7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e9b expref: 50 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830995.340121:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d2318594f00) 00010000:00010000:3.0:1787830995.340124:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787830995.340128:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2301669600, rc 0) 00000100:00100000:3.0:1787830995.340191:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220395e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+50:11335:x1874676433343104:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 257us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830995.340199:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 110 00000100:00100000:0.0:1787830995.347541:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787830995.347700:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433343360 00000100:00100000:2.0:1787830995.347714:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433343360 00000100:00100000:2.0:1787830995.347786:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 27 00000100:00100000:2.0:1787830995.347798:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203affc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+50:11335:x1874676433343360:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:2.0:1787830995.348119:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203affc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+51:11335:x1874676433343360:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 323us (592us total) trans 4294967391 rc 0/0 00000100:00100000:2.0:1787830995.348152:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 27 00000100:00100000:1.0:1787830995.428566:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787830995.428820:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433343488 00000100:00100000:3.0:1787830995.428832:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433343488 00000100:00100000:3.0:1787830995.428961:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 111 00000100:00100000:3.0:1787830995.428972:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220394f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+51:11345:x1874676433343488:12345-192.168.203.31@tcp:34:lfs.0 00010000:00010000:3.0:1787830995.429083:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668600/0x95459fb9d1d290ce lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830995.429109:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668600/0x95459fb9d1d290ce lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830995.429123:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668600/0x95459fb9d1d290ce lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830995.429140:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668800/0x95459fb9d1d290d5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830995.429148:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668800/0x95459fb9d1d290d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830995.429177:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668800/0x95459fb9d1d290d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830995.429268:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669a00/0x95459fb9d1d290dc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830995.429277:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669a00/0x95459fb9d1d290dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830995.429284:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669a00/0x95459fb9d1d290dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787830995.429340:0:6490:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669a00/0x95459fb9d1d290dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830995.429356:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668600/0x95459fb9d1d290ce lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830995.429362:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668600/0x95459fb9d1d290ce lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830995.429369:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668600/0x95459fb9d1d290ce lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830995.429375:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2301668600 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:3.0:1787830995.429379:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668600/0x95459fb9d1d290ce lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830995.429399:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668600/0x95459fb9d1d290ce lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830995.429413:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d2203615700) 00010000:00010000:3.0:1787830995.429424:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787830995.429431:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668600/0x95459fb9d1d290ce lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830995.429746:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668600/0x95459fb9d1d290ce lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830995.429768:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668800/0x95459fb9d1d290d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830995.429775:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668800/0x95459fb9d1d290d5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830995.429781:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668800/0x95459fb9d1d290d5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830995.429787:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2301668800 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:3.0:1787830995.429791:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668800/0x95459fb9d1d290d5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830995.429797:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668800/0x95459fb9d1d290d5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830995.429813:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8d2318594100) 00010000:00010000:3.0:1787830995.429816:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787830995.429820:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668800/0x95459fb9d1d290d5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830995.429827:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668800/0x95459fb9d1d290d5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830995.429843:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669a00/0x95459fb9d1d290dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830995.429855:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669a00/0x95459fb9d1d290dc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830995.429862:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669a00/0x95459fb9d1d290dc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830995.429868:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2301669a00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:3.0:1787830995.429871:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669a00/0x95459fb9d1d290dc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830995.430029:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669a00/0x95459fb9d1d290dc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830995.430040:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d2318594f00) 00010000:00010000:3.0:1787830995.430042:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787830995.430045:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669a00/0x95459fb9d1d290dc lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830995.430051:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669a00/0x95459fb9d1d290dc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830995.430185:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220394f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+51:11345:x1874676433343488:12345-192.168.203.31@tcp:34:lfs.0 Request processed in 1212us (1633us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830995.430194:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 111 00000100:00100000:1.0:1787830995.478169:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787830995.478289:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433343744 00000100:00100000:0.0:1787830995.478302:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433343744 00000100:00100000:0.0:1787830995.478380:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 112 00000100:00100000:0.0:1787830995.478402:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220394fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+51:11348:x1874676433343744:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:0.0:1787830995.478430:0:8620:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787830995.478458:0:8620:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11400/0x95459fb9d1d290e3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99423ea2 expref: -99 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830995.478557:0:8620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11000/0x95459fb9d1d290ea lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830995.479189:0:8620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11000/0x95459fb9d1d290ea lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830995.479203:0:8620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11000/0x95459fb9d1d290ea lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830995.479219:0:8620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10600/0x95459fb9d1d290f1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830995.479228:0:8620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10600/0x95459fb9d1d290f1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830995.479235:0:8620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10600/0x95459fb9d1d290f1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830995.479379:0:8620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11c00/0x95459fb9d1d290f8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830995.479388:0:8620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11c00/0x95459fb9d1d290f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830995.479396:0:8620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11c00/0x95459fb9d1d290f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787830995.479418:0:8620:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1787830995.479516:0:8620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11000/0x95459fb9d1d290ea lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830995.479523:0:8620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11000/0x95459fb9d1d290ea lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830995.479530:0:8620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11000/0x95459fb9d1d290ea lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830995.479544:0:8620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233bf11000 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:0.0:1787830995.479549:0:8620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11000/0x95459fb9d1d290ea lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830995.479558:0:8620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11000/0x95459fb9d1d290ea lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830995.479573:0:8620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d2203615700) 00010000:00010000:0.0:1787830995.479576:0:8620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787830995.479582:0:8620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11000/0x95459fb9d1d290ea lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830995.479589:0:8620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11000/0x95459fb9d1d290ea lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830995.479607:0:8620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10600/0x95459fb9d1d290f1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830995.479612:0:8620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10600/0x95459fb9d1d290f1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830995.479618:0:8620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10600/0x95459fb9d1d290f1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830995.479661:0:8620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233bf10600 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:0.0:1787830995.479664:0:8620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10600/0x95459fb9d1d290f1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830995.479671:0:8620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10600/0x95459fb9d1d290f1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830995.479690:0:8620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8d2318594100) 00010000:00010000:0.0:1787830995.479692:0:8620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787830995.479696:0:8620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10600/0x95459fb9d1d290f1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830995.479702:0:8620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10600/0x95459fb9d1d290f1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830995.479747:0:8620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11400/0x95459fb9d1d290e3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423ea2 expref: 54 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830995.479762:0:8620:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11c00/0x95459fb9d1d290f8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423ea2 expref: 53 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830995.479769:0:8620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d2318594f00) 00010000:00010000:0.0:1787830995.479772:0:8620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787830995.479775:0:8620:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233bf11c00, rc 0) 00000100:00100000:0.0:1787830995.479861:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220394fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+53:11348:x1874676433343744:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 1471us (1705us total) trans 4294967392 rc 0/0 00000100:00100000:0.0:1787830995.479870:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 112 00000100:00100000:0.0:1787830995.483745:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787830995.483977:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433343872 00000100:00100000:1.0:1787830995.483991:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433343872 00000100:00100000:1.0:1787830995.484065:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 113 00000100:00100000:1.0:1787830995.484077:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203afda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+53:11348:x1874676433343872:12345-192.168.203.31@tcp:54:lfs.0 00010000:00010000:1.0:1787830995.484207:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7600/0x95459fb9d1d29106 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830995.484229:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7600/0x95459fb9d1d29106 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830995.484263:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7600/0x95459fb9d1d29106 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830995.484312:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7600/0x95459fb9d1d29106 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830995.484320:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7600/0x95459fb9d1d29106 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830995.484837:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7600/0x95459fb9d1d29106 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830995.484847:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d23344b7600 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:1.0:1787830995.484853:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7600/0x95459fb9d1d29106 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830995.484863:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7600/0x95459fb9d1d29106 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830995.484891:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d2318594f00) 00010000:00010000:1.0:1787830995.484895:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787830995.484901:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7600/0x95459fb9d1d29106 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830995.484908:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7600/0x95459fb9d1d29106 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830995.485000:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203afda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+53:11348:x1874676433343872:12345-192.168.203.31@tcp:54:lfs.0 Request processed in 925us (1268us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830995.485009:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 113 00000100:00100000:1.0:1787830995.490435:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787830995.491080:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433344128 00000100:00100000:2.0:1787830995.491094:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433344128 00000100:00100000:2.0:1787830995.491165:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 28 00000100:00100000:2.0:1787830995.491176:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220394de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+53:11348:x1874676433344128:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:2.0:1787830995.494063:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220394de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+54:11348:x1874676433344128:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 2875us (3630us total) trans 4294967393 rc 0/0 00000100:00100000:2.0:1787830995.494080:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 28 00000100:00100000:2.0:1787830995.549271:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787830995.549418:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433344384 00000100:00100000:3.0:1787830995.549431:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433344384 00000100:00100000:3.0:1787830995.549509:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 114 00000100:00100000:3.0:1787830995.549521:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220380f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+54:11359:x1874676433344384:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:3.0:1787830995.549554:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787830995.549575:0:6490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787830995.549612:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0200/0x95459fb9d1d29088 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e86 expref: 54 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830995.549679:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d2203615700) 00010000:00010000:3.0:1787830995.549686:0:6490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787830995.549704:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669a00/0x95459fb9d1d2910d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99423ea9 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830995.549839:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668800/0x95459fb9d1d29114 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830995.549855:0:6490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11c00/0x95459fb9d1d290f8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423ea2 expref: 54 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830995.549863:0:6490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668800/0x95459fb9d1d29114 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830995.549913:0:6490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11c00/0x95459fb9d1d290f8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423ea2 expref: 54 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830995.549928:0:6490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11c00/0x95459fb9d1d290f8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423ea2 expref: 54 pid: 8620 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830995.549941:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203997c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6490:1874676443886336:192.168.203.31@tcp:104: 00000100:00100000:3.0:1787830995.550065:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d22028520c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787830995.554313:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787830995.554428:0:7432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433344512 00000100:00100000:2.0:1787830995.554438:0:7432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433344512 00010000:00010000:2.0:1787830995.554486:0:7432:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11c00/0x95459fb9d1d290f8 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423ea2 expref: 55 pid: 8620 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830995.554532:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 70 00000100:00100000:2.0:1787830995.554541:0:7432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203afde00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+55:2397:x1874676433344512:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787830995.554558:0:7432:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787830995.554566:0:7432:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11c00/0x95459fb9d1d290f8 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423ea2 expref: 55 pid: 8620 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830995.554580:0:7432:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11c00/0x95459fb9d1d290f8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423ea2 expref: 55 pid: 8620 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830995.554606:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d2318594f00) 00010000:00010000:2.0:1787830995.554612:0:7432:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668800/0x95459fb9d1d29114 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830995.554679:0:7432:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668800/0x95459fb9d1d29114 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830995.554688:0:7432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668800/0x95459fb9d1d29114 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830995.554711:0:7432:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787830995.554764:0:7432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203afde00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+55:2397:x1874676433344512:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 223us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830995.554772:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 70 00010000:00010000:3.0:1787830995.556742:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11c00/0x95459fb9d1d290f8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423ea2 expref: 54 pid: 8620 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830995.556801:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203997c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6490:1874676443886336:192.168.203.31@tcp:104: 00010000:00010000:3.0:1787830995.556835:0:6490:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668800/0x95459fb9d1d29114 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830995.556847:0:6490:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668800/0x95459fb9d1d29114 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830995.556853:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668800/0x95459fb9d1d29114 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787830995.556894:0:6490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:3.0:1787830995.558194:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669a00/0x95459fb9d1d2910d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423ea9 expref: 55 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830995.558220:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668800/0x95459fb9d1d29114 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423ea9 expref: 54 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830995.558231:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d2318594f00) 00010000:00010000:3.0:1787830995.558235:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787830995.559048:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2301668800, rc 0) 00000100:00100000:3.0:1787830995.559200:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220380f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+54:11359:x1874676433344384:12345-192.168.203.31@tcp:101:bash.0 Request processed in 9679us (9943us total) trans 4294967394 rc 0/0 00000100:00100000:3.0:1787830995.559211:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 114 00000100:00100000:0.0:1787830995.570458:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787830995.576234:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433344640 00000100:00100000:1.0:1787830995.576263:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433344640 00000100:00100000:1.0:1787830995.576353:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 115 00000100:00100000:1.0:1787830995.576365:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203afcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+54:11359:x1874676433344640:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:1.0:1787830995.576396:0:8620:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787830995.576422:0:8620:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7e00/0x95459fb9d1d29122 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99423eb0 expref: -99 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830995.576467:0:8620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7000/0x95459fb9d1d29129 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830995.576486:0:8620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7000/0x95459fb9d1d29129 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830995.576500:0:8620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7000/0x95459fb9d1d29129 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830995.576671:0:8620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7e00/0x95459fb9d1d29122 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423eb0 expref: 56 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830995.576693:0:8620:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7000/0x95459fb9d1d29129 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423eb0 expref: 55 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830995.576702:0:8620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d2318594f00) 00010000:00010000:1.0:1787830995.576706:0:8620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787830995.576709:0:8620:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d23344b7000, rc 0) 00000100:00100000:1.0:1787830995.576784:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203afcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+55:11359:x1874676433344640:12345-192.168.203.31@tcp:101:bash.0 Request processed in 422us (6342us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830995.576790:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 115 00000100:00100000:1.0:1787830995.587655:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787830995.587802:0:13771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433344896 00000100:00100000:0.0:1787830995.587823:0:13771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433344896 00000100:00100000:0.0:1787830995.587916:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 116 00000100:00100000:0.0:1787830995.587928:0:13771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220394ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47d7f0ed-283f-4b70-a741-6e74c5e52619+55:11359:x1874676433344896:12345-192.168.203.31@tcp:36:bash.0 00010000:00010000:0.0:1787830995.588265:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11000/0x95459fb9d1d29130 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830995.588287:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11000/0x95459fb9d1d29130 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830995.588305:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11000/0x95459fb9d1d29130 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787830995.589185:0:13771:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967395 00000004:00010000:0.0:1787830995.589231:0:13771:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c52c9417 reply state 00000000124c1ae9 transno 4294967396 ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11000/0x95459fb9d1d29130 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830995.589691:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11000/0x95459fb9d1d29130 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830995.589701:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d2318594f00) 00010000:00010000:0.0:1787830995.589704:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787830995.589709:0:13771:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787830995.591332:0:13771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220394ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47d7f0ed-283f-4b70-a741-6e74c5e52619+58:11359:x1874676433344896:12345-192.168.203.31@tcp:36:bash.0 Request processed in 3383us (3691us total) trans 4294967396 rc 0/0 00000100:00100000:0.0:1787830995.591344:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 116 00000020:00080000:0.0:1787830995.591351:0:13771:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787830995.598945:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787830995.599161:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433345024 00000100:00100000:3.0:1787830995.599173:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433345024 00000100:00100000:3.0:1787830995.599250:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 117 00000100:00100000:3.0:1787830995.599261:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2309d08780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+58:11359:x1874676433345024:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:3.0:1787830995.599311:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787830995.599351:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669a00/0x95459fb9d1d29137 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99423eb7 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830995.599601:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668600/0x95459fb9d1d2913e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830995.599621:0:6490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668800/0x95459fb9d1d29114 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423ea9 expref: 59 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830995.599679:0:6490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668600/0x95459fb9d1d2913e lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830995.599723:0:6490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668800/0x95459fb9d1d29114 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423ea9 expref: 59 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830995.599741:0:6490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668800/0x95459fb9d1d29114 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423ea9 expref: 59 pid: 6490 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830995.599756:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203997c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6490:1874676443886464:192.168.203.31@tcp:104: 00000100:00100000:3.0:1787830995.600334:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d22028520c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787830995.605136:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203997c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6490:1874676443886464:192.168.203.31@tcp:104: 00010000:00010000:0.0:1787830995.605177:0:6490:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668600/0x95459fb9d1d2913e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830995.611338:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787830995.612612:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433345152 00000100:00100000:1.0:1787830995.612643:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433345152 00010000:00010000:0.0:1787830995.613262:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668800/0x95459fb9d1d29114 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423ea9 expref: 60 pid: 6490 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830995.613354:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 71 00000100:00100000:0.0:1787830995.613367:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22039b83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+60:2396:x1874676433345152:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787830995.613386:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787830995.613395:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668800/0x95459fb9d1d29114 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423ea9 expref: 60 pid: 6490 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830995.613409:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668800/0x95459fb9d1d29114 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423ea9 expref: 60 pid: 6490 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830995.613450:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668800/0x95459fb9d1d29114 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423ea9 expref: 60 pid: 6490 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830995.613472:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d2318594f00) 00010000:00010000:0.0:1787830995.613479:0:6477:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668600/0x95459fb9d1d2913e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830995.613490:0:6477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668600/0x95459fb9d1d2913e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830995.613498:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668600/0x95459fb9d1d2913e lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830995.613795:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787830995.613867:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22039b83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+59:2396:x1874676433345152:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 502us (3008us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830995.613894:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 71 00010000:00010000:3.0:1787830995.616794:0:6490:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668600/0x95459fb9d1d2913e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830995.616822:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668600/0x95459fb9d1d2913e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787830995.616974:0:6490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:3.0:1787830995.616980:0:6490:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787830995.617039:0:6490:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668600/0x95459fb9d1d2913e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830995.617094:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669a00/0x95459fb9d1d29137 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423eb7 expref: 59 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830995.617118:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668600/0x95459fb9d1d2913e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423eb7 expref: 58 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830995.617128:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d2318594f00) 00010000:00010000:3.0:1787830995.617131:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787830995.617135:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2301668600, rc 0) 00000100:00100000:3.0:1787830995.617298:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2309d08780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+58:11359:x1874676433345024:12345-192.168.203.31@tcp:101:bash.0 Request processed in 18039us (18366us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830995.617315:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 117 00000100:00100000:2.0:1787830995.628697:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787830995.628918:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433345408 00000100:00100000:3.0:1787830995.628932:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433345408 00000100:00100000:3.0:1787830995.629114:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 29 00000100:00100000:3.0:1787830995.629127:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22039ba940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+58:11359:x1874676433345408:12345-192.168.203.31@tcp:35:bash.0 00000100:00100000:3.0:1787830995.629605:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22039ba940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+59:11359:x1874676433345408:12345-192.168.203.31@tcp:35:bash.0 Request processed in 480us (920us total) trans 4294967397 rc 0/0 00000100:00100000:3.0:1787830995.629615:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 29 00000100:00100000:0.0:1787830995.687093:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220394c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443886592:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787830995.687218:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830995.687552:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443886592 00000100:00100000:2.0:1787830995.687561:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443886592 00000100:00100000:2.0:1787830995.687643:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1787830995.687655:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443886592:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787830995.687701:0:7448:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:2.0:1787830995.687788:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443886592:12345-0@lo:41:osp-pre-0-1.0 Request processed in 135us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830995.687795:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1787830995.688112:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220394c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443886592:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787830995.694854:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787830995.695036:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433345536 00000100:00100000:1.0:1787830995.695049:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433345536 00000100:00100000:1.0:1787830995.695126:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 118 00000100:00100000:1.0:1787830995.695137:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a7bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+59:11365:x1874676433345536:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:1.0:1787830995.695168:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787830995.695196:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6e00/0x95459fb9d1d29145 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99423ebe expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830995.695316:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7c00/0x95459fb9d1d2914c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830995.695331:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7c00/0x95459fb9d1d2914c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830995.695345:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7c00/0x95459fb9d1d2914c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787830995.695399:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1787830995.695403:0:6492:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787830995.695427:0:6492:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7c00/0x95459fb9d1d2914c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830995.695457:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6e00/0x95459fb9d1d29145 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423ebe expref: 61 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830995.695476:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7c00/0x95459fb9d1d2914c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423ebe expref: 60 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830995.695496:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d2203615700) 00010000:00010000:1.0:1787830995.695499:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787830995.695503:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d23344b7c00, rc 0) 00000100:00100000:1.0:1787830995.695576:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a7bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+60:11365:x1874676433345536:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 441us (738us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830995.695583:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 118 00000100:00100000:1.0:1787830995.698788:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787830995.698848:0:13771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433345664 00000100:00100000:0.0:1787830995.698859:0:13771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433345664 00000100:00100000:0.0:1787830995.698946:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 119 00000100:00100000:0.0:1787830995.698956:0:13771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220394c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47d7f0ed-283f-4b70-a741-6e74c5e52619+60:11365:x1874676433345664:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:0.0:1787830995.699081:0:13771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787830995.699112:0:13771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11400/0x95459fb9d1d29153 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99423ec5 expref: -99 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830995.699196:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10600/0x95459fb9d1d2915a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830995.699213:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10600/0x95459fb9d1d2915a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830995.699228:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10600/0x95459fb9d1d2915a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830995.699304:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11c00/0x95459fb9d1d29161 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830995.699314:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11c00/0x95459fb9d1d29161 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830995.699321:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11c00/0x95459fb9d1d29161 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830995.699620:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3400/0x95459fb9d1d29168 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830995.699715:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3400/0x95459fb9d1d29168 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830995.699723:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3400/0x95459fb9d1d29168 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787830995.699774:0:13771:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1787830995.699779:0:13771:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787830995.699801:0:13771:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3400/0x95459fb9d1d29168 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830995.699813:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3400/0x95459fb9d1d29168 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830995.699822:0:13771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10600/0x95459fb9d1d2915a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830995.699828:0:13771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10600/0x95459fb9d1d2915a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830995.699835:0:13771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10600/0x95459fb9d1d2915a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830995.699840:0:13771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233bf10600 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:0.0:1787830995.699845:0:13771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10600/0x95459fb9d1d2915a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830995.699853:0:13771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10600/0x95459fb9d1d2915a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830995.699866:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d2203615700) 00010000:00010000:0.0:1787830995.699875:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787830995.699893:0:13771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10600/0x95459fb9d1d2915a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830995.699902:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10600/0x95459fb9d1d2915a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830995.699922:0:13771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11c00/0x95459fb9d1d29161 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830995.699927:0:13771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11c00/0x95459fb9d1d29161 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830995.699933:0:13771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11c00/0x95459fb9d1d29161 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830995.699938:0:13771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233bf11c00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:0.0:1787830995.699941:0:13771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11c00/0x95459fb9d1d29161 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830995.699947:0:13771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11c00/0x95459fb9d1d29161 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830995.699956:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8d2318594100) 00010000:00010000:0.0:1787830995.699959:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787830995.699962:0:13771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11c00/0x95459fb9d1d29161 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830995.700798:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11c00/0x95459fb9d1d29161 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830995.700848:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11400/0x95459fb9d1d29153 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423ec5 expref: 62 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830995.700899:0:13771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3400/0x95459fb9d1d29168 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423ec5 expref: 61 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830995.700908:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d2318594f00) 00010000:00010000:0.0:1787830995.700911:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787830995.700914:0:13771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2303aa3400, rc 0) 00000100:00100000:0.0:1787830995.701205:0:13771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220394c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47d7f0ed-283f-4b70-a741-6e74c5e52619+61:11365:x1874676433345664:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 2249us (2429us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830995.701216:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 119 00000100:00100000:0.0:1787830995.704852:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787830995.705187:0:7432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433346048 00000100:00100000:2.0:1787830995.705199:0:7432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433346048 00000100:00100000:2.0:1787830995.705327:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 8 00000100:00100000:2.0:1787830995.705340:0:7432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+61:2397:x1874676433346048:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787830995.705365:0:7432:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787830995.705400:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3400/0x95459fb9d1d29168 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423ec5 expref: 61 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830995.705439:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d2318594f00) 00010000:00010000:2.0:1787830995.705446:0:7432:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787830995.705523:0:7432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+60:2397:x1874676433346048:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 185us (685us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830995.705532:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 8 00000100:00100000:3.0:1787830995.705749:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787830995.706144:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433345920 00000100:00100000:3.0:1787830995.706151:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433345920 00000100:00100000:3.0:1787830995.706197:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 120 00000100:00100000:3.0:1787830995.706207:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203997c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+60:11365:x1874676433345920:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:3.0:1787830995.706299:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787830995.706322:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669200/0x95459fb9d1d2916f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99423ecc expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830995.706926:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1600/0x95459fb9d1d29176 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830995.706949:0:6490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668600/0x95459fb9d1d2913e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423eb7 expref: 61 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830995.706960:0:6490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1600/0x95459fb9d1d29176 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830995.707001:0:6490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668600/0x95459fb9d1d2913e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423eb7 expref: 61 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830995.707018:0:6490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668600/0x95459fb9d1d2913e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423eb7 expref: 61 pid: 6490 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830995.707033:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22039b8000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6490:1874676443886720:192.168.203.31@tcp:104: 00000100:00100000:2.0:1787830995.707146:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d233be683c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787830995.710593:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787830995.710796:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22039b8000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6490:1874676443886720:192.168.203.31@tcp:104: 00010000:00010000:2.0:1787830995.710831:0:6490:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1600/0x95459fb9d1d29176 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830995.710891:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433346176 00000100:00100000:1.0:1787830995.710898:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433346176 00010000:00010000:1.0:1787830995.711053:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668600/0x95459fb9d1d2913e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423eb7 expref: 62 pid: 6490 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830995.711089:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 72 00000100:00100000:1.0:1787830995.711099:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a792c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+62:2397:x1874676433346176:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787830995.711119:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787830995.711127:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668600/0x95459fb9d1d2913e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423eb7 expref: 62 pid: 6490 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830995.711136:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668600/0x95459fb9d1d2913e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423eb7 expref: 62 pid: 6490 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830995.711159:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668600/0x95459fb9d1d2913e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423eb7 expref: 62 pid: 6490 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830995.711174:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d2318594f00) 00010000:00010000:1.0:1787830995.711193:0:6476:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1600/0x95459fb9d1d29176 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830995.711202:0:6476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1600/0x95459fb9d1d29176 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830995.711209:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1600/0x95459fb9d1d29176 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830995.712215:0:6490:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1600/0x95459fb9d1d29176 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830995.712233:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1600/0x95459fb9d1d29176 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787830995.712253:0:6490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1787830995.712407:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669200/0x95459fb9d1d2916f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423ecc expref: 63 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830995.712431:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1600/0x95459fb9d1d29176 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423ecc expref: 62 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830995.712439:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d2318594f00) 00010000:00010000:2.0:1787830995.712443:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787830995.712446:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22039c1600, rc 0) 00000100:00100000:2.0:1787830995.712528:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203997c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+62:11365:x1874676433345920:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 6322us (6779us total) trans 4294967398 rc 0/0 00000100:00100000:2.0:1787830995.712538:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 120 00010000:00010000:1.0:1787830995.712636:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787830995.712661:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a792c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+61:2397:x1874676433346176:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 1564us (2083us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830995.712669:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 72 00000100:00100000:0.0:1787830995.720738:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787830995.720821:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433346432 00000100:00100000:1.0:1787830995.720835:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433346432 00000100:00100000:1.0:1787830995.720930:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 9 00000100:00100000:1.0:1787830995.720942:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a79680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+61:11365:x1874676433346432:12345-192.168.203.31@tcp:103:lfs.0 00010000:00010000:1.0:1787830995.720963:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787830995.720996:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669600/0x95459fb9d1d290c7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e9b expref: 61 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830995.721018:0:6475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d2318594f00) 00010000:00010000:1.0:1787830995.721025:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787830995.721096:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a79680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+60:11365:x1874676433346432:12345-192.168.203.31@tcp:103:lfs.0 Request processed in 157us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830995.721105:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 9 00000100:00100000:3.0:1787830995.723810:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787830995.723941:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433346560 00000100:00100000:2.0:1787830995.723952:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433346560 00000100:00100000:2.0:1787830995.724011:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 121 00000100:00100000:2.0:1787830995.724027:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220392cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+60:11365:x1874676433346560:12345-192.168.203.31@tcp:58:lfs.0 00010000:00010000:2.0:1787830995.724164:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d29184 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830995.724185:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d29184 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830995.724199:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d29184 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787830995.724357:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1787830995.724445:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220392cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+60:11365:x1874676433346560:12345-192.168.203.31@tcp:58:lfs.0 Request processed in 424us (647us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830995.724454:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 121 00000100:00100000:0.0:1787830995.726859:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787830995.727157:0:13771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433346688 00000100:00100000:1.0:1787830995.727169:0:13771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433346688 00000100:00100000:1.0:1787830995.727277:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 122 00000100:00100000:1.0:1787830995.727305:0:13771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a78b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47d7f0ed-283f-4b70-a741-6e74c5e52619+60:11365:x1874676433346688:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:1.0:1787830995.727338:0:13771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787830995.727365:0:13771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6e00/0x95459fb9d1d2918b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99423ed3 expref: -99 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830995.727429:0:13771:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d29184 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830995.727441:0:13771:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6e00/0x95459fb9d1d2918b lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423ed3 expref: 61 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830995.727463:0:13771:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d29184 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830995.727479:0:13771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6e00/0x95459fb9d1d2918b lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423ed3 expref: 61 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830995.727495:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d2318594f00) 00010000:00010000:1.0:1787830995.727499:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787830995.727503:0:13771:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6e00/0x95459fb9d1d2918b lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423ed3 expref: 61 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830995.727512:0:13771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d23344b6e00, rc 0) 00000100:00100000:1.0:1787830995.727581:0:13771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a78b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47d7f0ed-283f-4b70-a741-6e74c5e52619+61:11365:x1874676433346688:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 278us (733us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830995.727589:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 122 00010000:00010000:0.0:1787830995.943412:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787830996.134930:0:13758:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787830996.134943:0:13758:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787830996.134977:0:13758:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:0.0:1787830996.134990:0:13758:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787830996.135164:0:13758:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a7ad00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13758:1874676443886848:192.168.203.31@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787830996.135313:0:13758:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2307d753c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787830996.141850:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787830996.142003:0:13758:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a7ad00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13758:1874676443886848:192.168.203.31@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787830996.142504:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433346816 00000100:00100000:2.0:1787830996.142513:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433346816 00000100:00100000:2.0:1787830996.142602:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 123 00000100:00100000:2.0:1787830996.142612:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a79a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+61:11366:x1874676433346816:12345-192.168.203.31@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787830996.142684:0:6490:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787830996.142852:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a79a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+61:11366:x1874676433346816:12345-192.168.203.31@tcp:53:lhsmtool_posix.0 Request processed in 240us (1018us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830996.142862:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 123 00000100:00080000:3.0:1787830996.143438:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787830996.149831:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787830996.150014:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433346944 00000100:00100000:1.0:1787830996.150046:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433346944 00000100:00100000:1.0:1787830996.150127:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 124 00000100:00100000:1.0:1787830996.150138:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22039b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+61:11366:x1874676433346944:12345-192.168.203.31@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787830996.150235:0:8620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6a00/0x95459fb9d1d29192 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830996.150257:0:8620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6a00/0x95459fb9d1d29192 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830996.150284:0:8620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6a00/0x95459fb9d1d29192 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830996.150304:0:8620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7200/0x95459fb9d1d29199 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830996.150311:0:8620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7200/0x95459fb9d1d29199 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830996.150318:0:8620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7200/0x95459fb9d1d29199 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830996.151104:0:8620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6600/0x95459fb9d1d291a0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830996.151122:0:8620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6600/0x95459fb9d1d291a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830996.151130:0:8620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6600/0x95459fb9d1d291a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787830996.151196:0:8620:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:1.0:1787830996.151201:0:8620:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787830996.151228:0:8620:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6600/0x95459fb9d1d291a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830996.151243:0:8620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6a00/0x95459fb9d1d29192 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830996.151249:0:8620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6a00/0x95459fb9d1d29192 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830996.151258:0:8620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6a00/0x95459fb9d1d29192 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830996.151276:0:8620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d23344b6a00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:1.0:1787830996.151281:0:8620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6a00/0x95459fb9d1d29192 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830996.151290:0:8620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6a00/0x95459fb9d1d29192 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830996.151305:0:8620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d2318594400) 00010000:00010000:1.0:1787830996.151309:0:8620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787830996.151314:0:8620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6a00/0x95459fb9d1d29192 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830996.152501:0:8620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6a00/0x95459fb9d1d29192 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830996.152533:0:8620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7200/0x95459fb9d1d29199 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830996.152540:0:8620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7200/0x95459fb9d1d29199 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830996.152547:0:8620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7200/0x95459fb9d1d29199 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830996.152568:0:8620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d23344b7200 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:1.0:1787830996.152571:0:8620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7200/0x95459fb9d1d29199 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830996.152578:0:8620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7200/0x95459fb9d1d29199 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830996.152593:0:8620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff8d232b9c6400) 00010000:00010000:1.0:1787830996.152596:0:8620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787830996.152600:0:8620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7200/0x95459fb9d1d29199 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830996.152606:0:8620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7200/0x95459fb9d1d29199 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830996.153280:0:8620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6600/0x95459fb9d1d291a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830996.153292:0:8620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6600/0x95459fb9d1d291a0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830996.153298:0:8620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6600/0x95459fb9d1d291a0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830996.153304:0:8620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d23344b6600 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:1.0:1787830996.153307:0:8620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6600/0x95459fb9d1d291a0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830996.153313:0:8620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6600/0x95459fb9d1d291a0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830996.153348:0:8620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d2318594f00) 00010000:00010000:1.0:1787830996.153351:0:8620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787830996.153354:0:8620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6600/0x95459fb9d1d291a0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830996.153360:0:8620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6600/0x95459fb9d1d291a0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830996.153622:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22039b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+61:11366:x1874676433346944:12345-192.168.203.31@tcp:34:lhsmtool_posix.0 Request processed in 3474us (3794us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830996.153681:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 124 00000100:00100000:1.0:1787830996.160786:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787830996.160965:0:13771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433347200 00000100:00100000:0.0:1787830996.160980:0:13771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433347200 00000100:00100000:0.0:1787830996.161055:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 125 00000100:00100000:0.0:1787830996.161066:0:13771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220394e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47d7f0ed-283f-4b70-a741-6e74c5e52619+61:11366:x1874676433347200:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787830996.161104:0:13771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787830996.161123:0:13771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3c00/0x95459fb9d1d291a7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99423eda expref: -99 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830996.161236:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3600/0x95459fb9d1d291ae lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830996.161253:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3600/0x95459fb9d1d291ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830996.161266:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3600/0x95459fb9d1d291ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787830996.161277:0:13771:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1787830996.161366:0:13771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3600/0x95459fb9d1d291ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830996.161374:0:13771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3600/0x95459fb9d1d291ae lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830996.161380:0:13771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3600/0x95459fb9d1d291ae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830996.161385:0:13771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2303aa3600 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:0.0:1787830996.161389:0:13771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3600/0x95459fb9d1d291ae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830996.161397:0:13771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3600/0x95459fb9d1d291ae lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830996.161409:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d2318594f00) 00010000:00010000:0.0:1787830996.161419:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787830996.161425:0:13771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3600/0x95459fb9d1d291ae lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830996.161430:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3600/0x95459fb9d1d291ae lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830996.161470:0:13771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3c00/0x95459fb9d1d291a7 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423eda expref: 63 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830996.161480:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d2318594400) 00010000:00010000:0.0:1787830996.161483:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787830996.161486:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3c00/0x95459fb9d1d291a7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423eda expref: 63 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830996.161496:0:13771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2303aa3c00, rc 0) 00000100:00100000:0.0:1787830996.161570:0:13771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220394e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47d7f0ed-283f-4b70-a741-6e74c5e52619+62:11366:x1874676433347200:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 505us (797us total) trans 4294967399 rc 301/301 00000100:00100000:0.0:1787830996.161578:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 125 00000100:00100000:0.0:1787830996.166022:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787830996.166175:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433347328 00000100:00100000:2.0:1787830996.166185:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433347328 00000100:00100000:2.0:1787830996.166246:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 126 00000100:00100000:2.0:1787830996.166256:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a7b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+62:11366:x1874676433347328:12345-192.168.203.31@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787830996.166292:0:6491:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787830996.166415:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a7b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+62:11366:x1874676433347328:12345-192.168.203.31@tcp:53:lhsmtool_posix.0 Request processed in 160us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830996.166422:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 126 00000100:00100000:1.0:1787830996.172039:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787830996.172169:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433347584 00000100:00100000:0.0:1787830996.172184:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433347584 00000100:00100000:0.0:1787830996.172590:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 127 00000100:00100000:0.0:1787830996.172604:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220394f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+62:11366:x1874676433347584:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787830996.172724:0:8620:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787830996.172729:0:8620:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787830996.172766:0:8620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7c00/0x95459fb9d1d2914c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423ebe expref: 62 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830996.172812:0:8620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d2203615700) 00010000:00010000:0.0:1787830996.172819:0:8620:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787830996.172837:0:8620:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3c00/0x95459fb9d1d291bc lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99423ee1 expref: -99 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787830996.175353:0:8620:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:0.0:1787830996.176150:0:8620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3600/0x95459fb9d1d291c3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830996.176174:0:8620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3600/0x95459fb9d1d291c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830996.176187:0:8620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3600/0x95459fb9d1d291c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830996.176580:0:8620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3c00/0x95459fb9d1d291bc lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423ee1 expref: 64 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830996.176609:0:8620:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3600/0x95459fb9d1d291c3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423ee1 expref: 63 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830996.178771:0:8620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8d2309e00c00) 00010000:00010000:0.0:1787830996.178776:0:8620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787830996.178782:0:8620:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2303aa3600, rc 0) 00000100:00100000:0.0:1787830996.179081:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220394f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+63:11366:x1874676433347584:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 6473us (7049us total) trans 4294967400 rc 0/0 00000100:00100000:0.0:1787830996.179094:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 127 00000100:00100000:1.0:1787830996.184113:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787830996.184237:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433347840 00000100:00100000:2.0:1787830996.184250:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433347840 00000100:00100000:2.0:1787830996.184443:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 128 00000100:00100000:2.0:1787830996.184456:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d232f796d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+63:11366:x1874676433347840:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787830996.184570:0:6490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787830996.184605:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3600/0x95459fb9d1d291c3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423ee1 expref: 63 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830996.184653:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8d2309e00c00) 00010000:00010000:2.0:1787830996.184667:0:6490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787830996.184693:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1800/0x95459fb9d1d291d1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830996.184710:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1800/0x95459fb9d1d291d1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830996.184721:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1800/0x95459fb9d1d291d1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830996.184925:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1400/0x95459fb9d1d291d8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0xdce472e2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830996.184949:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1400/0x95459fb9d1d291d8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xdce472e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830996.184963:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1400/0x95459fb9d1d291d8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xdce472e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830996.185024:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1800/0x95459fb9d1d291d1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830996.185032:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1800/0x95459fb9d1d291d1 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830996.185039:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1800/0x95459fb9d1d291d1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830996.185058:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22039c1800 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:2.0:1787830996.185062:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1800/0x95459fb9d1d291d1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830996.185069:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1800/0x95459fb9d1d291d1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830996.185082:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d2203615700) 00010000:00010000:2.0:1787830996.185085:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787830996.185090:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1800/0x95459fb9d1d291d1 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830996.185096:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1800/0x95459fb9d1d291d1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830996.185112:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1400/0x95459fb9d1d291d8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xdce472e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830996.185118:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1400/0x95459fb9d1d291d8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xdce472e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830996.185124:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1400/0x95459fb9d1d291d8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xdce472e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830996.185129:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22039c1400 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:2.0:1787830996.185131:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1400/0x95459fb9d1d291d8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xdce472e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830996.185138:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1400/0x95459fb9d1d291d8 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xdce472e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830996.185159:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0xdce472e2 (ffff8d2203615c00) 00010000:00010000:2.0:1787830996.185162:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787830996.185166:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1400/0x95459fb9d1d291d8 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xdce472e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830996.185172:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1400/0x95459fb9d1d291d8 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xdce472e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830996.185288:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d232f796d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+62:11366:x1874676433347840:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 Request processed in 830us (1186us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787830996.185297:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 128 00000100:00100000:2.0:1787830996.187517:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787830996.187754:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433347968 00000100:00100000:0.0:1787830996.187766:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433347968 00000100:00100000:0.0:1787830996.187830:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 129 00000100:00100000:0.0:1787830996.187842:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203bb1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+62:11366:x1874676433347968:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787830996.187865:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787830996.187910:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3e00/0x95459fb9d1d291df lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99423ee8 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830996.187958:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2e00/0x95459fb9d1d291e6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830996.187973:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2e00/0x95459fb9d1d291e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830996.187985:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2e00/0x95459fb9d1d291e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830996.188137:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3e00/0x95459fb9d1d291df lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423ee8 expref: 64 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830996.188156:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2e00/0x95459fb9d1d291e6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423ee8 expref: 63 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830996.188165:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8d2309e00800) 00010000:00010000:0.0:1787830996.188169:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787830996.188172:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2303aa2e00, rc 0) 00000100:00100000:0.0:1787830996.188443:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203bb1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+63:11366:x1874676433347968:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 603us (938us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830996.188451:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 129 00000100:00100000:2.0:1787830996.195367:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787830996.195429:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433348224 00000100:00100000:0.0:1787830996.195441:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433348224 00000100:00100000:0.0:1787830996.195517:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 130 00000100:00100000:0.0:1787830996.195527:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203bb03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+63:11366:x1874676433348224:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787830996.195691:0:8620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3a00/0x95459fb9d1d291ed lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830996.195714:0:8620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3a00/0x95459fb9d1d291ed lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830996.195729:0:8620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3a00/0x95459fb9d1d291ed lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787830996.195954:0:8620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:0.0:1787830996.195967:0:8620:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 287196341366ns, next at 288196337578ns, rc = 0 00000004:00010000:0.0:1787830996.196039:0:8620:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000054421f64 reply state 00000000503b105e transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3a00/0x95459fb9d1d291ed lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830996.196056:0:8620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3a00/0x95459fb9d1d291ed lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830996.196065:0:8620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8d2309e00800) 00010000:00010000:0.0:1787830996.196068:0:8620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1787830996.196073:0:8620:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787830996.196935:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203bb03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+65:11366:x1874676433348224:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 Request processed in 1402us (1573us total) trans 4294967401 rc 0/0 00000100:00100000:0.0:1787830996.196946:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 130 00000100:00100000:1.0:1787830996.204213:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787830996.204411:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433348352 00000100:00100000:2.0:1787830996.204422:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433348352 00000100:00100000:2.0:1787830996.204525:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 131 00000100:00100000:2.0:1787830996.204536:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d232f795e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+65:11366:x1874676433348352:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787830996.204567:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787830996.204596:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1400/0x95459fb9d1d291f4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99423eef expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830996.204694:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1400/0x95459fb9d1d291f4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423eef expref: 66 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830996.204710:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1400/0x95459fb9d1d291f4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423eef expref: 66 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830996.204756:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8d2309e00800) 00010000:00010000:2.0:1787830996.204760:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787830996.204765:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22039c1400, rc 0) 00000100:00100000:2.0:1787830996.204841:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d232f795e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+66:11366:x1874676433348352:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 306us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830996.204849:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 131 00000100:00100000:1.0:1787830996.214669:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787830996.214777:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433348480 00000100:00100000:3.0:1787830996.214790:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433348480 00000100:00100000:3.0:1787830996.215030:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 45 00000100:00100000:3.0:1787830996.215043:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203764b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+8:2396:x1874676433348480:12345-192.168.203.31@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1787830996.215564:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203764b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+9:2396:x1874676433348480:12345-192.168.203.31@tcp:2:lhsmtool_posix.0 Request processed in 522us (907us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1787830996.215574:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 45 00000100:00080000:0.0:1787830996.215691:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787830996.218687:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787830996.218834:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433348736 00000100:00100000:3.0:1787830996.218847:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433348736 00000100:00100000:3.0:1787830996.219261:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 30 00000100:00100000:3.0:1787830996.219281:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203bb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+66:11366:x1874676433348736:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787830996.219583:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203bb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+67:11366:x1874676433348736:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 Request processed in 312us (909us total) trans 4294967402 rc 0/0 00000100:00100000:3.0:1787830996.219593:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 30 00000100:00100000:1.0:1787830996.224168:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787830996.224517:0:13771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433348992 00000100:00100000:0.0:1787830996.224530:0:13771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433348992 00000100:00100000:0.0:1787830996.224713:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 132 00000100:00100000:0.0:1787830996.224726:0:13771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203767840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47d7f0ed-283f-4b70-a741-6e74c5e52619+67:11366:x1874676433348992:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787830996.225065:0:13771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203767840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47d7f0ed-283f-4b70-a741-6e74c5e52619+67:11366:x1874676433348992:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 Request processed in 151us (720us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830996.225074:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 132 00000100:00100000:2.0:1787830996.228782:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787830996.237075:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433349120 00000100:00100000:0.0:1787830996.237100:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433349120 00000100:00100000:1.0:1787830996.237299:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 133 00000100:00100000:1.0:1787830996.237313:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203bb0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+67:11366:x1874676433349120:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787830996.237345:0:8620:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787830996.237374:0:8620:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6c00/0x95459fb9d1d291fb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99423ef6 expref: -99 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830996.237468:0:8620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6400/0x95459fb9d1d29202 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830996.237484:0:8620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6400/0x95459fb9d1d29202 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830996.237511:0:8620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6400/0x95459fb9d1d29202 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787830996.237570:0:8620:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787830996.237594:0:8620:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6400/0x95459fb9d1d29202 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830996.237655:0:8620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6c00/0x95459fb9d1d291fb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423ef6 expref: 69 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830996.237679:0:8620:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6400/0x95459fb9d1d29202 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423ef6 expref: 68 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830996.237689:0:8620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8d2309e00800) 00010000:00010000:1.0:1787830996.237692:0:8620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787830996.237696:0:8620:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d23344b6400, rc 0) 00000100:00100000:1.0:1787830996.237784:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203bb0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+68:11366:x1874676433349120:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 473us (9015us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830996.237792:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 133 00000100:00100000:2.0:1787830996.241590:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787830996.241744:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433349248 00000100:00100000:1.0:1787830996.241757:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433349248 00000100:00100000:1.0:1787830996.241818:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 46 00000100:00100000:1.0:1787830996.241828:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203bb3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+9:2397:x1874676433349248:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787830996.241851:0:8407:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787830996.241892:0:8407:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a0588e1c/0x95459fb9d1d29209 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99423efd expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787830996.241958:0:8407:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9022d4, blocks: 0x0 00010000:00010000:1.0:1787830996.241995:0:8407:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=287s v=(0 0) 00010000:00010000:1.0:1787830996.242001:0:8407:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787830996.242012:0:8407:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0588e1c/0x95459fb9d1d29209 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423efd expref: 10 pid: 8407 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830996.242045:0:8407:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a0588e1c/0x95459fb9d1d29209 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423efd expref: 10 pid: 8407 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830996.242061:0:8407:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d23344b6000, rc 0) 00000100:00100000:1.0:1787830996.242134:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203bb3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+10:2397:x1874676433349248:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 307us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830996.242142:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 46 00000100:00100000:2.0:1787830996.245201:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787830996.245388:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433349504 00000100:00100000:3.0:1787830996.245399:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433349504 00000100:00100000:2.0:1787830996.245575:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 134 00000100:00100000:2.0:1787830996.245586:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220390a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+68:11366:x1874676433349504:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787830996.245758:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220390a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+68:11366:x1874676433349504:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 Request processed in 174us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830996.245767:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 134 00000100:00100000:2.0:1787830996.255567:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787830996.256296:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433349632 00000100:00100000:1.0:1787830996.256312:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433349632 00000100:00100000:1.0:1787830996.256428:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 47 00000100:00100000:1.0:1787830996.256440:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220390b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+10:11366:x1874676433349632:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787830996.256465:0:8406:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787830996.256490:0:8406:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003acf69f2/0x95459fb9d1d29210 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99423f04 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830996.256544:0:8406:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a0588e1c/0x95459fb9d1d29209 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423efd expref: 11 pid: 8407 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830996.256578:0:8406:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787830996.256582:0:8406:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787830996.256590:0:8406:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003acf69f2/0x95459fb9d1d29210 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f04 expref: 11 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830996.256676:0:8406:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a0588e1c/0x95459fb9d1d29209 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423efd expref: 11 pid: 8407 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830996.256693:0:8406:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a0588e1c/0x95459fb9d1d29209 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423efd expref: 11 pid: 8407 timeout: 387 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830996.256709:0:8406:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203765e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8406:1874676443886976:192.168.203.31@tcp:104: 00000100:00100000:1.0:1787830996.256826:0:8406:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d232f727600 going to sleep for 11 seconds 00000100:00100000:0.0:1787830996.264651:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787830996.264886:0:8406:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203765e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8406:1874676443886976:192.168.203.31@tcp:104: 00010000:00010000:2.0:1787830996.264931:0:8406:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003acf69f2/0x95459fb9d1d29210 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f04 expref: 11 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830996.264958:0:8406:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d23344b6c00, rc 0) 00000100:00100000:2.0:1787830996.265025:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220390b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+11:11366:x1874676433349632:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 8586us (9472us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830996.265057:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 47 00000100:00100000:3.0:1787830996.265258:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433349760 00000100:00100000:3.0:1787830996.265276:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433349760 00010000:00010000:3.0:1787830996.265318:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a0588e1c/0x95459fb9d1d29209 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423efd expref: 11 pid: 8407 timeout: 387 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830996.265370:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 73 00000100:00100000:3.0:1787830996.265380:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2321e74850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+11:2396:x1874676433349760:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787830996.265398:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787830996.265425:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a0588e1c/0x95459fb9d1d29209 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423efd expref: 11 pid: 8407 timeout: 387 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830996.265441:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a0588e1c/0x95459fb9d1d29209 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423efd expref: 11 pid: 8407 timeout: 387 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830996.265467:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a0588e1c/0x95459fb9d1d29209 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423efd expref: 11 pid: 8407 timeout: 387 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830996.265483:0:6477:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787830996.265489:0:6477:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787830996.265498:0:6477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003acf69f2/0x95459fb9d1d29210 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f04 expref: 10 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830996.265511:0:6477:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003acf69f2/0x95459fb9d1d29210 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f04 expref: 10 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830996.265764:0:6477:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003acf69f2/0x95459fb9d1d29210 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f04 expref: 10 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830996.265781:0:6477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2334489680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6477:1874676443887104:192.168.203.31@tcp:105: 00000100:00100000:3.0:1787830996.265857:0:6477:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2202852cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787830996.277184:0:6477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2334489680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6477:1874676443887104:192.168.203.31@tcp:105: 00010000:00010000:3.0:1787830996.277223:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787830996.277297:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2321e74850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+10:2396:x1874676433349760:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 11917us (12683us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830996.277312:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 73 00000100:00100000:2.0:1787830996.277324:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787830996.277438:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433349888 00000100:00100000:1.0:1787830996.277447:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433349888 00002000:00100000:1.0:1787830996.277521:0:8411:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff8d2203908000 x1874676433349888/t0(0) o4->47d7f0ed-283f-4b70-a741-6e74c5e52619@192.168.203.31@tcp:67/0 lens 504/0 e 0 to 0 dl 1787831007 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787830996.277533:0:8411:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d2203908000 with x1874676433349888 ext(0->12) 00002000:00010000:1.0:1787830996.277538:0:8411:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d2203908000 00000100:00100000:1.0:1787830996.277570:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 2 00000100:00100000:1.0:1787830996.277581:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203908000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+10:2396:x1874676433349888:12345-192.168.203.31@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1787830996.280805:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203908000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+12:2396:x1874676433349888:12345-192.168.203.31@tcp:4:lhsmtool_posix.0 Request processed in 3211us (3466us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1787830996.280843:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 2 00002000:00100000:1.0:1787830996.280859:0:8411:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff8d2203908000 x1874676433349888/t4294967309(0) o4->47d7f0ed-283f-4b70-a741-6e74c5e52619@192.168.203.31@tcp:67/0 lens 504/448 e 0 to 0 dl 1787831007 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787830996.280887:0:8411:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d2203908000 with x1874676433349888 ext(0->12) 00002000:00010000:1.0:1787830996.280895:0:8411:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d2203908000 00000100:00100000:2.0:1787830996.287598:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787830996.287908:0:13771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433350016 00000100:00100000:0.0:1787830996.287927:0:13771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433350016 00000100:00100000:0.0:1787830996.288005:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 135 00000100:00100000:0.0:1787830996.288017:0:13771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203908f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47d7f0ed-283f-4b70-a741-6e74c5e52619+68:11366:x1874676433350016:12345-192.168.203.31@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1787830996.296819:0:6469:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967402 is committed 00000004:00080000:3.0:1787830996.296847:0:6469:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000004:00080000:3.0:1787830996.296906:0:6469:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:3.0:1787830996.296929:0:6469:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d23063bb6c0 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:3.0:1787830996.296935:0:6469:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d2203a88a00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d2303e3c3c0 00000020:00080000:3.0:1787830996.296939:0:6469:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d2203a88500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d23354c9000 00000004:00080000:3.0:1787830996.296975:0:6469:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00010000:00010000:1.0:1787830996.296999:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10400/0x95459fb9d1d28f15 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1787830996.297008:0:6469:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d2202713f00 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:3.0:1787830996.297011:0:6469:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d2203a88300 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d22027139c0 00010000:00010000:1.0:1787830996.297012:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10400/0x95459fb9d1d28f15 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1787830996.297014:0:6469:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d2203a88100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d2321935800 00010000:00010000:1.0:1787830996.297026:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10400/0x95459fb9d1d28f15 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1787830996.297031:0:6469:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00010000:00010000:1.0:1787830996.297034:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233bf10400 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:1.0:1787830996.297039:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10400/0x95459fb9d1d28f15 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830996.297047:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10400/0x95459fb9d1d28f15 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1787830996.297051:0:6522:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00010000:00010000:1.0:1787830996.297067:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8d2203615900) 00010000:00010000:1.0:1787830996.297071:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787830996.297076:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10400/0x95459fb9d1d28f15 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830996.297082:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10400/0x95459fb9d1d28f15 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1787830996.297143:0:6522:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00010000:00010000:1.0:1787830996.297143:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d28fbd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830996.297149:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d28fbd lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830996.297154:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d28fbd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830996.297159:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2307c76600 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:1.0:1787830996.297162:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d28fbd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830996.297168:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d28fbd lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830996.297176:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d2318594000) 00010000:00010000:1.0:1787830996.297178:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787830996.297182:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d28fbd lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830996.297188:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d28fbd lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830996.297203:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668e00/0x95459fb9d1d2903b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830996.297210:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668e00/0x95459fb9d1d2903b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830996.297216:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668e00/0x95459fb9d1d2903b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830996.297228:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2301668e00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:1.0:1787830996.297231:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668e00/0x95459fb9d1d2903b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830996.297237:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668e00/0x95459fb9d1d2903b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830996.297248:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8d2318594100) 00010000:00010000:1.0:1787830996.297250:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787830996.297253:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668e00/0x95459fb9d1d2903b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830996.297259:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668e00/0x95459fb9d1d2903b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830996.297272:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7a00/0x95459fb9d1d2905e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830996.297278:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7a00/0x95459fb9d1d2905e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830996.297284:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7a00/0x95459fb9d1d2905e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830996.297288:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d23344b7a00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:1.0:1787830996.297290:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7a00/0x95459fb9d1d2905e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830996.297295:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7a00/0x95459fb9d1d2905e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830996.297315:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8d2318594100) 00010000:00010000:1.0:1787830996.297317:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787830996.297688:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7a00/0x95459fb9d1d2905e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830996.297698:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7a00/0x95459fb9d1d2905e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830996.297716:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11000/0x95459fb9d1d29130 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830996.297723:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11000/0x95459fb9d1d29130 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830996.297728:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11000/0x95459fb9d1d29130 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830996.297733:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233bf11000 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:1.0:1787830996.297737:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11000/0x95459fb9d1d29130 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830996.297744:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11000/0x95459fb9d1d29130 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830996.297754:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d2318594f00) 00010000:00010000:1.0:1787830996.297756:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787830996.297759:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11000/0x95459fb9d1d29130 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830996.297765:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11000/0x95459fb9d1d29130 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830996.297791:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3a00/0x95459fb9d1d291ed lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830996.297797:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3a00/0x95459fb9d1d291ed lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830996.297804:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3a00/0x95459fb9d1d291ed lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830996.297809:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2303aa3a00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:1.0:1787830996.297813:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3a00/0x95459fb9d1d291ed lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830996.297819:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3a00/0x95459fb9d1d291ed lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830996.297827:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8d2309e00800) 00010000:00010000:1.0:1787830996.297829:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787830996.297833:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3a00/0x95459fb9d1d291ed lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830996.297849:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3a00/0x95459fb9d1d291ed lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830996.298006:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a7a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1874676443887232:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787830996.298095:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830996.298165:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a792c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443887360:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1787830996.298192:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830996.298212:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787830996.298218:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2336bfc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443887488:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787830996.298245:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830996.298603:0:8631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443887232 00000100:00100000:0.0:1787830996.298612:0:8631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443887232 00000100:00100000:0.0:1787830996.298766:0:8631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443887360 00000100:00100000:0.0:1787830996.298771:0:8631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443887360 00000100:00100000:0.0:1787830996.298784:0:8631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443887488 00000100:00100000:0.0:1787830996.298787:0:8631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443887488 00000100:00100000:0.0:1787830996.298805:0:8631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787830996.298814:0:8631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a79680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3620:x1874676443887232:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1787830996.298857:0:8631:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00010000:00010000:0.0:1787830996.298899:0:8631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002440e3fd/0x95459fb9d1d29217 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830996.298923:0:8631:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d7a8e00e/0x95459fb9d1d28fcb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e5c expref: 11 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830996.298935:0:8631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1787830996.298940:0:8631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787830996.298945:0:8631:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002440e3fd/0x95459fb9d1d29217 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830996.298979:0:8631:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d7a8e00e/0x95459fb9d1d28fcb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e5c expref: 11 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830996.298996:0:8631:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d7a8e00e/0x95459fb9d1d28fcb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e5c expref: 11 pid: 8408 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830996.299009:0:8631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a22940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8631:1874676443887616:192.168.203.31@tcp:104: 00000100:00100000:0.0:1787830996.299085:0:8631:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2307c34840 going to sleep for 11 seconds 00000100:00080000:0.0:1787830996.299102:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787830996.299107:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787830996.299121:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787830996.299129:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a7ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3621:x1874676443887360:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1787830996.299255:0:8406:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1787830996.299259:0:8406:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1787830996 00000100:00100000:1.0:1787830996.299294:0:13771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203908f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47d7f0ed-283f-4b70-a741-6e74c5e52619+16:11366:x1874676433350016:12345-192.168.203.31@tcp:44:lhsmtool_posix.0 Request processed in 11279us (11706us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830996.299305:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 135 00002000:00010000:0.0:1787830996.301171:0:8406:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1787830996.301174:0:8406:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 1787830996 -> 1787830996 00002000:00010000:0.0:1787830996.301177:0:8406:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1787830996.301794:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a7ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3621:x1874676443887360:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2658us (3593us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1787830996.301806:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000004:00080000:3.0:1787830996.302141:0:3621:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d2203a792c0/2, rc 0, transno 4294967310 00000100:00100000:3.0:1787830996.302151:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a792c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443887360:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1787830996.302823:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787830996.302845:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a20f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3621:x1874676443887488:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1787830996.302895:0:8406:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00002000:00010000:0.0:1787830996.302942:0:8406:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a9022d3, atime: 0x6a9022d3, ctime: 0x6a9022d3, blocks: 0x8 00010000:00010000:0.0:1787830996.302952:0:8406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009df61cfc/0x95459fb9d1d2921e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830996.302973:0:8406:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=287s v=(0 0) 00010000:00010000:0.0:1787830996.302979:0:8406:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787830996.302987:0:8406:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009df61cfc/0x95459fb9d1d2921e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830996.303006:0:8406:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009df61cfc/0x95459fb9d1d2921e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830996.303019:0:8406:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009df61cfc/0x95459fb9d1d2921e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830996.303027:0:8406:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009df61cfc/0x95459fb9d1d2921e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830996.303129:0:8406:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787830996.303365:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a20f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3621:x1874676443887488:12345-0@lo:6:osp-syn-0-0.0 Request processed in 530us (5118us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1787830996.303373:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000004:00080000:3.0:1787830996.303412:0:3621:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d2336bfc3c0/2, rc 0, transno 4294967305 00000100:00100000:3.0:1787830996.303421:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2336bfc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443887488:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787830996.305462:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787830996.306167:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433350144 00000100:00100000:0.0:1787830996.306179:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433350144 00000100:00100000:0.0:1787830996.306248:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 51 00000100:00100000:0.0:1787830996.306259:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2334489680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+12:2396:x1874676433350144:12345-192.168.203.31@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1787830996.306592:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787830996.306655:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433350272 00000100:00100000:3.0:1787830996.306660:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433350272 00010000:00010000:3.0:1787830996.306693:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d7a8e00e/0x95459fb9d1d28fcb lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e5c expref: 13 pid: 8408 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830996.306730:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 74 00000100:00100000:3.0:1787830996.306738:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220395de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+13:2396:x1874676433350272:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787830996.306751:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787830996.306758:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d7a8e00e/0x95459fb9d1d28fcb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e5c expref: 13 pid: 8408 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830996.306773:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d7a8e00e/0x95459fb9d1d28fcb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e5c expref: 13 pid: 8408 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830996.306793:0:8631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a22940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8631:1874676443887616:192.168.203.31@tcp:104: 00010000:00010000:3.0:1787830996.306804:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d7a8e00e/0x95459fb9d1d28fcb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e5c expref: 13 pid: 8408 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830996.306827:0:6475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787830996.306832:0:6475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787830996.306838:0:6475:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002440e3fd/0x95459fb9d1d29217 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830996.306851:0:6475:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002440e3fd/0x95459fb9d1d29217 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830996.307457:0:7431:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787830996.307468:0:7431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009df61cfc/0x95459fb9d1d2921e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830996.307479:0:7431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2303aa2000 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:2.0:1787830996.307484:0:7431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009df61cfc/0x95459fb9d1d2921e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830996.307496:0:7431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009df61cfc/0x95459fb9d1d2921e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830996.307513:0:7431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009df61cfc/0x95459fb9d1d2921e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830996.308787:0:7431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009df61cfc/0x95459fb9d1d2921e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830996.308833:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787830996.308835:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787830996.308838:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787830996.310528:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787830996.310662:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220395de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+12:2396:x1874676433350272:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 3915us (4062us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830996.310678:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 74 00000001:00080000:1.0:1787830996.312989:0:9484:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:1.0:1787830996.313008:0:9484:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000100:00100000:3.0:1787830996.313421:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2334489680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+6:2396:x1874676433350144:12345-192.168.203.31@tcp:16:lhsmtool_posix.0 Request processed in 7155us (7961us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830996.313434:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 51 00010000:00010000:0.0:1787830996.313988:0:8631:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002440e3fd/0x95459fb9d1d29217 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830996.314014:0:8631:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002440e3fd/0x95459fb9d1d29217 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830996.314022:0:8631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002440e3fd/0x95459fb9d1d29217 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830996.314036:0:8631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002440e3fd/0x95459fb9d1d29217 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830996.314044:0:8631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002440e3fd/0x95459fb9d1d29217 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830996.314088:0:8631:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787830996.314132:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787830996.314148:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002440e3fd/0x95459fb9d1d29217 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830996.314158:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2303aa3c00 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:1.0:1787830996.314162:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002440e3fd/0x95459fb9d1d29217 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830996.314172:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002440e3fd/0x95459fb9d1d29217 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830996.314197:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002440e3fd/0x95459fb9d1d29217 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830996.314204:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002440e3fd/0x95459fb9d1d29217 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830996.314227:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830996.314228:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830996.314230:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787830996.314321:0:8631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a79680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3620:x1874676443887232:12345-0@lo:6:osp-syn-1-0.0 Request processed in 15505us (16224us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1787830996.314331:0:8631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787830996.314428:0:3620:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:2.0:1787830996.314435:0:3620:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967310 00000004:00080000:2.0:1787830996.314461:0:3620:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d2203a792c0, transno 4294967310 00000100:00100000:2.0:1787830996.314490:0:3620:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8d2203a7a1c0 x1874676443887232/t4294967311(4294967311) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787831012 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1787830996.314503:0:3620:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d2203a7a1c0/2, rc 0, transno 4294967311 00000100:00100000:2.0:1787830996.314509:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a7a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1874676443887232:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787830996.318806:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787830996.318884:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433350528 00000100:00100000:1.0:1787830996.318897:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433350528 00000100:00100000:1.0:1787830996.318985:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 136 00000100:00100000:1.0:1787830996.318997:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2336bfe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+16:11366:x1874676433350528:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787830996.319085:0:8620:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787830996.319124:0:8620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6400/0x95459fb9d1d29202 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423ef6 expref: 16 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830996.319170:0:8620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8d2309e00800) 00010000:00010000:1.0:1787830996.319176:0:8620:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787830996.319216:0:8620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7a00/0x95459fb9d1d29225 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830996.319232:0:8620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7a00/0x95459fb9d1d29225 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830996.319243:0:8620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7a00/0x95459fb9d1d29225 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787830996.319417:0:8620:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d0b1b10e reply state 000000003726f73a transno 4294967403 ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7a00/0x95459fb9d1d29225 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830996.319430:0:8620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7a00/0x95459fb9d1d29225 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830996.319437:0:8620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8d2309e00800) 00010000:00010000:1.0:1787830996.319440:0:8620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787830996.319444:0:8620:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787830996.319582:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2336bfe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+17:11366:x1874676433350528:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 Request processed in 587us (789us total) trans 4294967403 rc 0/0 00000100:00100000:1.0:1787830996.319589:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 136 00000100:00100000:2.0:1787830996.325548:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787830996.325906:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433350656 00000100:00100000:0.0:1787830996.325919:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433350656 00000100:00100000:0.0:1787830996.325991:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 52 00000100:00100000:0.0:1787830996.326003:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2336bfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+6:2395:x1874676433350656:12345-192.168.203.31@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1787830996.326209:0:8406:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1787830996.326213:0:8406:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 1787830996 -> 1787830996 00002000:00010000:0.0:1787830996.326216:0:8406:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1787830995 00002000:00010000:0.0:1787830996.326218:0:8406:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 1787830996 -> 1787830996 00002000:00010000:0.0:1787830996.326220:0:8406:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1787830996.326298:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2336bfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+7:2395:x1874676433350656:12345-192.168.203.31@tcp:2:lhsmtool_posix.0 Request processed in 297us (763us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1787830996.326306:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 52 00000100:00100000:0.0:1787830996.330478:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787830996.331399:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433350912 00000100:00100000:2.0:1787830996.331413:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433350912 00000100:00100000:2.0:1787830996.331488:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 137 00000100:00100000:2.0:1787830996.331499:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a22940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+17:11366:x1874676433350912:12345-192.168.203.31@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1787830996.331854:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1c00/0x95459fb9d1d2922c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830996.331883:0:6490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2e00/0x95459fb9d1d291e6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423ee8 expref: 17 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830996.331895:0:6490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1c00/0x95459fb9d1d2922c lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830996.331939:0:6490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2e00/0x95459fb9d1d291e6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423ee8 expref: 17 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830996.331957:0:6490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2e00/0x95459fb9d1d291e6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423ee8 expref: 17 pid: 6492 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830996.331971:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2336bff480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6490:1874676443887744:192.168.203.31@tcp:104: 00000100:00100000:2.0:1787830996.332089:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d233be68480 going to sleep for 11 seconds 00000100:00100000:2.0:1787830996.335037:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787830996.335092:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2336bff480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6490:1874676443887744:192.168.203.31@tcp:104: 00010000:00010000:0.0:1787830996.335128:0:6490:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1c00/0x95459fb9d1d2922c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830996.335608:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433351040 00000100:00100000:1.0:1787830996.335617:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433351040 00010000:00010000:1.0:1787830996.335705:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2e00/0x95459fb9d1d291e6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423ee8 expref: 18 pid: 6492 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830996.335747:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 75 00000100:00100000:1.0:1787830996.335896:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220394f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+18:2396:x1874676433351040:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787830996.335915:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787830996.335923:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2e00/0x95459fb9d1d291e6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423ee8 expref: 18 pid: 6492 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830996.335935:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2e00/0x95459fb9d1d291e6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423ee8 expref: 18 pid: 6492 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830996.335962:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2e00/0x95459fb9d1d291e6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423ee8 expref: 18 pid: 6492 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830996.335982:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8d2309e00800) 00010000:00010000:1.0:1787830996.335987:0:6476:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1c00/0x95459fb9d1d2922c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830996.335999:0:6476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1c00/0x95459fb9d1d2922c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830996.336008:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1c00/0x95459fb9d1d2922c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830996.336039:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787830996.336114:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220394f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+17:2396:x1874676433351040:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 221us (1090us total) trans 0 rc 0/0 00010000:00010000:0.0:1787830996.336618:0:6490:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1c00/0x95459fb9d1d2922c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830996.336650:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1c00/0x95459fb9d1d2922c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830996.336720:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1c00/0x95459fb9d1d2922c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830996.336728:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1c00/0x95459fb9d1d2922c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830996.336735:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1c00/0x95459fb9d1d2922c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830996.336742:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22039c1c00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:0.0:1787830996.336747:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1c00/0x95459fb9d1d2922c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830996.336755:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1c00/0x95459fb9d1d2922c lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830996.336840:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8d2309e00800) 00010000:00010000:0.0:1787830996.336843:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787830996.336848:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1c00/0x95459fb9d1d2922c lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830996.336855:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1c00/0x95459fb9d1d2922c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830996.336922:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a22940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+17:11366:x1874676433350912:12345-192.168.203.31@tcp:55:lhsmtool_posix.0 Request processed in 5424us (6457us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787830996.337392:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 75 00000100:00100000:0.0:1787830996.337435:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 137 00000100:00100000:2.0:1787830996.340591:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787830996.340666:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433351168 00000100:00100000:3.0:1787830996.340679:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433351168 00000100:00100000:3.0:1787830996.340840:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 53 00000100:00100000:3.0:1787830996.340852:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22037921c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+7:2396:x1874676433351168:12345-192.168.203.31@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787830996.340919:0:8408:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b20c1294/0x95459fb9d1d29233 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830996.340944:0:8408:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003acf69f2/0x95459fb9d1d29210 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f04 expref: 7 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830996.340965:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787830996.340971:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787830996.340985:0:8408:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b20c1294/0x95459fb9d1d29233 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830996.341042:0:8408:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003acf69f2/0x95459fb9d1d29210 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f04 expref: 7 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830996.341059:0:8408:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003acf69f2/0x95459fb9d1d29210 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f04 expref: 7 pid: 8406 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830996.341101:0:8408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203afde00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8408:1874676443887872:192.168.203.31@tcp:104: 00000100:00100000:3.0:1787830996.341207:0:8408:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d22028529c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787830996.346903:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787830996.347050:0:8408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203afde00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8408:1874676443887872:192.168.203.31@tcp:104: 00010000:00010000:3.0:1787830996.347083:0:8408:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b20c1294/0x95459fb9d1d29233 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830996.348725:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433351296 00000100:00100000:1.0:1787830996.348741:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433351296 00010000:00010000:1.0:1787830996.349689:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003acf69f2/0x95459fb9d1d29210 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f04 expref: 8 pid: 8406 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830996.349783:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 76 00000100:00100000:1.0:1787830996.350349:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d232f6cbc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+8:2397:x1874676433351296:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787830996.350376:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787830996.350407:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003acf69f2/0x95459fb9d1d29210 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f04 expref: 8 pid: 8406 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830996.350425:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003acf69f2/0x95459fb9d1d29210 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f04 expref: 8 pid: 8406 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830996.350757:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003acf69f2/0x95459fb9d1d29210 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f04 expref: 8 pid: 8406 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830996.350843:0:6475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787830996.350849:0:6475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787830996.350856:0:6475:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b20c1294/0x95459fb9d1d29233 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830996.350869:0:6475:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b20c1294/0x95459fb9d1d29233 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830996.350979:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787830996.351062:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d232f6cbc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+7:2397:x1874676433351296:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 1268us (4172us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830996.351072:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 76 00010000:00010000:3.0:1787830996.354359:0:8408:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b20c1294/0x95459fb9d1d29233 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830996.354392:0:8408:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b20c1294/0x95459fb9d1d29233 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830996.354434:0:8408:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b20c1294/0x95459fb9d1d29233 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830996.354444:0:8408:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b20c1294/0x95459fb9d1d29233 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830996.354454:0:8408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b20c1294/0x95459fb9d1d29233 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830996.354463:0:8408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2301668800 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:3.0:1787830996.354468:0:8408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b20c1294/0x95459fb9d1d29233 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830996.354572:0:8408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b20c1294/0x95459fb9d1d29233 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830996.354960:0:8408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b20c1294/0x95459fb9d1d29233 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830996.354971:0:8408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b20c1294/0x95459fb9d1d29233 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830996.355174:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22037921c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+6:2396:x1874676433351168:12345-192.168.203.31@tcp:1:lhsmtool_posix.0 Request processed in 14317us (14591us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830996.355188:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 53 00000100:00100000:2.0:1787830996.360108:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787830996.360217:0:13771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433351552 00000100:00100000:1.0:1787830996.360229:0:13771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433351552 00000100:00100000:1.0:1787830996.360341:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 138 00000100:00100000:1.0:1787830996.360354:0:13771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d232f6c8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47d7f0ed-283f-4b70-a741-6e74c5e52619+16:11366:x1874676433351552:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787830996.360471:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6400/0x95459fb9d1d2923a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830996.360490:0:13771:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7000/0x95459fb9d1d29129 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423eb0 expref: 16 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830996.360499:0:13771:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6400/0x95459fb9d1d2923a lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830996.360550:0:13771:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7000/0x95459fb9d1d29129 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423eb0 expref: 16 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830996.360565:0:13771:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7000/0x95459fb9d1d29129 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423eb0 expref: 16 pid: 8620 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830996.360580:0:13771:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203765a40 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13771:1874676443888000:192.168.203.31@tcp:104: 00000100:00100000:1.0:1787830996.360891:0:13771:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d232f727600 going to sleep for 11 seconds 00000100:00100000:2.0:1787830996.363111:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787830996.363224:0:13771:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203765a40 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13771:1874676443888000:192.168.203.31@tcp:104: 00010000:00010000:1.0:1787830996.363259:0:13771:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6400/0x95459fb9d1d2923a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830996.363452:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433351680 00000100:00100000:3.0:1787830996.363462:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433351680 00010000:00010000:3.0:1787830996.363506:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7000/0x95459fb9d1d29129 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423eb0 expref: 17 pid: 8620 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830996.363551:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 77 00000100:00100000:3.0:1787830996.363561:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d232f6c83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+17:2396:x1874676433351680:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787830996.363578:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787830996.363587:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7000/0x95459fb9d1d29129 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423eb0 expref: 17 pid: 8620 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830996.363600:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7000/0x95459fb9d1d29129 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423eb0 expref: 17 pid: 8620 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830996.363685:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7000/0x95459fb9d1d29129 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423eb0 expref: 17 pid: 8620 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830996.363705:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d2318594f00) 00010000:00010000:3.0:1787830996.363712:0:6477:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6e00/0x95459fb9d1d2918b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423ed3 expref: 16 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830996.363723:0:6477:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6400/0x95459fb9d1d2923a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830996.363732:0:6477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6400/0x95459fb9d1d2923a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830996.363741:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6400/0x95459fb9d1d2923a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830996.363771:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787830996.363797:0:13771:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6400/0x95459fb9d1d2923a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830996.363830:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d232f6c83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+16:2396:x1874676433351680:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 270us (729us total) trans 0 rc 0/0 00010000:00010000:0.0:1787830996.363835:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6400/0x95459fb9d1d2923a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830996.363839:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 77 00010000:00010000:0.0:1787830996.364199:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2200/0x95459fb9d1d29241 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830996.364212:0:13771:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1400/0x95459fb9d1d291f4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423eef expref: 16 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830996.364221:0:13771:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2200/0x95459fb9d1d29241 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830996.364253:0:13771:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1400/0x95459fb9d1d291f4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423eef expref: 16 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830996.364269:0:13771:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1400/0x95459fb9d1d291f4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423eef expref: 16 pid: 6490 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830996.364283:0:13771:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a203c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13771:1874676443888128:192.168.203.31@tcp:104: 00000100:00100000:0.0:1787830996.364344:0:13771:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2307c34840 going to sleep for 11 seconds 00000100:00100000:3.0:1787830996.366405:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787830996.366543:0:13771:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a203c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13771:1874676443888128:192.168.203.31@tcp:104: 00010000:00010000:0.0:1787830996.366578:0:13771:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2200/0x95459fb9d1d29241 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830996.366871:0:7432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433351808 00000100:00100000:2.0:1787830996.366888:0:7432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433351808 00010000:00010000:2.0:1787830996.366933:0:7432:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1400/0x95459fb9d1d291f4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423eef expref: 17 pid: 6490 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830996.367026:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 78 00000100:00100000:2.0:1787830996.367037:0:7432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203afde00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+17:2397:x1874676433351808:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787830996.367055:0:7432:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787830996.367064:0:7432:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1400/0x95459fb9d1d291f4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423eef expref: 17 pid: 6490 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830996.367077:0:7432:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1400/0x95459fb9d1d291f4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423eef expref: 17 pid: 6490 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830996.367105:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1400/0x95459fb9d1d291f4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423eef expref: 17 pid: 6490 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830996.367127:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8d2309e00800) 00010000:00010000:2.0:1787830996.367133:0:7432:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2200/0x95459fb9d1d29241 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830996.367142:0:7432:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2200/0x95459fb9d1d29241 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830996.367173:0:7432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2200/0x95459fb9d1d29241 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830996.368015:0:7432:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787830996.368084:0:7432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203afde00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+16:2397:x1874676433351808:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 1045us (1686us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830996.368094:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 78 00010000:00010000:1.0:1787830996.368176:0:13771:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2200/0x95459fb9d1d29241 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830996.368186:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2200/0x95459fb9d1d29241 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787830996.368328:0:13771:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:1.0:1787830996.368449:0:13771:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:1.0:1787830996.368475:0:13771:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:1.0:1787830996.368546:0:13771:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203765a40 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:13771:1874676443888256:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1787830996.368593:0:13771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830996.368647:0:13771:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d22027139c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787830996.368734:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443888256 00000100:00100000:2.0:1787830996.368741:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443888256 00000100:00100000:2.0:1787830996.368803:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1787830996.368812:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203766d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:13771:x1874676443888256:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1787830996.369093:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203766d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:13771:x1874676443888256:12345-0@lo:1000:mdt00_004.0 Request processed in 282us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830996.369100:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1787830996.369181:0:13771:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203765a40 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:13771:1874676443888256:0@lo:1000:mdt00_004.0 00000001:00080000:0.0:1787830996.369505:0:13771:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:0.0:1787830996.369561:0:13771:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a203c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:13771:1874676443888384:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1787830996.369597:0:13771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830996.369743:0:13771:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d23100e0600 going to sleep for 11 seconds 00000100:00100000:3.0:1787830996.370476:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443888384 00000100:00100000:3.0:1787830996.370484:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443888384 00000100:00100000:2.0:1787830996.370727:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1787830996.370737:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:13771:x1874676443888384:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1787830996.371752:0:13771:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a203c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:13771:1874676443888384:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1787830996.371840:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:13771:x1874676443888384:12345-0@lo:1000:mdt00_004.0 Request processed in 890us (2027us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1787830996.371850:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00010000:00010000:0.0:1787830996.372086:0:13771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2200/0x95459fb9d1d29241 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830996.372099:0:13771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2200/0x95459fb9d1d29241 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830996.372108:0:13771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2200/0x95459fb9d1d29241 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830996.372115:0:13771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2303aa2200 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:0.0:1787830996.372121:0:13771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2200/0x95459fb9d1d29241 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830996.372129:0:13771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2200/0x95459fb9d1d29241 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830996.372148:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8d2309e00800) 00010000:00010000:0.0:1787830996.372152:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787830996.372158:0:13771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2200/0x95459fb9d1d29241 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830996.372166:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2200/0x95459fb9d1d29241 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830996.372196:0:13771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d29184 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830996.372222:0:13771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d29184 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830996.372228:0:13771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d29184 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830996.372234:0:13771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22039c0a00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:0.0:1787830996.372238:0:13771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d29184 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830996.372244:0:13771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d29184 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830996.372253:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d2318594f00) 00010000:00010000:0.0:1787830996.372256:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787830996.372265:0:13771:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6e00/0x95459fb9d1d2918b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423ed3 expref: 19 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830996.372278:0:13771:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6e00/0x95459fb9d1d2918b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423ed3 expref: 19 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830996.372288:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6e00/0x95459fb9d1d2918b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423ed3 expref: 19 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830996.372464:0:13771:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6e00/0x95459fb9d1d2918b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423ed3 expref: 19 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830996.372481:0:13771:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a21a40 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13771:1874676443888512:192.168.203.31@tcp:105: 00000100:00100000:0.0:1787830996.373753:0:13771:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d23129df240 going to sleep for 11 seconds 00000100:00100000:3.0:1787830996.377400:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787830996.377590:0:13771:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a21a40 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13771:1874676443888512:192.168.203.31@tcp:105: 00000100:00100000:2.0:1787830996.377738:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433351936 00000100:00100000:2.0:1787830996.377746:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433351936 00000100:00100000:2.0:1787830996.377810:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 31 00000100:00100000:2.0:1787830996.377820:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22039b83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+20:11365:x1874676433351936:12345-192.168.203.31@tcp:49:lfs.0 00010000:00010000:0.0:1787830996.378839:0:13771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d29184 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830996.378855:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d29184 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830996.378909:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2200/0x95459fb9d1d29248 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830996.378928:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2200/0x95459fb9d1d29248 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830996.378942:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2200/0x95459fb9d1d29248 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830996.378954:0:13771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2200/0x95459fb9d1d29248 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830996.378961:0:13771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2200/0x95459fb9d1d29248 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830996.378968:0:13771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2200/0x95459fb9d1d29248 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830996.378974:0:13771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2303aa2200 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:0.0:1787830996.379074:0:13771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2200/0x95459fb9d1d29248 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830996.379085:0:13771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2200/0x95459fb9d1d29248 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830996.379128:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d2318594f00) 00010000:00010000:0.0:1787830996.379131:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787830996.379137:0:13771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2200/0x95459fb9d1d29248 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830996.379143:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2200/0x95459fb9d1d29248 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830996.379153:0:13771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6400/0x95459fb9d1d2923a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830996.379158:0:13771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6400/0x95459fb9d1d2923a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830996.379164:0:13771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6400/0x95459fb9d1d2923a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830996.379170:0:13771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d23344b6400 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:0.0:1787830996.379172:0:13771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6400/0x95459fb9d1d2923a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830996.379179:0:13771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6400/0x95459fb9d1d2923a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830996.379187:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d2318594f00) 00010000:00010000:0.0:1787830996.379190:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787830996.379197:0:13771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6400/0x95459fb9d1d2923a lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830996.379204:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6400/0x95459fb9d1d2923a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830996.379484:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22039b83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+20:11365:x1874676433351936:12345-192.168.203.31@tcp:49:lfs.0 Request processed in 1659us (2091us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830996.379496:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 31 00000100:00100000:0.0:1787830996.380152:0:13771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d232f6c8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47d7f0ed-283f-4b70-a741-6e74c5e52619+19:11366:x1874676433351552:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 Request processed in 19799us (20056us total) trans 4294967408 rc 0/0 00000100:00100000:0.0:1787830996.380162:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 138 00000020:00080000:0.0:1787830996.380167:0:13771:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1787830996.381254:0:13758:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787830996.381263:0:13758:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:3.0:1787830996.384408:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787830996.384614:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433352192 00000100:00100000:0.0:1787830996.384655:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433352192 00000100:00100000:0.0:1787830996.384724:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 139 00000100:00100000:0.0:1787830996.384735:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203b6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+19:11365:x1874676433352192:12345-192.168.203.31@tcp:58:lfs.0 00000040:00080000:0.0:1787830996.384981:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:0.0:1787830996.385081:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203b6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+19:11365:x1874676433352192:12345-192.168.203.31@tcp:58:lfs.0 Request processed in 348us (696us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830996.385090:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 139 00000100:00100000:3.0:1787830996.387297:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787830996.387526:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433352448 00000100:00100000:2.0:1787830996.387536:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433352448 00000100:00100000:2.0:1787830996.387602:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 32 00000100:00100000:2.0:1787830996.387613:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d23066c9450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+19:11366:x1874676433352448:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787830996.388150:0:6493:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787830996.388192:0:6493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967409 00010000:00010000:2.0:1787830996.388233:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1400/0x95459fb9d1d2924f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830996.388254:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1400/0x95459fb9d1d2924f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830996.388268:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1400/0x95459fb9d1d2924f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830996.388278:0:6493:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1400/0x95459fb9d1d2924f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830996.388285:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1400/0x95459fb9d1d2924f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830996.388292:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1400/0x95459fb9d1d2924f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830996.388317:0:6493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787830996.388712:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787830996.388722:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1400/0x95459fb9d1d2924f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830996.388730:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22039c1400 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:0.0:1787830996.388735:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1400/0x95459fb9d1d2924f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830996.388744:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1400/0x95459fb9d1d2924f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830996.388773:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8d2309e00800) 00010000:00010000:0.0:1787830996.388777:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787830996.388782:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1400/0x95459fb9d1d2924f lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830996.388806:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1400/0x95459fb9d1d2924f lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830996.388820:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830996.388822:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830996.388824:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787830996.390903:0:13758:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1787830996.390928:0:13758:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787830996.391848:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d23066c9450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+21:11366:x1874676433352448:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 Request processed in 829us (1153us total) trans 4294967410 rc 0/0 00000100:00100000:2.0:1787830996.391864:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 32 00000020:00080000:2.0:1787830996.391882:0:6493:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787830996.403789:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787830996.404288:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433352576 00000100:00100000:0.0:1787830996.404302:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433352576 00000100:00100000:0.0:1787830996.404383:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 140 00000100:00100000:0.0:1787830996.404407:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a9de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+21:11368:x1874676433352576:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:0.0:1787830996.404456:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787830996.404486:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2200/0x95459fb9d1d29256 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99423f0b expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830996.404565:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2a00/0x95459fb9d1d2925d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830996.404583:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2a00/0x95459fb9d1d2925d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830996.404596:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2a00/0x95459fb9d1d2925d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830996.404613:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2400/0x95459fb9d1d29264 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830996.404620:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2400/0x95459fb9d1d29264 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830996.404667:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2400/0x95459fb9d1d29264 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830996.404786:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2c00/0x95459fb9d1d2926b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830996.404798:0:6490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1600/0x95459fb9d1d29176 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423ecc expref: 22 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830996.404808:0:6490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2c00/0x95459fb9d1d2926b lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830996.404851:0:6490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1600/0x95459fb9d1d29176 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423ecc expref: 22 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830996.404866:0:6490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1600/0x95459fb9d1d29176 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423ecc expref: 22 pid: 6490 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830996.404899:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a21a40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6490:1874676443888640:192.168.203.31@tcp:104: 00000100:00100000:0.0:1787830996.405015:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d23129df240 going to sleep for 11 seconds 00000100:00100000:3.0:1787830996.408083:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787830996.408131:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a21a40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6490:1874676443888640:192.168.203.31@tcp:104: 00010000:00010000:0.0:1787830996.408173:0:6490:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2c00/0x95459fb9d1d2926b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830996.408213:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433352832 00000100:00100000:2.0:1787830996.408222:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433352832 00000100:00100000:2.0:1787830996.408294:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 33 00000100:00100000:2.0:1787830996.408305:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+23:6626:x1874676433352832:12345-192.168.203.31@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787830996.408589:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+24:6626:x1874676433352832:12345-192.168.203.31@tcp:35:ldlm_bl.0 Request processed in 285us (521us total) trans 4294967411 rc 0/0 00000100:00100000:2.0:1787830996.408604:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 33 00000100:00100000:3.0:1787830996.410964:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787830996.411126:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433352960 00000100:00100000:0.0:1787830996.411137:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433352960 00010000:00010000:0.0:1787830996.411184:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1600/0x95459fb9d1d29176 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423ecc expref: 24 pid: 6490 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830996.411262:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 79 00000100:00100000:0.0:1787830996.411288:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2309cf8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+24:2396:x1874676433352960:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787830996.411304:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787830996.411311:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1600/0x95459fb9d1d29176 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423ecc expref: 24 pid: 6490 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830996.411336:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1600/0x95459fb9d1d29176 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423ecc expref: 24 pid: 6490 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830996.411362:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1600/0x95459fb9d1d29176 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423ecc expref: 24 pid: 6490 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830996.411379:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d2318594f00) 00010000:00010000:0.0:1787830996.411385:0:6477:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2c00/0x95459fb9d1d2926b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830996.411396:0:6477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2c00/0x95459fb9d1d2926b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830996.411416:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2c00/0x95459fb9d1d2926b lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830996.411448:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787830996.411505:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2309cf8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+23:2396:x1874676433352960:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 220us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830996.411513:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 79 00010000:00010000:2.0:1787830996.411567:0:6490:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2c00/0x95459fb9d1d2926b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830996.411576:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2c00/0x95459fb9d1d2926b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787830996.411656:0:6490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1787830996.411661:0:6490:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787830996.411683:0:6490:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2c00/0x95459fb9d1d2926b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830996.411697:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2c00/0x95459fb9d1d2926b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830996.411708:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2a00/0x95459fb9d1d2925d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830996.411716:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2a00/0x95459fb9d1d2925d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830996.411723:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2a00/0x95459fb9d1d2925d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830996.411730:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2303aa2a00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:2.0:1787830996.411735:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2a00/0x95459fb9d1d2925d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830996.411743:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2a00/0x95459fb9d1d2925d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830996.411753:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d2203615700) 00010000:00010000:2.0:1787830996.411762:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787830996.411768:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2a00/0x95459fb9d1d2925d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830996.411779:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2a00/0x95459fb9d1d2925d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830996.411792:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2400/0x95459fb9d1d29264 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830996.411799:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2400/0x95459fb9d1d29264 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830996.411806:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2400/0x95459fb9d1d29264 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830996.411811:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2303aa2400 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:2.0:1787830996.411814:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2400/0x95459fb9d1d29264 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830996.411820:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2400/0x95459fb9d1d29264 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830996.411829:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8d2309e00900) 00010000:00010000:2.0:1787830996.411832:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787830996.411834:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2400/0x95459fb9d1d29264 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830996.411841:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2400/0x95459fb9d1d29264 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830996.411896:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2200/0x95459fb9d1d29256 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f0b expref: 23 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830996.411923:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2c00/0x95459fb9d1d2926b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f0b expref: 22 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830996.411931:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d2318594f00) 00010000:00010000:2.0:1787830996.411934:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787830996.411936:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2303aa2c00, rc 0) 00000100:00100000:2.0:1787830996.411974:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a9de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+22:11368:x1874676433352576:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 7571us (8203us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830996.411984:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 140 00000100:00100000:2.0:1787830996.714355:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787830996.714377:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d232f6ca940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1874676443888768:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787830996.715733:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830996.715816:0:11489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443888768 00000100:00100000:2.0:1787830996.715825:0:11489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443888768 00000100:00100000:2.0:1787830996.715893:0:11489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787830996.715903:0:11489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203affc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1874676443888768:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787830996.715926:0:11489:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923529728 avail 3691978752 00000100:00100000:2.0:1787830996.715971:0:11489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203affc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1874676443888768:12345-0@lo:13:osp-pre-1-1.0 Request processed in 70us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830996.715978:0:11489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787830996.716121:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d232f6ca940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1874676443888768:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1787830996.716298:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787830996.717484:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203765e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3621:1874676443889024:0@lo:400:kworker.0 00000100:00100000:1.0:1787830996.717569:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830996.717594:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22038ec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3621:1874676443889536:0@lo:400:kworker.0 00000100:00100000:1.0:1787830996.717615:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830996.717655:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22038ec3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3621:1874676443890048:0@lo:400:kworker.0 00000100:00100000:1.0:1787830996.717676:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830996.717696:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787830996.717702:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2318d57840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443889152:0@lo:400:kworker.0 00000100:00100000:1.0:1787830996.717725:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830996.717741:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22038ee940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3621:1874676443889664:0@lo:400:kworker.0 00000100:00100000:1.0:1787830996.717760:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830996.717788:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443889024 00000100:00100000:1.0:1787830996.717793:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443889024 00000100:00100000:1.0:1787830996.717838:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443889536 00000100:00100000:1.0:1787830996.717841:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443889536 00000100:00100000:1.0:1787830996.717862:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443890048 00000100:00100000:1.0:1787830996.717881:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443890048 00000100:00100000:1.0:1787830996.717897:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443889664 00000100:00100000:1.0:1787830996.717899:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443889664 00000100:00100000:1.0:1787830996.717911:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1787830996.717917:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22038ef840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1874676443889024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830996.717956:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22038ef840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1874676443889024:12345-0@lo:400:kworker.0 Request processed in 39us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830996.717961:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1787830996.717975:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1787830996.717980:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22038ee580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1874676443889536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830996.718005:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22038ee580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1874676443889536:12345-0@lo:400:kworker.0 Request processed in 26us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830996.718011:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1787830996.718022:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1787830996.718028:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22038eed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1874676443890048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830996.718054:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22038eed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1874676443890048:12345-0@lo:400:kworker.0 Request processed in 27us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830996.718060:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1787830996.718070:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1787830996.718076:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22038ed2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1874676443889664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830996.718098:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22038ed2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1874676443889664:12345-0@lo:400:kworker.0 Request processed in 23us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830996.718104:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1787830996.718125:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443889152 00000100:00100000:1.0:1787830996.718128:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443889152 00000100:00100000:1.0:1787830996.718152:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1787830996.718158:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22038ed680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443889152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830996.718197:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22038ed680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443889152:12345-0@lo:400:kworker.0 Request processed in 39us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830996.718203:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00080000:1.0:1787830996.718223:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787830996.718226:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787830996.718252:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2318d57840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443889152:0@lo:400:kworker.0 00010000:00080000:1.0:1787830996.718265:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d22038ee940 x1874676443889664/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787831012 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787830996.718275:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22038ee940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3621:1874676443889664:0@lo:400:kworker.0 00000100:00100000:1.0:1787830996.718285:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203765e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3621:1874676443889024:0@lo:400:kworker.0 00000100:00100000:1.0:1787830996.718293:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22038ec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3621:1874676443889536:0@lo:400:kworker.0 00010000:00080000:1.0:1787830996.718302:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d22038ec3c0 x1874676443890048/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787831012 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787830996.718311:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22038ec3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3621:1874676443890048:0@lo:400:kworker.0 00000100:00100000:0.0:1787830996.718593:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22038ede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874676443889280:0@lo:400:kworker.0 00000100:00100000:0.0:1787830996.718643:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830996.718670:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22038ecb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443889792:0@lo:400:kworker.0 00000100:00100000:0.0:1787830996.718696:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830996.718713:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1787830996.718719:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203765a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a45944b-32e3-4193-a2a5-46f84222bc14:3619:1874676443888896:0@lo:400:kworker.0 00000100:00100000:0.0:1787830996.718743:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830996.718764:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22038eda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443889408:0@lo:400:kworker.0 00000100:00100000:0.0:1787830996.718795:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830996.718814:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22038ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3619:1874676443889920:0@lo:400:kworker.0 00000100:00100000:0.0:1787830996.718847:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830996.718879:0:13771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443889280 00000100:00100000:0.0:1787830996.718883:0:13771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443889280 00000100:00100000:0.0:1787830996.718905:0:13771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443889920 00000100:00100000:0.0:1787830996.718908:0:13771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443889920 00000100:00100000:0.0:1787830996.718926:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1787830996.718931:0:13771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2336bff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874676443889280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787830996.718965:0:13771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2336bff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874676443889280:12345-0@lo:400:kworker.0 Request processed in 35us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830996.718971:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1787830996.718983:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1787830996.718989:0:13771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22039a3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874676443889920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787830996.719013:0:13771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22039a3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874676443889920:12345-0@lo:400:kworker.0 Request processed in 25us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830996.719019:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1787830996.719044:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22038ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3619:1874676443889920:0@lo:400:kworker.0 00000100:00100000:0.0:1787830996.719052:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22038ede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874676443889280:0@lo:400:kworker.0 00000100:00100000:3.0:1787830996.719307:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443888896 00000100:00100000:3.0:1787830996.719311:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443888896 00000100:00100000:3.0:1787830996.719338:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:3.0:1787830996.719345:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233a681850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+24:3619:x1874676443888896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787830996.719382:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233a681850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+24:3619:x1874676443888896:12345-0@lo:400:kworker.0 Request processed in 38us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830996.719388:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:3.0:1787830996.719471:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203765a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a45944b-32e3-4193-a2a5-46f84222bc14:3619:1874676443888896:0@lo:400:kworker.0 00000100:00100000:2.0:1787830996.719884:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443889408 00000100:00100000:2.0:1787830996.719889:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443889408 00000100:00100000:2.0:1787830996.719921:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1787830996.719929:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22039a03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676443889408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787830996.719937:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787830996.719967:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d232f6ca940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443890176:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787830996.719987:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22039a03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676443889408:12345-0@lo:400:kworker.0 Request processed in 57us (1189us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830996.719996:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1787830996.720036:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22038eda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443889408:0@lo:400:kworker.0 00000100:00100000:3.0:1787830996.720050:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830996.720093:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443890176 00000100:00100000:2.0:1787830996.720100:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443890176 00000100:00100000:2.0:1787830996.720135:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787830996.720143:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2309cf8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3621:x1874676443890176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787830996.720161:0:8409:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923529728 avail 3691978752 00000100:00100000:2.0:1787830996.720211:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2309cf8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3621:x1874676443890176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830996.720218:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787830996.720328:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d232f6ca940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443890176:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787830996.720415:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443889792 00000100:00100000:1.0:1787830996.720422:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443889792 00000100:00100000:1.0:1787830996.720471:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787830996.720479:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a792c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443889792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830996.720526:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a792c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443889792:12345-0@lo:400:kworker.0 Request processed in 49us (1828us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830996.720533:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:1.0:1787830996.720559:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787830996.720562:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787830996.721175:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22038ecb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443889792:0@lo:400:kworker.0 00000040:00080000:3.0:1787830996.910011:0:13763:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787830996.966767:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787830997.209510:0:14223:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787830997.209519:0:14223:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787830997.209550:0:14223:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1787830997.209555:0:14223:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1787830997.415237:0:13758:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787830997.415261:0:13758:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787830997.415300:0:13758:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1787830997.415308:0:13758:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787830997.416127:0:13758:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22038ec3c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13758:1874676443890304:192.168.203.31@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787830997.416242:0:13758:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2202713900 going to sleep for 11 seconds 00000100:00100000:3.0:1787830997.422495:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787830997.422746:0:13758:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22038ec3c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13758:1874676443890304:192.168.203.31@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787830997.422959:0:13771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433353088 00000100:00100000:0.0:1787830997.422965:0:13771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433353088 00000100:00100000:0.0:1787830997.423021:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 141 00000100:00100000:0.0:1787830997.423030:0:13771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22037d9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47d7f0ed-283f-4b70-a741-6e74c5e52619+22:11380:x1874676433353088:12345-192.168.203.31@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787830997.423062:0:13771:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787830997.423310:0:13771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22037d9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47d7f0ed-283f-4b70-a741-6e74c5e52619+22:11380:x1874676433353088:12345-192.168.203.31@tcp:53:lhsmtool_posix.0 Request processed in 280us (822us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830997.423319:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 141 00000100:00100000:3.0:1787830997.426670:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787830997.426926:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433353344 00000100:00100000:1.0:1787830997.426935:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433353344 00000100:00100000:1.0:1787830997.427049:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 142 00000100:00100000:1.0:1787830997.427059:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22037d92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+22:11380:x1874676433353344:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787830997.427079:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787830997.427100:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7c00/0x95459fb9d1d29272 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99423f12 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830997.427194:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6a00/0x95459fb9d1d29279 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830997.427207:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6a00/0x95459fb9d1d29279 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830997.427220:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6a00/0x95459fb9d1d29279 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787830997.427231:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:1.0:1787830997.427340:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7c00/0x95459fb9d1d29272 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f12 expref: 25 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830997.427358:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6a00/0x95459fb9d1d29279 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f12 expref: 24 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830997.427390:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d2318594f00) 00010000:00010000:1.0:1787830997.427393:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787830997.427396:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d23344b6a00, rc 0) 00000100:00100000:1.0:1787830997.427447:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22037d92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+24:11380:x1874676433353344:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 390us (784us total) trans 4294967412 rc 0/0 00000100:00100000:1.0:1787830997.427454:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 142 00000100:00100000:3.0:1787830997.432061:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787830997.432104:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787830997.432179:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433353472 00000100:00100000:1.0:1787830997.432188:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433353472 00000100:00100000:1.0:1787830997.432252:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 10 00000100:00100000:1.0:1787830997.432261:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2321e75c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+24:2397:x1874676433353472:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787830997.432277:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787830997.432300:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6a00/0x95459fb9d1d29279 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f12 expref: 24 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830997.432316:0:6475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d2318594f00) 00010000:00010000:1.0:1787830997.432321:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787830997.432565:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2321e75c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+23:2397:x1874676433353472:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 303us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830997.432573:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 10 00000100:00100000:2.0:1787830997.432750:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433353728 00000100:00100000:2.0:1787830997.432766:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433353728 00000100:00100000:2.0:1787830997.432802:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 143 00000100:00100000:2.0:1787830997.432809:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22037d8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+23:11380:x1874676433353728:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787830997.432937:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0800/0x95459fb9d1d29287 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830997.432951:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0800/0x95459fb9d1d29287 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830997.432962:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0800/0x95459fb9d1d29287 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830997.433106:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0800/0x95459fb9d1d29287 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830997.433114:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0800/0x95459fb9d1d29287 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830997.433121:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0800/0x95459fb9d1d29287 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830997.433127:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22039c0800 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:2.0:1787830997.433131:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0800/0x95459fb9d1d29287 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830997.433139:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0800/0x95459fb9d1d29287 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830997.433148:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d2318594f00) 00010000:00010000:2.0:1787830997.433151:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787830997.433155:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0800/0x95459fb9d1d29287 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830997.433161:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0800/0x95459fb9d1d29287 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830997.433239:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22037d8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+24:11380:x1874676433353728:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 Request processed in 429us (1133us total) trans 4294967413 rc 0/0 00000100:00100000:2.0:1787830997.433246:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 143 00000040:00080000:1.0:1787830997.433456:0:13758:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787830997.433461:0:13758:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787830997.434111:0:13758:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1787830997.434121:0:13758:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787830997.438514:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787830997.438580:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433353984 00000100:00100000:2.0:1787830997.438589:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433353984 00000100:00100000:2.0:1787830997.439366:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 34 00000100:00100000:2.0:1787830997.439390:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22037db0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+24:11380:x1874676433353984:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787830997.439612:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22037db0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+25:11380:x1874676433353984:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 Request processed in 224us (1107us total) trans 4294967414 rc 0/0 00000100:00100000:2.0:1787830997.439619:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 34 00000001:00080000:3.0:1787830997.738337:0:8401:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:3.0:1787830997.738364:0:8401:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00010000:00010000:1.0:1787830997.991040:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787830998.096167:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787830998.096224:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787830998.096285:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787830998.096325:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787830998.096345:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787830998.096463:0:13771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433354368 00000100:00100000:0.0:1787830998.096476:0:13771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433354368 00000100:00100000:0.0:1787830998.096552:0:13771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433354880 00000100:00100000:0.0:1787830998.096555:0:13771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433354880 00000100:00100000:0.0:1787830998.096572:0:13771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433354240 00000100:00100000:0.0:1787830998.096574:0:13771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433354240 00000100:00100000:0.0:1787830998.096596:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 212 00000100:00100000:0.0:1787830998.096606:0:13771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22037da1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:2396:x1874676433354368:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1787830998.096733:0:13771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22037da1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:2396:x1874676433354368:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 128us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830998.096741:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 212 00000100:00100000:0.0:1787830998.096761:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 213 00000100:00100000:0.0:1787830998.096767:0:13771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22037d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c901c2b2-479b-44dc-8fa8-34fbacf02f07+5:2396:x1874676433354880:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1787830998.096790:0:13771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22037d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c901c2b2-479b-44dc-8fa8-34fbacf02f07+5:2396:x1874676433354880:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 24us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830998.096796:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 213 00000100:00100000:0.0:1787830998.096806:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 214 00000100:00100000:0.0:1787830998.096812:0:13771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22037d9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47d7f0ed-283f-4b70-a741-6e74c5e52619+25:2396:x1874676433354240:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1787830998.096849:0:13771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22037d9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47d7f0ed-283f-4b70-a741-6e74c5e52619+25:2396:x1874676433354240:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 37us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830998.096855:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 214 00000100:00100000:3.0:1787830998.097143:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787830998.097189:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787830998.097275:0:8631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433354624 00000100:00100000:2.0:1787830998.097279:0:8631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433354624 00000100:00100000:2.0:1787830998.097319:0:8631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433354496 00000100:00100000:2.0:1787830998.097322:0:8631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433354496 00000100:00100000:2.0:1787830998.097349:0:8631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 79 00000100:00100000:2.0:1787830998.097357:0:8631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22037dbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+6:2396:x1874676433354624:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1787830998.097411:0:8631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22037dbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+6:2396:x1874676433354624:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 56us (1126us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830998.097418:0:8631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 79 00000100:00100000:2.0:1787830998.097434:0:8631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 80 00000100:00100000:2.0:1787830998.097440:0:8631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22037d9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:2396:x1874676433354496:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1787830998.097465:0:8631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22037d9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:2396:x1874676433354496:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 25us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830998.097471:0:8631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 80 00000100:00100000:2.0:1787830998.097492:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433354752 00000100:00100000:2.0:1787830998.097495:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433354752 00000100:00100000:2.0:1787830998.097536:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 215 00000100:00100000:2.0:1787830998.097543:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22037d8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c901c2b2-479b-44dc-8fa8-34fbacf02f07+5:2396:x1874676433354752:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1787830998.097569:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22037d8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c901c2b2-479b-44dc-8fa8-34fbacf02f07+5:2396:x1874676433354752:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 26us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830998.097574:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 215 00000100:00100000:1.0:1787830998.098395:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433354112 00000100:00100000:1.0:1787830998.098412:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433354112 00000100:00100000:1.0:1787830998.098461:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 363 00000100:00100000:1.0:1787830998.098470:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d231859cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+13:2396:x1874676433354112:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1787830998.098657:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d231859cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+13:2396:x1874676433354112:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 155us (2473us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830998.098666:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 363 00000100:00080000:1.0:1787830998.098702:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787830998.098707:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787830998.098710:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787830998.098713:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000040:00080000:2.0:1787830998.950167:0:14274:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787830998.950176:0:14274:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787830998.950206:0:14274:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1787830998.950213:0:14274:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787830999.016174:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787830999.122192:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787830999.122280:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433355136 00000100:00100000:0.0:1787830999.122290:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433355136 00000100:00100000:0.0:1787830999.122457:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 144 00000100:00100000:0.0:1787830999.122468:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22037da940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+25:11400:x1874676433355136:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:0.0:1787830999.122487:0:8620:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787830999.122506:0:8620:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2800/0x95459fb9d1d2928e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99423f19 expref: -99 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830999.122608:0:8620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3400/0x95459fb9d1d29295 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830999.122664:0:8620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3400/0x95459fb9d1d29295 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830999.122677:0:8620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3400/0x95459fb9d1d29295 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787830999.122689:0:8620:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1787830999.122788:0:8620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2800/0x95459fb9d1d2928e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f19 expref: 28 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830999.122805:0:8620:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3400/0x95459fb9d1d29295 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f19 expref: 27 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830999.122814:0:8620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d2318594f00) 00010000:00010000:0.0:1787830999.122829:0:8620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787830999.122832:0:8620:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2303aa3400, rc 0) 00000100:00100000:0.0:1787830999.122908:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22037da940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+27:11400:x1874676433355136:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 442us (726us total) trans 4294967415 rc 0/0 00000100:00100000:0.0:1787830999.122916:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 144 00000100:00100000:2.0:1787830999.125223:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787830999.125408:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433355264 00000100:00100000:0.0:1787830999.125416:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433355264 00000100:00100000:0.0:1787830999.125475:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 145 00000100:00100000:0.0:1787830999.125484:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d232f6cbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+27:11400:x1874676433355264:12345-192.168.203.31@tcp:54:lfs.0 00010000:00010000:0.0:1787830999.125750:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2600/0x95459fb9d1d292a3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830999.125767:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2600/0x95459fb9d1d292a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830999.125778:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2600/0x95459fb9d1d292a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830999.125953:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2600/0x95459fb9d1d292a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830999.125962:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2600/0x95459fb9d1d292a3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830999.125970:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2600/0x95459fb9d1d292a3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830999.125976:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2303aa2600 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:0.0:1787830999.125980:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2600/0x95459fb9d1d292a3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830999.126005:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2600/0x95459fb9d1d292a3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830999.126017:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d2318594f00) 00010000:00010000:0.0:1787830999.126021:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787830999.126025:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2600/0x95459fb9d1d292a3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830999.126032:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2600/0x95459fb9d1d292a3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830999.126349:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d232f6cbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+27:11400:x1874676433355264:12345-192.168.203.31@tcp:54:lfs.0 Request processed in 864us (1132us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830999.126358:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 145 00000100:00100000:1.0:1787830999.219747:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787830999.219851:0:8631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433355392 00000100:00100000:2.0:1787830999.219872:0:8631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433355392 00000100:00100000:2.0:1787830999.219948:0:8631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 54 00000100:00100000:2.0:1787830999.219958:0:8631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22038ec780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+6:2397:x1874676433355392:12345-192.168.203.31@tcp:101:cat.0 00010000:00010000:2.0:1787830999.219976:0:8631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787830999.219996:0:8631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cb7b975b/0x95459fb9d1d292aa lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99423f20 expref: -99 pid: 8631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787830999.220022:0:8631:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a9022d4, atime: 0x6a9022d3, ctime: 0x6a9022d4, blocks: 0x8 00010000:00010000:2.0:1787830999.220040:0:8631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=290s v=(0 0) 00010000:00010000:2.0:1787830999.220045:0:8631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787830999.220056:0:8631:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cb7b975b/0x95459fb9d1d292aa lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f20 expref: 7 pid: 8631 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830999.220075:0:8631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cb7b975b/0x95459fb9d1d292aa lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f20 expref: 7 pid: 8631 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830999.220089:0:8631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22039c1c00, rc 0) 00000100:00100000:2.0:1787830999.220155:0:8631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22038ec780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+7:2397:x1874676433355392:12345-192.168.203.31@tcp:101:cat.0 Request processed in 199us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830999.220172:0:8631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 54 00000100:00100000:3.0:1787830999.224765:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787830999.224882:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433355520 00000100:00100000:0.0:1787830999.224892:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433355520 00002000:00100000:0.0:1787830999.224949:0:8413:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->4095) req@ffff8d22037d8b40 x1874676433355520/t0(0) o3->47d7f0ed-283f-4b70-a741-6e74c5e52619@192.168.203.31@tcp:70/0 lens 488/0 e 0 to 0 dl 1787831010 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787830999.224960:0:8413:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d22037d8b40 with x1874676433355520 ext(0->4095) 00002000:00010000:0.0:1787830999.224966:0:8413:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d22037d8b40 00000100:00100000:0.0:1787830999.225002:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 3 00000100:00100000:0.0:1787830999.225013:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22037d8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+7:2394:x1874676433355520:12345-192.168.203.31@tcp:3:cat.0 00000100:00100000:0.0:1787830999.225278:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22037d8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+7:2394:x1874676433355520:12345-192.168.203.31@tcp:3:cat.0 Request processed in 266us (522us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787830999.225291:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 3 00002000:00100000:0.0:1787830999.225298:0:8413:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->4095) req@ffff8d22037d8b40 x1874676433355520/t0(0) o3->47d7f0ed-283f-4b70-a741-6e74c5e52619@192.168.203.31@tcp:70/0 lens 488/4536 e 0 to 0 dl 1787831010 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787830999.225320:0:8413:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d22037d8b40 with x1874676433355520 ext(0->4095) 00002000:00010000:0.0:1787830999.225323:0:8413:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d22037d8b40 00000100:00100000:0.0:1787830999.784105:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787830999.784129:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22037db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1874676443890432:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787830999.784198:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830999.784424:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787830999.784459:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22037d83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443890560:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787830999.784493:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830999.784694:0:11489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443890432 00000100:00100000:3.0:1787830999.784703:0:11489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443890432 00000100:00100000:3.0:1787830999.784769:0:11489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443890560 00000100:00100000:3.0:1787830999.784772:0:11489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443890560 00000100:00100000:3.0:1787830999.784791:0:11489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787830999.784800:0:11489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22039a2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1874676443890432:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787830999.784827:0:11489:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787830999.784882:0:11489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22039a2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1874676443890432:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (684us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830999.784889:0:11489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787830999.784909:0:11489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787830999.784915:0:11489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d232f6c83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676443890560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787830999.784923:0:11489:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787830999.784949:0:11489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d232f6c83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676443890560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 35us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830999.784955:0:11489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:2.0:1787830999.785023:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787830999.785049:0:3619:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:2.0:1787830999.785056:0:3619:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967305 00000004:00080000:2.0:1787830999.785075:0:3619:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d2203634000, transno 4294967302 00000004:00080000:2.0:1787830999.785091:0:3619:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967305 00000004:00080000:2.0:1787830999.785102:0:3619:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d2336bfc3c0, transno 4294967305 00000100:00100000:2.0:1787830999.785113:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22037d83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443890560:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787830999.785349:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22037db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1874676443890432:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1787831000.039363:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787831000.296980:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787831000.297002:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22038ee940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676443890688:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787831000.297124:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831000.297166:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443890688 00000100:00100000:1.0:1787831000.297174:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443890688 00000100:00100000:1.0:1787831000.297218:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1787831000.297224:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22039a2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1874676443890688:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787831000.297250:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787831000.297292:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22039a2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1874676443890688:12345-0@lo:41:osp-pre-1-0.0 Request processed in 69us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831000.297297:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1787831000.297613:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22038ee940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676443890688:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787831000.807163:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22038ecf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676443890816:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787831000.807242:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831000.807432:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443890816 00000100:00100000:2.0:1787831000.807441:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443890816 00000100:00100000:2.0:1787831000.807500:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1787831000.807510:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22039a1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676443890816:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787831000.807546:0:7448:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:1.0:1787831000.807685:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22038ecf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676443890816:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787831000.807987:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22039a1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676443890816:12345-0@lo:41:osp-pre-0-1.0 Request processed in 478us (744us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831000.807995:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00010000:00010000:1.0:1787831001.068791:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787831001.831936:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787831001.831958:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d232f6ca940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1874676443890944:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787831001.832094:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831001.832222:0:11489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443890944 00000100:00100000:0.0:1787831001.832230:0:11489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443890944 00000100:00100000:0.0:1787831001.832281:0:11489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787831001.832290:0:11489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22039a0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1874676443890944:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787831001.832317:0:11489:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1787831001.832361:0:11489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22039a0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1874676443890944:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831001.832368:0:11489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:0.0:1787831001.832595:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787831001.832665:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d232f6ca940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1874676443890944:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787831001.837136:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787831001.837159:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d232f6ca940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443891072:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787831001.837224:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831001.837289:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443891072 00000100:00100000:2.0:1787831001.837297:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443891072 00000100:00100000:2.0:1787831001.837347:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787831001.837357:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203994b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3619:x1874676443891072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787831001.837376:0:8410:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1787831001.837421:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203994b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3619:x1874676443891072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831001.837438:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787831001.837486:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d232f6ca940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443891072:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1787831001.837794:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787831001.838122:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787831001.838133:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22039a30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a45944b-32e3-4193-a2a5-46f84222bc14:3622:1874676443891200:0@lo:400:kworker.0 00000100:00100000:0.0:1787831001.838172:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831001.838207:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443891200 00000100:00100000:0.0:1787831001.838212:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443891200 00000100:00100000:0.0:1787831001.838281:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:0.0:1787831001.838288:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d231859ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+24:3622:x1874676443891200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787831001.838326:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d231859ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+24:3622:x1874676443891200:12345-0@lo:400:kworker.0 Request processed in 39us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831001.838333:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:0.0:1787831001.838369:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22039a30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a45944b-32e3-4193-a2a5-46f84222bc14:3622:1874676443891200:0@lo:400:kworker.0 00000100:00100000:0.0:1787831001.838402:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22039a30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3622:1874676443891328:0@lo:400:kworker.0 00000100:00100000:0.0:1787831001.838426:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831001.838455:0:13771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443891328 00000100:00100000:0.0:1787831001.838459:0:13771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443891328 00000100:00100000:0.0:1787831001.838484:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1787831001.838491:0:13771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22039a21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1874676443891328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787831001.838524:0:13771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22039a21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1874676443891328:12345-0@lo:400:kworker.0 Request processed in 34us (97us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831001.838530:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1787831001.838556:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22039a30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3622:1874676443891328:0@lo:400:kworker.0 00000100:00100000:0.0:1787831001.838587:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22039a30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443891456:0@lo:400:kworker.0 00000100:00100000:0.0:1787831001.838649:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831001.838690:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443891456 00000100:00100000:0.0:1787831001.838694:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443891456 00000100:00100000:0.0:1787831001.838720:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1787831001.838727:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22039a3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443891456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787831001.838762:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22039a3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443891456:12345-0@lo:400:kworker.0 Request processed in 35us (112us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831001.838768:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1787831001.838794:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22039a30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443891456:0@lo:400:kworker.0 00000100:00100000:0.0:1787831001.839015:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22039a30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3620:1874676443891584:0@lo:400:kworker.0 00000100:00100000:0.0:1787831001.839044:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831001.839132:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22039a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443891712:0@lo:400:kworker.0 00000100:00100000:0.0:1787831001.839156:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831001.839184:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443891712 00000100:00100000:0.0:1787831001.839188:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443891712 00000100:00100000:0.0:1787831001.839210:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1787831001.839216:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22039a1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1874676443891712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787831001.839251:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22039a1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1874676443891712:12345-0@lo:400:kworker.0 Request processed in 35us (95us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831001.839257:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1787831001.839281:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22039a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443891712:0@lo:400:kworker.0 00000100:00100000:0.0:1787831001.839312:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22039a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3622:1874676443891840:0@lo:400:kworker.0 00000100:00100000:0.0:1787831001.839335:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831001.840984:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22038efc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443892224:0@lo:400:kworker.0 00000100:00100000:1.0:1787831001.841039:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831001.841103:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787831001.841109:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22038ee940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3621:1874676443892352:0@lo:400:kworker.0 00000100:00100000:3.0:1787831001.841205:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443892224 00000100:00100000:3.0:1787831001.841211:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443892224 00000100:00100000:3.0:1787831001.841270:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787831001.841279:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22038ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1874676443892224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787831001.841391:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22038ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1874676443892224:12345-0@lo:400:kworker.0 Request processed in 113us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831001.841397:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:1.0:1787831001.841798:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1787831001.843145:0:6469:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:1.0:1787831001.843183:0:6469:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d230550d000 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:1.0:1787831001.843188:0:6469:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d230526b300 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d2307c34840 00000020:00080000:1.0:1787831001.843192:0:6469:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d230526b700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d220382fe00 00000020:00080000:1.0:1787831001.843208:0:6469:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00010000:00010000:3.0:1787831001.844048:0:3606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7a00/0x95459fb9d1d29225 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831001.844061:0:3606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7a00/0x95459fb9d1d29225 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831001.844068:0:3606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7a00/0x95459fb9d1d29225 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831001.844074:0:3606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d23344b7a00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:3.0:1787831001.844079:0:3606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7a00/0x95459fb9d1d29225 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831001.844087:0:3606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7a00/0x95459fb9d1d29225 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831001.844103:0:3606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8d2309e00800) 00010000:00010000:3.0:1787831001.844106:0:3606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787831001.844110:0:3606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7a00/0x95459fb9d1d29225 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831001.844117:0:3606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7a00/0x95459fb9d1d29225 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831001.844371:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22038ee1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1874676443892096:0@lo:400:kworker.0 00000100:00100000:0.0:1787831001.844426:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831001.844450:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787831001.844465:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22038ef0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3620:1874676443891968:0@lo:400:kworker.0 00000100:00100000:0.0:1787831001.844491:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831001.844538:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443891584 00000100:00100000:2.0:1787831001.844544:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443891584 00000100:00100000:2.0:1787831001.844585:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443891840 00000100:00100000:2.0:1787831001.844589:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443891840 00000100:00100000:2.0:1787831001.844615:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1787831001.844639:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22039a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1874676443891584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787831001.844701:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22039a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1874676443891584:12345-0@lo:400:kworker.0 Request processed in 80us (5657us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831001.844709:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1787831001.844727:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1787831001.844734:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22039a0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1874676443891840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787831001.844764:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22039a0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1874676443891840:12345-0@lo:400:kworker.0 Request processed in 32us (5429us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831001.844770:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00080000:2.0:1787831001.844888:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00080000:1.0:1787831001.847323:0:6522:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:1.0:1787831001.847402:0:6522:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000001:00080000:1.0:1787831001.848957:0:9484:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967313 is committed 00000001:00080000:1.0:1787831001.848972:0:9484:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000100:00100000:0.0:1787831001.852285:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22038ec3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3620:1874676443892480:0@lo:400:kworker.0 00000100:00100000:0.0:1787831001.852460:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831001.852508:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22039a30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3620:1874676443891584:0@lo:400:kworker.0 00000100:00100000:0.0:1787831001.852546:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443892096 00000100:00100000:0.0:1787831001.852552:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443892096 00000100:00100000:0.0:1787831001.852605:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787831001.852614:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22039a2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1874676443892096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787831001.852643:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443891968 00000100:00100000:1.0:1787831001.852647:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443891968 00000100:00100000:1.0:1787831001.852678:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443892480 00000100:00100000:1.0:1787831001.852681:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443892480 00000100:00100000:0.0:1787831001.852681:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22039a2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1874676443892096:12345-0@lo:400:kworker.0 Request processed in 68us (8254us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831001.852688:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787831001.852701:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1787831001.852707:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22039a0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1874676443891968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787831001.852708:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831001.852736:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22038efc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443892224:0@lo:400:kworker.0 00000100:00100000:1.0:1787831001.852737:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22039a0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1874676443891968:12345-0@lo:400:kworker.0 Request processed in 32us (8246us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831001.852743:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1787831001.852753:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443892352 00000100:00100000:1.0:1787831001.852756:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443892352 00000100:00100000:0.0:1787831001.852761:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1787831001.852766:0:13771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22039a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1874676443892480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787831001.852771:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1787831001.852775:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22039a30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1874676443892352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787831001.852795:0:13771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22039a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1874676443892480:12345-0@lo:400:kworker.0 Request processed in 28us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831001.852800:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22039a30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1874676443892352:12345-0@lo:400:kworker.0 Request processed in 26us (92us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831001.852801:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1787831001.852806:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1787831001.852832:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22039a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3622:1874676443891840:0@lo:400:kworker.0 00000100:00080000:0.0:1787831001.852862:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787831001.852866:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787831001.852868:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787831001.852888:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d22038ef0c0 x1874676443891968/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787831017 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787831001.852923:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22038ef0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3620:1874676443891968:0@lo:400:kworker.0 00010000:00080000:0.0:1787831001.852937:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d22038ec3c0 x1874676443892480/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787831017 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787831001.852946:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22038ec3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3620:1874676443892480:0@lo:400:kworker.0 00000100:00100000:0.0:1787831001.852956:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22038ee1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1874676443892096:0@lo:400:kworker.0 00000100:00100000:0.0:1787831001.852981:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22038ee940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3621:1874676443892352:0@lo:400:kworker.0 00010000:00010000:0.0:1787831002.087154:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787831003.111934:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787831003.222869:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831003.222926:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831003.222963:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831003.222989:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831003.223013:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831003.223035:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831003.223061:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831003.223093:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433356160 00000100:00100000:2.0:1787831003.223102:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433356160 00000100:00100000:2.0:1787831003.223167:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433356032 00000100:00100000:2.0:1787831003.223171:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433356032 00000100:00100000:2.0:1787831003.223195:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 83 00000100:00100000:2.0:1787831003.223204:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220394f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+6:2394:x1874676433356160:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1787831003.223612:0:13771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433355904 00000100:00100000:1.0:1787831003.223618:0:13771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433355904 00000100:00100000:1.0:1787831003.223674:0:13771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433356416 00000100:00100000:1.0:1787831003.223677:0:13771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433356416 00000100:00100000:1.0:1787831003.223702:0:13771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433355776 00000100:00100000:1.0:1787831003.223704:0:13771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433355776 00000100:00100000:1.0:1787831003.223715:0:13771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433356288 00000100:00100000:1.0:1787831003.223717:0:13771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433356288 00000100:00100000:1.0:1787831003.223729:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 222 00000100:00100000:1.0:1787831003.223736:0:13771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a4b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:2394:x1874676433355904:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1787831003.223766:0:13771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a4b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:2394:x1874676433355904:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 31us (841us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831003.223774:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 222 00000100:00100000:1.0:1787831003.223792:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 223 00000100:00100000:1.0:1787831003.223797:0:13771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220394de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c901c2b2-479b-44dc-8fa8-34fbacf02f07+5:2394:x1874676433356416:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1787831003.223820:0:13771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220394de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c901c2b2-479b-44dc-8fa8-34fbacf02f07+5:2394:x1874676433356416:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 23us (830us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831003.223837:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 223 00000100:00100000:1.0:1787831003.223851:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 224 00000100:00100000:1.0:1787831003.223857:0:13771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203bb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47d7f0ed-283f-4b70-a741-6e74c5e52619+13:2394:x1874676433355776:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1787831003.223881:0:13771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203bb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47d7f0ed-283f-4b70-a741-6e74c5e52619+13:2394:x1874676433355776:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 25us (868us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831003.223886:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 224 00000100:00100000:1.0:1787831003.223898:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 225 00000100:00100000:1.0:1787831003.223903:0:13771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22039b83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c901c2b2-479b-44dc-8fa8-34fbacf02f07+5:2394:x1874676433356288:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1787831003.223924:0:13771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22039b83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c901c2b2-479b-44dc-8fa8-34fbacf02f07+5:2394:x1874676433356288:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 21us (862us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831003.223931:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 225 00000100:00100000:2.0:1787831003.224079:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220394f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+6:2394:x1874676433356160:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 72us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831003.224086:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 83 00000100:00100000:2.0:1787831003.224104:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 84 00000100:00100000:2.0:1787831003.224111:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22039ba940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:2394:x1874676433356032:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1787831003.224140:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22039ba940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:2394:x1874676433356032:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 31us (1105us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831003.224147:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 84 00000100:00080000:2.0:1787831003.224175:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787831003.224180:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787831003.224183:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787831003.224185:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787831003.225195:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433355648 00000100:00100000:3.0:1787831003.225206:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433355648 00000100:00100000:3.0:1787831003.225502:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 365 00000100:00100000:3.0:1787831003.225523:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d231859d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+13:2394:x1874676433355648:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1787831003.225582:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d231859d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+13:2394:x1874676433355648:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 61us (2722us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831003.225590:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 365 00000100:00100000:2.0:1787831003.877337:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831003.877537:0:13771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433356544 00000100:00100000:1.0:1787831003.877558:0:13771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433356544 00000100:00100000:1.0:1787831003.877611:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 146 00000100:00100000:1.0:1787831003.877620:0:13771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2314e73840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47d7f0ed-283f-4b70-a741-6e74c5e52619+13:11053:x1874676433356544:12345-192.168.203.31@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1787831003.877749:0:13771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2314e73840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47d7f0ed-283f-4b70-a741-6e74c5e52619+13:11053:x1874676433356544:12345-192.168.203.31@tcp:60:lhsmtool_posix.0 Request processed in 130us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831003.877756:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 146 00000100:00100000:3.0:1787831003.884830:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831003.884940:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433356672 00000100:00100000:2.0:1787831003.884950:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433356672 00000100:00100000:2.0:1787831003.885006:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 147 00000100:00100000:2.0:1787831003.885016:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22037da580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:11053:x1874676433356672:12345-192.168.203.31@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1787831003.885136:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22037da580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:11053:x1874676433356672:12345-192.168.203.31@tcp:60:lhsmtool_posix.0 Request processed in 121us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831003.885143:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 147 00000100:00100000:3.0:1787831003.890374:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831003.890459:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433356928 00000100:00100000:2.0:1787831003.890469:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433356928 00000100:00100000:2.0:1787831003.890608:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 35 00000100:00100000:2.0:1787831003.890619:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22037db840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+13:11053:x1874676433356928:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787831003.890894:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22037db840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+14:11053:x1874676433356928:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 Request processed in 275us (529us total) trans 4294967416 rc 0/0 00000100:00100000:2.0:1787831003.890902:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 35 00000100:00100000:0.0:1787831004.124387:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831004.124533:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433357056 00000100:00100000:2.0:1787831004.124546:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433357056 00000100:00100000:2.0:1787831004.124669:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 148 00000100:00100000:2.0:1787831004.124683:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22039a1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c901c2b2-479b-44dc-8fa8-34fbacf02f07+5:11858:x1874676433357056:12345-192.168.203.31@tcp:101:lsof.0 00010000:00010000:2.0:1787831004.124710:0:8620:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787831004.124739:0:8620:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1e00/0x95459fb9d1d292b1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99423f27 expref: -99 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831004.125139:0:8620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0200/0x95459fb9d1d292b8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831004.125159:0:8620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0200/0x95459fb9d1d292b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831004.125175:0:8620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0200/0x95459fb9d1d292b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787831004.125238:0:8620:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787831004.125242:0:8620:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787831004.125290:0:8620:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0200/0x95459fb9d1d292b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831004.125319:0:8620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1e00/0x95459fb9d1d292b1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f27 expref: 7 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831004.125365:0:8620:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0200/0x95459fb9d1d292b8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f27 expref: 6 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831004.125375:0:8620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d233a6f7300) 00010000:00010000:2.0:1787831004.125378:0:8620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787831004.125381:0:8620:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22039c0200, rc 0) 00000100:00100000:2.0:1787831004.125511:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22039a1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c901c2b2-479b-44dc-8fa8-34fbacf02f07+6:11858:x1874676433357056:12345-192.168.203.31@tcp:101:lsof.0 Request processed in 832us (1141us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831004.125519:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 148 00010000:00010000:1.0:1787831004.134894:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787831004.905322:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22037db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1874676443892608:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787831004.905491:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831004.905558:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443892608 00000100:00100000:2.0:1787831004.905572:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443892608 00000100:00100000:3.0:1787831004.905797:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22037d83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443892736:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1787831004.905982:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787831004.906908:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787831004.906928:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22039a12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1874676443892608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787831004.906959:0:8409:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787831004.907062:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22039a12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1874676443892608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 144us (1572us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831004.907070:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787831004.907158:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22037db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1874676443892608:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787831004.907310:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831004.907503:0:11489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443892736 00000100:00100000:1.0:1787831004.907510:0:11489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443892736 00000100:00100000:1.0:1787831004.907613:0:11489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787831004.907668:0:11489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22037dad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443892736:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787831004.907703:0:11489:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787831004.908859:0:11489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22037dad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443892736:12345-0@lo:13:osp-pre-0-1.0 Request processed in 156us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831004.908876:0:11489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:2.0:1787831004.909036:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787831004.909141:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22037d83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443892736:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1787831005.159658:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787831005.417853:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22038ecb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676443892864:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787831005.417958:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831005.418078:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443892864 00000100:00100000:2.0:1787831005.418089:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443892864 00000100:00100000:2.0:1787831005.418156:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1787831005.418167:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d232f6ca940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1874676443892864:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787831005.418211:0:7448:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787831005.418302:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d232f6ca940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1874676443892864:12345-0@lo:41:osp-pre-1-0.0 Request processed in 137us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831005.418332:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1787831005.418515:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22038ecb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676443892864:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787831005.927327:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22038eda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443892992:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787831005.927421:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831005.927493:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443892992 00000100:00100000:1.0:1787831005.927505:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443892992 00000100:00100000:1.0:1787831005.927583:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1787831005.927594:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22045c0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443892992:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787831005.927677:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:1.0:1787831005.927781:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22045c0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443892992:12345-0@lo:41:osp-pre-0-1.0 Request processed in 189us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831005.927790:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1787831005.929139:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22038eda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443892992:0@lo:41:osp-pre-0-1.0 00000040:00080000:3.0:1787831006.121322:0:13763:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787831006.183971:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787831006.496565:0:14471:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 07:43:25 (1787831005) 00000040:00080000:2.0:1787831006.630954:0:13758:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787831006.630963:0:13758:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787831006.631038:0:13758:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:2.0:1787831006.631045:0:13758:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787831006.951511:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22037d83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a45944b-32e3-4193-a2a5-46f84222bc14:3620:1874676443893120:0@lo:400:kworker.0 00000100:00100000:1.0:1787831006.951745:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831006.951773:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22045c2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676443893376:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787831006.951823:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831006.952164:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203634000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1874676443893632:0@lo:400:kworker.0 00000100:00100000:1.0:1787831006.952197:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831006.952219:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787831006.952226:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22037db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3620:1874676443893504:0@lo:400:kworker.0 00000100:00100000:1.0:1787831006.952252:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831006.952285:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443893632 00000100:00100000:1.0:1787831006.952292:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443893632 00000100:00100000:1.0:1787831006.952333:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1787831006.952342:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22038ede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1874676443893632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787831006.952392:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22038ede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1874676443893632:12345-0@lo:400:kworker.0 Request processed in 52us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831006.952399:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1787831006.952520:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203634000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1874676443893632:0@lo:400:kworker.0 00000100:00100000:1.0:1787831006.952553:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443893120 00000100:00100000:1.0:1787831006.952558:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443893120 00000100:00100000:1.0:1787831006.952585:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:1.0:1787831006.952592:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d231859f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+24:3620:x1874676443893120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787831006.952646:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d231859f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+24:3620:x1874676443893120:12345-0@lo:400:kworker.0 Request processed in 55us (1047us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831006.952652:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:1.0:1787831006.952681:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22037d83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a45944b-32e3-4193-a2a5-46f84222bc14:3620:1874676443893120:0@lo:400:kworker.0 00000100:00100000:1.0:1787831006.952716:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443893504 00000100:00100000:1.0:1787831006.952719:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443893504 00000100:00100000:1.0:1787831006.952746:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1787831006.952752:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22038ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1874676443893504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787831006.952796:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22038ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1874676443893504:12345-0@lo:400:kworker.0 Request processed in 44us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831006.952813:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1787831006.952831:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443893376 00000100:00100000:1.0:1787831006.952835:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443893376 00000100:00100000:1.0:1787831006.952869:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787831006.952889:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22045c0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1874676443893376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787831006.952920:0:8409:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1787831006.952952:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22045c0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1874676443893376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (1129us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831006.952959:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787831006.952977:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2314e712c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443893248:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787831006.953001:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831006.953020:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2336bfc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3621:1874676443893760:0@lo:400:kworker.0 00000100:00100000:1.0:1787831006.953039:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831006.953056:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787831006.953068:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a21a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443893888:0@lo:400:kworker.0 00000100:00100000:1.0:1787831006.953090:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831006.953114:0:11489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443893248 00000100:00100000:1.0:1787831006.953117:0:11489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443893248 00000100:00100000:1.0:1787831006.953141:0:11489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787831006.953147:0:11489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22038eda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443893248:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787831006.953156:0:11489:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1787831006.953183:0:11489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22038eda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443893248:12345-0@lo:13:osp-pre-1-1.0 Request processed in 37us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831006.953189:0:11489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787831006.953224:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2314e712c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443893248:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787831006.953248:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22037db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3620:1874676443893504:0@lo:400:kworker.0 00000100:00100000:1.0:1787831006.953272:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443893888 00000100:00100000:1.0:1787831006.953275:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443893888 00000100:00100000:1.0:1787831006.953296:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1787831006.953301:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22038ecf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1874676443893888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787831006.953334:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22038ecf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1874676443893888:12345-0@lo:400:kworker.0 Request processed in 32us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831006.953339:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1787831006.953361:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a21a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443893888:0@lo:400:kworker.0 00000100:00080000:1.0:1787831006.953400:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787831006.953484:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443893760 00000100:00100000:1.0:1787831006.953488:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443893760 00000100:00100000:1.0:1787831006.953515:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1787831006.953521:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22038ecb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1874676443893760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787831006.953555:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22038ecb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1874676443893760:12345-0@lo:400:kworker.0 Request processed in 34us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831006.953560:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1787831006.953588:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2336bfc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3621:1874676443893760:0@lo:400:kworker.0 00000100:00100000:0.0:1787831006.953871:0:3622:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:0.0:1787831006.953876:0:3622:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d2203a7a1c0, transno 4294967311 00000100:00100000:2.0:1787831006.954091:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a21a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3619:1874676443894016:0@lo:400:kworker.0 00000100:00100000:2.0:1787831006.954124:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831006.954155:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220453c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3619:1874676443894528:0@lo:400:kworker.0 00000100:00100000:2.0:1787831006.954174:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831006.954193:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787831006.954198:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220453f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3619:1874676443894144:0@lo:400:kworker.0 00000100:00100000:2.0:1787831006.954218:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831006.954234:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220453de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3619:1874676443894656:0@lo:400:kworker.0 00000100:00100000:2.0:1787831006.954252:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831006.954278:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443894016 00000100:00100000:2.0:1787831006.954281:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443894016 00000100:00100000:2.0:1787831006.954312:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443894528 00000100:00100000:2.0:1787831006.954315:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443894528 00000100:00100000:2.0:1787831006.954328:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443894144 00000100:00100000:2.0:1787831006.954330:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443894144 00000100:00100000:2.0:1787831006.954340:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443894656 00000100:00100000:2.0:1787831006.954343:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443894656 00000100:00100000:2.0:1787831006.954355:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1787831006.954361:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2314e70f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874676443894016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787831006.954398:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2314e70f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874676443894016:12345-0@lo:400:kworker.0 Request processed in 37us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831006.954403:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000004:00080000:0.0:1787831006.954489:0:3622:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967313 committed transno 4294967313 00000100:00100000:0.0:1787831006.954514:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22045c2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676443893376:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787831006.954556:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1787831006.954562:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2314e730c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874676443894528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787831006.954600:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2314e730c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874676443894528:12345-0@lo:400:kworker.0 Request processed in 34us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831006.954610:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1787831006.954640:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1787831006.954646:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2314e72580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874676443894144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787831006.954676:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2314e72580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874676443894144:12345-0@lo:400:kworker.0 Request processed in 30us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831006.954683:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1787831006.954698:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1787831006.954704:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2314e72940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874676443894656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787831006.954735:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2314e72940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874676443894656:12345-0@lo:400:kworker.0 Request processed in 31us (481us total) trans 0 rc 0/0 00000100:00080000:3.0:1787831006.954737:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787831006.954742:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00010000:00080000:2.0:1787831006.954770:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d220453f0c0 x1874676443894144/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787831022 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787831006.954781:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220453f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3619:1874676443894144:0@lo:400:kworker.0 00010000:00080000:2.0:1787831006.954789:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d220453de00 x1874676443894656/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787831022 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787831006.954796:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220453de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3619:1874676443894656:0@lo:400:kworker.0 00000100:00100000:2.0:1787831006.954817:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a21a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3619:1874676443894016:0@lo:400:kworker.0 00000100:00100000:2.0:1787831006.954826:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220453c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3619:1874676443894528:0@lo:400:kworker.0 00000100:00080000:3.0:1787831006.954871:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787831006.954914:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220453e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443894272:0@lo:400:kworker.0 00000100:00100000:1.0:1787831006.954945:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831006.954975:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787831006.954982:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220453fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443894400:0@lo:400:kworker.0 00000100:00100000:3.0:1787831006.954998:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443894272 00000100:00100000:3.0:1787831006.955004:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443894272 00000100:00100000:1.0:1787831006.955010:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831006.955054:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443894400 00000100:00100000:3.0:1787831006.955058:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787831006.955066:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443894400 00000100:00100000:3.0:1787831006.955070:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22038ee940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443894272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787831006.955101:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787831006.955110:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22038ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1874676443894400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787831006.955139:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22038ee940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443894272:12345-0@lo:400:kworker.0 Request processed in 72us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831006.955148:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:2.0:1787831006.955149:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787831006.955154:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22038ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1874676443894400:12345-0@lo:400:kworker.0 Request processed in 45us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831006.955164:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787831006.955199:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220453fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443894400:0@lo:400:kworker.0 00000100:00100000:1.0:1787831006.955211:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220453e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443894272:0@lo:400:kworker.0 00000001:00080000:2.0:1787831006.962428:0:6469:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000020:00080000:2.0:1787831006.962442:0:6469:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:1.0:1787831006.962775:0:6522:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:1.0:1787831006.962786:0:6522:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:1.0:1787831007.206853:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787831007.497219:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831007.497360:0:13771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433357312 00000100:00100000:3.0:1787831007.497370:0:13771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433357312 00000100:00100000:3.0:1787831007.497452:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 149 00000100:00100000:3.0:1787831007.497463:0:13771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22045c2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47d7f0ed-283f-4b70-a741-6e74c5e52619+13:12125:x1874676433357312:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787831007.497499:0:13771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787831007.497758:0:13771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668800/0x95459fb9d1d292bf lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99423f2e expref: -99 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831007.497908:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669a00/0x95459fb9d1d292c6 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831007.497921:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669a00/0x95459fb9d1d292c6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831007.497932:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669a00/0x95459fb9d1d292c6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831007.497963:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668e00/0x95459fb9d1d292cd lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831007.497971:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668e00/0x95459fb9d1d292cd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831007.497978:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668e00/0x95459fb9d1d292cd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831007.498068:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669600/0x95459fb9d1d292d4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831007.498077:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669600/0x95459fb9d1d292d4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831007.498084:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669600/0x95459fb9d1d292d4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787831007.498093:0:13771:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:3.0:1787831007.498181:0:13771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669a00/0x95459fb9d1d292c6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831007.498188:0:13771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669a00/0x95459fb9d1d292c6 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831007.498194:0:13771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669a00/0x95459fb9d1d292c6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831007.498200:0:13771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2301669a00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:3.0:1787831007.498204:0:13771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669a00/0x95459fb9d1d292c6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831007.498212:0:13771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669a00/0x95459fb9d1d292c6 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831007.498223:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8d2203615100) 00010000:00010000:3.0:1787831007.498226:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787831007.498231:0:13771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669a00/0x95459fb9d1d292c6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831007.498236:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669a00/0x95459fb9d1d292c6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831007.498249:0:13771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668e00/0x95459fb9d1d292cd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831007.498255:0:13771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668e00/0x95459fb9d1d292cd lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831007.498261:0:13771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668e00/0x95459fb9d1d292cd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831007.498276:0:13771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2301668e00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:3.0:1787831007.498280:0:13771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668e00/0x95459fb9d1d292cd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831007.498285:0:13771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668e00/0x95459fb9d1d292cd lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831007.498293:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8d233a6f8f00) 00010000:00010000:3.0:1787831007.498296:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787831007.498299:0:13771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668e00/0x95459fb9d1d292cd lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831007.498305:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668e00/0x95459fb9d1d292cd lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787831007.498443:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787831007.499233:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668800/0x95459fb9d1d292bf lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f2e expref: 16 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831007.499262:0:13771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669600/0x95459fb9d1d292d4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f2e expref: 15 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831007.499270:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d2318594400) 00010000:00010000:3.0:1787831007.499273:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787831007.499276:0:13771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2301669600, rc 0) 00000100:00100000:3.0:1787831007.499883:0:13771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22045c2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47d7f0ed-283f-4b70-a741-6e74c5e52619+15:12125:x1874676433357312:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 2419us (2671us total) trans 4294967417 rc 0/0 00000100:00100000:3.0:1787831007.499892:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 149 00000100:00100000:3.0:1787831007.506237:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831007.506363:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433357440 00000100:00100000:1.0:1787831007.506372:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433357440 00000100:00100000:1.0:1787831007.506883:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 150 00000100:00100000:1.0:1787831007.506897:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220453da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+15:12125:x1874676433357440:12345-192.168.203.31@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1787831007.506989:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220453da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+15:12125:x1874676433357440:12345-192.168.203.31@tcp:59:lhsmtool_posix.0 Request processed in 97us (763us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831007.507397:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 150 00000100:00100000:0.0:1787831007.510454:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831007.511186:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433357568 00000100:00100000:3.0:1787831007.511196:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433357568 00000100:00100000:3.0:1787831007.511575:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 11 00000100:00100000:3.0:1787831007.511585:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22045c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+15:2395:x1874676433357568:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787831007.511600:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787831007.511661:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669600/0x95459fb9d1d292d4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f2e expref: 15 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831007.511679:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d2318594400) 00010000:00010000:3.0:1787831007.511684:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787831007.511743:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22045c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+14:2395:x1874676433357568:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 159us (1296us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831007.511751:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 11 00000100:00100000:0.0:1787831007.515425:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831007.515567:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433357696 00000100:00100000:2.0:1787831007.515575:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433357696 00000100:00100000:2.0:1787831007.515673:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 151 00000100:00100000:2.0:1787831007.515685:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22045c03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:12125:x1874676433357696:12345-192.168.203.31@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1787831007.515775:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22045c03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:12125:x1874676433357696:12345-192.168.203.31@tcp:59:lhsmtool_posix.0 Request processed in 93us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831007.515782:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 151 00000100:00080000:3.0:1787831007.516461:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000040:00080000:0.0:1787831007.662692:0:13758:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787831007.662701:0:13758:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787831007.662722:0:13758:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:0.0:1787831007.662730:0:13758:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1787831008.169237:0:13763:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787831008.231562:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787831008.336590:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831008.336733:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831008.336809:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831008.336849:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831008.336881:0:8631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433358336 00000100:00100000:2.0:1787831008.336892:0:8631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433358336 00000100:00100000:2.0:1787831008.336967:0:8631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 87 00000100:00100000:2.0:1787831008.336977:0:8631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220384d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+6:2396:x1874676433358336:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1787831008.337173:0:8631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220384d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+6:2396:x1874676433358336:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 196us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831008.337182:0:8631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 87 00000100:00100000:0.0:1787831008.337905:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433357824 00000100:00100000:0.0:1787831008.337912:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433357824 00000100:00100000:0.0:1787831008.337963:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 367 00000100:00100000:0.0:1787831008.337972:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d231859d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+13:2396:x1874676433357824:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1787831008.338028:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d231859d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+13:2396:x1874676433357824:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 58us (1453us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831008.338036:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 367 00000100:00100000:3.0:1787831008.339058:0:13771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433358080 00000100:00100000:3.0:1787831008.339068:0:13771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433358080 00000100:00100000:3.0:1787831008.339133:0:13771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433358592 00000100:00100000:3.0:1787831008.339138:0:13771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433358592 00000100:00100000:3.0:1787831008.339173:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 232 00000100:00100000:3.0:1787831008.339182:0:13771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2314e712c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:2396:x1874676433358080:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1787831008.339387:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 233 00000100:00100000:0.0:1787831008.339397:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220384cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c901c2b2-479b-44dc-8fa8-34fbacf02f07+5:2396:x1874676433358592:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1787831008.339450:0:13771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2314e712c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:2396:x1874676433358080:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 268us (2716us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831008.339458:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 232 00000100:00080000:3.0:1787831008.339487:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787831008.339492:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787831008.343938:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220384cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c901c2b2-479b-44dc-8fa8-34fbacf02f07+5:2396:x1874676433358592:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 4525us (7070us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831008.343958:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 233 00000100:00100000:2.0:1787831008.353472:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831008.353532:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831008.353606:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831008.353669:0:13771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433357952 00000100:00100000:2.0:1787831008.353695:0:13771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433357952 00000100:00100000:2.0:1787831008.353758:0:13771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433358464 00000100:00100000:2.0:1787831008.353762:0:13771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433358464 00000100:00100000:2.0:1787831008.353913:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 234 00000100:00100000:2.0:1787831008.353927:0:13771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220384f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47d7f0ed-283f-4b70-a741-6e74c5e52619+14:2396:x1874676433357952:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1787831008.354024:0:13771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220384f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47d7f0ed-283f-4b70-a741-6e74c5e52619+14:2396:x1874676433357952:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 101us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831008.354032:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 234 00000100:00100000:2.0:1787831008.354056:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 235 00000100:00100000:2.0:1787831008.354063:0:13771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220384fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c901c2b2-479b-44dc-8fa8-34fbacf02f07+6:2396:x1874676433358464:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1787831008.354093:0:13771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220384fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c901c2b2-479b-44dc-8fa8-34fbacf02f07+6:2396:x1874676433358464:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 30us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831008.354100:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 235 00000100:00100000:3.0:1787831008.357239:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433358208 00000100:00100000:3.0:1787831008.357259:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433358208 00000100:00100000:3.0:1787831008.357341:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 88 00000100:00100000:3.0:1787831008.357351:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220384e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:2396:x1874676433358208:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1787831008.357425:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220384e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:2396:x1874676433358208:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 78us (3893us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831008.357433:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 88 00000100:00080000:2.0:1787831008.359199:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787831008.359210:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787831009.257087:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787831009.474135:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831009.474245:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433358720 00000100:00100000:1.0:1787831009.474258:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433358720 00000100:00100000:1.0:1787831009.474354:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 152 00000100:00100000:1.0:1787831009.474366:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220384de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+14:12167:x1874676433358720:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:1.0:1787831009.474393:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787831009.474423:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6200/0x95459fb9d1d292e2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99423f35 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831009.474553:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6a00/0x95459fb9d1d292e9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831009.474571:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6a00/0x95459fb9d1d292e9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831009.474585:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6a00/0x95459fb9d1d292e9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831009.474614:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7c00/0x95459fb9d1d292f0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831009.474648:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7c00/0x95459fb9d1d292f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831009.474657:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7c00/0x95459fb9d1d292f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787831009.476933:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787831009.477807:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6a00/0x95459fb9d1d292e9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831009.477824:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6a00/0x95459fb9d1d292e9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831009.477833:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6a00/0x95459fb9d1d292e9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831009.477992:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d23344b6a00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:0.0:1787831009.477997:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6a00/0x95459fb9d1d292e9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831009.478006:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6a00/0x95459fb9d1d292e9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831009.478028:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d233a6f7300) 00010000:00010000:0.0:1787831009.478031:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787831009.478038:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6a00/0x95459fb9d1d292e9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831009.478045:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6a00/0x95459fb9d1d292e9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831009.478060:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7c00/0x95459fb9d1d292f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831009.478066:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7c00/0x95459fb9d1d292f0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831009.478071:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7c00/0x95459fb9d1d292f0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831009.478077:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d23344b7c00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:0.0:1787831009.478080:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7c00/0x95459fb9d1d292f0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831009.478085:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7c00/0x95459fb9d1d292f0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831009.478103:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8d232b9c6e00) 00010000:00010000:0.0:1787831009.478105:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787831009.478109:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7c00/0x95459fb9d1d292f0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831009.478114:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7c00/0x95459fb9d1d292f0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831009.478172:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6200/0x95459fb9d1d292e2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f35 expref: 15 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831009.478185:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d233a6f7300) 00010000:00010000:0.0:1787831009.478187:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787831009.478190:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6200/0x95459fb9d1d292e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f35 expref: 15 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831009.478199:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d23344b6200, rc 0) 00000100:00100000:0.0:1787831009.478336:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220384de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+14:12167:x1874676433358720:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 3970us (4210us total) trans 0 rc 301/301 00000100:00100000:0.0:1787831009.478347:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 152 00000100:00100000:1.0:1787831009.496442:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831009.497038:0:13771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433358976 00000100:00100000:2.0:1787831009.497058:0:13771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433358976 00000100:00100000:2.0:1787831009.497153:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 153 00000100:00100000:2.0:1787831009.497167:0:13771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22038ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47d7f0ed-283f-4b70-a741-6e74c5e52619+14:12167:x1874676433358976:12345-192.168.203.31@tcp:36:lfs.0 00010000:00010000:2.0:1787831009.497248:0:13771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787831009.497286:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94800/0x95459fb9d1d28c36 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423d59 expref: 14 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831009.497309:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d233a6f7300) 00010000:00010000:2.0:1787831009.497330:0:13771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787831009.497420:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d292f7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831009.497438:0:13771:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0200/0x95459fb9d1d292b8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f27 expref: 5 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831009.497449:0:13771:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d292f7 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831009.497500:0:13771:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0200/0x95459fb9d1d292b8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f27 expref: 5 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831009.497519:0:13771:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0200/0x95459fb9d1d292b8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f27 expref: 5 pid: 8620 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831009.497537:0:13771:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220384da40 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13771:1874676443894784:192.168.203.31@tcp:104: 00000100:00100000:2.0:1787831009.497704:0:13771:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2203b6b0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787831009.506130:0:13771:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220384da40 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13771:1874676443894784:192.168.203.31@tcp:104: 00010000:00010000:3.0:1787831009.506174:0:13771:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d292f7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831009.506302:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831009.508221:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433359104 00000100:00100000:1.0:1787831009.508234:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433359104 00010000:00010000:1.0:1787831009.508280:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0200/0x95459fb9d1d292b8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f27 expref: 6 pid: 8620 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831009.510146:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 80 00000100:00100000:1.0:1787831009.510167:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22045c3840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c901c2b2-479b-44dc-8fa8-34fbacf02f07+6:2397:x1874676433359104:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787831009.510187:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787831009.510200:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0200/0x95459fb9d1d292b8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f27 expref: 6 pid: 8620 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831009.510232:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0200/0x95459fb9d1d292b8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f27 expref: 6 pid: 8620 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831009.510254:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0200/0x95459fb9d1d292b8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f27 expref: 6 pid: 8620 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831009.510268:0:6475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d233a6f7300) 00010000:00010000:1.0:1787831009.510274:0:6475:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d292f7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831009.510282:0:6475:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d292f7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831009.510290:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d292f7 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831009.510326:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787831009.510502:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22045c3840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c901c2b2-479b-44dc-8fa8-34fbacf02f07+5:2397:x1874676433359104:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 343us (4208us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831009.510510:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 80 00010000:00010000:3.0:1787831009.510688:0:13771:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d292f7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831009.510697:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d292f7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831009.510719:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669600/0x95459fb9d1d292fe lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831009.510729:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669600/0x95459fb9d1d292fe lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831009.510736:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669600/0x95459fb9d1d292fe lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831009.511213:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668800/0x95459fb9d1d29305 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831009.511221:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668800/0x95459fb9d1d29305 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831009.511226:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668800/0x95459fb9d1d29305 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787831009.511242:0:13771:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008cf9a4b7 reply state 000000009c791039 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668800/0x95459fb9d1d29305 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831009.511250:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668800/0x95459fb9d1d29305 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831009.511255:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d233a6f8e00) 00010000:00010000:3.0:1787831009.511256:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787831009.511258:0:13771:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787831009.511263:0:13771:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1787831009.511268:0:13771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d292f7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831009.511272:0:13771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d292f7 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831009.511277:0:13771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d292f7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831009.511280:0:13771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22039c0a00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:3.0:1787831009.511283:0:13771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d292f7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831009.511287:0:13771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d292f7 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831009.511292:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d233a6f7300) 00010000:00010000:3.0:1787831009.511293:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787831009.511296:0:13771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d292f7 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831009.511306:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d292f7 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787831009.511316:0:13771:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008cf9a4b7 reply state 000000009c791039 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669600/0x95459fb9d1d292fe lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831009.511321:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669600/0x95459fb9d1d292fe lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831009.511325:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8d233a6f8f00) 00010000:00010000:3.0:1787831009.511326:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787831009.511327:0:13771:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1787831009.511381:0:13771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22038ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47d7f0ed-283f-4b70-a741-6e74c5e52619+15:12167:x1874676433358976:12345-192.168.203.31@tcp:36:lfs.0 Request processed in 14219us (14949us total) trans 4294967418 rc 0/0 00000100:00100000:3.0:1787831009.511386:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 153 00000100:00100000:0.0:1787831009.551739:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831009.551875:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433359232 00000100:00100000:2.0:1787831009.551884:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433359232 00000100:00100000:2.0:1787831009.551945:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 154 00000100:00100000:2.0:1787831009.551954:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22045c2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+15:12175:x1874676433359232:12345-192.168.203.31@tcp:101:lctl.0 00010000:00010000:2.0:1787831009.551976:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787831009.551999:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1400/0x95459fb9d1d2930c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99423f3c expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831009.552067:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1600/0x95459fb9d1d29313 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831009.552095:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1600/0x95459fb9d1d29313 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831009.552107:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1600/0x95459fb9d1d29313 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787831009.552148:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787831009.552151:0:6492:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787831009.552172:0:6492:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1600/0x95459fb9d1d29313 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831009.552197:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1400/0x95459fb9d1d2930c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f3c expref: 17 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831009.552213:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1600/0x95459fb9d1d29313 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f3c expref: 16 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831009.552221:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2303e42700) 00010000:00010000:2.0:1787831009.552224:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787831009.552227:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22039c1600, rc 0) 00000100:00100000:2.0:1787831009.552280:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22045c2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+16:12175:x1874676433359232:12345-192.168.203.31@tcp:101:lctl.0 Request processed in 326us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831009.552287:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 154 00000100:00100000:0.0:1787831009.592073:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831009.592190:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433359360 00000100:00100000:2.0:1787831009.592200:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433359360 00000100:00100000:2.0:1787831009.592364:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 155 00000100:00100000:2.0:1787831009.592374:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22045c2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+16:12181:x1874676433359360:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:2.0:1787831009.592394:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787831009.592427:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1400/0x95459fb9d1d2931a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99423f43 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831009.592491:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1200/0x95459fb9d1d29321 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831009.592505:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1200/0x95459fb9d1d29321 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831009.592516:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1200/0x95459fb9d1d29321 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831009.592526:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1800/0x95459fb9d1d29328 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831009.592534:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1800/0x95459fb9d1d29328 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831009.592540:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1800/0x95459fb9d1d29328 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831009.592614:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0400/0x95459fb9d1d2932f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831009.592656:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0400/0x95459fb9d1d2932f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831009.592665:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0400/0x95459fb9d1d2932f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787831009.592699:0:6490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1787831009.592703:0:6490:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787831009.592726:0:6490:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0400/0x95459fb9d1d2932f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831009.592746:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1200/0x95459fb9d1d29321 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831009.592753:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1200/0x95459fb9d1d29321 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831009.592759:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1200/0x95459fb9d1d29321 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831009.592766:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22039c1200 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:2.0:1787831009.592770:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1200/0x95459fb9d1d29321 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831009.592790:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1200/0x95459fb9d1d29321 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831009.592802:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2303e42700) 00010000:00010000:2.0:1787831009.592805:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787831009.592810:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1200/0x95459fb9d1d29321 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831009.592816:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1200/0x95459fb9d1d29321 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831009.592828:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1800/0x95459fb9d1d29328 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831009.592836:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1800/0x95459fb9d1d29328 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831009.592841:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1800/0x95459fb9d1d29328 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831009.592853:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22039c1800 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:2.0:1787831009.592857:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1800/0x95459fb9d1d29328 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831009.592863:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1800/0x95459fb9d1d29328 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831009.592872:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8d233a6f8f00) 00010000:00010000:2.0:1787831009.592874:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787831009.592877:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1800/0x95459fb9d1d29328 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831009.592883:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1800/0x95459fb9d1d29328 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831009.592907:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1400/0x95459fb9d1d2931a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f43 expref: 18 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831009.592919:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0400/0x95459fb9d1d2932f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f43 expref: 17 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831009.592926:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d233a6f8e00) 00010000:00010000:2.0:1787831009.592928:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787831009.592930:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22039c0400, rc 0) 00000100:00100000:2.0:1787831009.592992:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22045c2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+17:12181:x1874676433359360:12345-192.168.203.31@tcp:101:bash.0 Request processed in 619us (928us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831009.593000:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 155 00000100:00100000:2.0:1787831009.596001:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831009.596091:0:13771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433359616 00000100:00100000:3.0:1787831009.596100:0:13771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433359616 00000100:00100000:3.0:1787831009.596153:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 156 00000100:00100000:3.0:1787831009.596174:0:13771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220384c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47d7f0ed-283f-4b70-a741-6e74c5e52619+17:12181:x1874676433359616:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:3.0:1787831009.596194:0:13771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787831009.596213:0:13771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668e00/0x95459fb9d1d29336 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99423f4a expref: -99 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831009.596324:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669a00/0x95459fb9d1d2933d lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831009.596338:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669a00/0x95459fb9d1d2933d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831009.596362:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669a00/0x95459fb9d1d2933d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831009.597663:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669200/0x95459fb9d1d29344 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831009.597681:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669200/0x95459fb9d1d29344 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831009.597690:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669200/0x95459fb9d1d29344 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787831009.598030:0:13771:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:3.0:1787831009.598174:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668600/0x95459fb9d1d2934b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831009.598184:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668600/0x95459fb9d1d2934b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831009.598192:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668600/0x95459fb9d1d2934b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831009.598224:0:13771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669a00/0x95459fb9d1d2933d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831009.598231:0:13771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669a00/0x95459fb9d1d2933d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831009.598237:0:13771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669a00/0x95459fb9d1d2933d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831009.598244:0:13771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2301669a00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:3.0:1787831009.598260:0:13771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669a00/0x95459fb9d1d2933d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831009.598269:0:13771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669a00/0x95459fb9d1d2933d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831009.598282:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d233a6f8e00) 00010000:00010000:3.0:1787831009.598285:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787831009.598289:0:13771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669a00/0x95459fb9d1d2933d lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831009.598296:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669a00/0x95459fb9d1d2933d lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787831009.598310:0:13771:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000048026d88 reply state 0000000015e17f59 transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669200/0x95459fb9d1d29344 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831009.598321:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669200/0x95459fb9d1d29344 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831009.598327:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8d233a6f8800) 00010000:00010000:3.0:1787831009.598329:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787831009.598332:0:13771:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787831009.598367:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668e00/0x95459fb9d1d29336 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f4a expref: 20 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831009.598382:0:13771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668600/0x95459fb9d1d2934b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f4a expref: 19 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831009.598389:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d233a6f8500) 00010000:00010000:3.0:1787831009.598391:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787831009.598400:0:13771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2301668600, rc 0) 00000100:00100000:3.0:1787831009.598462:0:13771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220384c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47d7f0ed-283f-4b70-a741-6e74c5e52619+20:12181:x1874676433359616:12345-192.168.203.31@tcp:101:bash.0 Request processed in 2290us (2469us total) trans 4294967419 rc 0/0 00000100:00100000:3.0:1787831009.598471:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 156 00000100:00100000:3.0:1787831009.602335:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831009.602410:0:8631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433359744 00000100:00100000:2.0:1787831009.602424:0:8631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433359744 00000100:00100000:2.0:1787831009.602496:0:8631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 55 00000100:00100000:2.0:1787831009.602507:0:8631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220453c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:2395:x1874676433359744:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:2.0:1787831009.602524:0:8631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787831009.602577:0:8631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000372817d3/0x95459fb9d1d29359 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99423f51 expref: -99 pid: 8631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787831009.602604:0:8631:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787831009.602659:0:8631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=300s v=(0 0) 00010000:00010000:2.0:1787831009.602665:0:8631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787831009.602674:0:8631:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000372817d3/0x95459fb9d1d29359 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f51 expref: 6 pid: 8631 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831009.602693:0:8631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000372817d3/0x95459fb9d1d29359 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f51 expref: 6 pid: 8631 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831009.602706:0:8631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22039c1400, rc 0) 00000100:00100000:2.0:1787831009.602766:0:8631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220453c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+6:2395:x1874676433359744:12345-192.168.203.31@tcp:101:bash.0 Request processed in 261us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831009.602774:0:8631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 55 00000100:00100000:0.0:1787831009.605038:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831009.605093:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433359872 00000100:00100000:3.0:1787831009.605108:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433359872 00000100:00100000:3.0:1787831009.605174:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 56 00000100:00100000:3.0:1787831009.605184:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22045c1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+6:12181:x1874676433359872:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:3.0:1787831009.605204:0:8407:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787831009.605224:0:8407:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d7a8e00e/0x95459fb9d1d29360 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99423f58 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831009.605312:0:8407:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000372817d3/0x95459fb9d1d29359 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f51 expref: 7 pid: 8631 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831009.605323:0:8407:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787831009.605327:0:8407:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787831009.605333:0:8407:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7a8e00e/0x95459fb9d1d29360 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f58 expref: 7 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831009.605373:0:8407:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000372817d3/0x95459fb9d1d29359 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f51 expref: 7 pid: 8631 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831009.605388:0:8407:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000372817d3/0x95459fb9d1d29359 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f51 expref: 7 pid: 8631 timeout: 400 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787831009.605474:0:8407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220453e940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8407:1874676443894912:192.168.203.31@tcp:104: 00000100:00100000:3.0:1787831009.605702:0:8407:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2202852600 going to sleep for 11 seconds 00000100:00100000:3.0:1787831009.607721:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831009.607728:0:8407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220453e940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8407:1874676443894912:192.168.203.31@tcp:104: 00010000:00010000:2.0:1787831009.607762:0:8407:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d7a8e00e/0x95459fb9d1d29360 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f58 expref: 7 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831009.607792:0:8407:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2307c77600, rc 0) 00000100:00100000:0.0:1787831009.607965:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433360000 00000100:00100000:0.0:1787831009.607972:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433360000 00010000:00010000:0.0:1787831009.608006:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000372817d3/0x95459fb9d1d29359 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f51 expref: 8 pid: 8631 timeout: 400 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831009.608067:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 81 00000100:00100000:0.0:1787831009.608076:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220453cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+8:2397:x1874676433360000:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787831009.608091:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787831009.608113:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000372817d3/0x95459fb9d1d29359 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f51 expref: 8 pid: 8631 timeout: 400 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831009.608126:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000372817d3/0x95459fb9d1d29359 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f51 expref: 8 pid: 8631 timeout: 400 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831009.608150:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000372817d3/0x95459fb9d1d29359 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f51 expref: 8 pid: 8631 timeout: 400 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831009.608176:0:6477:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787831009.608181:0:6477:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787831009.608189:0:6477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d7a8e00e/0x95459fb9d1d29360 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f58 expref: 7 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831009.608200:0:6477:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7a8e00e/0x95459fb9d1d29360 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f58 expref: 7 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831009.608231:0:6477:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000d7a8e00e/0x95459fb9d1d29360 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f58 expref: 7 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831009.608245:0:6477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22045c12c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6477:1874676443895040:192.168.203.31@tcp:105: 00000100:00100000:2.0:1787831009.608308:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22045c1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+7:12181:x1874676433359872:12345-192.168.203.31@tcp:101:bash.0 Request processed in 3125us (3275us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831009.608317:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 56 00000100:00100000:0.0:1787831009.608507:0:6477:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d233a674240 going to sleep for 11 seconds 00000100:00100000:3.0:1787831009.610872:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831009.610940:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433360256 00000100:00100000:2.0:1787831009.610946:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433360256 00000100:00100000:2.0:1787831009.610986:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 36 00000100:00100000:2.0:1787831009.610992:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220453f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+20:12181:x1874676433360256:12345-192.168.203.31@tcp:35:bash.0 00000100:00100000:2.0:1787831009.611223:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220453f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+21:12181:x1874676433360256:12345-192.168.203.31@tcp:35:bash.0 Request processed in 230us (355us total) trans 4294967420 rc 0/0 00000100:00100000:2.0:1787831009.611241:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 36 00000100:00100000:1.0:1787831009.611832:0:6477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22045c12c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6477:1874676443895040:192.168.203.31@tcp:105: 00010000:00010000:1.0:1787831009.611851:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787831009.611927:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220453cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+6:2397:x1874676433360000:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 3852us (4215us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831009.611935:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 81 00000100:00100000:3.0:1787831009.656966:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831009.658059:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433360512 00000100:00100000:1.0:1787831009.658069:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433360512 00000100:00100000:1.0:1787831009.658257:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 157 00000100:00100000:1.0:1787831009.658269:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220453c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+21:12191:x1874676433360512:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:1.0:1787831009.658292:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787831009.658312:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6600/0x95459fb9d1d29367 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99423f5f expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787831009.658408:0:6491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1787831009.658498:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6600/0x95459fb9d1d29367 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f5f expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831009.658581:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2303e42700) 00010000:00010000:1.0:1787831009.658586:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787831009.658592:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6600/0x95459fb9d1d29367 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f5f expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831009.658606:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d23344b6600, rc 0) 00000100:00100000:1.0:1787831009.658877:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220453c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+22:12191:x1874676433360512:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 608us (1918us total) trans 4294967421 rc 301/301 00000100:00100000:1.0:1787831009.658886:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 157 00000100:00100000:2.0:1787831009.663275:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831009.663352:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433360768 00000100:00100000:3.0:1787831009.663361:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433360768 00000100:00100000:3.0:1787831009.663414:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 37 00000100:00100000:3.0:1787831009.663423:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220384e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+22:12191:x1874676433360768:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:3.0:1787831009.663650:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220384e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+23:12191:x1874676433360768:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 228us (382us total) trans 4294967422 rc 0/0 00000100:00100000:3.0:1787831009.663658:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 37 00000100:00100000:0.0:1787831009.703454:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831009.703540:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433360896 00000100:00100000:1.0:1787831009.703550:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433360896 00000100:00100000:1.0:1787831009.703605:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 158 00000100:00100000:1.0:1787831009.703616:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22045c0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+23:12197:x1874676433360896:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:1.0:1787831009.703655:0:8620:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787831009.703675:0:8620:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6600/0x95459fb9d1d29375 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99423f66 expref: -99 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831009.705561:0:8620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7800/0x95459fb9d1d2937c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831009.705581:0:8620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7800/0x95459fb9d1d2937c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831009.705593:0:8620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7800/0x95459fb9d1d2937c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787831009.705651:0:8620:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1787831009.705655:0:8620:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787831009.705674:0:8620:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7800/0x95459fb9d1d2937c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831009.705874:0:8620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6600/0x95459fb9d1d29375 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f66 expref: 25 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831009.705897:0:8620:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7800/0x95459fb9d1d2937c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f66 expref: 24 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831009.705906:0:8620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d233a6f8e00) 00010000:00010000:1.0:1787831009.705909:0:8620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787831009.705914:0:8620:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d23344b7800, rc 0) 00000100:00100000:1.0:1787831009.705978:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22045c0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+24:12197:x1874676433360896:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 2363us (2533us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831009.705986:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 158 00000100:00100000:0.0:1787831009.713296:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831009.713451:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433361152 00000100:00100000:2.0:1787831009.713461:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433361152 00000100:00100000:2.0:1787831009.713585:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 159 00000100:00100000:2.0:1787831009.713596:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22045c30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+24:12197:x1874676433361152:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:2.0:1787831009.713614:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787831009.713736:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0c00/0x95459fb9d1d29383 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99423f6d expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831009.713852:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0e00/0x95459fb9d1d2938a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831009.713866:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0e00/0x95459fb9d1d2938a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831009.713876:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0e00/0x95459fb9d1d2938a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787831009.714023:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1787831009.714127:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0c00/0x95459fb9d1d29383 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f6d expref: 27 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831009.714144:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0e00/0x95459fb9d1d2938a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f6d expref: 26 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831009.714153:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d233a6f8500) 00010000:00010000:2.0:1787831009.714430:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787831009.714434:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22039c0e00, rc 0) 00000100:00100000:2.0:1787831009.714496:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22045c30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+26:12197:x1874676433361152:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 902us (1209us total) trans 4294967423 rc 0/0 00000100:00100000:2.0:1787831009.714512:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 159 00000100:00100000:3.0:1787831009.718726:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831009.719060:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831009.719266:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433361536 00000100:00100000:0.0:1787831009.719276:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433361536 00000100:00100000:0.0:1787831009.719346:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 12 00000100:00100000:0.0:1787831009.719357:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220453e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+26:2396:x1874676433361536:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787831009.719372:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787831009.719397:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0e00/0x95459fb9d1d2938a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f6d expref: 26 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831009.719417:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d233a6f8500) 00010000:00010000:0.0:1787831009.719422:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787831009.719484:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220453e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+25:2396:x1874676433361536:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 129us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831009.719492:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 12 00000100:00100000:1.0:1787831009.722669:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433361408 00000100:00100000:1.0:1787831009.722682:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433361408 00000100:00100000:1.0:1787831009.722766:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 160 00000100:00100000:1.0:1787831009.722776:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220453f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+25:12197:x1874676433361408:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:1.0:1787831009.722808:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787831009.722827:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6600/0x95459fb9d1d29398 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99423f74 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831009.722937:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7600/0x95459fb9d1d2939f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831009.722951:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7600/0x95459fb9d1d2939f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831009.722962:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7600/0x95459fb9d1d2939f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787831009.722974:0:6491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1787831009.723067:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6600/0x95459fb9d1d29398 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f74 expref: 28 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831009.723085:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7600/0x95459fb9d1d2939f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f74 expref: 27 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831009.723093:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d233a6f8500) 00010000:00010000:1.0:1787831009.723096:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787831009.723099:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d23344b7600, rc 0) 00000100:00100000:1.0:1787831009.723151:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220453f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+27:12197:x1874676433361408:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 377us (4434us total) trans 4294967424 rc 0/0 00000100:00100000:1.0:1787831009.723193:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 160 00000100:00100000:3.0:1787831009.730463:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831009.730615:0:8631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433361664 00000100:00100000:2.0:1787831009.730661:0:8631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433361664 00000100:00100000:2.0:1787831009.730708:0:8631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 57 00000100:00100000:2.0:1787831009.730719:0:8631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220453ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+6:2396:x1874676433361664:12345-192.168.203.31@tcp:1:lfs.0 00010000:00010000:2.0:1787831009.730758:0:8631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002b1ce2e/0x95459fb9d1d293ad lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831009.730777:0:8631:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d7a8e00e/0x95459fb9d1d29360 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f58 expref: 6 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831009.730795:0:8631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787831009.730799:0:8631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787831009.730803:0:8631:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000002b1ce2e/0x95459fb9d1d293ad lrc: 4/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831009.730849:0:8631:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d7a8e00e/0x95459fb9d1d29360 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f58 expref: 6 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831009.730862:0:8631:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d7a8e00e/0x95459fb9d1d29360 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f58 expref: 6 pid: 8407 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831009.730876:0:8631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220384cb40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8631:1874676443895168:192.168.203.31@tcp:104: 00000100:00100000:2.0:1787831009.730976:0:8631:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2203b6b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787831009.734792:0:8631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220384cb40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8631:1874676443895168:192.168.203.31@tcp:104: 00010000:00010000:2.0:1787831009.734819:0:8631:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000002b1ce2e/0x95459fb9d1d293ad lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831009.736582:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831009.739702:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433361792 00000100:00100000:0.0:1787831009.739716:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433361792 00002000:00100000:0.0:1787831009.739775:0:8413:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff8d220384cb40 x1874676433361792/t0(0) o4->47d7f0ed-283f-4b70-a741-6e74c5e52619@192.168.203.31@tcp:80/0 lens 504/0 e 0 to 0 dl 1787831020 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787831009.739795:0:8413:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d220384cb40 with x1874676433361792 ext(0->12) 00010000:00010000:0.0:1787831009.739805:0:8413:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000d7a8e00e/0x95459fb9d1d29360 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f58 expref: 7 pid: 8407 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831009.739823:0:8413:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000d7a8e00e/0x95459fb9d1d29360 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f58 expref: 7 pid: 8407 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787831009.739851:0:8413:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8d220384cb40 00000100:00100000:0.0:1787831009.740686:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 2 00000100:00100000:0.0:1787831009.740699:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220384cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+7:2397:x1874676433361792:12345-192.168.203.31@tcp:4:lfs.0 00000100:00100000:0.0:1787831009.742490:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220384cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+9:2397:x1874676433361792:12345-192.168.203.31@tcp:4:lfs.0 Request processed in 1786us (5905us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1787831009.742503:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 2 00002000:00100000:0.0:1787831009.743060:0:8413:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff8d220384cb40 x1874676433361792/t4294967306(0) o4->47d7f0ed-283f-4b70-a741-6e74c5e52619@192.168.203.31@tcp:80/0 lens 504/448 e 0 to 0 dl 1787831020 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787831009.743071:0:8413:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d220384cb40 with x1874676433361792 ext(0->12) 00010000:00010000:0.0:1787831009.743080:0:8413:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000d7a8e00e/0x95459fb9d1d29360 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f58 expref: 9 pid: 8407 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831009.743098:0:8413:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000d7a8e00e/0x95459fb9d1d29360 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f58 expref: 9 pid: 8407 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787831009.743106:0:8413:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8d220384cb40 00000100:00100000:0.0:1787831009.745727:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831009.745823:0:7432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433361920 00000100:00100000:3.0:1787831009.745840:0:7432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433361920 00010000:00010000:3.0:1787831009.745900:0:7432:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d7a8e00e/0x95459fb9d1d29360 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f58 expref: 9 pid: 8407 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787831009.745943:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 82 00000100:00100000:3.0:1787831009.745954:0:7432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22045c21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+9:2395:x1874676433361920:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787831009.745973:0:7432:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1787831009.745998:0:7432:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1787831009.746018:0:7432:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1787831010 00002000:00010000:3.0:1787831009.746021:0:7432:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1787831010 00002000:00010000:3.0:1787831009.746023:0:7432:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1787831010 00002000:00010000:3.0:1787831009.746025:0:7432:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1787831009.746034:0:7432:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d7a8e00e/0x95459fb9d1d29360 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f58 expref: 9 pid: 8407 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831009.746049:0:7432:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d7a8e00e/0x95459fb9d1d29360 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f58 expref: 9 pid: 8407 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831009.746082:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7a8e00e/0x95459fb9d1d29360 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f58 expref: 9 pid: 8407 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831009.746104:0:7432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787831009.746109:0:7432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787831009.746115:0:7432:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000002b1ce2e/0x95459fb9d1d293ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831009.746126:0:7432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000002b1ce2e/0x95459fb9d1d293ad lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831009.746171:0:7432:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787831009.746328:0:7432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22045c21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+8:2395:x1874676433361920:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 373us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831009.746338:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 82 00010000:00010000:2.0:1787831009.746842:0:8631:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000002b1ce2e/0x95459fb9d1d293ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831009.746855:0:8631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000002b1ce2e/0x95459fb9d1d293ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831009.746879:0:8631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002b1ce2e/0x95459fb9d1d293ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831009.746888:0:8631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000002b1ce2e/0x95459fb9d1d293ad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831009.746911:0:8631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000002b1ce2e/0x95459fb9d1d293ad lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831009.746919:0:8631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22039c0c00 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:2.0:1787831009.746924:0:8631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000002b1ce2e/0x95459fb9d1d293ad lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831009.746934:0:8631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000002b1ce2e/0x95459fb9d1d293ad lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831009.746948:0:8631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000002b1ce2e/0x95459fb9d1d293ad lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831009.746956:0:8631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000002b1ce2e/0x95459fb9d1d293ad lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831009.747028:0:8631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220453ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+7:2396:x1874676433361664:12345-192.168.203.31@tcp:1:lfs.0 Request processed in 16310us (16573us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831009.747036:0:8631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 57 00000100:00100000:0.0:1787831009.753850:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831009.753987:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433362176 00000100:00100000:3.0:1787831009.754000:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433362176 00000100:00100000:3.0:1787831009.754068:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 38 00000100:00100000:3.0:1787831009.754099:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d23066c8c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+27:12197:x1874676433362176:12345-192.168.203.31@tcp:35:lfs.0 00000004:00010000:3.0:1787831009.754175:0:6494:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7600/0x95459fb9d1d2939f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f74 expref: 27 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787831009.754442:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:3.0:1787831009.754594:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:3.0:1787831009.755106:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00010000:00010000:3.0:1787831009.755161:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d293b4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831009.755196:0:6494:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668600/0x95459fb9d1d2934b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f4a expref: 31 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831009.755209:0:6494:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d293b4 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831009.755269:0:6494:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668600/0x95459fb9d1d2934b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f4a expref: 31 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831009.755298:0:6494:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668600/0x95459fb9d1d2934b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f4a expref: 31 pid: 13771 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787831009.755318:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220453d680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6494:1874676443895296:192.168.203.31@tcp:104: 00000100:00100000:3.0:1787831009.755461:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2202852540 going to sleep for 11 seconds 00000100:00100000:3.0:1787831009.759337:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220453d680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6494:1874676443895296:192.168.203.31@tcp:104: 00010000:00010000:3.0:1787831009.759381:0:6494:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d293b4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831009.759980:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831009.760062:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433362304 00000100:00100000:1.0:1787831009.760091:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433362304 00010000:00010000:1.0:1787831009.760138:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668600/0x95459fb9d1d2934b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f4a expref: 32 pid: 13771 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831009.760322:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 83 00000100:00100000:1.0:1787831009.760332:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22045c3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+32:2396:x1874676433362304:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787831009.760348:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787831009.760355:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668600/0x95459fb9d1d2934b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f4a expref: 32 pid: 13771 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831009.760370:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668600/0x95459fb9d1d2934b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f4a expref: 32 pid: 13771 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831009.760391:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668600/0x95459fb9d1d2934b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f4a expref: 32 pid: 13771 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831009.760408:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d233a6f8500) 00010000:00010000:1.0:1787831009.760413:0:6476:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d293b4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831009.760422:0:6476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d293b4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831009.760429:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d293b4 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831009.760465:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787831009.760581:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22045c3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+31:2396:x1874676433362304:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 250us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831009.760598:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 83 00010000:00010000:0.0:1787831009.762539:0:6494:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d293b4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831009.762555:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d293b4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787831009.762706:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000001:00080000:0.0:1787831009.762827:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:0.0:1787831009.762915:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22045c0000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6494:1874676443895424:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787831009.762979:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831009.763005:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2307ca0c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787831009.763430:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443895424 00000100:00100000:1.0:1787831009.763438:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443895424 00000100:00080000:3.0:1787831009.763492:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787831009.763517:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1787831009.763529:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22045c1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6494:x1874676443895424:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787831009.763641:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22045c1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6494:x1874676443895424:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 95us (641us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831009.763650:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1787831009.763845:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22045c0000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6494:1874676443895424:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1787831009.764489:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:3.0:1787831009.764575:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220453d680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6494:1874676443895552:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787831009.767097:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831009.767176:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d22028523c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787831009.767373:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443895552 00000100:00100000:1.0:1787831009.767388:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443895552 00000100:00100000:1.0:1787831009.767453:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1787831009.767463:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220453d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6494:x1874676443895552:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787831009.768015:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220453d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6494:x1874676443895552:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 551us (924us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1787831009.768024:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1787831009.768138:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220453d680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6494:1874676443895552:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1787831009.769600:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:3.0:1787831009.769683:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d293b4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831009.769695:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d293b4 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831009.769702:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d293b4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831009.769709:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2307c77600 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:3.0:1787831009.769713:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d293b4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831009.769721:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d293b4 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831009.769736:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d233a6f8500) 00010000:00010000:3.0:1787831009.769740:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787831009.769744:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d293b4 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831009.769767:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d293b4 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787831009.769880:0:6494:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1787831009.769947:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:3.0:1787831009.769957:0:6494:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 300770332174ns, next at 301770330163ns, rc = 0 00000001:00080000:3.0:1787831009.769963:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:3.0:1787831009.769985:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d233a6f8500) 00010000:00010000:3.0:1787831009.769989:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787831009.769996:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7600/0x95459fb9d1d2939f lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f74 expref: 35 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787831009.770093:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d23066c8c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+34:12197:x1874676433362176:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 15997us (16258us total) trans 4294967433 rc 0/0 00000100:00100000:3.0:1787831009.770101:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 38 00000020:00080000:3.0:1787831009.770106:0:6494:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1787831009.773480:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831009.773559:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433362432 00000100:00100000:1.0:1787831009.773567:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433362432 00000100:00100000:1.0:1787831009.773660:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 161 00000100:00100000:1.0:1787831009.773672:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22045c1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+34:12197:x1874676433362432:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:1.0:1787831009.773694:0:8620:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787831009.773713:0:8620:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6600/0x95459fb9d1d293bb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99423f7b expref: -99 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831009.773767:0:8620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6600/0x95459fb9d1d293bb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f7b expref: 35 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831009.773811:0:8620:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6600/0x95459fb9d1d293bb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f7b expref: 35 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831009.773831:0:8620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d232b9c6900) 00010000:00010000:1.0:1787831009.773835:0:8620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787831009.773838:0:8620:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d23344b6600, rc 0) 00000100:00100000:1.0:1787831009.773883:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22045c1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+35:12197:x1874676433362432:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 215us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831009.773890:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 161 00000100:00100000:2.0:1787831009.776590:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831009.776762:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433362688 00000100:00100000:3.0:1787831009.776771:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433362688 00000100:00100000:3.0:1787831009.776826:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 39 00000100:00100000:3.0:1787831009.776835:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220384f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+35:12197:x1874676433362688:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:3.0:1787831009.777062:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220384f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+36:12197:x1874676433362688:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 227us (478us total) trans 4294967434 rc 0/0 00000100:00100000:3.0:1787831009.777071:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 39 00000100:00100000:2.0:1787831009.852199:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831009.852378:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433362944 00000100:00100000:3.0:1787831009.852391:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433362944 00000100:00100000:3.0:1787831009.852536:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 162 00000100:00100000:3.0:1787831009.852550:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220384c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+36:12207:x1874676433362944:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:3.0:1787831009.852604:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787831009.852678:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d293c2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99423f82 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787831009.852820:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1787831009.852954:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d293c2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f82 expref: 38 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831009.852972:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2303e42700) 00010000:00010000:3.0:1787831009.852976:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787831009.852982:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d293c2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f82 expref: 38 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831009.853000:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2307c77600, rc 0) 00000100:00100000:3.0:1787831009.853213:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220384c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+37:12207:x1874676433362944:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 665us (1028us total) trans 4294967435 rc 301/301 00000100:00100000:3.0:1787831009.853221:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 162 00000100:00100000:2.0:1787831009.856056:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831009.856177:0:13771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433363072 00000100:00100000:3.0:1787831009.856189:0:13771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433363072 00000100:00100000:3.0:1787831009.856310:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 163 00000100:00100000:3.0:1787831009.856323:0:13771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220384f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47d7f0ed-283f-4b70-a741-6e74c5e52619+37:12207:x1874676433363072:12345-192.168.203.31@tcp:34:lfs.0 00010000:00010000:3.0:1787831009.856447:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d293d0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831009.856469:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d293d0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831009.856484:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d293d0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831009.856519:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d293d7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831009.856528:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d293d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831009.856535:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d293d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831009.856656:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77800/0x95459fb9d1d293de lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831009.856667:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77800/0x95459fb9d1d293de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831009.856674:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77800/0x95459fb9d1d293de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787831009.856732:0:13771:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77800/0x95459fb9d1d293de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831009.856747:0:13771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d293d0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831009.856755:0:13771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d293d0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831009.856762:0:13771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d293d0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831009.856769:0:13771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2307c76600 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:3.0:1787831009.856789:0:13771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d293d0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831009.856806:0:13771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d293d0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831009.856822:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d233a6f8e00) 00010000:00010000:3.0:1787831009.856826:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787831009.856833:0:13771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d293d0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831009.856840:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d293d0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831009.856856:0:13771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d293d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831009.856862:0:13771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d293d7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831009.856867:0:13771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d293d7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831009.856872:0:13771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2307c77400 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:3.0:1787831009.856875:0:13771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d293d7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831009.856881:0:13771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d293d7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831009.856888:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8d233a6f8800) 00010000:00010000:3.0:1787831009.856891:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787831009.856894:0:13771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d293d7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831009.856912:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d293d7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831009.856924:0:13771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77800/0x95459fb9d1d293de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831009.856930:0:13771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77800/0x95459fb9d1d293de lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831009.856937:0:13771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77800/0x95459fb9d1d293de lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831009.856943:0:13771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2307c77800 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:3.0:1787831009.856946:0:13771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77800/0x95459fb9d1d293de lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831009.856952:0:13771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77800/0x95459fb9d1d293de lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831009.856961:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d232b9c6900) 00010000:00010000:3.0:1787831009.856963:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787831009.856966:0:13771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77800/0x95459fb9d1d293de lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831009.856972:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77800/0x95459fb9d1d293de lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787831009.857065:0:13771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220384f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47d7f0ed-283f-4b70-a741-6e74c5e52619+37:12207:x1874676433363072:12345-192.168.203.31@tcp:34:lfs.0 Request processed in 743us (1019us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831009.857073:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 163 00000100:00100000:2.0:1787831009.859542:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831009.859721:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433363328 00000100:00100000:3.0:1787831009.859733:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433363328 00000100:00100000:3.0:1787831009.859930:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 40 00000100:00100000:3.0:1787831009.859944:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220384e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+37:12207:x1874676433363328:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:3.0:1787831009.860221:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220384e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+38:12207:x1874676433363328:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 281us (692us total) trans 4294967436 rc 0/0 00000100:00100000:3.0:1787831009.860239:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 40 00000100:00100000:2.0:1787831009.906732:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831009.907088:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433363584 00000100:00100000:0.0:1787831009.907102:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433363584 00000100:00100000:0.0:1787831009.907251:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 164 00000100:00100000:0.0:1787831009.907265:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220384ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+38:12210:x1874676433363584:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:0.0:1787831009.907303:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787831009.907335:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3c00/0x95459fb9d1d293e5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99423f89 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831009.907460:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3000/0x95459fb9d1d293ec lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831009.907480:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3000/0x95459fb9d1d293ec lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831009.907494:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3000/0x95459fb9d1d293ec lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831009.907519:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2000/0x95459fb9d1d293f3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831009.907528:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2000/0x95459fb9d1d293f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831009.907559:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2000/0x95459fb9d1d293f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831009.907747:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3e00/0x95459fb9d1d293fa lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831009.907756:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3e00/0x95459fb9d1d293fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831009.907765:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3e00/0x95459fb9d1d293fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787831009.907905:0:6490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1787831009.908011:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3000/0x95459fb9d1d293ec lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831009.908020:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3000/0x95459fb9d1d293ec lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831009.908027:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3000/0x95459fb9d1d293ec lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831009.908035:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2303aa3000 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:0.0:1787831009.908040:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3000/0x95459fb9d1d293ec lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831009.908049:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3000/0x95459fb9d1d293ec lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831009.908064:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d233a6f8e00) 00010000:00010000:0.0:1787831009.908068:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787831009.908082:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3000/0x95459fb9d1d293ec lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831009.908089:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3000/0x95459fb9d1d293ec lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831009.908106:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2000/0x95459fb9d1d293f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831009.908113:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2000/0x95459fb9d1d293f3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831009.908120:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2000/0x95459fb9d1d293f3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831009.908125:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2303aa2000 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:0.0:1787831009.908129:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2000/0x95459fb9d1d293f3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831009.908135:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2000/0x95459fb9d1d293f3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831009.908143:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8d233a6f8800) 00010000:00010000:0.0:1787831009.908146:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787831009.908149:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2000/0x95459fb9d1d293f3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831009.908155:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2000/0x95459fb9d1d293f3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831009.908203:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3c00/0x95459fb9d1d293e5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f89 expref: 41 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831009.908231:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3e00/0x95459fb9d1d293fa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f89 expref: 40 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831009.908240:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d232b9c6900) 00010000:00010000:0.0:1787831009.908242:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787831009.908246:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2303aa3e00, rc 0) 00000100:00100000:0.0:1787831009.909939:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220384ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+40:12210:x1874676433363584:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 2667us (3213us total) trans 4294967437 rc 0/0 00000100:00100000:0.0:1787831009.909955:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 164 00000100:00100000:2.0:1787831009.922336:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831009.924791:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433363712 00000100:00100000:3.0:1787831009.924810:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433363712 00000100:00100000:3.0:1787831009.924894:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 165 00000100:00100000:3.0:1787831009.924905:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220384d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+40:12210:x1874676433363712:12345-192.168.203.31@tcp:54:lfs.0 00010000:00010000:3.0:1787831009.924990:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77800/0x95459fb9d1d29408 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831009.925011:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77800/0x95459fb9d1d29408 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831009.925025:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77800/0x95459fb9d1d29408 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831009.925070:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77800/0x95459fb9d1d29408 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831009.925078:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77800/0x95459fb9d1d29408 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831009.925085:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77800/0x95459fb9d1d29408 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831009.925091:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2307c77800 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:3.0:1787831009.925111:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77800/0x95459fb9d1d29408 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831009.925120:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77800/0x95459fb9d1d29408 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831009.925134:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d232b9c6900) 00010000:00010000:3.0:1787831009.925138:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787831009.925143:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77800/0x95459fb9d1d29408 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831009.925151:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77800/0x95459fb9d1d29408 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787831009.925247:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220384d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+40:12210:x1874676433363712:12345-192.168.203.31@tcp:54:lfs.0 Request processed in 344us (2925us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831009.925255:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 165 00000100:00100000:2.0:1787831009.930054:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831009.930256:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433363968 00000100:00100000:0.0:1787831009.930269:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433363968 00000100:00100000:0.0:1787831009.930341:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 41 00000100:00100000:0.0:1787831009.930354:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220384e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+40:12210:x1874676433363968:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:0.0:1787831009.930696:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220384e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+41:12210:x1874676433363968:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 344us (653us total) trans 4294967438 rc 0/0 00000100:00100000:0.0:1787831009.930706:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 41 00000100:00100000:0.0:1787831010.023132:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787831010.023234:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220453f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676443895680:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787831010.023394:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831010.023449:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787831010.023463:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220453cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443895808:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787831010.023503:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831010.023682:0:11489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443895680 00000100:00100000:0.0:1787831010.023692:0:11489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443895680 00000100:00100000:0.0:1787831010.023790:0:11489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443895808 00000100:00100000:0.0:1787831010.023795:0:11489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443895808 00000100:00100000:0.0:1787831010.023824:0:11489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787831010.023834:0:11489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22045c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676443895680:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787831010.023888:0:11489:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787831010.023943:0:11489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22045c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676443895680:12345-0@lo:13:osp-pre-0-1.0 Request processed in 111us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831010.023951:0:11489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787831010.023971:0:11489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787831010.023977:0:11489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22038efc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3621:x1874676443895808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787831010.023988:0:11489:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787831010.024015:0:11489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22038efc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3621:x1874676443895808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 38us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831010.024020:0:11489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787831010.024065:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220453f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676443895680:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787831010.025592:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220453cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443895808:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787831010.025789:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787831010.099529:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831010.099685:0:13771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433364224 00000100:00100000:3.0:1787831010.099698:0:13771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433364224 00000100:00100000:3.0:1787831010.099795:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 166 00000100:00100000:3.0:1787831010.099806:0:13771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220384c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47d7f0ed-283f-4b70-a741-6e74c5e52619+41:12241:x1874676433364224:12345-192.168.203.31@tcp:101:cat.0 00010000:00010000:3.0:1787831010.099839:0:13771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787831010.099867:0:13771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77800/0x95459fb9d1d2940f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99423f90 expref: -99 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831010.100005:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d29416 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831010.100023:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d29416 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831010.100053:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d29416 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787831010.100066:0:13771:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1787831010.100203:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77800/0x95459fb9d1d2940f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f90 expref: 44 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831010.103349:0:13771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d29416 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f90 expref: 43 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831010.103373:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d232b9c6900) 00010000:00010000:3.0:1787831010.103434:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787831010.103441:0:13771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2307c77400, rc 0) 00000100:00100000:3.0:1787831010.103546:0:13771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220384c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47d7f0ed-283f-4b70-a741-6e74c5e52619+43:12241:x1874676433364224:12345-192.168.203.31@tcp:101:cat.0 Request processed in 3740us (4029us total) trans 4294967439 rc 0/0 00000100:00100000:3.0:1787831010.103557:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 166 00000100:00100000:2.0:1787831010.108115:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831010.108172:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831010.108279:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433364608 00000100:00100000:0.0:1787831010.108291:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433364608 00000100:00100000:0.0:1787831010.108379:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 42 00000100:00100000:0.0:1787831010.108391:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220384da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+43:12241:x1874676433364608:12345-192.168.203.31@tcp:35:cat.0 00000100:00100000:1.0:1787831010.108537:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433364352 00000100:00100000:1.0:1787831010.108541:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433364352 00000100:00100000:1.0:1787831010.108586:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 13 00000100:00100000:1.0:1787831010.108594:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2321e76050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+45:2397:x1874676433364352:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787831010.108607:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787831010.108661:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d29416 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f90 expref: 45 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831010.108682:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d232b9c6900) 00010000:00010000:1.0:1787831010.108688:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787831010.108696:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220384da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+44:12241:x1874676433364608:12345-192.168.203.31@tcp:35:cat.0 Request processed in 308us (524us total) trans 4294967440 rc 0/0 00000100:00100000:0.0:1787831010.108705:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 42 00000100:00100000:1.0:1787831010.108707:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2321e76050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+44:2397:x1874676433364352:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 114us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831010.108732:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 13 00000100:00100000:2.0:1787831010.149486:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831010.149567:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433364864 00000100:00100000:0.0:1787831010.149581:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433364864 00000100:00100000:0.0:1787831010.149684:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 167 00000100:00100000:0.0:1787831010.149696:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22045230c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+43:12247:x1874676433364864:12345-192.168.203.31@tcp:101:dd.0 00010000:00010000:0.0:1787831010.149727:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787831010.149731:0:6490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787831010.149766:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7800/0x95459fb9d1d2937c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f66 expref: 43 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831010.149808:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d233a6f8e00) 00010000:00010000:0.0:1787831010.149815:0:6490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787831010.149834:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3c00/0x95459fb9d1d29424 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99423f97 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831010.149972:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2000/0x95459fb9d1d2942b lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831010.149987:0:6490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3e00/0x95459fb9d1d293fa lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f89 expref: 43 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831010.150011:0:6490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2000/0x95459fb9d1d2942b lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831010.150051:0:6490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3e00/0x95459fb9d1d293fa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f89 expref: 43 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831010.150066:0:6490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3e00/0x95459fb9d1d293fa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f89 expref: 43 pid: 6490 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831010.150081:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22045c12c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6490:1874676443895936:192.168.203.31@tcp:104: 00000100:00100000:0.0:1787831010.150192:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2303e72540 going to sleep for 11 seconds 00000100:00100000:0.0:1787831010.157051:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22045c12c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6490:1874676443895936:192.168.203.31@tcp:104: 00010000:00010000:0.0:1787831010.157089:0:6490:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2000/0x95459fb9d1d2942b lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831010.160183:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831010.160301:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433364992 00000100:00100000:1.0:1787831010.160314:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433364992 00010000:00010000:1.0:1787831010.160368:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3e00/0x95459fb9d1d293fa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f89 expref: 44 pid: 6490 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831010.160413:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 84 00000100:00100000:1.0:1787831010.160425:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22045221c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+44:2396:x1874676433364992:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787831010.160445:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787831010.160453:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3e00/0x95459fb9d1d293fa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f89 expref: 44 pid: 6490 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831010.160470:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3e00/0x95459fb9d1d293fa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f89 expref: 44 pid: 6490 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831010.160498:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3e00/0x95459fb9d1d293fa lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f89 expref: 44 pid: 6490 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831010.160519:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d232b9c6900) 00010000:00010000:1.0:1787831010.160525:0:6476:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2000/0x95459fb9d1d2942b lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831010.160535:0:6476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2000/0x95459fb9d1d2942b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831010.160544:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2000/0x95459fb9d1d2942b lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831010.160603:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787831010.160725:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22045221c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+43:2396:x1874676433364992:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 302us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831010.160733:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 84 00010000:00010000:0.0:1787831010.160912:0:6490:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2000/0x95459fb9d1d2942b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831010.160928:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2000/0x95459fb9d1d2942b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787831010.160950:0:6490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1787831010.161115:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3c00/0x95459fb9d1d29424 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f97 expref: 44 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831010.161132:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2000/0x95459fb9d1d2942b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f97 expref: 43 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831010.161140:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d232b9c6900) 00010000:00010000:0.0:1787831010.161143:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787831010.161145:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2303aa2000, rc 0) 00000100:00100000:0.0:1787831010.161191:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22045230c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+43:12247:x1874676433364864:12345-192.168.203.31@tcp:101:dd.0 Request processed in 11498us (11718us total) trans 4294967441 rc 0/0 00000100:00100000:0.0:1787831010.161199:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 167 00000100:00100000:2.0:1787831010.163974:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831010.164136:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433365120 00000100:00100000:1.0:1787831010.164148:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433365120 00000100:00100000:1.0:1787831010.164223:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 168 00000100:00100000:1.0:1787831010.164234:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204523c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+43:12247:x1874676433365120:12345-192.168.203.31@tcp:101:dd.0 00010000:00010000:1.0:1787831010.164265:0:8620:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787831010.164292:0:8620:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7e00/0x95459fb9d1d29439 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99423f9e expref: -99 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831010.164336:0:8620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7a00/0x95459fb9d1d29440 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831010.164354:0:8620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7a00/0x95459fb9d1d29440 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831010.164365:0:8620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7a00/0x95459fb9d1d29440 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831010.164511:0:8620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7e00/0x95459fb9d1d29439 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f9e expref: 45 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831010.164530:0:8620:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7a00/0x95459fb9d1d29440 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f9e expref: 44 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831010.164538:0:8620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d232b9c6900) 00010000:00010000:1.0:1787831010.164547:0:8620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787831010.164552:0:8620:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d23344b7a00, rc 0) 00000100:00100000:1.0:1787831010.164655:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204523c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+44:12247:x1874676433365120:12345-192.168.203.31@tcp:101:dd.0 Request processed in 423us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831010.164664:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 168 00000100:00100000:1.0:1787831010.173585:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831010.173756:0:13771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433365376 00000100:00100000:3.0:1787831010.173767:0:13771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433365376 00000100:00100000:3.0:1787831010.173854:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 169 00000100:00100000:3.0:1787831010.173866:0:13771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22038ec3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47d7f0ed-283f-4b70-a741-6e74c5e52619+44:12247:x1874676433365376:12345-192.168.203.31@tcp:36:dd.0 00010000:00010000:3.0:1787831010.174133:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77800/0x95459fb9d1d29447 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831010.174150:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77800/0x95459fb9d1d29447 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831010.174160:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77800/0x95459fb9d1d29447 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787831010.174218:0:13771:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967442 00000004:00010000:3.0:1787831010.174249:0:13771:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003701ebc7 reply state 00000000b60af21b transno 4294967443 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77800/0x95459fb9d1d29447 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831010.174261:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77800/0x95459fb9d1d29447 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831010.174270:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d232b9c6900) 00010000:00010000:3.0:1787831010.174273:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787831010.174277:0:13771:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787831010.174393:0:13771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22038ec3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47d7f0ed-283f-4b70-a741-6e74c5e52619+47:12247:x1874676433365376:12345-192.168.203.31@tcp:36:dd.0 Request processed in 528us (822us total) trans 4294967443 rc 0/0 00000100:00100000:3.0:1787831010.174400:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 169 00000020:00080000:3.0:1787831010.174406:0:13771:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787831010.280006:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787831010.441898:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831010.442090:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433365504 00000100:00100000:0.0:1787831010.442102:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433365504 00000100:00100000:0.0:1787831010.442190:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 170 00000100:00100000:0.0:1787831010.442212:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204520000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+47:12261:x1874676433365504:12345-192.168.203.31@tcp:101:stat.0 00010000:00010000:0.0:1787831010.442243:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787831010.442271:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3c00/0x95459fb9d1d2944e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99423fa5 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831010.442361:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3000/0x95459fb9d1d29455 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831010.442412:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3000/0x95459fb9d1d29455 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831010.442436:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3000/0x95459fb9d1d29455 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831010.442451:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3a00/0x95459fb9d1d2945c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831010.442458:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3a00/0x95459fb9d1d2945c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831010.442464:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3a00/0x95459fb9d1d2945c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831010.442562:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3600/0x95459fb9d1d29463 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831010.442573:0:6490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2000/0x95459fb9d1d2942b lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f97 expref: 48 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831010.442584:0:6490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3600/0x95459fb9d1d29463 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831010.442669:0:6490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2000/0x95459fb9d1d2942b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f97 expref: 48 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831010.442684:0:6490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2000/0x95459fb9d1d2942b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f97 expref: 48 pid: 6490 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831010.442711:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22045c12c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6490:1874676443896064:192.168.203.31@tcp:104: 00000100:00100000:0.0:1787831010.442856:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2303e72540 going to sleep for 11 seconds 00000100:00100000:2.0:1787831010.446658:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831010.446802:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22045c12c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6490:1874676443896064:192.168.203.31@tcp:104: 00010000:00010000:0.0:1787831010.446904:0:6490:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3600/0x95459fb9d1d29463 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787831010.446974:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433365760 00000100:00100000:3.0:1787831010.446981:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433365760 00000100:00100000:3.0:1787831010.447082:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 43 00000100:00100000:3.0:1787831010.447093:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204521e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+49:6626:x1874676433365760:12345-192.168.203.31@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787831010.449234:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204521e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+50:6626:x1874676433365760:12345-192.168.203.31@tcp:35:ldlm_bl.0 Request processed in 2131us (2611us total) trans 4294967444 rc 0/0 00000100:00100000:3.0:1787831010.449250:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 43 00000100:00100000:2.0:1787831010.454554:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831010.454859:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433365888 00000100:00100000:1.0:1787831010.454872:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433365888 00010000:00010000:0.0:1787831010.455156:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2000/0x95459fb9d1d2942b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f97 expref: 50 pid: 6490 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831010.455252:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 85 00000100:00100000:0.0:1787831010.455264:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204521a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+50:2397:x1874676433365888:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787831010.455285:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787831010.455309:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2000/0x95459fb9d1d2942b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f97 expref: 50 pid: 6490 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831010.455324:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2000/0x95459fb9d1d2942b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f97 expref: 50 pid: 6490 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831010.455353:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2000/0x95459fb9d1d2942b lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f97 expref: 50 pid: 6490 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831010.455375:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d232b9c6900) 00010000:00010000:0.0:1787831010.455381:0:6477:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3600/0x95459fb9d1d29463 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831010.455413:0:6477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3600/0x95459fb9d1d29463 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831010.455423:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3600/0x95459fb9d1d29463 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831010.455460:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787831010.455530:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204521a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+49:2397:x1874676433365888:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 268us (994us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831010.455539:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 85 00010000:00010000:2.0:1787831010.455601:0:6490:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3600/0x95459fb9d1d29463 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831010.455610:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3600/0x95459fb9d1d29463 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787831010.455697:0:6490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:2.0:1787831010.455703:0:6490:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787831010.455734:0:6490:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3600/0x95459fb9d1d29463 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831010.455747:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3600/0x95459fb9d1d29463 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831010.455757:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3000/0x95459fb9d1d29455 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831010.455764:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3000/0x95459fb9d1d29455 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831010.455785:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3000/0x95459fb9d1d29455 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831010.455803:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2303aa3000 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:2.0:1787831010.455808:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3000/0x95459fb9d1d29455 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831010.455817:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3000/0x95459fb9d1d29455 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831010.455828:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d233a6f8e00) 00010000:00010000:2.0:1787831010.455831:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787831010.455835:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3000/0x95459fb9d1d29455 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831010.455842:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3000/0x95459fb9d1d29455 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831010.455853:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3a00/0x95459fb9d1d2945c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831010.455859:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3a00/0x95459fb9d1d2945c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831010.455866:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3a00/0x95459fb9d1d2945c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831010.455871:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2303aa3a00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:2.0:1787831010.455874:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3a00/0x95459fb9d1d2945c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831010.455880:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3a00/0x95459fb9d1d2945c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831010.455900:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8d233a6f8800) 00010000:00010000:2.0:1787831010.455903:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787831010.455906:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3a00/0x95459fb9d1d2945c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831010.455912:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3a00/0x95459fb9d1d2945c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831010.455949:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3c00/0x95459fb9d1d2944e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423fa5 expref: 49 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831010.455964:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3600/0x95459fb9d1d29463 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423fa5 expref: 48 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831010.455972:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d232b9c6900) 00010000:00010000:2.0:1787831010.455974:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787831010.455976:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2303aa3600, rc 0) 00000100:00100000:2.0:1787831010.456008:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204520000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+48:12261:x1874676433365504:12345-192.168.203.31@tcp:101:stat.0 Request processed in 13808us (14125us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831010.456016:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 170 00000100:00100000:2.0:1787831010.535073:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a7a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443896192:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787831010.535180:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831010.535402:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443896192 00000100:00100000:0.0:1787831010.535412:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443896192 00000100:00100000:0.0:1787831010.535480:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1787831010.535491:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204520780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676443896192:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787831010.535536:0:7448:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787831010.535598:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204520780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676443896192:12345-0@lo:41:osp-pre-1-0.0 Request processed in 109us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831010.535606:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1787831010.535730:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a7a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443896192:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787831010.536340:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831010.536424:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433366144 00000100:00100000:0.0:1787831010.536430:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433366144 00000100:00100000:0.0:1787831010.536475:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 171 00000100:00100000:0.0:1787831010.536483:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+48:12267:x1874676433366144:12345-192.168.203.31@tcp:36:truncate.0 00010000:00010000:0.0:1787831010.536540:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787831010.536574:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3600/0x95459fb9d1d29463 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423fa5 expref: 48 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831010.536600:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d232b9c6900) 00010000:00010000:0.0:1787831010.536660:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787831010.536893:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2000/0x95459fb9d1d2946a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831010.536910:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2000/0x95459fb9d1d2946a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831010.536921:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2000/0x95459fb9d1d2946a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787831010.536970:0:6491:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967445 00000004:00010000:0.0:1787831010.537011:0:6491:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000057b7540 reply state 000000008ea0464e transno 4294967446 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2000/0x95459fb9d1d2946a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831010.537026:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2000/0x95459fb9d1d2946a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831010.537033:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d232b9c6900) 00010000:00010000:0.0:1787831010.537036:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787831010.537039:0:6491:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787831010.537139:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+50:12267:x1874676433366144:12345-192.168.203.31@tcp:36:truncate.0 Request processed in 656us (802us total) trans 4294967446 rc 0/0 00000100:00100000:0.0:1787831010.537146:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 171 00000020:00080000:0.0:1787831010.537150:0:6491:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787831010.715011:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831010.715397:0:13771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433366272 00000100:00100000:3.0:1787831010.715410:0:13771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433366272 00000100:00100000:3.0:1787831010.715484:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 172 00000100:00100000:3.0:1787831010.715496:0:13771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2336bfc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47d7f0ed-283f-4b70-a741-6e74c5e52619+50:12281:x1874676433366272:12345-192.168.203.31@tcp:101:stat.0 00010000:00010000:3.0:1787831010.715526:0:13771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787831010.715554:0:13771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d29471 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99423fac expref: -99 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831010.715677:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d29478 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831010.715691:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d29478 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831010.715701:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d29478 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831010.715708:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d2947f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831010.715713:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d2947f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831010.715718:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d2947f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831010.715806:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d29486 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831010.715815:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d29486 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831010.715821:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d29486 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787831010.715939:0:13771:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:3.0:1787831010.715943:0:13771:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787831010.715966:0:13771:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d29486 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831010.716197:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d29486 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831010.716369:0:13771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d29478 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831010.716377:0:13771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d29478 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831010.716384:0:13771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d29478 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831010.716391:0:13771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2307c77600 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:3.0:1787831010.716395:0:13771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d29478 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831010.716405:0:13771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d29478 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831010.716420:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d233a6f8e00) 00010000:00010000:3.0:1787831010.716423:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787831010.716429:0:13771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d29478 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831010.716436:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d29478 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831010.716453:0:13771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d2947f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831010.716459:0:13771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d2947f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831010.716472:0:13771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d2947f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831010.716478:0:13771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2307c76400 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:3.0:1787831010.716481:0:13771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d2947f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831010.716488:0:13771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d2947f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831010.716496:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8d233a6f8800) 00010000:00010000:3.0:1787831010.716498:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787831010.716501:0:13771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d2947f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831010.716507:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d2947f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831010.716544:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d29471 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423fac expref: 52 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831010.716559:0:13771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d29486 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423fac expref: 51 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831010.716566:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d232b9c6900) 00010000:00010000:3.0:1787831010.716568:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787831010.716571:0:13771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2307c77a00, rc 0) 00000100:00100000:3.0:1787831010.716711:0:13771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2336bfc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47d7f0ed-283f-4b70-a741-6e74c5e52619+51:12281:x1874676433366272:12345-192.168.203.31@tcp:101:stat.0 Request processed in 1217us (1714us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831010.716728:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 172 00000100:00100000:0.0:1787831010.791739:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831010.791972:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433366528 00000100:00100000:2.0:1787831010.791985:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433366528 00000100:00100000:2.0:1787831010.792097:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 173 00000100:00100000:2.0:1787831010.792109:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22045c12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+51:12291:x1874676433366528:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:2.0:1787831010.792135:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787831010.792179:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0c00/0x95459fb9d1d2948d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99423fb3 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787831010.792333:0:6490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1787831010.792476:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0c00/0x95459fb9d1d2948d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423fb3 expref: 53 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831010.792495:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2303e42700) 00010000:00010000:2.0:1787831010.792499:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787831010.792505:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0c00/0x95459fb9d1d2948d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423fb3 expref: 53 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831010.792521:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22039c0c00, rc 0) 00000100:00100000:2.0:1787831010.792591:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22045c12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+52:12291:x1874676433366528:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 484us (866us total) trans 4294967447 rc 301/301 00000100:00100000:2.0:1787831010.792598:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 173 00000100:00100000:1.0:1787831010.795320:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831010.795654:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433366784 00000100:00100000:3.0:1787831010.795665:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433366784 00000100:00100000:3.0:1787831010.795734:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 44 00000100:00100000:3.0:1787831010.795745:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d23066cac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+52:12291:x1874676433366784:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:3.0:1787831010.796057:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d23066cac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+53:12291:x1874676433366784:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 312us (749us total) trans 4294967448 rc 0/0 00000100:00100000:3.0:1787831010.796065:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 44 00000100:00100000:1.0:1787831010.840557:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831010.840673:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433367040 00000100:00100000:2.0:1787831010.840686:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433367040 00000100:00100000:2.0:1787831010.840758:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 174 00000100:00100000:2.0:1787831010.840781:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22037db0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+53:12297:x1874676433367040:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:2.0:1787831010.840813:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787831010.840839:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0c00/0x95459fb9d1d2949b lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99423fba expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831010.840979:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0e00/0x95459fb9d1d294a2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831010.840997:0:6492:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d29486 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423fac expref: 54 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831010.841024:0:6492:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0e00/0x95459fb9d1d294a2 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831010.841062:0:6492:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d29486 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423fac expref: 54 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831010.841078:0:6492:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d29486 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423fac expref: 54 pid: 13771 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831010.841092:0:6492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204522940 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6492:1874676443896320:192.168.203.31@tcp:104: 00000100:00100000:2.0:1787831010.841217:0:6492:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2203b6b9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787831010.850272:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831010.850461:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433367168 00000100:00100000:0.0:1787831010.850473:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433367168 00010000:00010000:0.0:1787831010.850531:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d29486 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423fac expref: 55 pid: 13771 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831010.850580:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 86 00000100:00100000:0.0:1787831010.850591:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22037db840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+55:2396:x1874676433367168:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787831010.850669:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787831010.850678:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d29486 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423fac expref: 55 pid: 13771 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831010.850694:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d29486 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423fac expref: 55 pid: 13771 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831010.850724:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d232b9c6900) 00010000:00010000:0.0:1787831010.850730:0:6476:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0e00/0x95459fb9d1d294a2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831010.850742:0:6476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0e00/0x95459fb9d1d294a2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831010.850751:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0e00/0x95459fb9d1d294a2 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831010.850789:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787831010.850861:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22037db840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+55:2396:x1874676433367168:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 272us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831010.850870:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 86 00010000:00010000:2.0:1787831010.851549:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d29486 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423fac expref: 54 pid: 13771 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831010.851575:0:6492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204522940 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6492:1874676443896320:192.168.203.31@tcp:104: 00010000:00010000:2.0:1787831010.851601:0:6492:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0e00/0x95459fb9d1d294a2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831010.851610:0:6492:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0e00/0x95459fb9d1d294a2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831010.851616:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0e00/0x95459fb9d1d294a2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787831010.851686:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:2.0:1787831010.851866:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0c00/0x95459fb9d1d2949b lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423fba expref: 55 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831010.851902:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0e00/0x95459fb9d1d294a2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423fba expref: 54 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831010.851910:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d232b9c6900) 00010000:00010000:2.0:1787831010.851914:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787831010.851916:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22039c0e00, rc 0) 00000100:00100000:2.0:1787831010.851978:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22037db0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+54:12297:x1874676433367040:12345-192.168.203.31@tcp:101:bash.0 Request processed in 11210us (11432us total) trans 4294967449 rc 0/0 00000100:00100000:2.0:1787831010.851987:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 174 00000100:00100000:1.0:1787831010.855992:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831010.856178:0:13771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433367424 00000100:00100000:3.0:1787831010.856192:0:13771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433367424 00000100:00100000:3.0:1787831010.856272:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 175 00000100:00100000:3.0:1787831010.856284:0:13771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22037db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47d7f0ed-283f-4b70-a741-6e74c5e52619+54:12297:x1874676433367424:12345-192.168.203.31@tcp:36:bash.0 00010000:00010000:3.0:1787831010.856599:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d294b0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831010.856620:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d294b0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831010.856675:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d294b0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787831010.856727:0:13771:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967450 00000004:00010000:3.0:1787831010.856752:0:13771:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000cd78d09 reply state 00000000326cad0b transno 4294967451 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d294b0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831010.856783:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d294b0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831010.856805:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d232b9c6900) 00010000:00010000:3.0:1787831010.856809:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787831010.856814:0:13771:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787831010.856919:0:13771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22037db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47d7f0ed-283f-4b70-a741-6e74c5e52619+57:12297:x1874676433367424:12345-192.168.203.31@tcp:36:bash.0 Request processed in 636us (942us total) trans 4294967451 rc 0/0 00000100:00100000:3.0:1787831010.856927:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 175 00000020:00080000:3.0:1787831010.856933:0:13771:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787831010.863549:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831010.863666:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433367552 00000100:00100000:0.0:1787831010.863679:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433367552 00000100:00100000:0.0:1787831010.863753:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 176 00000100:00100000:0.0:1787831010.863764:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22037d83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+57:12297:x1874676433367552:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:0.0:1787831010.863810:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787831010.863842:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3600/0x95459fb9d1d294b7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99423fc1 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831010.863990:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3200/0x95459fb9d1d294be lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831010.864009:0:6490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0e00/0x95459fb9d1d294a2 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423fba expref: 58 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831010.864020:0:6490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3200/0x95459fb9d1d294be lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831010.864063:0:6490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0e00/0x95459fb9d1d294a2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423fba expref: 58 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831010.864079:0:6490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0e00/0x95459fb9d1d294a2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423fba expref: 58 pid: 6492 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831010.864094:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22045c3480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6490:1874676443896448:192.168.203.31@tcp:104: 00000100:00100000:0.0:1787831010.864205:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2307c34840 going to sleep for 11 seconds 00000100:00100000:1.0:1787831010.867685:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831010.867789:0:7432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433367680 00000100:00100000:3.0:1787831010.867800:0:7432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433367680 00010000:00010000:3.0:1787831010.867855:0:7432:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0e00/0x95459fb9d1d294a2 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423fba expref: 59 pid: 6492 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787831010.867911:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 87 00000100:00100000:3.0:1787831010.867922:0:7432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203634000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+59:2397:x1874676433367680:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787831010.867942:0:7432:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787831010.867950:0:7432:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0e00/0x95459fb9d1d294a2 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423fba expref: 59 pid: 6492 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831010.867965:0:7432:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0e00/0x95459fb9d1d294a2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423fba expref: 59 pid: 6492 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831010.867993:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d232b9c6900) 00010000:00010000:3.0:1787831010.868000:0:7432:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3200/0x95459fb9d1d294be lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831010.868012:0:7432:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3200/0x95459fb9d1d294be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831010.868044:0:7432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3200/0x95459fb9d1d294be lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831010.868067:0:7432:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787831010.868135:0:7432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203634000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+59:2397:x1874676433367680:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 214us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831010.868142:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 87 00010000:00010000:0.0:1787831010.868467:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0e00/0x95459fb9d1d294a2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423fba expref: 58 pid: 6492 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831010.868489:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22045c3480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6490:1874676443896448:192.168.203.31@tcp:104: 00010000:00010000:0.0:1787831010.868522:0:6490:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3200/0x95459fb9d1d294be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831010.868544:0:6490:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3200/0x95459fb9d1d294be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831010.868564:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3200/0x95459fb9d1d294be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787831010.868680:0:6490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1787831010.868686:0:6490:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787831010.868713:0:6490:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3200/0x95459fb9d1d294be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831010.868755:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3600/0x95459fb9d1d294b7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423fc1 expref: 58 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831010.868787:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3200/0x95459fb9d1d294be lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423fc1 expref: 57 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831010.868795:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d232b9c6900) 00010000:00010000:0.0:1787831010.868797:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787831010.868800:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2303aa3200, rc 0) 00000100:00100000:0.0:1787831010.869398:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22037d83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+57:12297:x1874676433367552:12345-192.168.203.31@tcp:101:bash.0 Request processed in 5632us (5859us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831010.869418:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 176 00000100:00100000:1.0:1787831010.873264:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831010.873348:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433367936 00000100:00100000:3.0:1787831010.873360:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433367936 00000100:00100000:3.0:1787831010.873438:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 45 00000100:00100000:3.0:1787831010.873449:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220395de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+57:12297:x1874676433367936:12345-192.168.203.31@tcp:35:bash.0 00000100:00100000:3.0:1787831010.875414:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220395de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+58:12297:x1874676433367936:12345-192.168.203.31@tcp:35:bash.0 Request processed in 1958us (2155us total) trans 4294967452 rc 0/0 00000100:00100000:3.0:1787831010.875426:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 45 00000100:00100000:1.0:1787831010.966103:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831010.966269:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433368192 00000100:00100000:2.0:1787831010.966278:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433368192 00000100:00100000:2.0:1787831010.966336:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 177 00000100:00100000:2.0:1787831010.966345:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203afde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+58:12307:x1874676433368192:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:2.0:1787831010.966367:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787831010.966387:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1400/0x95459fb9d1d294c5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99423fc8 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787831010.966493:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1787831010.966577:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1400/0x95459fb9d1d294c5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423fc8 expref: 60 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831010.966591:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2303e42700) 00010000:00010000:2.0:1787831010.966593:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787831010.966598:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1400/0x95459fb9d1d294c5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423fc8 expref: 60 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831010.966660:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22039c1400, rc 0) 00000100:00100000:2.0:1787831010.966870:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203afde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+59:12307:x1874676433368192:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 525us (775us total) trans 4294967453 rc 301/301 00000100:00100000:2.0:1787831010.966878:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 177 00000100:00100000:2.0:1787831010.980975:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831010.985579:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433368320 00000100:00100000:0.0:1787831010.985592:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433368320 00000100:00100000:0.0:1787831010.985738:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 178 00000100:00100000:0.0:1787831010.985749:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204522940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+59:12307:x1874676433368320:12345-192.168.203.31@tcp:34:lfs.0 00010000:00010000:0.0:1787831010.985857:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3600/0x95459fb9d1d294d3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831010.985875:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3600/0x95459fb9d1d294d3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831010.985893:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3600/0x95459fb9d1d294d3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831010.985907:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2600/0x95459fb9d1d294da lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831010.985915:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2600/0x95459fb9d1d294da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831010.985922:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2600/0x95459fb9d1d294da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831010.985994:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2800/0x95459fb9d1d294e1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831010.986003:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2800/0x95459fb9d1d294e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831010.986010:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2800/0x95459fb9d1d294e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787831010.986063:0:6491:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2800/0x95459fb9d1d294e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831010.986075:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3600/0x95459fb9d1d294d3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831010.986082:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3600/0x95459fb9d1d294d3 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831010.986090:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3600/0x95459fb9d1d294d3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831010.986105:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2303aa3600 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:0.0:1787831010.986110:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3600/0x95459fb9d1d294d3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831010.986117:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3600/0x95459fb9d1d294d3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831010.986129:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d233a6f8e00) 00010000:00010000:0.0:1787831010.986132:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787831010.986137:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3600/0x95459fb9d1d294d3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831010.986144:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3600/0x95459fb9d1d294d3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831010.986157:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2600/0x95459fb9d1d294da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831010.986163:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2600/0x95459fb9d1d294da lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831010.986169:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2600/0x95459fb9d1d294da lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831010.986174:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2303aa2600 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:0.0:1787831010.986177:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2600/0x95459fb9d1d294da lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831010.986184:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2600/0x95459fb9d1d294da lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831010.986201:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8d233a6f8800) 00010000:00010000:0.0:1787831010.986203:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787831010.986207:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2600/0x95459fb9d1d294da lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831010.986212:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2600/0x95459fb9d1d294da lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831010.986236:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2800/0x95459fb9d1d294e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831010.986242:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2800/0x95459fb9d1d294e1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831010.986248:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2800/0x95459fb9d1d294e1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831010.986253:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2303aa2800 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:0.0:1787831010.986255:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2800/0x95459fb9d1d294e1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831010.986260:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2800/0x95459fb9d1d294e1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831010.986267:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d232b9c6900) 00010000:00010000:0.0:1787831010.986269:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787831010.986272:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2800/0x95459fb9d1d294e1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831010.986276:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2800/0x95459fb9d1d294e1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831010.986617:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204522940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+59:12307:x1874676433368320:12345-192.168.203.31@tcp:34:lfs.0 Request processed in 868us (5648us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831010.986880:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 178 00000100:00100000:1.0:1787831010.996054:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831011.001868:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433368576 00000100:00100000:3.0:1787831011.001882:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433368576 00000100:00100000:3.0:1787831011.002283:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 46 00000100:00100000:3.0:1787831011.002295:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2309cf8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+59:12307:x1874676433368576:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:3.0:1787831011.002527:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2309cf8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+60:12307:x1874676433368576:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 235us (6482us total) trans 4294967454 rc 0/0 00000100:00100000:3.0:1787831011.002536:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 46 00000100:00080000:2.0:1787831011.006750:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787831011.046951:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787831011.046973:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203765a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443896576:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787831011.047216:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831011.047348:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443896576 00000100:00100000:1.0:1787831011.047356:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443896576 00000100:00100000:1.0:1787831011.052862:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1787831011.052882:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204520b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443896576:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787831011.052932:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1787831011.053020:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204520b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443896576:12345-0@lo:41:osp-pre-0-1.0 Request processed in 146us (5804us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831011.053051:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1787831011.053143:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203765a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443896576:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787831011.069691:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831011.070201:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433368832 00000100:00100000:0.0:1787831011.070211:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433368832 00000100:00100000:0.0:1787831011.070277:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 179 00000100:00100000:0.0:1787831011.070285:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220453cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+60:12310:x1874676433368832:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:2.0:1787831011.071043:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787831011.071066:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1400/0x95459fb9d1d294e8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99423fcf expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831011.071144:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1200/0x95459fb9d1d294ef lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831011.071157:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1200/0x95459fb9d1d294ef lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831011.071169:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1200/0x95459fb9d1d294ef lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831011.071188:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1800/0x95459fb9d1d294f6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831011.071195:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1800/0x95459fb9d1d294f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831011.071215:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1800/0x95459fb9d1d294f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831011.072570:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0800/0x95459fb9d1d294fd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831011.072588:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0800/0x95459fb9d1d294fd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831011.072598:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0800/0x95459fb9d1d294fd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787831011.072608:0:6490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1787831011.073041:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1200/0x95459fb9d1d294ef lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831011.073050:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1200/0x95459fb9d1d294ef lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831011.073056:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1200/0x95459fb9d1d294ef lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831011.073063:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22039c1200 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:2.0:1787831011.073067:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1200/0x95459fb9d1d294ef lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831011.073074:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1200/0x95459fb9d1d294ef lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831011.073097:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d233a6f8e00) 00010000:00010000:2.0:1787831011.073100:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787831011.073118:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1200/0x95459fb9d1d294ef lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831011.073125:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1200/0x95459fb9d1d294ef lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831011.073139:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1800/0x95459fb9d1d294f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831011.073145:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1800/0x95459fb9d1d294f6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831011.073150:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1800/0x95459fb9d1d294f6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831011.073155:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22039c1800 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:2.0:1787831011.073158:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1800/0x95459fb9d1d294f6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831011.073163:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1800/0x95459fb9d1d294f6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831011.073180:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8d233a6f8800) 00010000:00010000:2.0:1787831011.073182:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787831011.073185:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1800/0x95459fb9d1d294f6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831011.073190:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1800/0x95459fb9d1d294f6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831011.073238:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1400/0x95459fb9d1d294e8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423fcf expref: 63 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831011.073264:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0800/0x95459fb9d1d294fd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423fcf expref: 62 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831011.073271:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d232b9c6900) 00010000:00010000:2.0:1787831011.073273:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787831011.073275:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22039c0800, rc 0) 00000100:00100000:2.0:1787831011.073806:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220453cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+62:12310:x1874676433368832:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 3519us (4338us total) trans 4294967455 rc 0/0 00000100:00100000:2.0:1787831011.073816:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 179 00000100:00100000:1.0:1787831011.078365:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831011.078572:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433368960 00000100:00100000:0.0:1787831011.078582:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433368960 00000100:00100000:0.0:1787831011.078663:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 14 00000100:00100000:0.0:1787831011.078673:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203765e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+62:2394:x1874676433368960:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787831011.078688:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787831011.078713:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0800/0x95459fb9d1d294fd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423fcf expref: 62 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831011.078731:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d232b9c6900) 00010000:00010000:0.0:1787831011.078736:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787831011.079200:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203765e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+61:2394:x1874676433368960:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 527us (842us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831011.079208:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 14 00000100:00100000:1.0:1787831011.088822:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831011.089853:0:13771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433369088 00000100:00100000:2.0:1787831011.089863:0:13771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433369088 00000100:00100000:2.0:1787831011.090004:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 180 00000100:00100000:2.0:1787831011.090016:0:13771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203765a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47d7f0ed-283f-4b70-a741-6e74c5e52619+61:12310:x1874676433369088:12345-192.168.203.31@tcp:54:lfs.0 00010000:00010000:2.0:1787831011.090093:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d2950b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831011.090110:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d2950b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831011.090120:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d2950b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831011.090153:0:13771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d2950b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831011.090160:0:13771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d2950b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831011.090195:0:13771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d2950b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831011.090201:0:13771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22039c0a00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:2.0:1787831011.090205:0:13771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d2950b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831011.090213:0:13771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d2950b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831011.090226:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d232b9c6900) 00010000:00010000:2.0:1787831011.090229:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787831011.090233:0:13771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d2950b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831011.090240:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d2950b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831011.090312:0:13771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203765a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47d7f0ed-283f-4b70-a741-6e74c5e52619+61:12310:x1874676433369088:12345-192.168.203.31@tcp:54:lfs.0 Request processed in 299us (1498us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831011.090319:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 180 00000100:00100000:1.0:1787831011.095373:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831011.098971:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433369344 00000100:00100000:3.0:1787831011.098985:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433369344 00000100:00100000:2.0:1787831011.099190:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 47 00000100:00100000:2.0:1787831011.099200:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2318d57840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+61:12310:x1874676433369344:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:2.0:1787831011.099441:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2318d57840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+62:12310:x1874676433369344:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 243us (4076us total) trans 4294967456 rc 0/0 00000100:00100000:2.0:1787831011.099449:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 47 00000100:00100000:3.0:1787831011.297037:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831011.297144:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433369600 00000100:00100000:0.0:1787831011.297153:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433369600 00000100:00100000:0.0:1787831011.297220:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 181 00000100:00100000:0.0:1787831011.297229:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220453e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+62:12328:x1874676433369600:12345-192.168.203.31@tcp:101:cat.0 00010000:00010000:0.0:1787831011.297252:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787831011.297285:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2800/0x95459fb9d1d29512 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99423fd6 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831011.297388:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2600/0x95459fb9d1d29519 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831011.297416:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2600/0x95459fb9d1d29519 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831011.297427:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2600/0x95459fb9d1d29519 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787831011.297437:0:6491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1787831011.297552:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2800/0x95459fb9d1d29512 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423fd6 expref: 65 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831011.297571:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2600/0x95459fb9d1d29519 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423fd6 expref: 64 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831011.297579:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d232b9c6900) 00010000:00010000:0.0:1787831011.297582:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787831011.297586:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2303aa2600, rc 0) 00000100:00100000:0.0:1787831011.297693:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220453e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+64:12328:x1874676433369600:12345-192.168.203.31@tcp:101:cat.0 Request processed in 464us (665us total) trans 4294967457 rc 0/0 00000100:00100000:0.0:1787831011.297700:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 181 00010000:00010000:1.0:1787831011.303204:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787831011.348858:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831011.348976:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433369728 00000100:00100000:2.0:1787831011.348985:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433369728 00000100:00100000:2.0:1787831011.349051:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 182 00000100:00100000:2.0:1787831011.349060:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220453cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+64:12329:x1874676433369728:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:2.0:1787831011.349091:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787831011.349111:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1400/0x95459fb9d1d29527 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99423fdd expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831011.349176:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1800/0x95459fb9d1d2952e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831011.349190:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1800/0x95459fb9d1d2952e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831011.349201:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1800/0x95459fb9d1d2952e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787831011.349250:0:6490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1787831011.349254:0:6490:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787831011.349271:0:6490:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1800/0x95459fb9d1d2952e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831011.349297:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1400/0x95459fb9d1d29527 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423fdd expref: 66 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831011.349314:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1800/0x95459fb9d1d2952e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423fdd expref: 65 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831011.349321:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d233a6f8e00) 00010000:00010000:2.0:1787831011.349324:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787831011.349328:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22039c1800, rc 0) 00000100:00100000:2.0:1787831011.349386:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220453cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+65:12329:x1874676433369728:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 327us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831011.349399:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 182 00000100:00100000:2.0:1787831011.358541:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831011.358705:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433370112 00000100:00100000:1.0:1787831011.358714:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433370112 00000100:00100000:1.0:1787831011.358778:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 48 00000100:00100000:1.0:1787831011.358788:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204523480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+65:12329:x1874676433370112:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:1.0:1787831011.359052:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204523480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+66:12329:x1874676433370112:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 264us (523us total) trans 4294967458 rc 0/0 00000100:00100000:1.0:1787831011.359060:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 48 00000100:00100000:3.0:1787831011.366272:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831011.366455:0:7432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433370240 00000100:00100000:0.0:1787831011.366464:0:7432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433370240 00000100:00100000:0.0:1787831011.366539:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 15 00000100:00100000:0.0:1787831011.366549:0:7432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220453f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+66:12329:x1874676433370240:12345-192.168.203.31@tcp:103:lfs.0 00010000:00010000:0.0:1787831011.366579:0:7432:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787831011.366600:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3200/0x95459fb9d1d294be lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423fc1 expref: 66 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831011.366622:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2600/0x95459fb9d1d29519 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423fd6 expref: 65 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831011.366677:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6600/0x95459fb9d1d293bb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f7b expref: 64 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831011.366687:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d232b9c6900) 00010000:00010000:0.0:1787831011.366692:0:7432:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787831011.366746:0:7432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220453f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+63:12329:x1874676433370240:12345-192.168.203.31@tcp:103:lfs.0 Request processed in 199us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831011.366754:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 15 00000100:00100000:3.0:1787831011.372108:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831011.372267:0:13771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433370368 00000100:00100000:2.0:1787831011.372276:0:13771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433370368 00000100:00100000:2.0:1787831011.372330:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 183 00000100:00100000:2.0:1787831011.372340:0:13771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220453e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47d7f0ed-283f-4b70-a741-6e74c5e52619+63:12329:x1874676433370368:12345-192.168.203.31@tcp:58:lfs.0 00010000:00010000:2.0:1787831011.372452:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1200/0x95459fb9d1d29535 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831011.372468:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1200/0x95459fb9d1d29535 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831011.372478:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1200/0x95459fb9d1d29535 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787831011.372566:0:13771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:2.0:1787831011.372670:0:13771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220453e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47d7f0ed-283f-4b70-a741-6e74c5e52619+63:12329:x1874676433370368:12345-192.168.203.31@tcp:58:lfs.0 Request processed in 331us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831011.372677:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 183 00000100:00100000:2.0:1787831011.409440:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831011.409522:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433370496 00000100:00100000:1.0:1787831011.409531:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433370496 00000100:00100000:1.0:1787831011.409584:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 184 00000100:00100000:1.0:1787831011.409592:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22045203c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+63:12331:x1874676433370496:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:1.0:1787831011.409610:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787831011.409648:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7000/0x95459fb9d1d2953c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99423fe4 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831011.409712:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6600/0x95459fb9d1d29543 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831011.409725:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6600/0x95459fb9d1d29543 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831011.409735:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6600/0x95459fb9d1d29543 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831011.409762:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6400/0x95459fb9d1d2954a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831011.409783:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6400/0x95459fb9d1d2954a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831011.409790:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6400/0x95459fb9d1d2954a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831011.409861:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6c00/0x95459fb9d1d29551 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831011.409871:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6c00/0x95459fb9d1d29551 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831011.409878:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6c00/0x95459fb9d1d29551 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787831011.409914:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1787831011.409918:0:6492:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787831011.409934:0:6492:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6c00/0x95459fb9d1d29551 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831011.409946:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6c00/0x95459fb9d1d29551 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831011.409953:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6600/0x95459fb9d1d29543 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831011.409959:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6600/0x95459fb9d1d29543 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831011.409975:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6600/0x95459fb9d1d29543 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831011.409980:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d23344b6600 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:1.0:1787831011.409983:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6600/0x95459fb9d1d29543 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831011.409991:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6600/0x95459fb9d1d29543 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831011.410002:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d233a6f8e00) 00010000:00010000:1.0:1787831011.410005:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787831011.410009:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6600/0x95459fb9d1d29543 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831011.410014:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6600/0x95459fb9d1d29543 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831011.410026:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6400/0x95459fb9d1d2954a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831011.410032:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6400/0x95459fb9d1d2954a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831011.410038:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6400/0x95459fb9d1d2954a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831011.410043:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d23344b6400 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:1.0:1787831011.410045:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6400/0x95459fb9d1d2954a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831011.410061:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6400/0x95459fb9d1d2954a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831011.410069:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8d233a6f8800) 00010000:00010000:1.0:1787831011.410071:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787831011.410074:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6400/0x95459fb9d1d2954a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831011.410091:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6400/0x95459fb9d1d2954a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831011.410120:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7000/0x95459fb9d1d2953c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423fe4 expref: 65 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831011.410133:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6c00/0x95459fb9d1d29551 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423fe4 expref: 64 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831011.410140:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d232b9c6900) 00010000:00010000:1.0:1787831011.410143:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787831011.410145:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d23344b6c00, rc 0) 00000100:00100000:1.0:1787831011.410201:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22045203c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+64:12331:x1874676433370496:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 609us (771us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831011.410208:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 184 00000040:00080000:1.0:1787831011.753609:0:13758:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787831011.753618:0:13758:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787831011.753689:0:13758:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:1.0:1787831011.753699:0:13758:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787831011.753848:0:13758:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204555e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13758:1874676443896704:192.168.203.31@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787831011.753951:0:13758:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d23063bb6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787831011.759986:0:13758:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204555e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13758:1874676443896704:192.168.203.31@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787831011.763503:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831011.769954:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433370624 00000100:00100000:0.0:1787831011.769966:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433370624 00000100:00100000:0.0:1787831011.770029:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 185 00000100:00100000:0.0:1787831011.770038:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204555e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+64:12342:x1874676433370624:12345-192.168.203.31@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787831011.770070:0:8620:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787831011.770187:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204555e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+64:12342:x1874676433370624:12345-192.168.203.31@tcp:53:lhsmtool_posix.0 Request processed in 150us (6693us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831011.770195:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 185 00000100:00100000:2.0:1787831011.774858:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831011.774941:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433370752 00000100:00100000:0.0:1787831011.774950:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433370752 00000100:00100000:0.0:1787831011.775005:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 186 00000100:00100000:0.0:1787831011.775014:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204522580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+64:12342:x1874676433370752:12345-192.168.203.31@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787831011.775089:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2800/0x95459fb9d1d29558 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831011.775105:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2800/0x95459fb9d1d29558 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831011.775117:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2800/0x95459fb9d1d29558 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831011.779746:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3600/0x95459fb9d1d2955f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831011.779837:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3600/0x95459fb9d1d2955f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831011.779850:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3600/0x95459fb9d1d2955f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831011.779889:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3200/0x95459fb9d1d29566 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831011.779900:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3200/0x95459fb9d1d29566 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831011.779907:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3200/0x95459fb9d1d29566 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787831011.779956:0:6491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1787831011.779961:0:6491:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787831011.779974:0:6491:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3200/0x95459fb9d1d29566 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831011.779985:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2800/0x95459fb9d1d29558 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831011.780007:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2800/0x95459fb9d1d29558 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831011.780014:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2800/0x95459fb9d1d29558 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831011.780019:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2303aa2800 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:0.0:1787831011.780024:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2800/0x95459fb9d1d29558 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831011.780031:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2800/0x95459fb9d1d29558 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831011.780043:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d2318594400) 00010000:00010000:0.0:1787831011.780046:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787831011.780051:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2800/0x95459fb9d1d29558 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831011.780057:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2800/0x95459fb9d1d29558 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831011.780072:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3600/0x95459fb9d1d2955f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831011.780077:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3600/0x95459fb9d1d2955f lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831011.780082:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3600/0x95459fb9d1d2955f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831011.780086:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2303aa3600 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:0.0:1787831011.780095:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3600/0x95459fb9d1d2955f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831011.780102:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3600/0x95459fb9d1d2955f lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831011.780109:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff8d2309e00a00) 00010000:00010000:0.0:1787831011.780112:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787831011.780115:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3600/0x95459fb9d1d2955f lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831011.780121:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3600/0x95459fb9d1d2955f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831011.780134:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3200/0x95459fb9d1d29566 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831011.780140:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3200/0x95459fb9d1d29566 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831011.780144:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3200/0x95459fb9d1d29566 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831011.780149:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2303aa3200 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:0.0:1787831011.780152:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3200/0x95459fb9d1d29566 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831011.780157:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3200/0x95459fb9d1d29566 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831011.780163:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d232b9c6900) 00010000:00010000:0.0:1787831011.780165:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787831011.780173:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3200/0x95459fb9d1d29566 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831011.780179:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3200/0x95459fb9d1d29566 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831011.780499:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204522580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+64:12342:x1874676433370752:12345-192.168.203.31@tcp:34:lhsmtool_posix.0 Request processed in 5482us (5645us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831011.780510:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 186 00000100:00100000:0.0:1787831011.783909:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831011.784000:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433371008 00000100:00100000:2.0:1787831011.784009:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433371008 00000100:00100000:2.0:1787831011.784093:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 187 00000100:00100000:2.0:1787831011.784103:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22045c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+64:12342:x1874676433371008:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787831011.784123:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787831011.784142:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1400/0x95459fb9d1d2956d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99423feb expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831011.784270:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d29574 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831011.784283:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d29574 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831011.784294:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d29574 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787831011.784416:0:6490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1787831011.784489:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d29574 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831011.784497:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d29574 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831011.784503:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d29574 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831011.784510:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22039c0a00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:2.0:1787831011.784513:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d29574 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831011.784520:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d29574 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831011.784532:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d232b9c6900) 00010000:00010000:2.0:1787831011.784535:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787831011.784540:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d29574 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831011.784556:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d29574 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831011.784592:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1400/0x95459fb9d1d2956d lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423feb expref: 66 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831011.784602:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d2318594400) 00010000:00010000:2.0:1787831011.784605:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787831011.784609:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1400/0x95459fb9d1d2956d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423feb expref: 66 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831011.784618:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22039c1400, rc 0) 00000100:00100000:2.0:1787831011.784726:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22045c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+65:12342:x1874676433371008:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 623us (825us total) trans 4294967459 rc 301/301 00000100:00100000:2.0:1787831011.784734:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 187 00000100:00100000:1.0:1787831011.801570:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831011.803895:0:13771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433371136 00000100:00100000:2.0:1787831011.803911:0:13771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433371136 00000100:00100000:2.0:1787831011.804041:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 188 00000100:00100000:2.0:1787831011.804051:0:13771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204555a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47d7f0ed-283f-4b70-a741-6e74c5e52619+65:12342:x1874676433371136:12345-192.168.203.31@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787831011.804085:0:13771:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787831011.804201:0:13771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204555a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47d7f0ed-283f-4b70-a741-6e74c5e52619+65:12342:x1874676433371136:12345-192.168.203.31@tcp:53:lhsmtool_posix.0 Request processed in 152us (2641us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831011.804209:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 188 00000100:00100000:1.0:1787831011.811227:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831011.811278:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433371392 00000100:00100000:3.0:1787831011.811288:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433371392 00000100:00100000:3.0:1787831011.811351:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 189 00000100:00100000:3.0:1787831011.811362:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204554780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+65:12342:x1874676433371392:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787831011.811383:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787831011.811386:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787831011.811413:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1800/0x95459fb9d1d2952e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423fdd expref: 65 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831011.811432:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d233a6f8e00) 00010000:00010000:3.0:1787831011.811438:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787831011.811451:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d29582 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99423ff2 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787831011.812092:0:6491:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:3.0:1787831011.812224:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d29589 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831011.812283:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d29589 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831011.812296:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d29589 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831011.812347:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d29582 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423ff2 expref: 67 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831011.812375:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d29589 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423ff2 expref: 66 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831011.812383:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8d233a6f8500) 00010000:00010000:3.0:1787831011.812386:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787831011.812388:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2307c77600, rc 0) 00000100:00100000:3.0:1787831011.812451:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204554780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+66:12342:x1874676433371392:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 1091us (1242us total) trans 4294967460 rc 0/0 00000100:00100000:3.0:1787831011.812459:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 189 00000100:00100000:0.0:1787831011.815218:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831011.815332:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433371648 00000100:00100000:2.0:1787831011.815342:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433371648 00000100:00100000:2.0:1787831011.815397:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 190 00000100:00100000:2.0:1787831011.815414:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22045c3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+66:12342:x1874676433371648:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787831011.815475:0:6490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787831011.815498:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d29589 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423ff2 expref: 66 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831011.815513:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8d233a6f8500) 00010000:00010000:2.0:1787831011.815523:0:6490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787831011.815543:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1400/0x95459fb9d1d29597 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831011.815558:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1400/0x95459fb9d1d29597 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831011.815566:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1400/0x95459fb9d1d29597 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831011.816934:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d2959e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0xdedb71df bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831011.816953:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d2959e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xdedb71df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831011.816965:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d2959e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xdedb71df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831011.817015:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1400/0x95459fb9d1d29597 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831011.817022:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1400/0x95459fb9d1d29597 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831011.817043:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1400/0x95459fb9d1d29597 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831011.817050:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22039c1400 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:2.0:1787831011.817054:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1400/0x95459fb9d1d29597 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831011.817061:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1400/0x95459fb9d1d29597 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831011.817070:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d233a6f8e00) 00010000:00010000:2.0:1787831011.817072:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787831011.817076:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1400/0x95459fb9d1d29597 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831011.817081:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1400/0x95459fb9d1d29597 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831011.817090:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d2959e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xdedb71df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831011.817093:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d2959e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xdedb71df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831011.817097:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d2959e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xdedb71df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831011.817100:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22039c0a00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:2.0:1787831011.817101:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d2959e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xdedb71df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831011.817112:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d2959e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xdedb71df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831011.817116:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0xdedb71df (ffff8d2303e42900) 00010000:00010000:2.0:1787831011.817118:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787831011.817119:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d2959e lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xdedb71df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831011.817123:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d2959e lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xdedb71df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831011.817227:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22045c3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+65:12342:x1874676433371648:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 Request processed in 1811us (2010us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787831011.817235:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 190 00000100:00100000:1.0:1787831011.821883:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831011.825857:0:13771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433371776 00000100:00100000:2.0:1787831011.825872:0:13771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433371776 00000100:00100000:2.0:1787831011.825942:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 191 00000100:00100000:2.0:1787831011.825952:0:13771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204556940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47d7f0ed-283f-4b70-a741-6e74c5e52619+65:12342:x1874676433371776:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787831011.825973:0:13771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787831011.825997:0:13771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0800/0x95459fb9d1d295a5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99423ff9 expref: -99 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831011.826033:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1e00/0x95459fb9d1d295ac lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831011.826046:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1e00/0x95459fb9d1d295ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831011.826057:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1e00/0x95459fb9d1d295ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831011.826163:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0800/0x95459fb9d1d295a5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423ff9 expref: 67 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831011.826178:0:13771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1e00/0x95459fb9d1d295ac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423ff9 expref: 66 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831011.826186:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8d2303e42100) 00010000:00010000:2.0:1787831011.826189:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787831011.826192:0:13771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22039c1e00, rc 0) 00000100:00100000:2.0:1787831011.826255:0:13771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204556940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47d7f0ed-283f-4b70-a741-6e74c5e52619+66:12342:x1874676433371776:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 305us (4380us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831011.826262:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 191 00000100:00100000:1.0:1787831011.833664:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831011.833758:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433372032 00000100:00100000:3.0:1787831011.833784:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433372032 00000100:00100000:3.0:1787831011.833837:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 192 00000100:00100000:3.0:1787831011.833845:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204554b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+66:12342:x1874676433372032:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787831011.833923:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d295b3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831011.833940:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d295b3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831011.833950:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d295b3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787831011.834108:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:3.0:1787831011.834118:0:6491:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 302834492984ns, next at 303834490551ns, rc = 0 00000004:00010000:3.0:1787831011.834165:0:6491:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003e779778 reply state 00000000cc5e72d8 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d295b3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831011.834198:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d295b3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831011.834206:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8d2303e42100) 00010000:00010000:3.0:1787831011.834209:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1787831011.834220:0:6491:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787831011.834310:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204554b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+68:12342:x1874676433372032:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 Request processed in 464us (684us total) trans 4294967461 rc 0/0 00000100:00100000:3.0:1787831011.834318:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 192 00000100:00100000:3.0:1787831011.838049:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831011.838137:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433372160 00000100:00100000:1.0:1787831011.838146:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433372160 00000100:00100000:1.0:1787831011.838203:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 193 00000100:00100000:1.0:1787831011.838224:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220453e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+68:12342:x1874676433372160:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787831011.838245:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787831011.838264:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6a00/0x95459fb9d1d295ba lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99424000 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831011.838330:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6a00/0x95459fb9d1d295ba lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424000 expref: 69 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831011.838343:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6a00/0x95459fb9d1d295ba lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424000 expref: 69 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831011.838361:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8d2303e42100) 00010000:00010000:1.0:1787831011.838364:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787831011.838368:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d23344b6a00, rc 0) 00000100:00100000:1.0:1787831011.838429:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220453e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+69:12342:x1874676433372160:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 217us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831011.838436:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 193 00000100:00100000:2.0:1787831011.842084:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831011.842325:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433372288 00000100:00100000:3.0:1787831011.842335:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433372288 00000100:00100000:3.0:1787831011.842397:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 58 00000100:00100000:3.0:1787831011.842406:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204522d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+6:2396:x1874676433372288:12345-192.168.203.31@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1787831011.842609:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204522d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+7:2396:x1874676433372288:12345-192.168.203.31@tcp:2:lhsmtool_posix.0 Request processed in 204us (533us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1787831011.842618:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 58 00000100:00080000:2.0:1787831011.842960:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787831011.848838:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831011.849902:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433372544 00000100:00100000:3.0:1787831011.849914:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433372544 00000100:00100000:3.0:1787831011.849969:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 49 00000100:00100000:3.0:1787831011.849978:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204521680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+69:12342:x1874676433372544:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787831011.850196:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204521680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+70:12342:x1874676433372544:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 Request processed in 218us (1365us total) trans 4294967462 rc 0/0 00000100:00100000:3.0:1787831011.850204:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 49 00000100:00100000:0.0:1787831011.866546:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831011.866618:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433372800 00000100:00100000:2.0:1787831011.866643:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433372800 00000100:00100000:2.0:1787831011.866702:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 194 00000100:00100000:2.0:1787831011.866713:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22045c21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+70:12342:x1874676433372800:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787831011.866842:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22045c21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+70:12342:x1874676433372800:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 Request processed in 132us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831011.866849:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 194 00000100:00100000:2.0:1787831011.871437:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831011.871553:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433372928 00000100:00100000:3.0:1787831011.871574:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433372928 00000100:00100000:3.0:1787831011.871654:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 195 00000100:00100000:3.0:1787831011.871664:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22045212c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+70:12342:x1874676433372928:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787831011.871684:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787831011.871702:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d295c1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99424007 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831011.871763:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d295c8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831011.871791:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d295c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831011.871803:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d295c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787831011.871845:0:6490:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787831011.872608:0:6490:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d295c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831011.872729:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d295c1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424007 expref: 72 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831011.872750:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d295c8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424007 expref: 71 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831011.872759:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8d2303e42100) 00010000:00010000:3.0:1787831011.872763:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787831011.872778:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2307c77400, rc 0) 00000100:00100000:3.0:1787831011.872895:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22045212c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+71:12342:x1874676433372928:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 1232us (1466us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831011.872914:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 195 00000100:00100000:2.0:1787831011.882504:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831011.888379:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433373056 00000100:00100000:0.0:1787831011.888390:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433373056 00000100:00100000:0.0:1787831011.888729:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 59 00000100:00100000:0.0:1787831011.888738:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204520f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+7:2397:x1874676433373056:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787831011.888754:0:8406:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787831011.888853:0:8406:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000083fbec92/0x95459fb9d1d295cf lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a9942400e expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787831011.889070:0:8406:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9022e4, blocks: 0x0 00010000:00010000:0.0:1787831011.889089:0:8406:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=302s v=(0 0) 00010000:00010000:0.0:1787831011.889094:0:8406:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787831011.889104:0:8406:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000083fbec92/0x95459fb9d1d295cf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a9942400e expref: 8 pid: 8406 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831011.889124:0:8406:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000083fbec92/0x95459fb9d1d295cf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a9942400e expref: 8 pid: 8406 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831011.889153:0:8406:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2303aa3800, rc 0) 00000100:00100000:0.0:1787831011.889495:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204520f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+8:2397:x1874676433373056:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 479us (6723us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831011.889503:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 59 00000100:00100000:2.0:1787831011.892569:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831011.892639:0:13771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433373312 00000100:00100000:2.0:1787831011.892648:0:13771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433373312 00000100:00100000:2.0:1787831011.892691:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 196 00000100:00100000:2.0:1787831011.892700:0:13771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204521e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47d7f0ed-283f-4b70-a741-6e74c5e52619+71:12342:x1874676433373312:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787831011.892808:0:13771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204521e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47d7f0ed-283f-4b70-a741-6e74c5e52619+71:12342:x1874676433373312:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 Request processed in 108us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831011.892815:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 196 00000100:00100000:3.0:1787831011.898019:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831011.898332:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433373440 00000100:00100000:0.0:1787831011.898342:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433373440 00000100:00100000:0.0:1787831011.898393:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 60 00000100:00100000:0.0:1787831011.898402:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220453fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+8:12342:x1874676433373440:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787831011.898418:0:8408:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787831011.898434:0:8408:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002440e3fd/0x95459fb9d1d295d6 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99424015 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831011.898463:0:8408:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000083fbec92/0x95459fb9d1d295cf lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a9942400e expref: 9 pid: 8406 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831011.898471:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787831011.898476:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787831011.898481:0:8408:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002440e3fd/0x95459fb9d1d295d6 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424015 expref: 9 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831011.898510:0:8408:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000083fbec92/0x95459fb9d1d295cf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.31@tcp remote: 0xe558a92a9942400e expref: 9 pid: 8406 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831011.898524:0:8408:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000083fbec92/0x95459fb9d1d295cf lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a9942400e expref: 9 pid: 8406 timeout: 402 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831011.898549:0:8408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22045c3c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8408:1874676443896832:192.168.203.31@tcp:104: 00000100:00100000:0.0:1787831011.898656:0:8408:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2307c34840 going to sleep for 11 seconds 00000100:00100000:0.0:1787831011.901696:0:8408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22045c3c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8408:1874676443896832:192.168.203.31@tcp:104: 00010000:00010000:0.0:1787831011.901735:0:8408:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002440e3fd/0x95459fb9d1d295d6 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424015 expref: 9 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831011.901755:0:8408:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2303aa3c00, rc 0) 00000100:00100000:0.0:1787831011.901818:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220453fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+9:12342:x1874676433373440:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 3417us (3807us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831011.901827:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 60 00000100:00100000:3.0:1787831011.904182:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831011.904286:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433373568 00000100:00100000:3.0:1787831011.904294:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433373568 00010000:00010000:3.0:1787831011.904585:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000083fbec92/0x95459fb9d1d295cf lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a9942400e expref: 9 pid: 8406 timeout: 402 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787831011.904620:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 88 00000100:00100000:3.0:1787831011.904650:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2305351c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+9:2396:x1874676433373568:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787831011.904664:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787831011.904685:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000083fbec92/0x95459fb9d1d295cf lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a9942400e expref: 9 pid: 8406 timeout: 402 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831011.904699:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000083fbec92/0x95459fb9d1d295cf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a9942400e expref: 9 pid: 8406 timeout: 402 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831011.904719:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000083fbec92/0x95459fb9d1d295cf lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a9942400e expref: 9 pid: 8406 timeout: 402 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831011.904736:0:6475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787831011.904740:0:6475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787831011.904748:0:6475:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002440e3fd/0x95459fb9d1d295d6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424015 expref: 8 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831011.904789:0:6475:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002440e3fd/0x95459fb9d1d295d6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424015 expref: 8 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831011.904824:0:6475:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000002440e3fd/0x95459fb9d1d295d6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424015 expref: 8 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787831011.904837:0:6475:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220453c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6475:1874676443896960:192.168.203.31@tcp:105: 00000100:00100000:3.0:1787831011.905068:0:6475:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2305287780 going to sleep for 11 seconds 00000100:00100000:1.0:1787831011.928351:0:6475:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220453c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6475:1874676443896960:192.168.203.31@tcp:105: 00010000:00010000:1.0:1787831011.928377:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787831011.928410:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831011.928425:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2305351c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+8:2396:x1874676433373568:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 23777us (24251us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831011.928435:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 88 00000100:00100000:2.0:1787831011.928515:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433373696 00000100:00100000:2.0:1787831011.928522:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433373696 00002000:00100000:2.0:1787831011.928562:0:8411:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff8d220442cf00 x1874676433373696/t0(0) o4->47d7f0ed-283f-4b70-a741-6e74c5e52619@192.168.203.31@tcp:82/0 lens 504/0 e 0 to 0 dl 1787831022 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787831011.928573:0:8411:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d220442cf00 with x1874676433373696 ext(0->8) 00002000:00010000:2.0:1787831011.928577:0:8411:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d220442cf00 00000100:00100000:2.0:1787831011.928603:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 4 00000100:00100000:2.0:1787831011.928612:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220442cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+8:2396:x1874676433373696:12345-192.168.203.31@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787831011.929890:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220442cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+10:2396:x1874676433373696:12345-192.168.203.31@tcp:4:lhsmtool_posix.0 Request processed in 1271us (1473us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1787831011.929900:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 4 00002000:00100000:2.0:1787831011.929910:0:8411:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff8d220442cf00 x1874676433373696/t4294967315(0) o4->47d7f0ed-283f-4b70-a741-6e74c5e52619@192.168.203.31@tcp:82/0 lens 504/448 e 0 to 0 dl 1787831022 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787831011.929919:0:8411:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d220442cf00 with x1874676433373696 ext(0->8) 00002000:00010000:2.0:1787831011.929924:0:8411:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d220442cf00 00000100:00100000:1.0:1787831011.935673:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831011.935800:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433373824 00000100:00100000:2.0:1787831011.935810:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433373824 00000100:00100000:2.0:1787831011.935878:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 197 00000100:00100000:2.0:1787831011.935887:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204557480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+71:12342:x1874676433373824:12345-192.168.203.31@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1787831011.941948:0:6469:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967462 is committed 00000004:00080000:2.0:1787831011.941964:0:6469:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000004:00080000:2.0:1787831011.942021:0:6469:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:2.0:1787831011.942038:0:6469:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d2202852240 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:2.0:1787831011.942053:0:6469:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d2202854800 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d2202852540 00000020:00080000:2.0:1787831011.942056:0:6469:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d2202854d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d2203a4e600 00000100:00100000:0.0:1787831011.942097:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22045c3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443897088:0@lo:2:osp-syn-1-0.0 00000020:00080000:2.0:1787831011.942123:0:6522:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000100:00100000:0.0:1787831011.942154:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831011.942198:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787831011.942205:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220442f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443897216:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787831011.942228:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831011.942268:0:8631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443897088 00000100:00100000:0.0:1787831011.942274:0:8631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443897088 00000100:00100000:0.0:1787831011.942326:0:8631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443897216 00000100:00100000:0.0:1787831011.942330:0:8631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443897216 00000100:00100000:0.0:1787831011.942352:0:8631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787831011.942360:0:8631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a21a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3621:x1874676443897088:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1787831011.942452:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669600/0x95459fb9d1d292fe lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787831011.942460:0:8631:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1787831011.942463:0:8631:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1787831012 00010000:00010000:1.0:1787831011.942464:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669600/0x95459fb9d1d292fe lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787831011.942466:0:8631:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00010000:00010000:1.0:1787831011.942471:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669600/0x95459fb9d1d292fe lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787831011.942474:0:8631:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1787831012 -> 1787831012 00002000:00010000:0.0:1787831011.942476:0:8631:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1787831011.942478:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2301669600 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:1.0:1787831011.942482:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669600/0x95459fb9d1d292fe lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831011.942490:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669600/0x95459fb9d1d292fe lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831011.942506:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8d233a6f8f00) 00000100:00100000:0.0:1787831011.942509:0:8631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a21a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3621:x1874676443897088:12345-0@lo:2:osp-syn-1-0.0 Request processed in 150us (355us total) trans 4294967316 rc 0/0 00010000:00010000:1.0:1787831011.942510:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787831011.942514:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669600/0x95459fb9d1d292fe lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831011.942516:0:8631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00010000:1.0:1787831011.942521:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669600/0x95459fb9d1d292fe lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831011.942531:0:8631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787831011.942537:0:8631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a203c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3621:x1874676443897216:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1787831011.942540:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668800/0x95459fb9d1d29305 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1787831011.942550:0:8631:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:4 count 1 00010000:00010000:1.0:1787831011.942551:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668800/0x95459fb9d1d29305 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831011.942556:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668800/0x95459fb9d1d29305 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831011.942561:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2301668800 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:1.0:1787831011.942564:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668800/0x95459fb9d1d29305 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831011.942569:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668800/0x95459fb9d1d29305 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787831011.942571:0:8631:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a9022e2, atime: 0x6a9022e2, ctime: 0x6a9022e2, blocks: 0x8 00010000:00010000:0.0:1787831011.942577:0:8631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d3fd276/0x95459fb9d1d295dd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831011.942578:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d233a6f8e00) 00010000:00010000:1.0:1787831011.942580:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787831011.942583:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668800/0x95459fb9d1d29305 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831011.942588:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668800/0x95459fb9d1d29305 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831011.942590:0:8631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=302s v=(0 0) 00010000:00010000:0.0:1787831011.942594:0:8631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787831011.942600:0:8631:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d3fd276/0x95459fb9d1d295dd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831011.942601:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669200/0x95459fb9d1d29344 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831011.942608:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669200/0x95459fb9d1d29344 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831011.942613:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669200/0x95459fb9d1d29344 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831011.942614:0:8631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d3fd276/0x95459fb9d1d295dd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831011.942618:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2301669200 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:1.0:1787831011.942643:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669200/0x95459fb9d1d29344 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831011.942650:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669200/0x95459fb9d1d29344 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831011.942657:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8d233a6f8800) 00010000:00010000:1.0:1787831011.942659:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787831011.942662:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669200/0x95459fb9d1d29344 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831011.942667:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669200/0x95459fb9d1d29344 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831011.942669:0:8631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d3fd276/0x95459fb9d1d295dd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831011.942677:0:8631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009d3fd276/0x95459fb9d1d295dd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831011.942682:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77800/0x95459fb9d1d29447 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831011.942686:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77800/0x95459fb9d1d29447 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831011.942691:0:8631:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787831011.942692:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77800/0x95459fb9d1d29447 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831011.942697:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2307c77800 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:1.0:1787831011.942699:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77800/0x95459fb9d1d29447 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831011.942705:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77800/0x95459fb9d1d29447 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831011.942711:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d232b9c6900) 00010000:00010000:1.0:1787831011.942713:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787831011.942721:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77800/0x95459fb9d1d29447 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831011.942726:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77800/0x95459fb9d1d29447 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831011.942736:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2000/0x95459fb9d1d2946a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831011.942748:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2000/0x95459fb9d1d2946a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831011.942754:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2000/0x95459fb9d1d2946a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831011.942758:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2303aa2000 already unused, calling callback (ffffffffc1b094f0) 00000100:00100000:0.0:1787831011.942784:0:8631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a203c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3621:x1874676443897216:12345-0@lo:6:osp-syn-0-0.0 Request processed in 247us (555us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1787831011.942791:0:8631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000004:00080000:0.0:1787831011.942848:0:3621:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d220442f0c0/2, rc 0, transno 4294967308 00000100:00100000:0.0:1787831011.942854:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220442f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443897216:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1787831011.942864:0:3621:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d22045c3c00/2, rc 0, transno 4294967316 00000100:00100000:0.0:1787831011.942867:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22045c3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443897088:0@lo:2:osp-syn-1-0.0 00000020:00080000:2.0:1787831011.943399:0:6522:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00080000:2.0:1787831011.943409:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787831011.943413:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787831011.943421:0:7431:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787831011.943427:0:7431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009d3fd276/0x95459fb9d1d295dd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831011.943434:0:7431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2303aa3a00 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:2.0:1787831011.943437:0:7431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009d3fd276/0x95459fb9d1d295dd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831011.943445:0:7431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009d3fd276/0x95459fb9d1d295dd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831011.943457:0:7431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009d3fd276/0x95459fb9d1d295dd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831011.943463:0:7431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d3fd276/0x95459fb9d1d295dd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831011.943484:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787831011.943485:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787831011.943487:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787831011.943599:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204557480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+22:12342:x1874676433373824:12345-192.168.203.31@tcp:44:lhsmtool_posix.0 Request processed in 7708us (7931us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831011.943608:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 197 00010000:00010000:1.0:1787831011.943758:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2000/0x95459fb9d1d2946a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831011.943834:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2000/0x95459fb9d1d2946a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831011.943845:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d232b9c6900) 00010000:00010000:1.0:1787831011.943847:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787831011.943850:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2000/0x95459fb9d1d2946a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831011.943856:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2000/0x95459fb9d1d2946a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831011.943871:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d294b0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831011.943877:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d294b0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831011.943890:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d294b0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831011.943895:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2307c76600 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:1.0:1787831011.943899:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d294b0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831011.943905:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d294b0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831011.943913:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d232b9c6900) 00010000:00010000:1.0:1787831011.943915:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787831011.943918:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d294b0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831011.943924:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d294b0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831011.943937:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d295b3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831011.943943:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d295b3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831011.943949:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d295b3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831011.943954:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2307c77a00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:1.0:1787831011.943957:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d295b3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831011.943972:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d295b3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831011.943980:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8d2303e42100) 00010000:00010000:1.0:1787831011.943982:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787831011.943985:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d295b3 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831011.943991:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d295b3 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831011.955123:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831011.955211:0:8631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433373952 00000100:00100000:0.0:1787831011.955229:0:8631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433373952 00000100:00100000:0.0:1787831011.955284:0:8631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 63 00000100:00100000:0.0:1787831011.955394:0:8631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22045543c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+10:2395:x1874676433373952:12345-192.168.203.31@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1787831011.957388:0:9484:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967316 is committed 00000001:00080000:3.0:1787831011.957399:0:9484:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000100:00100000:0.0:1787831011.957737:0:8631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22045543c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+7:2395:x1874676433373952:12345-192.168.203.31@tcp:16:lhsmtool_posix.0 Request processed in 2440us (2620us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831011.957747:0:8631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 63 00000100:00100000:0.0:1787831011.964979:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831011.965074:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433374208 00000100:00100000:3.0:1787831011.965083:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433374208 00000100:00100000:3.0:1787831011.965158:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 198 00000100:00100000:3.0:1787831011.965182:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22046452c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+19:12342:x1874676433374208:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787831011.965239:0:6490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787831011.965267:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d295c8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424007 expref: 19 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831011.965286:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8d2303e42100) 00010000:00010000:3.0:1787831011.965302:0:6490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787831011.965336:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d295e4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831011.965351:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d295e4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831011.965374:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d295e4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787831011.965502:0:6490:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c43e77dc reply state 0000000059e0ef74 transno 4294967463 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d295e4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831011.965514:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d295e4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831011.965520:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8d2303e42100) 00010000:00010000:3.0:1787831011.965522:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787831011.965525:0:6490:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787831011.966418:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22046452c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+20:12342:x1874676433374208:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 Request processed in 1239us (1443us total) trans 4294967463 rc 0/0 00000100:00100000:3.0:1787831011.966427:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 198 00000100:00100000:1.0:1787831011.973237:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831011.973315:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433374336 00000100:00100000:3.0:1787831011.973325:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433374336 00000100:00100000:3.0:1787831011.973385:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 64 00000100:00100000:3.0:1787831011.973395:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2335782050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+7:2394:x1874676433374336:12345-192.168.203.31@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787831011.973550:0:8408:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1787831011.973554:0:8408:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1787831012 -> 1787831011 00002000:00010000:3.0:1787831011.973556:0:8408:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1787831010 00002000:00010000:3.0:1787831011.973558:0:8408:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1787831012 -> 1787831011 00002000:00010000:3.0:1787831011.973561:0:8408:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1787831011.973618:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2335782050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+8:2394:x1874676433374336:12345-192.168.203.31@tcp:2:lhsmtool_posix.0 Request processed in 225us (391us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1787831011.973647:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 64 00000100:00100000:1.0:1787831011.977082:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831011.977163:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433374592 00000100:00100000:3.0:1787831011.977173:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433374592 00000100:00100000:3.0:1787831011.977240:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 199 00000100:00100000:3.0:1787831011.977250:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204557840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+20:12342:x1874676433374592:12345-192.168.203.31@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787831011.977323:0:8620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d295eb lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831011.977339:0:8620:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1e00/0x95459fb9d1d295ac lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423ff9 expref: 20 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831011.977348:0:8620:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d295eb lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831011.977381:0:8620:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1e00/0x95459fb9d1d295ac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423ff9 expref: 20 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831011.977394:0:8620:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1e00/0x95459fb9d1d295ac lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423ff9 expref: 20 pid: 13771 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787831011.977408:0:8620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220453c780 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8620:1874676443897344:192.168.203.31@tcp:104: 00000100:00100000:3.0:1787831011.977492:0:8620:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d22027a7840 going to sleep for 11 seconds 00000100:00100000:1.0:1787831011.981815:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831011.982115:0:7432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433374720 00000100:00100000:0.0:1787831011.982123:0:7432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433374720 00010000:00010000:0.0:1787831011.982161:0:7432:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1e00/0x95459fb9d1d295ac lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423ff9 expref: 21 pid: 13771 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831011.982199:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 89 00000100:00100000:0.0:1787831011.982208:0:7432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204556580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+21:2396:x1874676433374720:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787831011.982230:0:7432:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787831011.982236:0:7432:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1e00/0x95459fb9d1d295ac lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423ff9 expref: 21 pid: 13771 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831011.982260:0:7432:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1e00/0x95459fb9d1d295ac lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423ff9 expref: 21 pid: 13771 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831011.982281:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8d2303e42100) 00010000:00010000:0.0:1787831011.982286:0:7432:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d295eb lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831011.982296:0:7432:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d295eb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831011.982303:0:7432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d295eb lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831011.982324:0:7432:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787831011.982371:0:7432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204556580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+21:2396:x1874676433374720:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 164us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831011.982379:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 89 00010000:00010000:3.0:1787831011.982560:0:8620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1e00/0x95459fb9d1d295ac lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423ff9 expref: 20 pid: 13771 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787831011.982589:0:8620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220453c780 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8620:1874676443897344:192.168.203.31@tcp:104: 00010000:00010000:3.0:1787831011.982607:0:8620:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d295eb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831011.982651:0:8620:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d295eb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831011.982657:0:8620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d295eb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831011.982695:0:8620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d295eb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831011.982701:0:8620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d295eb lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831011.982707:0:8620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d295eb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831011.982713:0:8620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2307c76400 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:3.0:1787831011.982717:0:8620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d295eb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831011.982723:0:8620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d295eb lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831011.982732:0:8620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8d2303e42100) 00010000:00010000:3.0:1787831011.982735:0:8620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1787831011.982739:0:8620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d295eb lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831011.982744:0:8620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d295eb lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787831011.983095:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204557840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+19:12342:x1874676433374592:12345-192.168.203.31@tcp:55:lhsmtool_posix.0 Request processed in 5845us (6020us total) trans 0 rc -22/-22 00000100:00100000:3.0:1787831011.983111:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 199 00000100:00100000:3.0:1787831012.006367:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831012.006507:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433374848 00000100:00100000:1.0:1787831012.006518:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433374848 00000100:00100000:1.0:1787831012.006577:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 65 00000100:00100000:1.0:1787831012.006588:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220453c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+8:2395:x1874676433374848:12345-192.168.203.31@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787831012.006668:0:8406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d5385f2b/0x95459fb9d1d295f2 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831012.006689:0:8406:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002440e3fd/0x95459fb9d1d295d6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424015 expref: 8 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831012.006698:0:8406:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1787831012.006703:0:8406:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787831012.006708:0:8406:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d5385f2b/0x95459fb9d1d295f2 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831012.006756:0:8406:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002440e3fd/0x95459fb9d1d295d6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424015 expref: 8 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831012.006785:0:8406:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002440e3fd/0x95459fb9d1d295d6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424015 expref: 8 pid: 8408 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831012.006801:0:8406:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204556d00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8406:1874676443897472:192.168.203.31@tcp:104: 00000100:00100000:1.0:1787831012.006874:0:8406:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d22028529c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787831012.011659:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831012.011784:0:8406:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204556d00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8406:1874676443897472:192.168.203.31@tcp:104: 00010000:00010000:0.0:1787831012.011812:0:8406:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d5385f2b/0x95459fb9d1d295f2 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831012.012028:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433374976 00000100:00100000:2.0:1787831012.012034:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433374976 00010000:00010000:2.0:1787831012.012070:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002440e3fd/0x95459fb9d1d295d6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424015 expref: 9 pid: 8408 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831012.012107:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 90 00000100:00100000:2.0:1787831012.012116:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204555680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+9:2396:x1874676433374976:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787831012.012131:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787831012.012153:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002440e3fd/0x95459fb9d1d295d6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424015 expref: 9 pid: 8408 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831012.012166:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002440e3fd/0x95459fb9d1d295d6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424015 expref: 9 pid: 8408 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831012.012190:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002440e3fd/0x95459fb9d1d295d6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424015 expref: 9 pid: 8408 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831012.012206:0:6476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787831012.012210:0:6476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787831012.012239:0:6476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d5385f2b/0x95459fb9d1d295f2 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831012.012250:0:6476:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d5385f2b/0x95459fb9d1d295f2 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831012.012279:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787831012.012333:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204555680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+8:2396:x1874676433374976:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 218us (715us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831012.012341:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 90 00010000:00010000:0.0:1787831012.012757:0:8406:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d5385f2b/0x95459fb9d1d295f2 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.012777:0:8406:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d5385f2b/0x95459fb9d1d295f2 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.012811:0:8406:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d5385f2b/0x95459fb9d1d295f2 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.012820:0:8406:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d5385f2b/0x95459fb9d1d295f2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.012829:0:8406:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d5385f2b/0x95459fb9d1d295f2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.012837:0:8406:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d23344b7800 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:0.0:1787831012.012841:0:8406:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5385f2b/0x95459fb9d1d295f2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.012849:0:8406:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5385f2b/0x95459fb9d1d295f2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.012863:0:8406:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d5385f2b/0x95459fb9d1d295f2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.012871:0:8406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d5385f2b/0x95459fb9d1d295f2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831012.012930:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220453c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+7:2395:x1874676433374848:12345-192.168.203.31@tcp:1:lhsmtool_posix.0 Request processed in 6343us (6574us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831012.012938:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 65 00000100:00100000:1.0:1787831012.016592:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831012.016736:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433375232 00000100:00100000:2.0:1787831012.016745:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433375232 00000100:00100000:2.0:1787831012.016810:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 200 00000100:00100000:2.0:1787831012.016819:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22045552c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+19:12342:x1874676433375232:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787831012.016897:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1e00/0x95459fb9d1d295f9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831012.016915:0:6491:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7a00/0x95459fb9d1d29440 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f9e expref: 19 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831012.016926:0:6491:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1e00/0x95459fb9d1d295f9 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831012.016960:0:6491:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7a00/0x95459fb9d1d29440 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f9e expref: 19 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831012.016974:0:6491:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7a00/0x95459fb9d1d29440 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f9e expref: 19 pid: 8620 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831012.017010:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220442e1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6491:1874676443897600:192.168.203.31@tcp:104: 00000100:00100000:2.0:1787831012.017091:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d231852ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1787831012.020622:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831012.020727:0:7432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433375360 00000100:00100000:3.0:1787831012.020735:0:7432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433375360 00010000:00010000:3.0:1787831012.020790:0:7432:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7a00/0x95459fb9d1d29440 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f9e expref: 20 pid: 8620 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787831012.020823:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 91 00000100:00100000:3.0:1787831012.020833:0:7432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220442fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+20:2397:x1874676433375360:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787831012.020848:0:7432:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787831012.020854:0:7432:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7a00/0x95459fb9d1d29440 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f9e expref: 20 pid: 8620 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.020867:0:7432:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7a00/0x95459fb9d1d29440 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f9e expref: 20 pid: 8620 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.020891:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d232b9c6900) 00010000:00010000:3.0:1787831012.020897:0:7432:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1e00/0x95459fb9d1d295f9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.020906:0:7432:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1e00/0x95459fb9d1d295f9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.020913:0:7432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1e00/0x95459fb9d1d295f9 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.020932:0:7432:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787831012.020989:0:7432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220442fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+20:2397:x1874676433375360:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 158us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831012.021011:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 91 00010000:00010000:0.0:1787831012.021101:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7a00/0x95459fb9d1d29440 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f9e expref: 19 pid: 8620 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831012.021117:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220442e1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6491:1874676443897600:192.168.203.31@tcp:104: 00010000:00010000:0.0:1787831012.021137:0:6491:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1e00/0x95459fb9d1d295f9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.021145:0:6491:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1e00/0x95459fb9d1d295f9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.021150:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1e00/0x95459fb9d1d295f9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.021320:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3e00/0x95459fb9d1d29600 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.021332:0:6491:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6a00/0x95459fb9d1d295ba lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424000 expref: 19 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.021340:0:6491:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3e00/0x95459fb9d1d29600 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.021368:0:6491:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6a00/0x95459fb9d1d295ba lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424000 expref: 19 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.021383:0:6491:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6a00/0x95459fb9d1d295ba lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424000 expref: 19 pid: 6492 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831012.021396:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204644f00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6491:1874676443897728:192.168.203.31@tcp:104: 00000100:00100000:0.0:1787831012.021447:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2303e72540 going to sleep for 11 seconds 00000100:00100000:0.0:1787831012.024064:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204644f00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6491:1874676443897728:192.168.203.31@tcp:104: 00010000:00010000:0.0:1787831012.024093:0:6491:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3e00/0x95459fb9d1d29600 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831012.026104:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831012.026180:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433375488 00000100:00100000:0.0:1787831012.026189:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433375488 00010000:00010000:0.0:1787831012.026238:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6a00/0x95459fb9d1d295ba lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424000 expref: 20 pid: 6492 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831012.026277:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 92 00000100:00100000:0.0:1787831012.026286:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220442c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+20:2397:x1874676433375488:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787831012.026302:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787831012.026309:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6a00/0x95459fb9d1d295ba lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424000 expref: 20 pid: 6492 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.026322:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6a00/0x95459fb9d1d295ba lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424000 expref: 20 pid: 6492 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.026344:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6a00/0x95459fb9d1d295ba lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424000 expref: 20 pid: 6492 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.026363:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8d2303e42100) 00010000:00010000:0.0:1787831012.026369:0:6476:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3e00/0x95459fb9d1d29600 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.026378:0:6476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3e00/0x95459fb9d1d29600 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.026386:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3e00/0x95459fb9d1d29600 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.026440:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787831012.026495:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220442c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+19:2397:x1874676433375488:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 210us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831012.026503:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 92 00010000:00010000:2.0:1787831012.026977:0:6491:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3e00/0x95459fb9d1d29600 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831012.026986:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3e00/0x95459fb9d1d29600 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787831012.027089:0:6491:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:2.0:1787831012.027201:0:6491:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:2.0:1787831012.027249:0:6491:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:2.0:1787831012.027324:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220442de00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6491:1874676443897856:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787831012.027385:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831012.027483:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443897856 00000100:00100000:1.0:1787831012.027490:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443897856 00000100:00100000:1.0:1787831012.027524:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1787831012.027531:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220442da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6491:x1874676443897856:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787831012.027607:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220442da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6491:x1874676443897856:12345-0@lo:1000:mdt00_001.0 Request processed in 76us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831012.027614:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1787831012.027731:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2307ca0c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787831012.027751:0:6491:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:2.0:1787831012.027756:0:6491:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d22045c3c00, transno 4294967316 00000100:00100000:2.0:1787831012.027914:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220442de00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6491:1874676443897856:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1787831012.028023:0:6491:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:2.0:1787831012.028062:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220442de00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6491:1874676443897984:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787831012.028089:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831012.028115:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d220289c480 going to sleep for 11 seconds 00000100:00100000:1.0:1787831012.028158:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443897984 00000100:00100000:1.0:1787831012.028162:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443897984 00000100:00100000:1.0:1787831012.028192:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787831012.028198:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220442c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6491:x1874676443897984:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787831012.028300:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220442c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6491:x1874676443897984:12345-0@lo:1000:mdt00_001.0 Request processed in 102us (209us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1787831012.028307:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1787831012.029305:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220442de00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6491:1874676443897984:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1787831012.029349:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3e00/0x95459fb9d1d29600 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.029359:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3e00/0x95459fb9d1d29600 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.029365:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3e00/0x95459fb9d1d29600 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.029370:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2303aa3e00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:0.0:1787831012.029374:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3e00/0x95459fb9d1d29600 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.029381:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3e00/0x95459fb9d1d29600 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.029394:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8d2303e42100) 00010000:00010000:0.0:1787831012.029396:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787831012.029411:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3e00/0x95459fb9d1d29600 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.029418:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3e00/0x95459fb9d1d29600 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.029441:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1200/0x95459fb9d1d29535 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.029459:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1200/0x95459fb9d1d29535 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.029465:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1200/0x95459fb9d1d29535 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.029470:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22039c1200 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:0.0:1787831012.029473:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1200/0x95459fb9d1d29535 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.029479:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1200/0x95459fb9d1d29535 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.029488:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d232b9c6900) 00010000:00010000:0.0:1787831012.029491:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787831012.029494:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1200/0x95459fb9d1d29535 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.029500:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1200/0x95459fb9d1d29535 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.029522:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2200/0x95459fb9d1d29607 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.029534:0:6491:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6c00/0x95459fb9d1d29551 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423fe4 expref: 22 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.029543:0:6491:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2200/0x95459fb9d1d29607 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.029573:0:6491:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6c00/0x95459fb9d1d29551 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423fe4 expref: 22 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.029594:0:6491:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6c00/0x95459fb9d1d29551 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423fe4 expref: 22 pid: 6492 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831012.029606:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204644f00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6491:1874676443898112:192.168.203.31@tcp:104: 00000100:00100000:0.0:1787831012.029695:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2303e72540 going to sleep for 11 seconds 00000100:00100000:2.0:1787831012.035312:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831012.035408:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204644f00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6491:1874676443898112:192.168.203.31@tcp:104: 00010000:00010000:0.0:1787831012.035436:0:6491:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2200/0x95459fb9d1d29607 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787831012.035538:0:7432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433375616 00000100:00100000:3.0:1787831012.035546:0:7432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433375616 00010000:00010000:3.0:1787831012.035584:0:7432:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6c00/0x95459fb9d1d29551 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423fe4 expref: 23 pid: 6492 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787831012.035659:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 93 00000100:00100000:3.0:1787831012.035671:0:7432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220442e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+23:2396:x1874676433375616:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787831012.035687:0:7432:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787831012.035694:0:7432:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6c00/0x95459fb9d1d29551 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423fe4 expref: 23 pid: 6492 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.035706:0:7432:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6c00/0x95459fb9d1d29551 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423fe4 expref: 23 pid: 6492 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.035729:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6c00/0x95459fb9d1d29551 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99423fe4 expref: 23 pid: 6492 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.035746:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d232b9c6900) 00010000:00010000:3.0:1787831012.035751:0:7432:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2200/0x95459fb9d1d29607 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.035774:0:7432:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2200/0x95459fb9d1d29607 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.035783:0:7432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2200/0x95459fb9d1d29607 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.035824:0:7432:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787831012.035871:0:7432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220442e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+22:2396:x1874676433375616:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 203us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831012.035879:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 93 00010000:00010000:0.0:1787831012.036463:0:6491:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2200/0x95459fb9d1d29607 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.036473:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2200/0x95459fb9d1d29607 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.036485:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2200/0x95459fb9d1d29607 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.036491:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2200/0x95459fb9d1d29607 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.036498:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2200/0x95459fb9d1d29607 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.036504:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2303aa2200 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:0.0:1787831012.036508:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2200/0x95459fb9d1d29607 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.036515:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2200/0x95459fb9d1d29607 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.036534:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d232b9c6900) 00010000:00010000:0.0:1787831012.036536:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787831012.036540:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2200/0x95459fb9d1d29607 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.036546:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2200/0x95459fb9d1d29607 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.036559:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1e00/0x95459fb9d1d295f9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.036565:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1e00/0x95459fb9d1d295f9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.036570:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1e00/0x95459fb9d1d295f9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.036575:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22039c1e00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:0.0:1787831012.036578:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1e00/0x95459fb9d1d295f9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.036583:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1e00/0x95459fb9d1d295f9 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.036590:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d232b9c6900) 00010000:00010000:0.0:1787831012.036593:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787831012.036596:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1e00/0x95459fb9d1d295f9 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.036602:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1e00/0x95459fb9d1d295f9 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831012.036792:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22045552c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+21:12342:x1874676433375232:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 Request processed in 19972us (20208us total) trans 4294967468 rc 0/0 00000100:00100000:0.0:1787831012.036800:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 200 00000020:00080000:0.0:1787831012.036804:0:6491:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1787831012.036980:0:13758:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787831012.036985:0:13758:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787831012.037464:0:13758:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1787831012.037473:0:13758:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787831012.048392:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831012.048478:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433375872 00000100:00100000:3.0:1787831012.048488:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433375872 00000100:00100000:3.0:1787831012.048543:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 50 00000100:00100000:3.0:1787831012.048553:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d23066cb450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+21:12342:x1874676433375872:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787831012.048842:0:6494:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787831012.048871:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967469 00010000:00010000:3.0:1787831012.048902:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d2960e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.048918:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d2960e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.048929:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d2960e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.048937:0:6494:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d2960e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.048943:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d2960e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.048949:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d2960e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.048970:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787831012.049064:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d23066cb450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+23:12342:x1874676433375872:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 Request processed in 512us (679us total) trans 4294967470 rc 0/0 00000100:00100000:3.0:1787831012.049071:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 50 00000020:00080000:3.0:1787831012.049076:0:6494:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787831012.049190:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787831012.049198:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d2960e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.049205:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2307c77400 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:0.0:1787831012.049209:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d2960e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.049227:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d2960e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.049239:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8d2303e42100) 00010000:00010000:0.0:1787831012.049242:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787831012.049247:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d2960e lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.049252:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d2960e lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.049264:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787831012.049265:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787831012.049267:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787831012.076985:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220442cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a45944b-32e3-4193-a2a5-46f84222bc14:3619:1874676443898240:0@lo:400:kworker.0 00000100:00100000:2.0:1787831012.077059:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831012.077110:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220442e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443898752:0@lo:400:kworker.0 00000100:00100000:2.0:1787831012.077135:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831012.077155:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220442e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443899264:0@lo:400:kworker.0 00000100:00100000:3.0:1787831012.077330:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220442c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443898496:0@lo:400:kworker.0 00000100:00100000:3.0:1787831012.077361:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831012.077381:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220442d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3621:1874676443899008:0@lo:400:kworker.0 00000100:00100000:3.0:1787831012.077403:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831012.077418:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a7ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3621:1874676443899520:0@lo:400:kworker.0 00000100:00100000:3.0:1787831012.077437:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831012.077459:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1787831012.077465:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220442f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3621:1874676443898624:0@lo:400:kworker.0 00000100:00100000:3.0:1787831012.077484:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831012.077499:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220442d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443899136:0@lo:400:kworker.0 00000100:00100000:3.0:1787831012.077521:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220442f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3620:1874676443898368:0@lo:400:kworker.0 00000100:00100000:3.0:1787831012.077541:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831012.077557:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220442ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3620:1874676443898880:0@lo:400:kworker.0 00000100:00100000:3.0:1787831012.077576:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831012.077601:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203bb3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3620:1874676443899392:0@lo:400:kworker.0 00000100:00100000:3.0:1787831012.077619:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831012.077661:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443898752 00000100:00100000:3.0:1787831012.077668:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443898752 00000100:00100000:3.0:1787831012.077706:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443898496 00000100:00100000:3.0:1787831012.077708:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443898496 00000100:00100000:3.0:1787831012.077722:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1787831012.077730:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676443898752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787831012.077811:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831012.077851:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443898240 00000100:00100000:2.0:1787831012.077855:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443898240 00000100:00100000:2.0:1787831012.077881:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:2.0:1787831012.077887:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d231859c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+24:3619:x1874676443898240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787831012.077925:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d231859c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+24:3619:x1874676443898240:12345-0@lo:400:kworker.0 Request processed in 38us (867us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831012.077932:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:2.0:1787831012.077965:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1787831012.077972:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220453ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443898496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787831012.078003:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220453ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443898496:12345-0@lo:400:kworker.0 Request processed in 32us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831012.078008:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1787831012.078029:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443899264 00000100:00100000:2.0:1787831012.078032:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443899264 00000100:00100000:2.0:1787831012.078058:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787831012.078065:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22037921c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3619:x1874676443899264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787831012.078097:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22037921c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3619:x1874676443899264:12345-0@lo:400:kworker.0 Request processed in 33us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831012.078103:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787831012.078120:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831012.078139:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a79680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443899648:0@lo:400:kworker.0 00000100:00100000:2.0:1787831012.078170:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831012.078329:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443899008 00000100:00100000:0.0:1787831012.078334:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443899008 00000100:00100000:0.0:1787831012.078363:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443899520 00000100:00100000:0.0:1787831012.078366:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443899520 00000100:00100000:0.0:1787831012.078390:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443898624 00000100:00100000:0.0:1787831012.078393:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443898624 00000100:00100000:0.0:1787831012.078403:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443898368 00000100:00100000:0.0:1787831012.078406:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443898368 00000100:00100000:0.0:1787831012.078415:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443898880 00000100:00100000:0.0:1787831012.078417:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443898880 00000100:00100000:0.0:1787831012.078429:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443899392 00000100:00100000:0.0:1787831012.078431:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443899392 00000100:00100000:0.0:1787831012.078442:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1787831012.078448:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220453fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1874676443899008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787831012.078481:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220453fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1874676443899008:12345-0@lo:400:kworker.0 Request processed in 34us (1077us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831012.078487:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1787831012.078502:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1787831012.078507:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220453de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1874676443899520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787831012.078533:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220453de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1874676443899520:12345-0@lo:400:kworker.0 Request processed in 26us (1095us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831012.078539:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1787831012.078549:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1787831012.078554:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220453f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1874676443898624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787831012.078578:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220453f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1874676443898624:12345-0@lo:400:kworker.0 Request processed in 24us (1094us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831012.078584:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1787831012.078594:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1787831012.078599:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220453f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1874676443898368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787831012.079786:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220453f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1874676443898368:12345-0@lo:400:kworker.0 Request processed in 1180us (2236us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831012.079808:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1787831012.079832:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1787831012.079841:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220453c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1874676443898880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787831012.079889:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220453c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1874676443898880:12345-0@lo:400:kworker.0 Request processed in 50us (2311us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831012.079895:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1787831012.079907:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1787831012.079913:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2309cf8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1874676443899392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787831012.079939:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2309cf8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1874676443899392:12345-0@lo:400:kworker.0 Request processed in 26us (2319us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831012.079945:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1787831012.081323:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220442c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443898496:0@lo:400:kworker.0 00010000:00080000:2.0:1787831012.081352:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d220442d680 x1874676443899008/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787831028 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787831012.081364:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220442d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3621:1874676443899008:0@lo:400:kworker.0 00010000:00080000:2.0:1787831012.081376:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2203a7ad00 x1874676443899520/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787831028 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787831012.081384:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a7ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3621:1874676443899520:0@lo:400:kworker.0 00000100:00100000:2.0:1787831012.081413:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220442f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3621:1874676443898624:0@lo:400:kworker.0 00000100:00100000:2.0:1787831012.081443:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443899136 00000100:00100000:2.0:1787831012.081448:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443899136 00000100:00100000:2.0:1787831012.081489:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443899648 00000100:00100000:2.0:1787831012.081492:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443899648 00000100:00100000:2.0:1787831012.081509:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787831012.081515:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2336bfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443899136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787831012.081581:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2336bfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443899136:12345-0@lo:400:kworker.0 Request processed in 66us (3459us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831012.081588:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787831012.081603:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787831012.081609:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2334489680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443899648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787831012.081654:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2334489680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443899648:12345-0@lo:400:kworker.0 Request processed in 46us (3484us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831012.081660:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:2.0:1787831012.081682:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787831012.081693:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787831012.081696:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787831012.081698:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787831012.081742:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22046470c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443899776:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787831012.081787:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831012.081820:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220442cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a45944b-32e3-4193-a2a5-46f84222bc14:3619:1874676443898240:0@lo:400:kworker.0 00000100:00100000:2.0:1787831012.081834:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220442e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443899264:0@lo:400:kworker.0 00000100:00100000:2.0:1787831012.081848:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787831012.081853:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a7ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443899904:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787831012.081878:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831012.081905:0:11489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443899776 00000100:00100000:2.0:1787831012.081908:0:11489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443899776 00000100:00100000:2.0:1787831012.081932:0:11489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443899904 00000100:00100000:2.0:1787831012.081934:0:11489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443899904 00000100:00100000:2.0:1787831012.081945:0:11489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787831012.081952:0:11489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220442f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3619:x1874676443899776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787831012.081966:0:11489:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923525632 avail 3691974656 00000100:00100000:2.0:1787831012.082000:0:11489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220442f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3619:x1874676443899776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 49us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831012.082006:0:11489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787831012.082017:0:11489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787831012.082022:0:11489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220442e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443899904:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787831012.082030:0:11489:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923525632 avail 3691974656 00000100:00100000:2.0:1787831012.082051:0:11489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220442e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443899904:12345-0@lo:13:osp-pre-1-1.0 Request processed in 30us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831012.082057:0:11489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787831012.082099:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a7ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443899904:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787831012.082112:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22046470c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443899776:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787831012.082137:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220442d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443899136:0@lo:400:kworker.0 00000100:00100000:2.0:1787831012.082145:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a79680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443899648:0@lo:400:kworker.0 00000100:00100000:3.0:1787831012.085974:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676443898752:12345-0@lo:400:kworker.0 Request processed in 8236us (8830us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831012.085989:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1787831012.086074:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220442f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3620:1874676443898368:0@lo:400:kworker.0 00000100:00100000:3.0:1787831012.086089:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220442ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3620:1874676443898880:0@lo:400:kworker.0 00000100:00100000:3.0:1787831012.086100:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203bb3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3620:1874676443899392:0@lo:400:kworker.0 00000100:00100000:2.0:1787831012.093345:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220442e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443898752:0@lo:400:kworker.0 00000040:00080000:3.0:1787831012.175553:0:14618:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787831012.175562:0:14618:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787831012.175594:0:14618:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:3.0:1787831012.175600:0:14618:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787831012.302582:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831012.302747:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433376128 00000100:00100000:0.0:1787831012.302757:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433376128 00000100:00100000:0.0:1787831012.302827:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 201 00000100:00100000:0.0:1787831012.302838:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203bb3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+23:12352:x1874676433376128:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:0.0:1787831012.302869:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787831012.302891:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2200/0x95459fb9d1d29615 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a9942401c expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.302989:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3e00/0x95459fb9d1d2961c lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.303002:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3e00/0x95459fb9d1d2961c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.303013:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3e00/0x95459fb9d1d2961c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787831012.303034:0:6491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1787831012.303133:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2200/0x95459fb9d1d29615 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a9942401c expref: 26 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.303150:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3e00/0x95459fb9d1d2961c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a9942401c expref: 25 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.303158:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d233a6f8e00) 00010000:00010000:0.0:1787831012.303161:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787831012.303164:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2303aa3e00, rc 0) 00000100:00100000:0.0:1787831012.303235:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203bb3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+25:12352:x1874676433376128:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 398us (661us total) trans 4294967471 rc 0/0 00000100:00100000:0.0:1787831012.303243:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 201 00000100:00100000:2.0:1787831012.310226:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831012.310362:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433376256 00000100:00100000:3.0:1787831012.310371:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433376256 00000100:00100000:3.0:1787831012.310424:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 202 00000100:00100000:3.0:1787831012.310432:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220442e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+25:12352:x1874676433376256:12345-192.168.203.31@tcp:34:lfs.0 00010000:00010000:3.0:1787831012.310493:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d2962a lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.310507:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d2962a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.310514:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d2962a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.310524:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d29631 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.310529:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d29631 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.310543:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d29631 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.310618:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d29638 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.310651:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d29638 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.310657:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d29638 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787831012.310696:0:6492:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d29638 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.310709:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d2962a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.310715:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d2962a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.310723:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d2962a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.310730:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2307c77a00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:3.0:1787831012.310735:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d2962a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.310803:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d2962a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.310816:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d233a6f8e00) 00010000:00010000:3.0:1787831012.310825:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787831012.310832:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d2962a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.310839:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d2962a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.310853:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d29631 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.310859:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d29631 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.310865:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d29631 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.310870:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2307c76400 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:3.0:1787831012.310873:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d29631 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.310880:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d29631 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.310888:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8d233a6f8700) 00010000:00010000:3.0:1787831012.310890:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787831012.310893:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d29631 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.310899:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d29631 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.310912:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d29638 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.310923:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d29638 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.310928:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d29638 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.311795:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2307c76600 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:3.0:1787831012.311800:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d29638 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.311807:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d29638 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.311817:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d233a6f8400) 00010000:00010000:3.0:1787831012.311820:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787831012.311824:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d29638 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.311830:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d29638 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787831012.311915:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220442e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+25:12352:x1874676433376256:12345-192.168.203.31@tcp:34:lfs.0 Request processed in 1482us (1697us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831012.311924:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 202 00010000:00010000:1.0:1787831012.328606:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787831012.370492:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831012.370536:0:13771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433376512 00000100:00100000:3.0:1787831012.370545:0:13771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433376512 00000100:00100000:3.0:1787831012.370587:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 203 00000100:00100000:3.0:1787831012.370593:0:13771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220442d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47d7f0ed-283f-4b70-a741-6e74c5e52619+25:12355:x1874676433376512:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:3.0:1787831012.370611:0:13771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787831012.370659:0:13771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d2963f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99424023 expref: -99 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.370719:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d29646 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.370730:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d29646 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.370738:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d29646 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.370747:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d2964d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.370751:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d2964d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.370754:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d2964d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.370899:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77800/0x95459fb9d1d29654 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.370908:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77800/0x95459fb9d1d29654 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.370916:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77800/0x95459fb9d1d29654 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787831012.370930:0:13771:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:3.0:1787831012.371004:0:13771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d29646 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.371022:0:13771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d29646 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.371028:0:13771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d29646 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.371035:0:13771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2307c76400 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:3.0:1787831012.371040:0:13771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d29646 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.371047:0:13771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d29646 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.371060:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d233a6f8e00) 00010000:00010000:3.0:1787831012.371063:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787831012.371068:0:13771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d29646 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.371136:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d29646 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.371151:0:13771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d2964d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.371155:0:13771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d2964d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.371158:0:13771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d2964d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.371161:0:13771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2307c77a00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:3.0:1787831012.371168:0:13771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d2964d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.371172:0:13771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d2964d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.371178:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8d233a6f8400) 00010000:00010000:3.0:1787831012.371180:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787831012.371182:0:13771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d2964d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.371186:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d2964d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.371223:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d2963f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424023 expref: 28 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.371232:0:13771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77800/0x95459fb9d1d29654 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424023 expref: 27 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.371363:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d233a6f8700) 00010000:00010000:3.0:1787831012.371366:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787831012.371369:0:13771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2307c77800, rc 0) 00000100:00100000:3.0:1787831012.371442:0:13771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220442d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47d7f0ed-283f-4b70-a741-6e74c5e52619+27:12355:x1874676433376512:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 847us (958us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1787831012.371449:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 203 00000100:00100000:0.0:1787831012.375830:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831012.375902:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433376640 00000100:00100000:3.0:1787831012.375912:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433376640 00000100:00100000:3.0:1787831012.375978:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 204 00000100:00100000:3.0:1787831012.375989:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22046461c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+27:12355:x1874676433376640:12345-192.168.203.31@tcp:54:lfs.0 00010000:00010000:3.0:1787831012.376057:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d29662 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.376069:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d29662 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.376077:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d29662 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.376104:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d29662 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.376109:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d29662 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.376114:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d29662 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.376117:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2307c77400 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:3.0:1787831012.376120:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d29662 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.376124:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d29662 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.376132:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d233a6f8700) 00010000:00010000:3.0:1787831012.376134:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787831012.376137:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d29662 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.376141:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d29662 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787831012.376203:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22046461c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+27:12355:x1874676433376640:12345-192.168.203.31@tcp:54:lfs.0 Request processed in 217us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831012.376415:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 204 00000100:00100000:0.0:1787831012.379358:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831012.379476:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433376896 00000100:00100000:3.0:1787831012.379485:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433376896 00000100:00100000:3.0:1787831012.379531:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 51 00000100:00100000:3.0:1787831012.379541:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204647c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+27:12355:x1874676433376896:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:3.0:1787831012.379786:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204647c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+28:12355:x1874676433376896:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 246us (436us total) trans 4294967473 rc 0/0 00000100:00100000:3.0:1787831012.379794:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 51 00000100:00100000:2.0:1787831012.422256:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831012.422316:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433377152 00000100:00100000:3.0:1787831012.422325:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433377152 00000100:00100000:3.0:1787831012.422395:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 205 00000100:00100000:3.0:1787831012.422407:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220442cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+28:11888:x1874676433377152:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:3.0:1787831012.422431:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787831012.422452:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d29669 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a9942402a expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.422552:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d29670 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.422566:0:6492:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77800/0x95459fb9d1d29654 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424023 expref: 29 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.422575:0:6492:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d29670 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.422651:0:6492:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77800/0x95459fb9d1d29654 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424023 expref: 29 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.422666:0:6492:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77800/0x95459fb9d1d29654 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424023 expref: 29 pid: 13771 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787831012.422680:0:6492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2318d57840 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6492:1874676443900032:192.168.203.31@tcp:104: 00000100:00100000:3.0:1787831012.422776:0:6492:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d233be68180 going to sleep for 11 seconds 00000100:00100000:1.0:1787831012.431408:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831012.431560:0:6492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2318d57840 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6492:1874676443900032:192.168.203.31@tcp:104: 00010000:00010000:3.0:1787831012.431667:0:6492:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d29670 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831012.432297:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433377280 00000100:00100000:0.0:1787831012.432305:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433377280 00010000:00010000:0.0:1787831012.432348:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77800/0x95459fb9d1d29654 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424023 expref: 30 pid: 13771 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831012.432432:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 94 00000100:00100000:0.0:1787831012.432442:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204554f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+30:2397:x1874676433377280:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787831012.432456:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787831012.432463:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77800/0x95459fb9d1d29654 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424023 expref: 30 pid: 13771 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.432493:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77800/0x95459fb9d1d29654 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424023 expref: 30 pid: 13771 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.432514:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77800/0x95459fb9d1d29654 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424023 expref: 30 pid: 13771 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.432532:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d233a6f8700) 00010000:00010000:0.0:1787831012.432537:0:6476:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d29670 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.432547:0:6476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d29670 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.432555:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d29670 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.432583:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787831012.432664:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204554f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+29:2397:x1874676433377280:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 223us (1265us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831012.432672:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 94 00010000:00010000:3.0:1787831012.436470:0:6492:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d29670 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.436487:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d29670 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787831012.436509:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:3.0:1787831012.437567:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d29669 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a9942402a expref: 30 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.437594:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d29670 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a9942402a expref: 29 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.437603:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d233a6f8700) 00010000:00010000:3.0:1787831012.437607:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787831012.437639:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2307c76600, rc 0) 00000100:00100000:3.0:1787831012.437760:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220442cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+29:11888:x1874676433377152:12345-192.168.203.31@tcp:101:bash.0 Request processed in 15355us (15512us total) trans 4294967474 rc 0/0 00000100:00100000:3.0:1787831012.437779:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 205 00000100:00100000:1.0:1787831012.446938:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831012.447022:0:13771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433377408 00000100:00100000:3.0:1787831012.447031:0:13771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433377408 00000100:00100000:3.0:1787831012.447089:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 206 00000100:00100000:3.0:1787831012.447099:0:13771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22045570c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47d7f0ed-283f-4b70-a741-6e74c5e52619+29:11888:x1874676433377408:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:3.0:1787831012.447123:0:13771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787831012.447143:0:13771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d2967e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99424031 expref: -99 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.447176:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d29685 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.447191:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d29685 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.447202:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d29685 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.447313:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d2967e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424031 expref: 31 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.447331:0:13771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d29685 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424031 expref: 30 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.447340:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d233a6f8700) 00010000:00010000:3.0:1787831012.447343:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787831012.447353:0:13771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2307c77a00, rc 0) 00000100:00100000:3.0:1787831012.447413:0:13771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22045570c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47d7f0ed-283f-4b70-a741-6e74c5e52619+30:11888:x1874676433377408:12345-192.168.203.31@tcp:101:bash.0 Request processed in 316us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831012.447421:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 206 00000100:00100000:2.0:1787831012.452246:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831012.452337:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433377664 00000100:00100000:3.0:1787831012.452349:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433377664 00000100:00100000:3.0:1787831012.452408:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 207 00000100:00100000:3.0:1787831012.452418:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220442d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+30:11888:x1874676433377664:12345-192.168.203.31@tcp:36:bash.0 00010000:00010000:3.0:1787831012.452664:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d2968c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.452682:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d2968c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.452693:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d2968c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787831012.452735:0:6490:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000004:00010000:3.0:1787831012.452758:0:6490:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000066fa6fa8 reply state 00000000faad8b18 transno 4294967476 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d2968c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.452783:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d2968c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.452790:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d233a6f8700) 00010000:00010000:3.0:1787831012.452793:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787831012.452797:0:6490:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1787831012.452843:0:6490:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000100:00100000:3.0:1787831012.452942:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220442d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+34:11888:x1874676433377664:12345-192.168.203.31@tcp:36:bash.0 Request processed in 525us (705us total) trans 4294967477 rc 0/0 00000100:00100000:3.0:1787831012.452950:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 207 00000020:00080000:3.0:1787831012.452968:0:6490:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1787831012.458468:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831012.458668:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433377792 00000100:00100000:3.0:1787831012.458679:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433377792 00000100:00100000:3.0:1787831012.458733:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 208 00000100:00100000:3.0:1787831012.458743:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220442c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+34:11888:x1874676433377792:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:3.0:1787831012.458776:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787831012.458798:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d29693 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99424038 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.458858:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d29693 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424038 expref: 35 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.458873:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d29693 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424038 expref: 35 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.458892:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d233a6f8700) 00010000:00010000:3.0:1787831012.458896:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787831012.458900:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2307c77400, rc 0) 00000100:00100000:3.0:1787831012.458960:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220442c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+35:11888:x1874676433377792:12345-192.168.203.31@tcp:101:bash.0 Request processed in 218us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831012.458968:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 208 00000100:00100000:1.0:1787831012.463274:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831012.463374:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433377920 00000100:00100000:2.0:1787831012.463383:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433377920 00000100:00100000:2.0:1787831012.463441:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 66 00000100:00100000:2.0:1787831012.463450:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22045561c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+7:11888:x1874676433377920:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:2.0:1787831012.463467:0:8407:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787831012.463497:0:8407:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004501f9c4/0x95459fb9d1d2969a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a9942403f expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787831012.463523:0:8407:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a9022e3, atime: 0x6a9022e2, ctime: 0x6a9022e3, blocks: 0x8 00010000:00010000:2.0:1787831012.463542:0:8407:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=303s v=(0 0) 00010000:00010000:2.0:1787831012.463547:0:8407:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787831012.463555:0:8407:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004501f9c4/0x95459fb9d1d2969a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.31@tcp remote: 0xe558a92a9942403f expref: 8 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831012.463572:0:8407:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004501f9c4/0x95459fb9d1d2969a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.31@tcp remote: 0xe558a92a9942403f expref: 8 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831012.463600:0:8407:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22039c1e00, rc 0) 00000100:00100000:2.0:1787831012.463687:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22045561c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+8:11888:x1874676433377920:12345-192.168.203.31@tcp:101:bash.0 Request processed in 238us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831012.463695:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 66 00000100:00100000:2.0:1787831012.466226:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831012.466287:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433378048 00000100:00100000:0.0:1787831012.466296:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433378048 00002000:00010000:0.0:1787831012.466333:0:8413:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:0.0:1787831012.466339:0:8413:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d220442ed00 with x1874676433378048 ext(0->18446744073709551615) 00002000:00010000:0.0:1787831012.466350:0:8413:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d220442ed00. 00000100:00100000:0.0:1787831012.466413:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 5 00000100:00100000:0.0:1787831012.466423:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220442ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+8:2397:x1874676433378048:12345-192.168.203.31@tcp:10:bash.0 00002000:00010000:0.0:1787831012.466707:0:8413:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1787831012.466711:0:8413:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1787831011 -> 1787831012 00002000:00010000:0.0:1787831012.466714:0:8413:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 1787831010 -> 1787831010 00002000:00010000:0.0:1787831012.466715:0:8413:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1787831011 -> 1787831012 00002000:00010000:0.0:1787831012.466717:0:8413:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:0.0:1787831012.466791:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220442ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+9:2397:x1874676433378048:12345-192.168.203.31@tcp:10:bash.0 Request processed in 369us (578us total) trans 4294967319 rc 0/0 00000100:00100000:0.0:1787831012.466798:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 5 00002000:00010000:0.0:1787831012.466801:0:8413:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:0.0:1787831012.466804:0:8413:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d220442ed00 with x1874676433378048 ext(0->18446744073709551615) 00002000:00010000:0.0:1787831012.466808:0:8413:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d220442ed00. 00000100:00100000:1.0:1787831012.535498:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831012.535649:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433378176 00000100:00100000:0.0:1787831012.535659:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433378176 00000100:00100000:0.0:1787831012.535724:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 209 00000100:00100000:0.0:1787831012.535735:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204557c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+35:12370:x1874676433378176:12345-192.168.203.31@tcp:34:lfs.0 00010000:00010000:0.0:1787831012.535875:0:8620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2e00/0x95459fb9d1d296a1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.535892:0:8620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2e00/0x95459fb9d1d296a1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.535965:0:8620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2e00/0x95459fb9d1d296a1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.535982:0:8620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2a00/0x95459fb9d1d296a8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.535989:0:8620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2a00/0x95459fb9d1d296a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.536009:0:8620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2a00/0x95459fb9d1d296a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.536145:0:8620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2400/0x95459fb9d1d296af lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.536155:0:8620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2400/0x95459fb9d1d296af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.536163:0:8620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2400/0x95459fb9d1d296af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787831012.536321:0:8620:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2400/0x95459fb9d1d296af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.536335:0:8620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2e00/0x95459fb9d1d296a1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.536342:0:8620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2e00/0x95459fb9d1d296a1 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.536349:0:8620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2e00/0x95459fb9d1d296a1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.536356:0:8620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2303aa2e00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:0.0:1787831012.536360:0:8620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2e00/0x95459fb9d1d296a1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.536367:0:8620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2e00/0x95459fb9d1d296a1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.536379:0:8620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d233a6f8e00) 00010000:00010000:0.0:1787831012.536388:0:8620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787831012.536393:0:8620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2e00/0x95459fb9d1d296a1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.536399:0:8620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2e00/0x95459fb9d1d296a1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.536492:0:8620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2a00/0x95459fb9d1d296a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.536498:0:8620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2a00/0x95459fb9d1d296a8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.536504:0:8620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2a00/0x95459fb9d1d296a8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.536509:0:8620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2303aa2a00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:0.0:1787831012.536511:0:8620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2a00/0x95459fb9d1d296a8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.536516:0:8620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2a00/0x95459fb9d1d296a8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.536523:0:8620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8d2309e00a00) 00010000:00010000:0.0:1787831012.536526:0:8620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787831012.536528:0:8620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2a00/0x95459fb9d1d296a8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.536533:0:8620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2a00/0x95459fb9d1d296a8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.536544:0:8620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2400/0x95459fb9d1d296af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.536557:0:8620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2400/0x95459fb9d1d296af lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.536562:0:8620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2400/0x95459fb9d1d296af lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.536566:0:8620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2303aa2400 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:0.0:1787831012.536569:0:8620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2400/0x95459fb9d1d296af lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.536575:0:8620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2400/0x95459fb9d1d296af lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.536582:0:8620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d233a6f8700) 00010000:00010000:0.0:1787831012.536584:0:8620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787831012.536586:0:8620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2400/0x95459fb9d1d296af lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.536591:0:8620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2400/0x95459fb9d1d296af lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831012.536814:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204557c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+35:12370:x1874676433378176:12345-192.168.203.31@tcp:34:lfs.0 Request processed in 1079us (1322us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831012.536822:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 209 00000100:00100000:3.0:1787831012.599862:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831012.600066:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433378432 00000100:00100000:0.0:1787831012.600076:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433378432 00000100:00100000:0.0:1787831012.600134:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 210 00000100:00100000:0.0:1787831012.600144:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2318d57840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+35:12373:x1874676433378432:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:0.0:1787831012.600162:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787831012.600198:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2400/0x95459fb9d1d296b6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99424046 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.600520:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2a00/0x95459fb9d1d296bd lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.600535:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2a00/0x95459fb9d1d296bd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.600546:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2a00/0x95459fb9d1d296bd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.600561:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2e00/0x95459fb9d1d296c4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.600568:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2e00/0x95459fb9d1d296c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.600575:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2e00/0x95459fb9d1d296c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.601124:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2200/0x95459fb9d1d296cb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.601136:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2200/0x95459fb9d1d296cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.601145:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2200/0x95459fb9d1d296cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787831012.601156:0:6490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1787831012.601705:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2a00/0x95459fb9d1d296bd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.601728:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2a00/0x95459fb9d1d296bd lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.601746:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2a00/0x95459fb9d1d296bd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.601752:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2303aa2a00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:0.0:1787831012.601756:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2a00/0x95459fb9d1d296bd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.601772:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2a00/0x95459fb9d1d296bd lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.601785:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d233a6f8e00) 00010000:00010000:0.0:1787831012.601788:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787831012.601793:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2a00/0x95459fb9d1d296bd lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.601799:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2a00/0x95459fb9d1d296bd lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.601813:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2e00/0x95459fb9d1d296c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.601819:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2e00/0x95459fb9d1d296c4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.601825:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2e00/0x95459fb9d1d296c4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.601830:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2303aa2e00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:0.0:1787831012.601838:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2e00/0x95459fb9d1d296c4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.601845:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2e00/0x95459fb9d1d296c4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.601852:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8d2309e00a00) 00010000:00010000:0.0:1787831012.601854:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787831012.601857:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2e00/0x95459fb9d1d296c4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.601863:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2e00/0x95459fb9d1d296c4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.601903:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2400/0x95459fb9d1d296b6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424046 expref: 38 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.601916:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2200/0x95459fb9d1d296cb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424046 expref: 37 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.601924:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d233a6f8700) 00010000:00010000:0.0:1787831012.601926:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787831012.601928:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2303aa2200, rc 0) 00000100:00100000:0.0:1787831012.602046:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2318d57840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+37:12373:x1874676433378432:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 1904us (2195us total) trans 4294967478 rc 0/0 00000100:00100000:0.0:1787831012.602055:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 210 00000100:00100000:3.0:1787831012.611720:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831012.611955:0:13771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433378560 00000100:00100000:0.0:1787831012.611965:0:13771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433378560 00000100:00100000:0.0:1787831012.612026:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 211 00000100:00100000:0.0:1787831012.612036:0:13771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a48b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47d7f0ed-283f-4b70-a741-6e74c5e52619+37:12373:x1874676433378560:12345-192.168.203.31@tcp:54:lfs.0 00010000:00010000:0.0:1787831012.612176:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2400/0x95459fb9d1d296d9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.612194:0:13771:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d29670 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a9942402a expref: 37 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.612203:0:13771:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2400/0x95459fb9d1d296d9 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.612237:0:13771:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d29670 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0xe558a92a9942402a expref: 37 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.612250:0:13771:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d29670 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a9942402a expref: 37 pid: 6492 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831012.612457:0:13771:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204644000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13771:1874676443900160:192.168.203.31@tcp:104: 00000100:00100000:0.0:1787831012.612606:0:13771:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2203b6b480 going to sleep for 11 seconds 00000100:00100000:1.0:1787831012.616284:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831012.616530:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433378816 00000100:00100000:3.0:1787831012.616538:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433378816 00000100:00100000:3.0:1787831012.616610:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 52 00000100:00100000:3.0:1787831012.616619:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204554000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+38:6158:x1874676433378816:12345-192.168.203.31@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787831012.616949:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204554000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+39:6158:x1874676433378816:12345-192.168.203.31@tcp:35:ldlm_bl.0 Request processed in 330us (672us total) trans 4294967479 rc 0/0 00000100:00100000:3.0:1787831012.616970:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 52 00000100:00100000:0.0:1787831012.617509:0:13771:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204644000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13771:1874676443900160:192.168.203.31@tcp:104: 00010000:00010000:0.0:1787831012.617533:0:13771:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2400/0x95459fb9d1d296d9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787831012.620940:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831012.622109:0:7432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433378944 00000100:00100000:0.0:1787831012.622123:0:7432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433378944 00010000:00010000:0.0:1787831012.622173:0:7432:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d29670 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a9942402a expref: 39 pid: 6492 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831012.622300:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 95 00000100:00100000:0.0:1787831012.622312:0:7432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2305ffb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+39:2397:x1874676433378944:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787831012.622343:0:7432:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787831012.622352:0:7432:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d29670 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a9942402a expref: 39 pid: 6492 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.622366:0:7432:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d29670 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a9942402a expref: 39 pid: 6492 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.622389:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d29670 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a9942402a expref: 39 pid: 6492 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.622415:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d233a6f8700) 00010000:00010000:0.0:1787831012.622421:0:7432:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2400/0x95459fb9d1d296d9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.622431:0:7432:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2400/0x95459fb9d1d296d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.622438:0:7432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2400/0x95459fb9d1d296d9 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.622529:0:7432:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787831012.622592:0:7432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2305ffb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+38:2397:x1874676433378944:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 283us (1660us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831012.622601:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 95 00010000:00010000:3.0:1787831012.623105:0:13771:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2400/0x95459fb9d1d296d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.623115:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2400/0x95459fb9d1d296d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.623157:0:13771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2400/0x95459fb9d1d296d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.623164:0:13771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2400/0x95459fb9d1d296d9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.623170:0:13771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2400/0x95459fb9d1d296d9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.623176:0:13771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2303aa2400 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:3.0:1787831012.623180:0:13771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2400/0x95459fb9d1d296d9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.623187:0:13771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2400/0x95459fb9d1d296d9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.623197:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d233a6f8700) 00010000:00010000:3.0:1787831012.623200:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787831012.623204:0:13771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2400/0x95459fb9d1d296d9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.623210:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2400/0x95459fb9d1d296d9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787831012.623374:0:13771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a48b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47d7f0ed-283f-4b70-a741-6e74c5e52619+37:12373:x1874676433378560:12345-192.168.203.31@tcp:54:lfs.0 Request processed in 11338us (11662us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831012.623382:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 211 00000100:00100000:3.0:1787831012.625984:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831012.626236:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433379200 00000100:00100000:1.0:1787831012.626246:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433379200 00000100:00100000:1.0:1787831012.626317:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 53 00000100:00100000:1.0:1787831012.626326:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220392cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+37:12373:x1874676433379200:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:1.0:1787831012.626549:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220392cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+38:12373:x1874676433379200:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 223us (572us total) trans 4294967480 rc 0/0 00000100:00100000:1.0:1787831012.626557:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 53 00000100:00100000:1.0:1787831012.716070:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831012.716162:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433379456 00000100:00100000:0.0:1787831012.716171:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433379456 00000100:00100000:0.0:1787831012.716227:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 212 00000100:00100000:0.0:1787831012.716236:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204556580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+38:12384:x1874676433379456:12345-192.168.203.31@tcp:101:cat.0 00010000:00010000:0.0:1787831012.716273:0:8620:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787831012.716293:0:8620:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2e00/0x95459fb9d1d296e0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a9942404d expref: -99 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.716357:0:8620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2a00/0x95459fb9d1d296e7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.716371:0:8620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2a00/0x95459fb9d1d296e7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.716492:0:8620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2a00/0x95459fb9d1d296e7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.716510:0:8620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3c00/0x95459fb9d1d296ee lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.716518:0:8620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3c00/0x95459fb9d1d296ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.716525:0:8620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3c00/0x95459fb9d1d296ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.716672:0:8620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3000/0x95459fb9d1d296f5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.716680:0:8620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3000/0x95459fb9d1d296f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.716687:0:8620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3000/0x95459fb9d1d296f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787831012.716696:0:8620:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:0.0:1787831012.716790:0:8620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2a00/0x95459fb9d1d296e7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.716799:0:8620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2a00/0x95459fb9d1d296e7 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.716805:0:8620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2a00/0x95459fb9d1d296e7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.716812:0:8620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2303aa2a00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:0.0:1787831012.716816:0:8620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2a00/0x95459fb9d1d296e7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.716823:0:8620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2a00/0x95459fb9d1d296e7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.716835:0:8620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d233a6f8e00) 00010000:00010000:0.0:1787831012.716838:0:8620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787831012.716842:0:8620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2a00/0x95459fb9d1d296e7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.716848:0:8620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2a00/0x95459fb9d1d296e7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.716861:0:8620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3c00/0x95459fb9d1d296ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.716866:0:8620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3c00/0x95459fb9d1d296ee lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.716872:0:8620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3c00/0x95459fb9d1d296ee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.716877:0:8620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2303aa3c00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:0.0:1787831012.716886:0:8620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3c00/0x95459fb9d1d296ee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.716892:0:8620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3c00/0x95459fb9d1d296ee lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.716900:0:8620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8d2309e00a00) 00010000:00010000:0.0:1787831012.716903:0:8620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787831012.716905:0:8620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3c00/0x95459fb9d1d296ee lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.716911:0:8620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3c00/0x95459fb9d1d296ee lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.716949:0:8620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2e00/0x95459fb9d1d296e0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a9942404d expref: 41 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.716962:0:8620:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3000/0x95459fb9d1d296f5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a9942404d expref: 40 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.716969:0:8620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d233a6f8700) 00010000:00010000:0.0:1787831012.716971:0:8620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787831012.716973:0:8620:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2303aa3000, rc 0) 00000100:00100000:0.0:1787831012.717124:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204556580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+40:12384:x1874676433379456:12345-192.168.203.31@tcp:101:cat.0 Request processed in 887us (1061us total) trans 4294967481 rc 0/0 00000100:00100000:0.0:1787831012.717131:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 212 00000100:00100000:3.0:1787831012.723708:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831012.724138:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433379712 00000100:00100000:1.0:1787831012.724149:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433379712 00000100:00100000:1.0:1787831012.724208:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 54 00000100:00100000:1.0:1787831012.724218:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220380d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+40:12384:x1874676433379712:12345-192.168.203.31@tcp:35:cat.0 00000100:00100000:1.0:1787831012.725031:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220380d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+41:12384:x1874676433379712:12345-192.168.203.31@tcp:35:cat.0 Request processed in 811us (1326us total) trans 4294967482 rc 0/0 00000100:00100000:1.0:1787831012.725041:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 54 00000100:00100000:2.0:1787831012.765786:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831012.765893:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433379968 00000100:00100000:0.0:1787831012.765902:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433379968 00000100:00100000:0.0:1787831012.765959:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 213 00000100:00100000:0.0:1787831012.765970:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220442f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+41:12385:x1874676433379968:12345-192.168.203.31@tcp:36:rm.0 00010000:00010000:0.0:1787831012.766043:0:6490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1787831012.766070:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d29693 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424038 expref: 41 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.766088:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3000/0x95459fb9d1d296f5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a9942404d expref: 40 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.766096:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2200/0x95459fb9d1d296cb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424046 expref: 39 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.766103:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d29685 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424031 expref: 38 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.766113:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d233a6f8700) 00010000:00010000:0.0:1787831012.766117:0:6490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787831012.766134:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2e00/0x95459fb9d1d29703 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.766143:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2e00/0x95459fb9d1d29703 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.766149:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2e00/0x95459fb9d1d29703 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.766158:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3c00/0x95459fb9d1d2970a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.766162:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3c00/0x95459fb9d1d2970a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.766174:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3c00/0x95459fb9d1d2970a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.766237:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2a00/0x95459fb9d1d29711 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.766242:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2a00/0x95459fb9d1d29711 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.766246:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2a00/0x95459fb9d1d29711 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787831012.766424:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00010000:00010000:0.0:1787831012.766463:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2000/0x95459fb9d1d29718 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.766471:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2000/0x95459fb9d1d29718 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.766478:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2000/0x95459fb9d1d29718 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.766485:0:6490:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2000/0x95459fb9d1d29718 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.766490:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2000/0x95459fb9d1d29718 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.766496:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2000/0x95459fb9d1d29718 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.766520:0:6490:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787831012.766543:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2a00/0x95459fb9d1d29711 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.766550:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2a00/0x95459fb9d1d29711 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.766556:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2a00/0x95459fb9d1d29711 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.766562:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2303aa2a00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:0.0:1787831012.766566:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2a00/0x95459fb9d1d29711 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.766573:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2a00/0x95459fb9d1d29711 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.766582:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d233a6f8700) 00010000:00010000:0.0:1787831012.766584:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787831012.766588:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2a00/0x95459fb9d1d29711 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.766594:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2a00/0x95459fb9d1d29711 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.766606:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2e00/0x95459fb9d1d29703 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.766611:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2e00/0x95459fb9d1d29703 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.766617:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2e00/0x95459fb9d1d29703 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.766621:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2303aa2e00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:0.0:1787831012.766868:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2e00/0x95459fb9d1d29703 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.766875:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2e00/0x95459fb9d1d29703 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.766885:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d233a6f8e00) 00010000:00010000:0.0:1787831012.766888:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787831012.766891:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2e00/0x95459fb9d1d29703 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.766894:0:7431:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787831012.766898:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2e00/0x95459fb9d1d29703 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.766903:0:7431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2000/0x95459fb9d1d29718 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787831012.766912:0:6490:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fc6783f4 reply state 000000003b0c87f3 transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3c00/0x95459fb9d1d2970a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.766913:0:7431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2303aa2000 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:3.0:1787831012.766918:0:7431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2000/0x95459fb9d1d29718 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.766932:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3c00/0x95459fb9d1d2970a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.766934:0:7431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2000/0x95459fb9d1d29718 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.766950:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8d2309e00a00) 00010000:00010000:0.0:1787831012.766954:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787831012.766957:0:7431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d233a6f8700) 00000100:00100000:0.0:1787831012.766957:0:6490:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787831012.766963:0:7431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787831012.766967:0:7431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2000/0x95459fb9d1d29718 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.766973:0:7431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2000/0x95459fb9d1d29718 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.766984:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787831012.766986:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787831012.766988:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787831012.767042:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220442f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+39:12385:x1874676433379968:12345-192.168.203.31@tcp:36:rm.0 Request processed in 1072us (1264us total) trans 4294967483 rc 0/0 00000100:00100000:0.0:1787831012.767050:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 213 00000100:00100000:3.0:1787831012.831002:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831012.831076:0:13771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433380224 00000100:00100000:0.0:1787831012.831091:0:13771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433380224 00000100:00100000:0.0:1787831012.831152:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 214 00000100:00100000:0.0:1787831012.831243:0:13771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220380e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47d7f0ed-283f-4b70-a741-6e74c5e52619+39:12391:x1874676433380224:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:0.0:1787831012.831268:0:13771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787831012.831302:0:13771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2e00/0x95459fb9d1d2971f lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99424054 expref: -99 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.831403:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2a00/0x95459fb9d1d29726 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.831419:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2a00/0x95459fb9d1d29726 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.831430:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2a00/0x95459fb9d1d29726 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.831438:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2200/0x95459fb9d1d2972d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.831443:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2200/0x95459fb9d1d2972d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.831447:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2200/0x95459fb9d1d2972d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787831012.831735:0:13771:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:0.0:1787831012.832142:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3000/0x95459fb9d1d29734 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.832149:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3000/0x95459fb9d1d29734 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.832154:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3000/0x95459fb9d1d29734 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.832417:0:13771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2a00/0x95459fb9d1d29726 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.832432:0:13771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2a00/0x95459fb9d1d29726 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.832437:0:13771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2a00/0x95459fb9d1d29726 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.832440:0:13771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2303aa2a00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:0.0:1787831012.832443:0:13771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2a00/0x95459fb9d1d29726 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.832448:0:13771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2a00/0x95459fb9d1d29726 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.832457:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d233a6f8e00) 00010000:00010000:0.0:1787831012.832459:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787831012.832463:0:13771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2a00/0x95459fb9d1d29726 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.832467:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2a00/0x95459fb9d1d29726 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787831012.832476:0:13771:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000006ecdeae reply state 000000009ceae95d transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2200/0x95459fb9d1d2972d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.832483:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2200/0x95459fb9d1d2972d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.832486:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8d2309e00a00) 00010000:00010000:0.0:1787831012.832488:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787831012.832490:0:13771:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787831012.832511:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2e00/0x95459fb9d1d2971f lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424054 expref: 42 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.832525:0:13771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3000/0x95459fb9d1d29734 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424054 expref: 41 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831012.832530:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d2309e00700) 00010000:00010000:0.0:1787831012.832531:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787831012.832533:0:13771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2303aa3000, rc 0) 00000100:00100000:0.0:1787831012.832595:0:13771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220380e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47d7f0ed-283f-4b70-a741-6e74c5e52619+42:12391:x1874676433380224:12345-192.168.203.31@tcp:101:bash.0 Request processed in 1436us (1604us total) trans 4294967484 rc 0/0 00000100:00100000:0.0:1787831012.832600:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 214 00000100:00100000:3.0:1787831012.836283:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831012.836455:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433380352 00000100:00100000:2.0:1787831012.836465:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433380352 00000100:00100000:2.0:1787831012.836551:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 67 00000100:00100000:2.0:1787831012.836573:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2309d09e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+7:2397:x1874676433380352:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:2.0:1787831012.836591:0:8406:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787831012.836612:0:8406:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000002b1ce2e/0x95459fb9d1d29742 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a9942405b expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787831012.836684:0:8406:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787831012.836702:0:8406:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=303s v=(0 0) 00010000:00010000:2.0:1787831012.836708:0:8406:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787831012.836718:0:8406:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000002b1ce2e/0x95459fb9d1d29742 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a9942405b expref: 8 pid: 8406 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831012.836738:0:8406:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000002b1ce2e/0x95459fb9d1d29742 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a9942405b expref: 8 pid: 8406 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831012.836752:0:8406:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22039c0c00, rc 0) 00000100:00100000:2.0:1787831012.836831:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2309d09e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+8:2397:x1874676433380352:12345-192.168.203.31@tcp:101:bash.0 Request processed in 271us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831012.836838:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 67 00000100:00080000:0.0:1787831012.837206:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787831012.839740:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831012.840458:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433380480 00000100:00100000:3.0:1787831012.840468:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433380480 00000100:00100000:3.0:1787831012.840522:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 68 00000100:00100000:3.0:1787831012.840532:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220442fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+8:12391:x1874676433380480:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:3.0:1787831012.840548:0:8407:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787831012.840564:0:8407:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000023de687f/0x95459fb9d1d29749 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99424062 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.840593:0:8407:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000002b1ce2e/0x95459fb9d1d29742 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a9942405b expref: 9 pid: 8406 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.840603:0:8407:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787831012.840607:0:8407:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787831012.840612:0:8407:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000023de687f/0x95459fb9d1d29749 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424062 expref: 9 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.840673:0:8407:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000002b1ce2e/0x95459fb9d1d29742 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.31@tcp remote: 0xe558a92a9942405b expref: 9 pid: 8406 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.840687:0:8407:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000002b1ce2e/0x95459fb9d1d29742 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a9942405b expref: 9 pid: 8406 timeout: 403 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787831012.840700:0:8407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2309d0a1c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8407:1874676443900288:192.168.203.31@tcp:104: 00000100:00100000:3.0:1787831012.840798:0:8407:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d233be689c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787831012.859508:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831012.859806:0:8407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2309d0a1c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8407:1874676443900288:192.168.203.31@tcp:104: 00000100:00100000:2.0:1787831012.859935:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433380608 00000100:00100000:2.0:1787831012.859953:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433380608 00010000:00010000:2.0:1787831012.860019:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000002b1ce2e/0x95459fb9d1d29742 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a9942405b expref: 10 pid: 8406 timeout: 403 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.860027:0:8407:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000023de687f/0x95459fb9d1d29749 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424062 expref: 10 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831012.860066:0:8407:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2307c77800, rc 0) 00000100:00100000:2.0:1787831012.860184:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 96 00000100:00100000:2.0:1787831012.860197:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204555680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+10:2396:x1874676433380608:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787831012.860236:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787831012.860266:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000002b1ce2e/0x95459fb9d1d29742 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a9942405b expref: 10 pid: 8406 timeout: 403 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831012.860294:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000002b1ce2e/0x95459fb9d1d29742 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a9942405b expref: 10 pid: 8406 timeout: 403 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787831012.860326:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220442fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+10:12391:x1874676433380480:12345-192.168.203.31@tcp:101:bash.0 Request processed in 19616us (20413us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831012.860339:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 68 00010000:00010000:2.0:1787831012.860351:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000002b1ce2e/0x95459fb9d1d29742 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a9942405b expref: 10 pid: 8406 timeout: 403 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831012.860371:0:6475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787831012.860376:0:6475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787831012.860387:0:6475:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000023de687f/0x95459fb9d1d29749 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424062 expref: 8 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831012.860413:0:6475:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000023de687f/0x95459fb9d1d29749 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424062 expref: 8 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831012.860454:0:6475:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000023de687f/0x95459fb9d1d29749 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424062 expref: 8 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831012.860471:0:6475:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220442c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6475:1874676443900416:192.168.203.31@tcp:105: 00000100:00100000:2.0:1787831012.860563:0:6475:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d220289cf00 going to sleep for 11 seconds 00000100:00100000:2.0:1787831012.864262:0:6475:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220442c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6475:1874676443900416:192.168.203.31@tcp:105: 00010000:00010000:2.0:1787831012.864296:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787831012.864375:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204555680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+8:2396:x1874676433380608:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 4178us (4880us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831012.864389:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 96 00000100:00100000:3.0:1787831012.868428:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831012.868619:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433380864 00000100:00100000:2.0:1787831012.868659:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433380864 00000100:00100000:2.0:1787831012.868734:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 55 00000100:00100000:2.0:1787831012.868746:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2309d0a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+42:12391:x1874676433380864:12345-192.168.203.31@tcp:35:bash.0 00000100:00100000:2.0:1787831012.869393:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2309d0a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+43:12391:x1874676433380864:12345-192.168.203.31@tcp:35:bash.0 Request processed in 646us (974us total) trans 4294967485 rc 0/0 00000100:00100000:2.0:1787831012.869404:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 55 00000100:00100000:1.0:1787831012.956159:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831012.956873:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433380992 00000100:00100000:2.0:1787831012.956882:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433380992 00002000:00100000:2.0:1787831012.956933:0:8411:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff8d2204554f00 x1874676433380992/t0(0) o4->47d7f0ed-283f-4b70-a741-6e74c5e52619@192.168.203.31@tcp:83/0 lens 504/0 e 0 to 0 dl 1787831023 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787831012.956956:0:8411:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d2204554f00 with x1874676433380992 ext(0->8) 00002000:00010000:2.0:1787831012.956962:0:8411:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d2204554f00 00000100:00100000:2.0:1787831012.956997:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 6 00000100:00100000:2.0:1787831012.957006:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204554f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+8:2396:x1874676433380992:12345-192.168.203.31@tcp:4:bash.0 00000100:00100000:1.0:1787831012.957588:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831012.958642:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433381120 00000100:00100000:2.0:1787831012.958652:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433381120 00000100:00100000:0.0:1787831012.958949:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204554f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+11:2396:x1874676433380992:12345-192.168.203.31@tcp:4:bash.0 Request processed in 1931us (2786us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1787831012.958965:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 6 00002000:00100000:0.0:1787831012.958992:0:8411:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff8d2204554f00 x1874676433380992/t4294967309(0) o4->47d7f0ed-283f-4b70-a741-6e74c5e52619@192.168.203.31@tcp:83/0 lens 504/448 e 0 to 0 dl 1787831023 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787831012.959006:0:8411:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d2204554f00 with x1874676433380992 ext(0->8) 00000100:00100000:3.0:1787831012.959007:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 69 00002000:00010000:0.0:1787831012.959018:0:8411:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d2204554f00 00000100:00100000:3.0:1787831012.959028:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204556d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+11:2396:x1874676433381120:12345-192.168.203.31@tcp:16:kworker.0 00000001:00080000:3.0:1787831012.961302:0:8401:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:3.0:1787831012.961319:0:8401:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000100:00100000:2.0:1787831012.961530:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204556d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+6:2396:x1874676433381120:12345-192.168.203.31@tcp:16:kworker.0 Request processed in 2503us (3948us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831012.961541:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 69 00000100:00100000:1.0:1787831013.051220:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831013.051411:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433381248 00000100:00100000:0.0:1787831013.051428:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433381248 00000100:00080000:2.0:1787831013.051537:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787831013.051555:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 215 00000100:00100000:0.0:1787831013.051568:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22045543c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+43:12407:x1874676433381248:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:0.0:1787831013.051598:0:8620:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787831013.051675:0:8620:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2a00/0x95459fb9d1d29750 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99424069 expref: -99 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831013.051794:0:8620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3a00/0x95459fb9d1d29757 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831013.051811:0:8620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3a00/0x95459fb9d1d29757 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831013.051828:0:8620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3a00/0x95459fb9d1d29757 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787831013.052014:0:8620:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1787831013.052019:0:8620:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787831013.052046:0:8620:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3a00/0x95459fb9d1d29757 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831013.052077:0:8620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2a00/0x95459fb9d1d29750 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424069 expref: 45 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831013.052099:0:8620:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3a00/0x95459fb9d1d29757 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424069 expref: 44 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831013.052109:0:8620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d233a6f8e00) 00010000:00010000:0.0:1787831013.052112:0:8620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787831013.052116:0:8620:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2303aa3a00, rc 0) 00000100:00100000:0.0:1787831013.052397:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22045543c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+44:12407:x1874676433381248:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 830us (1185us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831013.052406:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 215 00000100:00100000:3.0:1787831013.056907:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831013.057043:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433381504 00000100:00100000:0.0:1787831013.057060:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433381504 00000100:00100000:0.0:1787831013.057298:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 216 00000100:00100000:0.0:1787831013.057312:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203afc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+44:12407:x1874676433381504:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:0.0:1787831013.057946:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787831013.058058:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3800/0x95459fb9d1d2975e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99424070 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831013.058231:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2600/0x95459fb9d1d29765 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831013.058250:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2600/0x95459fb9d1d29765 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831013.058265:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2600/0x95459fb9d1d29765 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787831013.058279:0:6490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1787831013.058439:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3800/0x95459fb9d1d2975e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424070 expref: 47 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831013.059101:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2600/0x95459fb9d1d29765 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424070 expref: 46 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831013.059114:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d2309e00700) 00010000:00010000:0.0:1787831013.059117:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787831013.059120:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2303aa2600, rc 0) 00000100:00100000:0.0:1787831013.059341:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203afc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+46:12407:x1874676433381504:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 2026us (2437us total) trans 4294967486 rc 0/0 00000100:00100000:0.0:1787831013.059350:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 216 00000100:00100000:3.0:1787831013.061751:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831013.061803:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831013.061900:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433381888 00000100:00100000:2.0:1787831013.061909:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433381888 00000100:00100000:0.0:1787831013.061954:0:13771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433381760 00000100:00100000:2.0:1787831013.061975:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 16 00000100:00100000:2.0:1787831013.061985:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220395ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+46:2396:x1874676433381888:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787831013.062002:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1787831013.062006:0:13771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433381760 00000100:00100000:0.0:1787831013.062069:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 217 00000100:00100000:0.0:1787831013.062079:0:13771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220395de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47d7f0ed-283f-4b70-a741-6e74c5e52619+47:12407:x1874676433381760:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:2.0:1787831013.062100:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2600/0x95459fb9d1d29765 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424070 expref: 47 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831013.062106:0:13771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787831013.062126:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d2309e00700) 00010000:00010000:2.0:1787831013.062131:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787831013.062132:0:13771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2a00/0x95459fb9d1d29773 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99424077 expref: -99 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831013.062179:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220395ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+47:2396:x1874676433381888:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 193us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831013.062188:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 16 00010000:00010000:0.0:1787831013.062270:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2800/0x95459fb9d1d2977a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831013.062289:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2800/0x95459fb9d1d2977a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831013.062303:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2800/0x95459fb9d1d2977a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787831013.062318:0:13771:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1787831013.062581:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2a00/0x95459fb9d1d29773 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424077 expref: 48 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831013.062601:0:13771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2800/0x95459fb9d1d2977a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424077 expref: 47 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831013.062609:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d2309e00700) 00010000:00010000:0.0:1787831013.062613:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787831013.062616:0:13771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2303aa2800, rc 0) 00000100:00100000:0.0:1787831013.062704:0:13771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220395de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47d7f0ed-283f-4b70-a741-6e74c5e52619+47:12407:x1874676433381760:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 626us (961us total) trans 4294967487 rc 0/0 00000100:00100000:0.0:1787831013.062712:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 217 00000100:00100000:1.0:1787831013.070433:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831013.070900:0:8631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433382016 00000100:00100000:2.0:1787831013.070910:0:8631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433382016 00000100:00100000:2.0:1787831013.070982:0:8631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 70 00000100:00100000:2.0:1787831013.070992:0:8631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204523840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+6:2397:x1874676433382016:12345-192.168.203.31@tcp:1:lfs.0 00010000:00010000:2.0:1787831013.071038:0:8631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002b1ce2e/0x95459fb9d1d29788 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831013.071057:0:8631:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000023de687f/0x95459fb9d1d29749 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424062 expref: 6 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831013.071067:0:8631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1787831013.071072:0:8631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787831013.071077:0:8631:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000002b1ce2e/0x95459fb9d1d29788 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831013.071111:0:8631:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000023de687f/0x95459fb9d1d29749 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424062 expref: 6 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831013.071127:0:8631:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000023de687f/0x95459fb9d1d29749 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424062 expref: 6 pid: 8407 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831013.071141:0:8631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220442c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8631:1874676443900544:192.168.203.31@tcp:104: 00000100:00100000:2.0:1787831013.071249:0:8631:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d220289c780 going to sleep for 11 seconds 00000100:00100000:3.0:1787831013.076553:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831013.076769:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433382144 00000100:00100000:0.0:1787831013.076777:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433382144 00010000:00010000:0.0:1787831013.076813:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000023de687f/0x95459fb9d1d29749 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424062 expref: 7 pid: 8407 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831013.076857:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 97 00000100:00100000:0.0:1787831013.076865:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22039a2940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+7:2396:x1874676433382144:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787831013.076879:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1787831013.076895:0:6476:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1787831013.076898:0:6476:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1787831013 00002000:00010000:0.0:1787831013.076900:0:6476:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1787831013 00002000:00010000:0.0:1787831013.076902:0:6476:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1787831013.076908:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000023de687f/0x95459fb9d1d29749 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424062 expref: 7 pid: 8407 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831013.076921:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000023de687f/0x95459fb9d1d29749 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424062 expref: 7 pid: 8407 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831013.076947:0:6476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787831013.076951:0:6476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787831013.076957:0:6476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000002b1ce2e/0x95459fb9d1d29788 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831013.076967:0:6476:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000002b1ce2e/0x95459fb9d1d29788 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831013.076985:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787831013.077041:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22039a2940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+7:2396:x1874676433382144:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 177us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831013.077049:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 97 00010000:00010000:2.0:1787831013.077446:0:8631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000023de687f/0x95459fb9d1d29749 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424062 expref: 6 pid: 8407 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831013.077471:0:8631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220442c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8631:1874676443900544:192.168.203.31@tcp:104: 00010000:00010000:2.0:1787831013.077489:0:8631:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000002b1ce2e/0x95459fb9d1d29788 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831013.077505:0:8631:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000002b1ce2e/0x95459fb9d1d29788 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831013.077512:0:8631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000002b1ce2e/0x95459fb9d1d29788 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831013.077531:0:8631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002b1ce2e/0x95459fb9d1d29788 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831013.077538:0:8631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000002b1ce2e/0x95459fb9d1d29788 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831013.077546:0:8631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000002b1ce2e/0x95459fb9d1d29788 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831013.077553:0:8631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22039c0c00 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:2.0:1787831013.077557:0:8631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000002b1ce2e/0x95459fb9d1d29788 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831013.077566:0:8631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000002b1ce2e/0x95459fb9d1d29788 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831013.077577:0:8631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000002b1ce2e/0x95459fb9d1d29788 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831013.077593:0:8631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000002b1ce2e/0x95459fb9d1d29788 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831013.077865:0:8631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204523840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:2397:x1874676433382016:12345-192.168.203.31@tcp:1:lfs.0 Request processed in 6874us (7442us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831013.077874:0:8631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 70 00000100:00100000:3.0:1787831013.084544:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831013.084706:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433382400 00000100:00100000:2.0:1787831013.084715:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433382400 00000100:00100000:2.0:1787831013.084783:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 56 00000100:00100000:2.0:1787831013.084793:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d23066c9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+47:12407:x1874676433382400:12345-192.168.203.31@tcp:35:lfs.0 00000004:00010000:2.0:1787831013.084855:0:6493:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2800/0x95459fb9d1d2977a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424077 expref: 47 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787831013.085059:0:6493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:2.0:1787831013.085091:0:6493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:2.0:1787831013.085389:0:6493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00010000:00010000:2.0:1787831013.085426:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0c00/0x95459fb9d1d2978f lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831013.085441:0:6493:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3000/0x95459fb9d1d29734 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424054 expref: 51 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831013.085450:0:6493:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0c00/0x95459fb9d1d2978f lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831013.085715:0:6493:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3000/0x95459fb9d1d29734 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424054 expref: 51 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831013.085745:0:6493:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3000/0x95459fb9d1d29734 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424054 expref: 51 pid: 13771 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831013.085823:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220442c000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6493:1874676443900672:192.168.203.31@tcp:104: 00000100:00100000:2.0:1787831013.085908:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d220289c780 going to sleep for 11 seconds 00000100:00100000:3.0:1787831013.088605:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831013.088880:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220442c000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6493:1874676443900672:192.168.203.31@tcp:104: 00010000:00010000:2.0:1787831013.088906:0:6493:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0c00/0x95459fb9d1d2978f lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831013.089126:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433382528 00000100:00100000:1.0:1787831013.089133:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433382528 00010000:00010000:1.0:1787831013.089169:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3000/0x95459fb9d1d29734 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424054 expref: 52 pid: 13771 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831013.089211:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 98 00000100:00100000:1.0:1787831013.089221:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22038ec780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+52:2396:x1874676433382528:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787831013.089236:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787831013.089243:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3000/0x95459fb9d1d29734 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424054 expref: 52 pid: 13771 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831013.089254:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3000/0x95459fb9d1d29734 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424054 expref: 52 pid: 13771 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831013.089287:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3000/0x95459fb9d1d29734 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424054 expref: 52 pid: 13771 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831013.089303:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d2309e00700) 00010000:00010000:1.0:1787831013.089307:0:6477:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0c00/0x95459fb9d1d2978f lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831013.089316:0:6477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0c00/0x95459fb9d1d2978f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831013.089324:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0c00/0x95459fb9d1d2978f lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831013.089369:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787831013.089418:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22038ec780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+51:2396:x1874676433382528:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 198us (821us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831013.089426:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 98 00010000:00010000:2.0:1787831013.089439:0:6493:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0c00/0x95459fb9d1d2978f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831013.089447:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0c00/0x95459fb9d1d2978f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787831013.089557:0:6493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000001:00080000:2.0:1787831013.089688:0:6493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:2.0:1787831013.089789:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220442c000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6493:1874676443900800:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787831013.089835:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831013.089881:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d220289c000 going to sleep for 11 seconds 00000100:00100000:0.0:1787831013.090059:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443900800 00000100:00100000:0.0:1787831013.090064:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443900800 00000100:00100000:0.0:1787831013.090112:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1787831013.090120:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220442e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6493:x1874676443900800:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787831013.090197:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220442e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6493:x1874676443900800:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 78us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831013.090216:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00080000:2.0:1787831013.090545:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787831013.090572:0:6493:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967308 gen 2 00000004:00080000:2.0:1787831013.090577:0:6493:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967308 00000004:00080000:2.0:1787831013.090593:0:6493:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d220442f0c0, transno 4294967308 00000100:00100000:2.0:1787831013.090617:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220442c000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6493:1874676443900800:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1787831013.090750:0:6493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:2.0:1787831013.091585:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220442c000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6493:1874676443900928:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787831013.091657:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831013.091694:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d220289c300 going to sleep for 11 seconds 00000100:00100000:3.0:1787831013.091750:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443900928 00000100:00100000:3.0:1787831013.091927:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443900928 00000100:00100000:3.0:1787831013.092009:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1787831013.092017:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220442f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6493:x1874676443900928:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787831013.092157:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220442f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6493:x1874676443900928:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 141us (499us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1787831013.092164:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1787831013.092240:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220442c000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6493:1874676443900928:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1787831013.092290:0:6493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:2.0:1787831013.092323:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0c00/0x95459fb9d1d2978f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831013.092333:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0c00/0x95459fb9d1d2978f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831013.092340:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0c00/0x95459fb9d1d2978f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831013.092348:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22039c0c00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:2.0:1787831013.092352:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0c00/0x95459fb9d1d2978f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831013.092359:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0c00/0x95459fb9d1d2978f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831013.092373:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d2309e00700) 00010000:00010000:2.0:1787831013.092376:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787831013.092380:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0c00/0x95459fb9d1d2978f lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831013.092386:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0c00/0x95459fb9d1d2978f lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787831013.092480:0:6493:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1787831013.092531:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:2.0:1787831013.092552:0:6493:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 304092926528ns, next at 305092924417ns, rc = 0 00000001:00080000:2.0:1787831013.092558:0:6493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:2.0:1787831013.092579:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d2309e00700) 00010000:00010000:2.0:1787831013.092581:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787831013.092588:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2800/0x95459fb9d1d2977a lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424077 expref: 55 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831013.092694:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d23066c9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+54:12407:x1874676433382400:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 7903us (8160us total) trans 4294967496 rc 0/0 00000100:00100000:2.0:1787831013.092702:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 56 00000020:00080000:2.0:1787831013.092705:0:6493:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1787831013.097352:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831013.097655:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433382656 00000100:00100000:0.0:1787831013.097664:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433382656 00000100:00100000:0.0:1787831013.097723:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 218 00000100:00100000:0.0:1787831013.097733:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22038ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+54:12407:x1874676433382656:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:0.0:1787831013.097754:0:8620:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787831013.097786:0:8620:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3800/0x95459fb9d1d29796 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a9942407e expref: -99 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831013.097839:0:8620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3800/0x95459fb9d1d29796 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a9942407e expref: 55 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831013.097854:0:8620:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3800/0x95459fb9d1d29796 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a9942407e expref: 55 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831013.097872:0:8620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d2309e00800) 00010000:00010000:0.0:1787831013.097875:0:8620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787831013.097878:0:8620:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2303aa3800, rc 0) 00000100:00100000:0.0:1787831013.097932:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22038ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+55:12407:x1874676433382656:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 201us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831013.097953:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 218 00000100:00100000:2.0:1787831013.104214:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831013.104329:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433382912 00000100:00100000:1.0:1787831013.104339:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433382912 00000100:00100000:1.0:1787831013.104393:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 57 00000100:00100000:1.0:1787831013.104403:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204554000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+55:12407:x1874676433382912:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:1.0:1787831013.104645:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204554000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+56:12407:x1874676433382912:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 220us (418us total) trans 4294967497 rc 0/0 00000100:00100000:1.0:1787831013.104654:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 57 00000100:00100000:2.0:1787831013.159068:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831013.159164:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433383040 00000100:00100000:0.0:1787831013.159175:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433383040 00000100:00100000:0.0:1787831013.159241:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 219 00000100:00100000:0.0:1787831013.159252:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220392cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+56:12417:x1874676433383040:12345-192.168.203.31@tcp:34:lfs.0 00010000:00010000:0.0:1787831013.159339:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3600/0x95459fb9d1d2979d lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831013.159357:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3600/0x95459fb9d1d2979d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831013.159370:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3600/0x95459fb9d1d2979d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831013.159383:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3200/0x95459fb9d1d297a4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831013.159391:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3200/0x95459fb9d1d297a4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831013.159398:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3200/0x95459fb9d1d297a4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831013.159480:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3000/0x95459fb9d1d297ab lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831013.159489:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3000/0x95459fb9d1d297ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831013.159497:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3000/0x95459fb9d1d297ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787831013.159561:0:6490:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3000/0x95459fb9d1d297ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831013.159574:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3600/0x95459fb9d1d2979d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831013.159581:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3600/0x95459fb9d1d2979d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831013.159587:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3600/0x95459fb9d1d2979d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831013.159594:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2303aa3600 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:0.0:1787831013.159598:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3600/0x95459fb9d1d2979d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831013.159606:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3600/0x95459fb9d1d2979d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831013.159618:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d233a6f8e00) 00010000:00010000:0.0:1787831013.159622:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787831013.159652:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3600/0x95459fb9d1d2979d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831013.159658:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3600/0x95459fb9d1d2979d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831013.159671:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3200/0x95459fb9d1d297a4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831013.159677:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3200/0x95459fb9d1d297a4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831013.159690:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3200/0x95459fb9d1d297a4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831013.159696:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2303aa3200 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:0.0:1787831013.159700:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3200/0x95459fb9d1d297a4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831013.159707:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3200/0x95459fb9d1d297a4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831013.159715:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8d2309e00a00) 00010000:00010000:0.0:1787831013.159718:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787831013.159721:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3200/0x95459fb9d1d297a4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831013.159727:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3200/0x95459fb9d1d297a4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831013.159736:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3000/0x95459fb9d1d297ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831013.159742:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3000/0x95459fb9d1d297ab lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831013.159748:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3000/0x95459fb9d1d297ab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831013.159753:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2303aa3000 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:0.0:1787831013.159755:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3000/0x95459fb9d1d297ab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831013.159780:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3000/0x95459fb9d1d297ab lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831013.159789:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d2309e00800) 00010000:00010000:0.0:1787831013.159791:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787831013.159793:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3000/0x95459fb9d1d297ab lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831013.159799:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3000/0x95459fb9d1d297ab lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831013.159872:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220392cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+56:12417:x1874676433383040:12345-192.168.203.31@tcp:34:lfs.0 Request processed in 622us (813us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831013.159880:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 219 00000100:00100000:3.0:1787831013.189788:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831013.189904:0:13771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433383296 00000100:00100000:0.0:1787831013.189913:0:13771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433383296 00000100:00100000:0.0:1787831013.189977:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 220 00000100:00100000:0.0:1787831013.189987:0:13771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22038ee940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47d7f0ed-283f-4b70-a741-6e74c5e52619+56:12420:x1874676433383296:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:0.0:1787831013.190006:0:13771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787831013.190026:0:13771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3000/0x95459fb9d1d297b2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99424085 expref: -99 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831013.190091:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3200/0x95459fb9d1d297b9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831013.190104:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3200/0x95459fb9d1d297b9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831013.190116:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3200/0x95459fb9d1d297b9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831013.190134:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3600/0x95459fb9d1d297c0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831013.190142:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3600/0x95459fb9d1d297c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831013.190149:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3600/0x95459fb9d1d297c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831013.190250:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2800/0x95459fb9d1d297c7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831013.190259:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2800/0x95459fb9d1d297c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831013.190266:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2800/0x95459fb9d1d297c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787831013.190275:0:13771:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1787831013.190347:0:13771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3200/0x95459fb9d1d297b9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831013.190355:0:13771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3200/0x95459fb9d1d297b9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831013.190361:0:13771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3200/0x95459fb9d1d297b9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831013.190367:0:13771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2303aa3200 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:0.0:1787831013.190372:0:13771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3200/0x95459fb9d1d297b9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831013.190390:0:13771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3200/0x95459fb9d1d297b9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831013.190402:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d233a6f8e00) 00010000:00010000:0.0:1787831013.190406:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787831013.190411:0:13771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3200/0x95459fb9d1d297b9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831013.190417:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3200/0x95459fb9d1d297b9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831013.190430:0:13771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3600/0x95459fb9d1d297c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831013.190436:0:13771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3600/0x95459fb9d1d297c0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831013.190441:0:13771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3600/0x95459fb9d1d297c0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831013.190447:0:13771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2303aa3600 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:0.0:1787831013.190449:0:13771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3600/0x95459fb9d1d297c0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831013.190455:0:13771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3600/0x95459fb9d1d297c0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831013.190462:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8d2309e00a00) 00010000:00010000:0.0:1787831013.190465:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787831013.190468:0:13771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3600/0x95459fb9d1d297c0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831013.190483:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3600/0x95459fb9d1d297c0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831013.190518:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3000/0x95459fb9d1d297b2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424085 expref: 59 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831013.190531:0:13771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2800/0x95459fb9d1d297c7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424085 expref: 58 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831013.190539:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d2309e00800) 00010000:00010000:0.0:1787831013.190542:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787831013.190544:0:13771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2303aa2800, rc 0) 00000100:00100000:0.0:1787831013.190611:0:13771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22038ee940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47d7f0ed-283f-4b70-a741-6e74c5e52619+58:12420:x1874676433383296:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 626us (833us total) trans 4294967498 rc 0/0 00000100:00100000:0.0:1787831013.190618:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 220 00000100:00100000:2.0:1787831013.192720:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831013.192915:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433383424 00000100:00100000:3.0:1787831013.192924:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433383424 00000100:00100000:3.0:1787831013.192974:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 221 00000100:00100000:3.0:1787831013.192983:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220380d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+58:12420:x1874676433383424:12345-192.168.203.31@tcp:54:lfs.0 00010000:00010000:3.0:1787831013.193039:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d297d5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831013.193054:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d297d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831013.193065:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d297d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831013.193095:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d297d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831013.193101:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d297d5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831013.193108:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d297d5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831013.193114:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2307c77400 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:3.0:1787831013.193118:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d297d5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831013.193125:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d297d5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831013.193136:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d2309e00800) 00010000:00010000:3.0:1787831013.193139:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787831013.193155:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d297d5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831013.193161:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d297d5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787831013.193286:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220380d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+58:12420:x1874676433383424:12345-192.168.203.31@tcp:54:lfs.0 Request processed in 304us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831013.193294:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 221 00000100:00100000:3.0:1787831013.202169:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831013.202275:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433383680 00000100:00100000:2.0:1787831013.202290:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433383680 00000100:00100000:2.0:1787831013.202351:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 58 00000100:00100000:2.0:1787831013.202361:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22038ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+58:12420:x1874676433383680:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:2.0:1787831013.202576:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22038ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+59:12420:x1874676433383680:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 215us (416us total) trans 4294967499 rc 0/0 00000100:00100000:2.0:1787831013.202584:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 58 00000100:00100000:1.0:1787831013.284830:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831013.284942:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433383936 00000100:00100000:2.0:1787831013.284958:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433383936 00000100:00100000:2.0:1787831013.285041:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 222 00000100:00100000:2.0:1787831013.285051:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204523480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+59:12430:x1874676433383936:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:2.0:1787831013.285075:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787831013.285078:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787831013.285121:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3a00/0x95459fb9d1d29757 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424069 expref: 59 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831013.285139:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d233a6f8e00) 00010000:00010000:2.0:1787831013.285145:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787831013.285159:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0800/0x95459fb9d1d297dc lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a9942408c expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831013.285584:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1800/0x95459fb9d1d297e3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831013.285599:0:6491:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2800/0x95459fb9d1d297c7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424085 expref: 59 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831013.285608:0:6491:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1800/0x95459fb9d1d297e3 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831013.285750:0:6491:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2800/0x95459fb9d1d297c7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424085 expref: 59 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831013.285775:0:6491:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2800/0x95459fb9d1d297c7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424085 expref: 59 pid: 13771 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831013.285788:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2309d0a1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6491:1874676443901056:192.168.203.31@tcp:104: 00000100:00100000:2.0:1787831013.285903:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d220289ca80 going to sleep for 11 seconds 00000100:00100000:3.0:1787831013.291516:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831013.292469:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433384064 00000100:00100000:0.0:1787831013.292480:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433384064 00010000:00010000:0.0:1787831013.292528:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2800/0x95459fb9d1d297c7 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424085 expref: 60 pid: 13771 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831013.292573:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 99 00000100:00100000:0.0:1787831013.292583:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22039b9e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+60:2397:x1874676433384064:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787831013.292597:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787831013.292605:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2800/0x95459fb9d1d297c7 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424085 expref: 60 pid: 13771 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831013.292669:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2800/0x95459fb9d1d297c7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424085 expref: 60 pid: 13771 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831013.292692:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d2309e00800) 00010000:00010000:0.0:1787831013.292698:0:6476:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1800/0x95459fb9d1d297e3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831013.292707:0:6476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1800/0x95459fb9d1d297e3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831013.292715:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1800/0x95459fb9d1d297e3 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831013.292734:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787831013.292798:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22039b9e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+60:2397:x1874676433384064:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 216us (1292us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831013.292806:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 99 00010000:00010000:2.0:1787831013.296344:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2800/0x95459fb9d1d297c7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424085 expref: 59 pid: 13771 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831013.296370:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2309d0a1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6491:1874676443901056:192.168.203.31@tcp:104: 00010000:00010000:2.0:1787831013.296412:0:6491:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1800/0x95459fb9d1d297e3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831013.296423:0:6491:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1800/0x95459fb9d1d297e3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831013.296428:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1800/0x95459fb9d1d297e3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787831013.296451:0:6491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1787831013.296593:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0800/0x95459fb9d1d297dc lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a9942408c expref: 60 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831013.296608:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1800/0x95459fb9d1d297e3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a9942408c expref: 59 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831013.296617:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d2309e00800) 00010000:00010000:2.0:1787831013.296621:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787831013.296642:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22039c1800, rc 0) 00000100:00100000:2.0:1787831013.296799:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204523480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+59:12430:x1874676433383936:12345-192.168.203.31@tcp:101:bash.0 Request processed in 11749us (11993us total) trans 4294967500 rc 0/0 00000100:00100000:2.0:1787831013.296809:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 222 00000100:00100000:3.0:1787831013.311052:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831013.313128:0:13771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433384192 00000100:00100000:0.0:1787831013.313141:0:13771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433384192 00000100:00100000:0.0:1787831013.313206:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 223 00000100:00100000:0.0:1787831013.313215:0:13771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22039b9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47d7f0ed-283f-4b70-a741-6e74c5e52619+59:12430:x1874676433384192:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:0.0:1787831013.313237:0:13771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787831013.313256:0:13771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3200/0x95459fb9d1d297f1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99424093 expref: -99 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831013.313290:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2a00/0x95459fb9d1d297f8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831013.313322:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2a00/0x95459fb9d1d297f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831013.313333:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2a00/0x95459fb9d1d297f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831013.313433:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3200/0x95459fb9d1d297f1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424093 expref: 61 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831013.313575:0:13771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2a00/0x95459fb9d1d297f8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424093 expref: 60 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831013.313585:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d2309e00800) 00010000:00010000:0.0:1787831013.313588:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787831013.313592:0:13771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2303aa2a00, rc 0) 00000100:00100000:0.0:1787831013.313722:0:13771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22039b9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47d7f0ed-283f-4b70-a741-6e74c5e52619+60:12430:x1874676433384192:12345-192.168.203.31@tcp:101:bash.0 Request processed in 507us (2681us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831013.313729:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 223 00000100:00100000:1.0:1787831013.326898:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831013.328174:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433384448 00000100:00100000:0.0:1787831013.328188:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433384448 00000100:00100000:1.0:1787831013.328390:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 224 00000100:00100000:1.0:1787831013.328402:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204521680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+60:12430:x1874676433384448:12345-192.168.203.31@tcp:36:bash.0 00010000:00010000:1.0:1787831013.328738:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6600/0x95459fb9d1d297ff lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831013.328767:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6600/0x95459fb9d1d297ff lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831013.328778:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6600/0x95459fb9d1d297ff lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787831013.328818:0:6490:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967501 00000004:00010000:1.0:1787831013.328842:0:6490:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dad84f1b reply state 0000000049d1d2bf transno 4294967502 ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6600/0x95459fb9d1d297ff lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831013.328874:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6600/0x95459fb9d1d297ff lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831013.328882:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d2309e00800) 00010000:00010000:1.0:1787831013.328885:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787831013.328888:0:6490:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787831013.328987:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204521680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+63:12430:x1874676433384448:12345-192.168.203.31@tcp:36:bash.0 Request processed in 587us (2097us total) trans 4294967502 rc 0/0 00000100:00100000:1.0:1787831013.328995:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 224 00000020:00080000:1.0:1787831013.329000:0:6490:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787831013.336808:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831013.336915:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433384576 00000100:00100000:2.0:1787831013.336924:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433384576 00000100:00100000:2.0:1787831013.336975:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 225 00000100:00100000:2.0:1787831013.336983:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204522d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+63:12430:x1874676433384576:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:2.0:1787831013.337004:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787831013.337021:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0800/0x95459fb9d1d29806 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a9942409a expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831013.337115:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0e00/0x95459fb9d1d2980d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831013.337128:0:6491:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1800/0x95459fb9d1d297e3 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a9942408c expref: 64 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831013.337137:0:6491:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0e00/0x95459fb9d1d2980d lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831013.337168:0:6491:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1800/0x95459fb9d1d297e3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0xe558a92a9942408c expref: 64 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831013.337180:0:6491:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1800/0x95459fb9d1d297e3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a9942408c expref: 64 pid: 6491 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831013.337193:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2309d0a1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6491:1874676443901184:192.168.203.31@tcp:104: 00000100:00100000:2.0:1787831013.337280:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d220289ca80 going to sleep for 11 seconds 00010000:00010000:0.0:1787831013.351254:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787831013.352521:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831013.352567:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2309d0a1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6491:1874676443901184:192.168.203.31@tcp:104: 00010000:00010000:2.0:1787831013.352598:0:6491:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0e00/0x95459fb9d1d2980d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831013.353580:0:7432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433384704 00000100:00100000:0.0:1787831013.353593:0:7432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433384704 00010000:00010000:0.0:1787831013.353702:0:7432:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1800/0x95459fb9d1d297e3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a9942408c expref: 65 pid: 6491 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831013.353741:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 100 00000100:00100000:0.0:1787831013.353828:0:7432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22039ba940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+65:2396:x1874676433384704:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787831013.353868:0:7432:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787831013.353877:0:7432:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1800/0x95459fb9d1d297e3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a9942408c expref: 65 pid: 6491 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831013.353895:0:7432:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1800/0x95459fb9d1d297e3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a9942408c expref: 65 pid: 6491 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831013.354523:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1800/0x95459fb9d1d297e3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a9942408c expref: 65 pid: 6491 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831013.354546:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d2309e00800) 00010000:00010000:0.0:1787831013.354562:0:7432:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0e00/0x95459fb9d1d2980d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831013.354575:0:7432:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0e00/0x95459fb9d1d2980d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831013.354583:0:7432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0e00/0x95459fb9d1d2980d lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831013.355523:0:7432:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787831013.355646:0:7432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22039ba940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+64:2396:x1874676433384704:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 1869us (3113us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831013.355660:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 100 00010000:00010000:2.0:1787831013.355932:0:6491:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0e00/0x95459fb9d1d2980d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831013.355942:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0e00/0x95459fb9d1d2980d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787831013.356012:0:6491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1787831013.356032:0:6491:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787831013.356068:0:6491:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0e00/0x95459fb9d1d2980d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831013.356109:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0800/0x95459fb9d1d29806 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a9942409a expref: 64 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831013.356138:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0e00/0x95459fb9d1d2980d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a9942409a expref: 63 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831013.356147:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d2309e00800) 00010000:00010000:2.0:1787831013.356151:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787831013.356154:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22039c0e00, rc 0) 00000100:00100000:2.0:1787831013.356192:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204522d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+63:12430:x1874676433384576:12345-192.168.203.31@tcp:101:bash.0 Request processed in 19210us (19393us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831013.356200:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 225 00000100:00100000:1.0:1787831013.364349:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831013.364485:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433384960 00000100:00100000:2.0:1787831013.364498:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433384960 00000100:00100000:2.0:1787831013.365075:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 59 00000100:00100000:2.0:1787831013.365092:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204520f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+63:12430:x1874676433384960:12345-192.168.203.31@tcp:35:bash.0 00000100:00100000:2.0:1787831013.365415:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204520f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+64:12430:x1874676433384960:12345-192.168.203.31@tcp:35:bash.0 Request processed in 328us (1079us total) trans 4294967503 rc 0/0 00000100:00100000:2.0:1787831013.365424:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 59 00000100:00100000:1.0:1787831013.439728:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831013.440112:0:13771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433385088 00000100:00100000:0.0:1787831013.440125:0:13771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433385088 00000100:00100000:0.0:1787831013.440210:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 226 00000100:00100000:0.0:1787831013.440223:0:13771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22045221c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47d7f0ed-283f-4b70-a741-6e74c5e52619+64:12436:x1874676433385088:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:0.0:1787831013.440276:0:13771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787831013.440303:0:13771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3200/0x95459fb9d1d29814 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a994240a1 expref: -99 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831013.440384:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2600/0x95459fb9d1d2981b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831013.440401:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2600/0x95459fb9d1d2981b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831013.440415:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2600/0x95459fb9d1d2981b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787831013.440472:0:13771:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1787831013.440476:0:13771:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787831013.440498:0:13771:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2600/0x95459fb9d1d2981b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831013.440529:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3200/0x95459fb9d1d29814 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994240a1 expref: 66 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831013.440549:0:13771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2600/0x95459fb9d1d2981b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994240a1 expref: 65 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831013.440558:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d233a6f8e00) 00010000:00010000:0.0:1787831013.440561:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787831013.441785:0:13771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2303aa2600, rc 0) 00000100:00100000:0.0:1787831013.441887:0:13771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22045221c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47d7f0ed-283f-4b70-a741-6e74c5e52619+65:12436:x1874676433385088:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 1664us (2280us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831013.441898:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 226 00000100:00100000:2.0:1787831013.447315:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831013.447431:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433385216 00000100:00100000:1.0:1787831013.447443:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433385216 00000100:00100000:1.0:1787831013.447544:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 227 00000100:00100000:1.0:1787831013.447556:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2309d0a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+65:12436:x1874676433385216:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:1.0:1787831013.447594:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787831013.447666:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7c00/0x95459fb9d1d29822 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a994240a8 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831013.447753:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6200/0x95459fb9d1d29829 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831013.447784:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6200/0x95459fb9d1d29829 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831013.447798:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6200/0x95459fb9d1d29829 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831013.447829:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7200/0x95459fb9d1d29830 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831013.447845:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7200/0x95459fb9d1d29830 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831013.447853:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7200/0x95459fb9d1d29830 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831013.449084:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6c00/0x95459fb9d1d29837 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831013.449106:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6c00/0x95459fb9d1d29837 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831013.449117:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6c00/0x95459fb9d1d29837 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787831013.449175:0:6490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:1.0:1787831013.449179:0:6490:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787831013.449203:0:6490:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6c00/0x95459fb9d1d29837 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831013.449218:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6c00/0x95459fb9d1d29837 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831013.449227:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6200/0x95459fb9d1d29829 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831013.449235:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6200/0x95459fb9d1d29829 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831013.449259:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6200/0x95459fb9d1d29829 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831013.449266:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d23344b6200 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:1.0:1787831013.449270:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6200/0x95459fb9d1d29829 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831013.449279:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6200/0x95459fb9d1d29829 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831013.449292:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d233a6f8e00) 00010000:00010000:1.0:1787831013.449296:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787831013.449301:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6200/0x95459fb9d1d29829 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831013.449308:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6200/0x95459fb9d1d29829 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831013.449324:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7200/0x95459fb9d1d29830 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831013.449330:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7200/0x95459fb9d1d29830 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831013.449335:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7200/0x95459fb9d1d29830 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831013.449340:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d23344b7200 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:1.0:1787831013.449342:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7200/0x95459fb9d1d29830 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831013.449357:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7200/0x95459fb9d1d29830 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831013.449366:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8d2309e00a00) 00010000:00010000:1.0:1787831013.449369:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787831013.449372:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7200/0x95459fb9d1d29830 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831013.449378:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7200/0x95459fb9d1d29830 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831013.449416:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7c00/0x95459fb9d1d29822 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994240a8 expref: 67 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831013.449430:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6c00/0x95459fb9d1d29837 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994240a8 expref: 66 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831013.449438:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d2309e00800) 00010000:00010000:1.0:1787831013.449441:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787831013.449443:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d23344b6c00, rc 0) 00000100:00100000:1.0:1787831013.449532:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2309d0a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+66:12436:x1874676433385216:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 1978us (2232us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831013.449542:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 227 00000100:00100000:3.0:1787831013.455695:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831013.455969:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433385472 00000100:00100000:1.0:1787831013.455983:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433385472 00000100:00100000:1.0:1787831013.456066:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 242 00000100:00100000:1.0:1787831013.456078:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220394f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:2397:x1874676433385472:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1787831013.456195:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220394f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:2397:x1874676433385472:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 119us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831013.456204:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 242 00000100:00080000:2.0:1787831013.458843:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787831013.459044:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831013.459129:0:13771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433385728 00000100:00100000:0.0:1787831013.459142:0:13771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433385728 00000100:00100000:0.0:1787831013.459225:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 243 00000100:00100000:0.0:1787831013.459235:0:13771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22045c3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c901c2b2-479b-44dc-8fa8-34fbacf02f07+5:2397:x1874676433385728:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1787831013.459322:0:13771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22045c3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c901c2b2-479b-44dc-8fa8-34fbacf02f07+5:2397:x1874676433385728:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 88us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831013.459330:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 243 00000100:00080000:1.0:1787831013.459495:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787831013.463963:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831013.464011:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831013.464018:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433385344 00000100:00100000:2.0:1787831013.464032:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433385344 00000100:00100000:3.0:1787831013.464047:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831013.464090:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831013.464108:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 369 00000100:00100000:3.0:1787831013.464120:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433385984 00000100:00100000:3.0:1787831013.464126:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433385984 00000100:00100000:2.0:1787831013.464143:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d231859e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+13:2397:x1874676433385344:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1787831013.464179:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 17 00000100:00100000:3.0:1787831013.464188:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2305ff8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+66:2394:x1874676433385984:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787831013.464203:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787831013.464235:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6c00/0x95459fb9d1d29837 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994240a8 expref: 66 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831013.464256:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d2309e00800) 00010000:00010000:3.0:1787831013.464262:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787831013.464319:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433385600 00000100:00100000:1.0:1787831013.464322:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433385856 00000100:00100000:0.0:1787831013.464325:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433385600 00000100:00100000:1.0:1787831013.464330:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433385856 00000100:00100000:0.0:1787831013.464381:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 92 00000100:00100000:0.0:1787831013.464389:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22045c1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+9:2397:x1874676433385600:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1787831013.464465:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d231859e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+13:2397:x1874676433385344:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 327us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831013.464475:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 369 00000100:00100000:3.0:1787831013.465011:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2305ff8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+65:2394:x1874676433385984:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 821us (918us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831013.465019:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 17 00000100:00100000:0.0:1787831013.465074:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22045c1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+9:2397:x1874676433385600:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 682us (1069us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831013.465083:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 92 00000100:00080000:0.0:1787831013.471789:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787831013.471805:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787831013.475159:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831013.475270:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433386240 00000100:00100000:3.0:1787831013.475286:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433386240 00000100:00100000:3.0:1787831013.475370:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 228 00000100:00100000:3.0:1787831013.475382:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220453d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+65:12436:x1874676433386240:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:3.0:1787831013.475411:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787831013.475440:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d2983e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a994240af expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831013.475789:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d29845 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831013.475810:0:6491:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0e00/0x95459fb9d1d2980d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a9942409a expref: 66 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831013.475823:0:6491:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d29845 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831013.475868:0:6491:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0e00/0x95459fb9d1d2980d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0xe558a92a9942409a expref: 66 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831013.475886:0:6491:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0e00/0x95459fb9d1d2980d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a9942409a expref: 66 pid: 6491 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787831013.475903:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220384e1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6491:1874676443901312:192.168.203.31@tcp:104: 00000100:00100000:3.0:1787831013.476069:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d233be68300 going to sleep for 11 seconds 00000100:00100000:1.0:1787831013.476325:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 244 00000100:00100000:1.0:1787831013.476337:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220384d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c901c2b2-479b-44dc-8fa8-34fbacf02f07+5:2397:x1874676433385856:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1787831013.476394:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220384d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c901c2b2-479b-44dc-8fa8-34fbacf02f07+5:2397:x1874676433385856:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 60us (12346us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831013.476403:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 244 00000100:00100000:3.0:1787831013.481398:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220384e1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6491:1874676443901312:192.168.203.31@tcp:104: 00010000:00010000:3.0:1787831013.481440:0:6491:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d29845 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831013.487054:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831013.487673:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433386368 00000100:00100000:1.0:1787831013.487688:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433386368 00010000:00010000:1.0:1787831013.487750:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0e00/0x95459fb9d1d2980d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a9942409a expref: 67 pid: 6491 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831013.487815:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 101 00000100:00100000:1.0:1787831013.487828:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a79680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+67:2397:x1874676433386368:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787831013.487860:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787831013.487870:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0e00/0x95459fb9d1d2980d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a9942409a expref: 67 pid: 6491 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831013.487887:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0e00/0x95459fb9d1d2980d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a9942409a expref: 67 pid: 6491 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831013.488079:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0e00/0x95459fb9d1d2980d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a9942409a expref: 67 pid: 6491 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831013.488118:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d2309e00800) 00010000:00010000:1.0:1787831013.488125:0:6477:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d29845 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831013.488136:0:6477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d29845 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831013.488145:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d29845 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831013.488178:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787831013.488252:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a79680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+66:2397:x1874676433386368:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 426us (1213us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831013.488261:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 101 00010000:00010000:3.0:1787831013.488314:0:6491:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d29845 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831013.488326:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d29845 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787831013.488351:0:6491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1787831013.488549:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d2983e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994240af expref: 67 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831013.488579:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d29845 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994240af expref: 66 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831013.488588:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d2309e00800) 00010000:00010000:3.0:1787831013.488591:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787831013.488594:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2307c77400, rc 0) 00000100:00100000:3.0:1787831013.488693:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220453d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+66:12436:x1874676433386240:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 13313us (13550us total) trans 4294967504 rc 0/0 00000100:00100000:3.0:1787831013.488701:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 228 00000100:00100000:2.0:1787831013.493750:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831013.494124:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433386624 00000100:00100000:1.0:1787831013.494133:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433386624 00000100:00100000:1.0:1787831013.494249:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 18 00000100:00100000:1.0:1787831013.494261:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a7ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+66:12436:x1874676433386624:12345-192.168.203.31@tcp:103:lfs.0 00010000:00010000:1.0:1787831013.494279:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787831013.494305:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3800/0x95459fb9d1d29796 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a9942407e expref: 66 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831013.494323:0:6475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d2309e00800) 00010000:00010000:1.0:1787831013.494328:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787831013.494384:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a7ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+65:12436:x1874676433386624:12345-192.168.203.31@tcp:103:lfs.0 Request processed in 126us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831013.494392:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 18 00000100:00100000:2.0:1787831013.496362:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831013.496502:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433386752 00000100:00100000:0.0:1787831013.496511:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433386752 00000100:00100000:0.0:1787831013.496562:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 229 00000100:00100000:0.0:1787831013.496571:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220390b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+65:12436:x1874676433386752:12345-192.168.203.31@tcp:58:lfs.0 00010000:00010000:0.0:1787831013.496801:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3200/0x95459fb9d1d29853 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831013.496817:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3200/0x95459fb9d1d29853 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831013.496828:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3200/0x95459fb9d1d29853 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787831013.497133:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:0.0:1787831013.497303:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220390b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+65:12436:x1874676433386752:12345-192.168.203.31@tcp:58:lfs.0 Request processed in 733us (947us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831013.497312:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 229 00000100:00100000:2.0:1787831013.499578:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831013.499671:0:13771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433386880 00000100:00100000:0.0:1787831013.499680:0:13771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433386880 00000100:00100000:0.0:1787831013.499773:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 230 00000100:00100000:0.0:1787831013.499782:0:13771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47d7f0ed-283f-4b70-a741-6e74c5e52619+65:12436:x1874676433386880:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:0.0:1787831013.499798:0:13771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787831013.499816:0:13771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2e00/0x95459fb9d1d2985a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a994240b6 expref: -99 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831013.499866:0:13771:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3200/0x95459fb9d1d29853 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831013.499877:0:13771:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2e00/0x95459fb9d1d2985a lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994240b6 expref: 66 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831013.499895:0:13771:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3200/0x95459fb9d1d29853 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831013.499907:0:13771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2e00/0x95459fb9d1d2985a lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994240b6 expref: 66 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831013.499919:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d2309e00800) 00010000:00010000:0.0:1787831013.499922:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787831013.499926:0:13771:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2e00/0x95459fb9d1d2985a lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994240b6 expref: 66 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831013.499948:0:13771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2303aa2e00, rc 0) 00000100:00100000:0.0:1787831013.499999:0:13771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47d7f0ed-283f-4b70-a741-6e74c5e52619+66:12436:x1874676433386880:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 219us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831013.500006:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 230 00000040:00080000:0.0:1787831014.119003:0:13758:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787831014.119013:0:13758:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787831014.119038:0:13758:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 5 00000040:00080000:0.0:1787831014.119046:0:13758:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787831014.119183:0:13758:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204644000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13758:1874676443901440:192.168.203.31@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787831014.119301:0:13758:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2203b6b180 going to sleep for 11 seconds 00000100:00100000:2.0:1787831014.130929:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831014.131143:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433387008 00000100:00100000:3.0:1787831014.131155:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433387008 00000100:00100000:2.0:1787831014.131352:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 231 00000100:00100000:2.0:1787831014.131366:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22045b5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+67:12437:x1874676433387008:12345-192.168.203.31@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787831014.131417:0:8620:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787831014.131586:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22045b5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+67:12437:x1874676433387008:12345-192.168.203.31@tcp:53:lhsmtool_posix.0 Request processed in 224us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831014.131596:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 231 00000100:00100000:0.0:1787831014.134044:0:13758:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204644000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13758:1874676443901440:192.168.203.31@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787831014.139269:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831014.139551:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433387136 00000100:00100000:0.0:1787831014.139564:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433387136 00000100:00100000:0.0:1787831014.139730:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 232 00000100:00100000:0.0:1787831014.139743:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22045b4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+66:12437:x1874676433387136:12345-192.168.203.31@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787831014.139861:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2000/0x95459fb9d1d29861 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831014.139883:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2000/0x95459fb9d1d29861 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831014.139898:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2000/0x95459fb9d1d29861 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831014.139915:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2400/0x95459fb9d1d29868 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831014.139944:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2400/0x95459fb9d1d29868 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831014.139951:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2400/0x95459fb9d1d29868 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831014.139981:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3800/0x95459fb9d1d2986f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831014.139992:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3800/0x95459fb9d1d2986f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831014.139999:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3800/0x95459fb9d1d2986f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787831014.140088:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1787831014.140094:0:6492:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787831014.140110:0:6492:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3800/0x95459fb9d1d2986f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831014.140122:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2000/0x95459fb9d1d29861 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831014.140129:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2000/0x95459fb9d1d29861 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831014.140136:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2000/0x95459fb9d1d29861 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831014.140142:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2303aa2000 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:0.0:1787831014.140146:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2000/0x95459fb9d1d29861 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831014.140162:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2000/0x95459fb9d1d29861 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831014.140177:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d2318594400) 00010000:00010000:0.0:1787831014.140180:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787831014.140187:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2000/0x95459fb9d1d29861 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831014.140194:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2000/0x95459fb9d1d29861 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831014.140210:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2400/0x95459fb9d1d29868 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831014.140217:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2400/0x95459fb9d1d29868 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831014.140234:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2400/0x95459fb9d1d29868 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831014.140239:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2303aa2400 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:0.0:1787831014.140242:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2400/0x95459fb9d1d29868 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831014.140248:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2400/0x95459fb9d1d29868 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831014.140256:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff8d2309e00d00) 00010000:00010000:0.0:1787831014.140259:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787831014.140262:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2400/0x95459fb9d1d29868 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831014.140278:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2400/0x95459fb9d1d29868 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831014.140295:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3800/0x95459fb9d1d2986f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831014.140301:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3800/0x95459fb9d1d2986f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831014.140307:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3800/0x95459fb9d1d2986f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831014.140312:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2303aa3800 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:0.0:1787831014.140315:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3800/0x95459fb9d1d2986f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831014.140322:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3800/0x95459fb9d1d2986f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831014.140330:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d2309e00800) 00010000:00010000:0.0:1787831014.140333:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787831014.140335:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3800/0x95459fb9d1d2986f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831014.140339:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3800/0x95459fb9d1d2986f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831014.140445:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22045b4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+66:12437:x1874676433387136:12345-192.168.203.31@tcp:34:lhsmtool_posix.0 Request processed in 704us (1190us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831014.140454:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 232 00000100:00100000:1.0:1787831014.145597:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831014.146050:0:13771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433387392 00000100:00100000:0.0:1787831014.146062:0:13771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433387392 00000100:00100000:0.0:1787831014.146182:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 233 00000100:00100000:0.0:1787831014.146195:0:13771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204521a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47d7f0ed-283f-4b70-a741-6e74c5e52619+66:12437:x1874676433387392:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787831014.146238:0:13771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787831014.146264:0:13771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2800/0x95459fb9d1d29876 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a994240bd expref: -99 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831014.146407:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3600/0x95459fb9d1d2987d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831014.146425:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3600/0x95459fb9d1d2987d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831014.146438:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3600/0x95459fb9d1d2987d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787831014.146451:0:13771:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:0.0:1787831014.146565:0:13771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3600/0x95459fb9d1d2987d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831014.146573:0:13771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3600/0x95459fb9d1d2987d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831014.146580:0:13771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3600/0x95459fb9d1d2987d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831014.146587:0:13771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2303aa3600 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:0.0:1787831014.146592:0:13771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3600/0x95459fb9d1d2987d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831014.146600:0:13771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3600/0x95459fb9d1d2987d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831014.146659:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d2309e00800) 00010000:00010000:0.0:1787831014.146663:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787831014.146678:0:13771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3600/0x95459fb9d1d2987d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831014.146685:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3600/0x95459fb9d1d2987d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831014.146739:0:13771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2800/0x95459fb9d1d29876 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994240bd expref: 68 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831014.146769:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d2318594400) 00010000:00010000:0.0:1787831014.146772:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787831014.146776:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2800/0x95459fb9d1d29876 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994240bd expref: 68 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831014.146789:0:13771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2303aa2800, rc 0) 00000100:00100000:0.0:1787831014.149494:0:13771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204521a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47d7f0ed-283f-4b70-a741-6e74c5e52619+67:12437:x1874676433387392:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 3287us (4001us total) trans 4294967505 rc 301/301 00000100:00100000:0.0:1787831014.153237:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 233 00000100:00100000:3.0:1787831014.154145:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831014.154347:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433387520 00000100:00100000:2.0:1787831014.154359:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433387520 00000100:00100000:2.0:1787831014.154432:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 234 00000100:00100000:2.0:1787831014.154444:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220384e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+67:12437:x1874676433387520:12345-192.168.203.31@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787831014.154507:0:6491:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787831014.155846:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220384e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+67:12437:x1874676433387520:12345-192.168.203.31@tcp:53:lhsmtool_posix.0 Request processed in 1386us (1837us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831014.155861:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 234 00000100:00100000:2.0:1787831014.160764:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831014.161331:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433387776 00000100:00100000:0.0:1787831014.161345:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433387776 00000100:00100000:0.0:1787831014.161428:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 235 00000100:00100000:0.0:1787831014.161441:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22045b6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+67:12437:x1874676433387776:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787831014.161469:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787831014.161473:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787831014.161505:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2600/0x95459fb9d1d2981b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994240a1 expref: 67 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831014.162173:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d233a6f8e00) 00010000:00010000:0.0:1787831014.162179:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787831014.162323:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1800/0x95459fb9d1d2988b lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a994240c4 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787831014.162986:0:6492:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x6:0x0], index 1: 0 00010000:00010000:2.0:1787831014.163178:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0800/0x95459fb9d1d29892 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831014.163196:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0800/0x95459fb9d1d29892 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831014.163209:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0800/0x95459fb9d1d29892 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831014.163269:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1800/0x95459fb9d1d2988b lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994240c4 expref: 69 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831014.163285:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0800/0x95459fb9d1d29892 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994240c4 expref: 68 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831014.163293:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8d2203615000) 00010000:00010000:2.0:1787831014.163297:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787831014.163299:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22039c0800, rc 0) 00000100:00100000:2.0:1787831014.163390:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22045b6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+68:12437:x1874676433387776:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 1951us (2648us total) trans 4294967506 rc 0/0 00000100:00100000:2.0:1787831014.163399:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 235 00000100:00100000:1.0:1787831014.167723:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831014.167922:0:13771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433388032 00000100:00100000:0.0:1787831014.167937:0:13771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433388032 00000100:00100000:0.0:1787831014.168015:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 236 00000100:00100000:0.0:1787831014.168027:0:13771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22037dbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47d7f0ed-283f-4b70-a741-6e74c5e52619+68:12437:x1874676433388032:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787831014.168781:0:13771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787831014.168823:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0800/0x95459fb9d1d29892 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994240c4 expref: 68 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831014.169737:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8d2203615000) 00010000:00010000:0.0:1787831014.169764:0:13771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787831014.170290:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6200/0x95459fb9d1d298a0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831014.170312:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6200/0x95459fb9d1d298a0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831014.170325:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6200/0x95459fb9d1d298a0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831014.170344:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7600/0x95459fb9d1d298a7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x666f6f5b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831014.170352:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7600/0x95459fb9d1d298a7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x666f6f5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831014.170370:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7600/0x95459fb9d1d298a7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x666f6f5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831014.170434:0:13771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6200/0x95459fb9d1d298a0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831014.170442:0:13771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6200/0x95459fb9d1d298a0 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831014.170449:0:13771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6200/0x95459fb9d1d298a0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831014.170456:0:13771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d23344b6200 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:1.0:1787831014.170461:0:13771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6200/0x95459fb9d1d298a0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831014.170500:0:13771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6200/0x95459fb9d1d298a0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831014.170512:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d233a6f8e00) 00010000:00010000:1.0:1787831014.170516:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787831014.170520:0:13771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6200/0x95459fb9d1d298a0 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831014.170527:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6200/0x95459fb9d1d298a0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831014.170541:0:13771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7600/0x95459fb9d1d298a7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x666f6f5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831014.170547:0:13771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7600/0x95459fb9d1d298a7 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x666f6f5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831014.170554:0:13771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7600/0x95459fb9d1d298a7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x666f6f5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831014.170559:0:13771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d23344b7600 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:1.0:1787831014.170562:0:13771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7600/0x95459fb9d1d298a7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x666f6f5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831014.170568:0:13771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7600/0x95459fb9d1d298a7 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x666f6f5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831014.170576:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x666f6f5b (ffff8d232b9c6600) 00010000:00010000:1.0:1787831014.170578:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787831014.170581:0:13771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7600/0x95459fb9d1d298a7 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x666f6f5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831014.170600:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7600/0x95459fb9d1d298a7 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x666f6f5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831014.170783:0:13771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22037dbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47d7f0ed-283f-4b70-a741-6e74c5e52619+67:12437:x1874676433388032:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 Request processed in 2753us (3073us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787831014.170794:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 236 00000100:00100000:3.0:1787831014.176820:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831014.177191:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433388160 00000100:00100000:2.0:1787831014.177203:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433388160 00000100:00100000:2.0:1787831014.177299:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 237 00000100:00100000:2.0:1787831014.177312:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220384f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+67:12437:x1874676433388160:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787831014.177377:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787831014.177410:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1800/0x95459fb9d1d298ae lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a994240cb expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831014.177458:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0200/0x95459fb9d1d298b5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831014.177476:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0200/0x95459fb9d1d298b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831014.177488:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0200/0x95459fb9d1d298b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831014.177691:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1800/0x95459fb9d1d298ae lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994240cb expref: 69 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831014.177714:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0200/0x95459fb9d1d298b5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994240cb expref: 68 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831014.177724:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8d2203615a00) 00010000:00010000:2.0:1787831014.177727:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787831014.177731:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22039c0200, rc 0) 00000100:00100000:2.0:1787831014.177820:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220384f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+68:12437:x1874676433388160:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 511us (1015us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831014.177829:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 237 00000100:00100000:2.0:1787831014.181796:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831014.182096:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433388416 00000100:00100000:3.0:1787831014.182109:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433388416 00000100:00100000:3.0:1787831014.182210:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 238 00000100:00100000:3.0:1787831014.182222:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22045b4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+68:12437:x1874676433388416:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787831014.182797:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d298bc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831014.182820:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d298bc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831014.182836:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d298bc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787831014.183050:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:3.0:1787831014.183063:0:6492:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 305183437502ns, next at 306183434049ns, rc = 0 00000004:00010000:3.0:1787831014.183136:0:6492:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000eec9f4bf reply state 00000000462a97e4 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d298bc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831014.183152:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d298bc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831014.183161:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8d2203615a00) 00010000:00010000:3.0:1787831014.183164:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1787831014.183168:0:6492:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787831014.184006:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22045b4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+70:12437:x1874676433388416:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 Request processed in 1779us (2215us total) trans 4294967507 rc 0/0 00000100:00100000:3.0:1787831014.184018:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 238 00000100:00100000:1.0:1787831014.196894:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831014.197010:0:13771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433388544 00000100:00100000:3.0:1787831014.197022:0:13771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433388544 00000100:00100000:3.0:1787831014.197097:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 239 00000100:00100000:3.0:1787831014.197109:0:13771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22037d9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47d7f0ed-283f-4b70-a741-6e74c5e52619+70:12437:x1874676433388544:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787831014.197162:0:13771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787831014.197191:0:13771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d298c3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a994240d2 expref: -99 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831014.197282:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d298c3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994240d2 expref: 71 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831014.197298:0:13771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d298c3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994240d2 expref: 71 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831014.197320:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8d2203615a00) 00010000:00010000:3.0:1787831014.197324:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787831014.197328:0:13771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2307c76600, rc 0) 00000100:00100000:3.0:1787831014.197420:0:13771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22037d9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47d7f0ed-283f-4b70-a741-6e74c5e52619+71:12437:x1874676433388544:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 313us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831014.197428:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 239 00000100:00100000:1.0:1787831014.201321:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831014.201539:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433388672 00000100:00100000:3.0:1787831014.201552:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433388672 00000100:00100000:3.0:1787831014.201670:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 71 00000100:00100000:3.0:1787831014.201685:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22037db840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+9:2396:x1874676433388672:12345-192.168.203.31@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1787831014.202002:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22037db840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+10:2396:x1874676433388672:12345-192.168.203.31@tcp:2:lhsmtool_posix.0 Request processed in 320us (692us total) trans 4294967320 rc 0/0 00000100:00100000:3.0:1787831014.202011:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 71 00000100:00100000:0.0:1787831014.207175:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831014.208006:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433388928 00000100:00100000:3.0:1787831014.208021:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433388928 00000100:00100000:3.0:1787831014.208116:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 60 00000100:00100000:3.0:1787831014.208129:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204644000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+71:12437:x1874676433388928:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787831014.208475:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204644000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+72:12437:x1874676433388928:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 Request processed in 348us (1318us total) trans 4294967508 rc 0/0 00000100:00100000:3.0:1787831014.208484:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 60 00000100:00100000:1.0:1787831014.210993:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831014.211102:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433389184 00000100:00100000:0.0:1787831014.211114:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433389184 00000100:00100000:0.0:1787831014.211223:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 240 00000100:00100000:0.0:1787831014.211235:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203637c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+72:12437:x1874676433389184:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787831014.211395:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203637c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+72:12437:x1874676433389184:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 Request processed in 161us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831014.211415:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 240 00000100:00100000:3.0:1787831014.213480:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831014.214088:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433389312 00000100:00100000:1.0:1787831014.214101:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433389312 00000100:00100000:1.0:1787831014.214177:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 241 00000100:00100000:1.0:1787831014.214189:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220384e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+72:12437:x1874676433389312:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787831014.214312:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787831014.214344:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7800/0x95459fb9d1d298ca lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a994240d9 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831014.214482:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7e00/0x95459fb9d1d298d1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831014.214500:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7e00/0x95459fb9d1d298d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831014.214514:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7e00/0x95459fb9d1d298d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787831014.214575:0:6490:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787831014.214600:0:6490:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7e00/0x95459fb9d1d298d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831014.214674:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7800/0x95459fb9d1d298ca lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994240d9 expref: 74 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831014.214696:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7e00/0x95459fb9d1d298d1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994240d9 expref: 73 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831014.214706:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8d2203615a00) 00010000:00010000:1.0:1787831014.214709:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787831014.214714:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d23344b7e00, rc 0) 00000100:00100000:1.0:1787831014.215093:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220384e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+73:12437:x1874676433389312:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 905us (1625us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831014.215102:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 241 00000100:00100000:2.0:1787831014.220086:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831014.220194:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433389440 00000100:00100000:0.0:1787831014.220215:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433389440 00000100:00100000:0.0:1787831014.220286:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 72 00000100:00100000:0.0:1787831014.220298:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22045b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+10:2397:x1874676433389440:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787831014.220540:0:8408:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787831014.220568:0:8408:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d0d0439d/0x95459fb9d1d298d8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a994240e0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787831014.220603:0:8408:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9022e6, blocks: 0x0 00010000:00010000:0.0:1787831014.220723:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=305s v=(0 0) 00010000:00010000:0.0:1787831014.220729:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787831014.220741:0:8408:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d0d0439d/0x95459fb9d1d298d8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994240e0 expref: 11 pid: 8408 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831014.220839:0:8408:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d0d0439d/0x95459fb9d1d298d8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994240e0 expref: 11 pid: 8408 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831014.220857:0:8408:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2303aa2800, rc 0) 00000100:00100000:2.0:1787831014.221614:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22045b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+11:2397:x1874676433389440:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 1312us (1536us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831014.221664:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 72 00000100:00100000:2.0:1787831014.223827:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831014.223919:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433389696 00000100:00100000:3.0:1787831014.223932:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433389696 00000100:00100000:3.0:1787831014.224008:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 242 00000100:00100000:3.0:1787831014.224019:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22045b43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+73:12437:x1874676433389696:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787831014.224156:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22045b43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+73:12437:x1874676433389696:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 Request processed in 137us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831014.224165:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 242 00000100:00100000:3.0:1787831014.226599:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831014.226779:0:8631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433389824 00000100:00100000:2.0:1787831014.226791:0:8631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433389824 00000100:00100000:2.0:1787831014.226968:0:8631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 73 00000100:00100000:2.0:1787831014.226981:0:8631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220384e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+11:12437:x1874676433389824:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787831014.227006:0:8631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787831014.227033:0:8631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007304afea/0x95459fb9d1d298df lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a994240e7 expref: -99 pid: 8631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831014.227075:0:8631:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d0d0439d/0x95459fb9d1d298d8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994240e0 expref: 12 pid: 8408 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831014.227086:0:8631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787831014.227091:0:8631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787831014.227098:0:8631:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007304afea/0x95459fb9d1d298df lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994240e7 expref: 12 pid: 8631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831014.227147:0:8631:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d0d0439d/0x95459fb9d1d298d8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.31@tcp remote: 0xe558a92a994240e0 expref: 12 pid: 8408 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831014.227164:0:8631:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d0d0439d/0x95459fb9d1d298d8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a994240e0 expref: 12 pid: 8408 timeout: 405 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831014.227181:0:8631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22045b7840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8631:1874676443901568:192.168.203.31@tcp:104: 00000100:00100000:2.0:1787831014.227568:0:8631:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d220289c840 going to sleep for 11 seconds 00000100:00100000:0.0:1787831014.231356:0:8631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22045b7840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8631:1874676443901568:192.168.203.31@tcp:104: 00010000:00010000:0.0:1787831014.231410:0:8631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007304afea/0x95459fb9d1d298df lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xe558a92a994240e7 expref: 12 pid: 8631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831014.231436:0:8631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22039c1200, rc 0) 00000100:00100000:0.0:1787831014.231513:0:8631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220384e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+12:12437:x1874676433389824:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 4535us (4927us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831014.231746:0:8631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 73 00000100:00100000:1.0:1787831014.232892:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831014.233132:0:7432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433389952 00000100:00100000:0.0:1787831014.233141:0:7432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433389952 00010000:00010000:0.0:1787831014.233187:0:7432:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d0d0439d/0x95459fb9d1d298d8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a994240e0 expref: 12 pid: 8408 timeout: 405 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831014.233248:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 102 00000100:00100000:0.0:1787831014.233256:0:7432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203636940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+12:2397:x1874676433389952:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787831014.233275:0:7432:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787831014.233302:0:7432:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d0d0439d/0x95459fb9d1d298d8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a994240e0 expref: 12 pid: 8408 timeout: 405 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831014.233317:0:7432:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d0d0439d/0x95459fb9d1d298d8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a994240e0 expref: 12 pid: 8408 timeout: 405 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831014.233353:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d0d0439d/0x95459fb9d1d298d8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a994240e0 expref: 12 pid: 8408 timeout: 405 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831014.233372:0:7432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787831014.233378:0:7432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787831014.233387:0:7432:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007304afea/0x95459fb9d1d298df lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0xe558a92a994240e7 expref: 11 pid: 8631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831014.233410:0:7432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007304afea/0x95459fb9d1d298df lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0xe558a92a994240e7 expref: 11 pid: 8631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831014.233450:0:7432:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000007304afea/0x95459fb9d1d298df lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xe558a92a994240e7 expref: 11 pid: 8631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831014.233465:0:7432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204645e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7432:1874676443901696:192.168.203.31@tcp:105: 00000100:00100000:0.0:1787831014.233558:0:7432:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2203b6b180 going to sleep for 11 seconds 00000100:00100000:0.0:1787831014.236271:0:7432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204645e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7432:1874676443901696:192.168.203.31@tcp:105: 00010000:00010000:0.0:1787831014.236307:0:7432:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787831014.236426:0:7432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203636940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+11:2397:x1874676433389952:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 3168us (3539us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831014.236439:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 102 00000100:00100000:2.0:1787831014.237619:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831014.238110:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433390080 00000100:00100000:0.0:1787831014.238121:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433390080 00002000:00100000:0.0:1787831014.238186:0:8413:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x6:0x0] (0->12) req@ffff8d22045b6580 x1874676433390080/t0(0) o4->47d7f0ed-283f-4b70-a741-6e74c5e52619@192.168.203.31@tcp:85/0 lens 504/0 e 0 to 0 dl 1787831025 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787831014.238199:0:8413:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d22045b6580 with x1874676433390080 ext(0->12) 00002000:00010000:0.0:1787831014.238206:0:8413:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d22045b6580 00000100:00100000:0.0:1787831014.238377:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 7 00000100:00100000:0.0:1787831014.238389:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22045b6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+11:2397:x1874676433390080:12345-192.168.203.31@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1787831014.240786:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22045b6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+13:2397:x1874676433390080:12345-192.168.203.31@tcp:4:lhsmtool_posix.0 Request processed in 2385us (3171us total) trans 4294967321 rc 0/0 00000100:00100000:0.0:1787831014.240803:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 7 00002000:00100000:0.0:1787831014.240888:0:8413:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x6:0x0] (0->12) req@ffff8d22045b6580 x1874676433390080/t4294967321(0) o4->47d7f0ed-283f-4b70-a741-6e74c5e52619@192.168.203.31@tcp:85/0 lens 504/448 e 0 to 0 dl 1787831025 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787831014.240901:0:8413:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d22045b6580 with x1874676433390080 ext(0->12) 00002000:00010000:0.0:1787831014.240908:0:8413:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d22045b6580 00000100:00100000:1.0:1787831014.246914:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831014.247015:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433390208 00000100:00100000:3.0:1787831014.247027:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433390208 00000100:00100000:3.0:1787831014.247088:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 243 00000100:00100000:3.0:1787831014.247097:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203634000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+73:12437:x1874676433390208:12345-192.168.203.31@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1787831014.251034:0:6469:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967508 is committed 00000004:00080000:3.0:1787831014.251059:0:6469:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000004:00080000:3.0:1787831014.251115:0:6469:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:3.0:1787831014.251152:0:6469:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d220289c000 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:3.0:1787831014.251159:0:6469:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d22027f2900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d220289c6c0 00000020:00080000:3.0:1787831014.251163:0:6469:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d22027f2800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d2307d66a00 00000020:00080000:3.0:1787831014.251225:0:6469:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d220289cb40 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:3.0:1787831014.251229:0:6469:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d22027f2700 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d220289c900 00000020:00080000:3.0:1787831014.251248:0:6469:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d22027f2f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d2203958800 00000020:00080000:3.0:1787831014.251263:0:6469:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:3.0:1787831014.251292:0:6522:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:3.0:1787831014.251395:0:6522:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1787831014.251580:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203634000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+27:12437:x1874676433390208:12345-192.168.203.31@tcp:44:lhsmtool_posix.0 Request processed in 4475us (4685us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831014.251593:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 243 00000100:00100000:1.0:1787831014.251702:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203764b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443901824:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1787831014.251812:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831014.251847:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443901824 00000100:00100000:3.0:1787831014.251856:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443901824 00000100:00100000:1.0:1787831014.251856:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787831014.251864:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203765e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443901952:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1787831014.251890:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831014.252500:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22045b6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443902080:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787831014.252880:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787831014.253128:0:3606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d295e4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831014.253152:0:3606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d295e4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831014.253175:0:3606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d295e4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831014.253182:0:3606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2307c77600 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:0.0:1787831014.253188:0:3606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d295e4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831014.253205:0:3606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d295e4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831014.253225:0:3606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8d2303e42100) 00010000:00010000:0.0:1787831014.253229:0:3606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787831014.253235:0:3606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d295e4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831014.253242:0:3606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d295e4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831014.253289:0:3606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d2968c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831014.253296:0:3606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d2968c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831014.253302:0:3606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d2968c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831014.253308:0:3606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2307c76400 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:0.0:1787831014.253311:0:3606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d2968c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831014.253505:0:3606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d2968c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831014.253515:0:3606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d233a6f8700) 00010000:00010000:0.0:1787831014.253518:0:3606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787831014.253522:0:3606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d2968c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831014.253528:0:3606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d2968c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831014.253547:0:3606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3c00/0x95459fb9d1d2970a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831014.253553:0:3606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3c00/0x95459fb9d1d2970a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831014.253560:0:3606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3c00/0x95459fb9d1d2970a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831014.253565:0:3606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2303aa3c00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:0.0:1787831014.253569:0:3606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3c00/0x95459fb9d1d2970a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831014.253575:0:3606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3c00/0x95459fb9d1d2970a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831014.253585:0:3606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8d2309e00a00) 00010000:00010000:0.0:1787831014.253587:0:3606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787831014.253590:0:3606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3c00/0x95459fb9d1d2970a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831014.253603:0:3606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3c00/0x95459fb9d1d2970a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831014.253617:0:3606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2200/0x95459fb9d1d2972d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831014.253653:0:3606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2200/0x95459fb9d1d2972d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831014.253661:0:3606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2200/0x95459fb9d1d2972d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831014.253667:0:3606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2303aa2200 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:0.0:1787831014.253670:0:3606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2200/0x95459fb9d1d2972d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831014.253677:0:3606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2200/0x95459fb9d1d2972d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831014.253685:0:3606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8d2309e00a00) 00010000:00010000:0.0:1787831014.253688:0:3606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787831014.253691:0:3606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2200/0x95459fb9d1d2972d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831014.253696:0:3606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2200/0x95459fb9d1d2972d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831014.253712:0:3606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6600/0x95459fb9d1d297ff lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831014.253720:0:3606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6600/0x95459fb9d1d297ff lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831014.253731:0:3606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6600/0x95459fb9d1d297ff lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831014.253737:0:3606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d23344b6600 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:0.0:1787831014.253740:0:3606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6600/0x95459fb9d1d297ff lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831014.253746:0:3606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6600/0x95459fb9d1d297ff lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831014.253766:0:3606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d2309e00800) 00010000:00010000:0.0:1787831014.253769:0:3606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787831014.253772:0:3606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6600/0x95459fb9d1d297ff lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831014.253778:0:3606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6600/0x95459fb9d1d297ff lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831014.253791:0:3606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d298bc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831014.253798:0:3606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d298bc lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831014.253803:0:3606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d298bc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831014.253808:0:3606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2307c77a00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:0.0:1787831014.253811:0:3606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d298bc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831014.253827:0:3606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d298bc lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831014.253837:0:3606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8d2203615a00) 00010000:00010000:0.0:1787831014.253839:0:3606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787831014.253842:0:3606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d298bc lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831014.253848:0:3606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d298bc lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787831014.253889:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787831014.254645:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443901952 00000100:00100000:1.0:1787831014.254658:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443901952 00000100:00100000:1.0:1787831014.254707:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443902080 00000100:00100000:1.0:1787831014.254710:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443902080 00000100:00100000:1.0:1787831014.254728:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787831014.254737:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22044030c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3621:x1874676443901824:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1787831014.254786:0:8408:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00010000:00010000:1.0:1787831014.254828:0:8408:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089be6766/0x95459fb9d1d298e6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831014.254854:0:8408:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004501f9c4/0x95459fb9d1d2969a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.31@tcp remote: 0xe558a92a9942403f expref: 12 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831014.254864:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1787831014.254869:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787831014.254875:0:8408:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000089be6766/0x95459fb9d1d298e6 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831014.254916:0:8408:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004501f9c4/0x95459fb9d1d2969a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.31@tcp remote: 0xe558a92a9942403f expref: 12 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831014.254934:0:8408:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004501f9c4/0x95459fb9d1d2969a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.31@tcp remote: 0xe558a92a9942403f expref: 12 pid: 8407 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831014.254950:0:8408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204403c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8408:1874676443902208:192.168.203.31@tcp:104: 00000100:00100000:3.0:1787831014.255014:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787831014.255028:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22044021c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3621:x1874676443901952:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1787831014.255054:0:8408:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d22028520c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787831014.255504:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00002000:00010000:3.0:1787831014.255652:0:8406:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1787831014.255657:0:8406:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1787831014 00002000:00010000:3.0:1787831014.255660:0:8406:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787831014.255663:0:8406:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb ctime from disk: 1787831014 -> 1787831014 00002000:00010000:3.0:1787831014.255666:0:8406:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1787831014.255736:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22044021c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3621:x1874676443901952:12345-0@lo:2:osp-syn-1-0.0 Request processed in 712us (3843us total) trans 4294967322 rc 0/0 00000100:00100000:3.0:1787831014.255746:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787831014.255784:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433390336 00000100:00100000:3.0:1787831014.255789:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433390336 00000004:00080000:1.0:1787831014.255893:0:3621:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d2203765e00/2, rc 0, transno 4294967322 00000100:00100000:1.0:1787831014.255903:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203765e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443901952:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1787831014.256022:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787831014.256033:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22045b5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3619:x1874676443902080:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787831014.256059:0:8407:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00002000:00010000:1.0:1787831014.256088:0:8407:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a9022e5, atime: 0x0, ctime: 0x6a9022e5, blocks: 0x8 00010000:00010000:1.0:1787831014.256105:0:8407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d29575cf/0x95459fb9d1d298ed lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831014.256118:0:8407:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=305s v=(0 0) 00010000:00010000:1.0:1787831014.256122:0:8407:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787831014.256130:0:8407:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d29575cf/0x95459fb9d1d298ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831014.256148:0:8407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d29575cf/0x95459fb9d1d298ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831014.256159:0:8407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d29575cf/0x95459fb9d1d298ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831014.256167:0:8407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d29575cf/0x95459fb9d1d298ed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831014.256187:0:8407:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787831014.256499:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22045b5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3619:x1874676443902080:12345-0@lo:6:osp-syn-0-0.0 Request processed in 468us (3618us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1787831014.256507:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787831014.256523:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 77 00000100:00100000:1.0:1787831014.256530:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204400000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+13:2396:x1874676433390336:12345-192.168.203.31@tcp:16:lhsmtool_posix.0 00010000:00010000:1.0:1787831014.256581:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787831014.256589:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d29575cf/0x95459fb9d1d298ed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831014.256609:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d23344b7600 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:1.0:1787831014.256614:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d29575cf/0x95459fb9d1d298ed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831014.256644:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d29575cf/0x95459fb9d1d298ed lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831014.256663:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d29575cf/0x95459fb9d1d298ed lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831014.256670:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d29575cf/0x95459fb9d1d298ed lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831014.256690:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787831014.256691:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787831014.256693:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1787831014.258780:0:3619:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d22045b6d00/2, rc 0, transno 4294967311 00000100:00100000:0.0:1787831014.259255:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22045b6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443902080:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787831014.260034:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831014.260147:0:8408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204403c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8408:1874676443902208:192.168.203.31@tcp:104: 00010000:00010000:2.0:1787831014.260183:0:8408:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000089be6766/0x95459fb9d1d298e6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831014.260570:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433390464 00000100:00100000:0.0:1787831014.260580:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433390464 00010000:00010000:0.0:1787831014.260653:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004501f9c4/0x95459fb9d1d2969a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.31@tcp remote: 0xe558a92a9942403f expref: 14 pid: 8407 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831014.260699:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 103 00000100:00100000:0.0:1787831014.260707:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220384da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+14:2396:x1874676433390464:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787831014.260724:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787831014.260729:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004501f9c4/0x95459fb9d1d2969a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.31@tcp remote: 0xe558a92a9942403f expref: 14 pid: 8407 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831014.260741:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004501f9c4/0x95459fb9d1d2969a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.31@tcp remote: 0xe558a92a9942403f expref: 14 pid: 8407 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831014.260809:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004501f9c4/0x95459fb9d1d2969a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.31@tcp remote: 0xe558a92a9942403f expref: 14 pid: 8407 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831014.260842:0:6476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787831014.260848:0:6476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787831014.260854:0:6476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000089be6766/0x95459fb9d1d298e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831014.260866:0:6476:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000089be6766/0x95459fb9d1d298e6 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831014.260901:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787831014.260931:0:8408:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000089be6766/0x95459fb9d1d298e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831014.260944:0:8408:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000089be6766/0x95459fb9d1d298e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831014.260957:0:8408:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089be6766/0x95459fb9d1d298e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831014.260967:0:8408:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000089be6766/0x95459fb9d1d298e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831014.260988:0:8408:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787831014.260989:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220384da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+13:2396:x1874676433390464:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 271us (947us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831014.261001:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 103 00010000:00010000:3.0:1787831014.261651:0:7431:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787831014.261662:0:7431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000089be6766/0x95459fb9d1d298e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831014.261674:0:7431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d23344b7a00 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:3.0:1787831014.261690:0:7431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000089be6766/0x95459fb9d1d298e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831014.261702:0:7431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000089be6766/0x95459fb9d1d298e6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831014.261720:0:7431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000089be6766/0x95459fb9d1d298e6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831014.261728:0:7431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000089be6766/0x95459fb9d1d298e6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831014.261759:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787831014.261761:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787831014.261763:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787831014.264545:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22044030c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3621:x1874676443901824:12345-0@lo:6:osp-syn-1-0.0 Request processed in 9798us (12724us total) trans 4294967323 rc 0/0 00000100:00100000:2.0:1787831014.264561:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000004:00080000:1.0:1787831014.264837:0:3621:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d2203764b40/2, rc 0, transno 4294967323 00000100:00100000:1.0:1787831014.264853:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203764b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443901824:0@lo:6:osp-syn-1-0.0 00000001:00080000:3.0:1787831014.267920:0:9484:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000001:00080000:3.0:1787831014.267935:0:9484:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000100:00100000:1.0:1787831014.268482:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204400000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+7:2396:x1874676433390336:12345-192.168.203.31@tcp:16:lhsmtool_posix.0 Request processed in 11661us (12689us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831014.268498:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 77 00000100:00100000:3.0:1787831014.271247:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831014.271390:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433390720 00000100:00100000:2.0:1787831014.271416:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433390720 00000100:00100000:2.0:1787831014.271567:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 244 00000100:00100000:2.0:1787831014.271579:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204555680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+21:12437:x1874676433390720:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787831014.271674:0:8620:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787831014.271708:0:8620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7e00/0x95459fb9d1d298d1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994240d9 expref: 21 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831014.271729:0:8620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8d2203615a00) 00010000:00010000:2.0:1787831014.271734:0:8620:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787831014.271785:0:8620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0e00/0x95459fb9d1d298f4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831014.271800:0:8620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0e00/0x95459fb9d1d298f4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831014.271811:0:8620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0e00/0x95459fb9d1d298f4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787831014.271989:0:8620:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f2071ba5 reply state 000000001d9aa395 transno 4294967509 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0e00/0x95459fb9d1d298f4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831014.272004:0:8620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0e00/0x95459fb9d1d298f4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831014.272012:0:8620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8d2203615a00) 00010000:00010000:2.0:1787831014.272015:0:8620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787831014.272017:0:8620:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787831014.272148:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204555680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+22:12437:x1874676433390720:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 Request processed in 571us (914us total) trans 4294967509 rc 0/0 00000100:00100000:2.0:1787831014.272155:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 244 00000100:00100000:3.0:1787831014.275320:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831014.275461:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433390848 00000100:00100000:2.0:1787831014.275511:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433390848 00000100:00100000:2.0:1787831014.275595:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 78 00000100:00100000:2.0:1787831014.275606:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220395ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+7:2396:x1874676433390848:12345-192.168.203.31@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787831014.275940:0:8406:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1787831014.275945:0:8406:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb mtime from disk: 1787831014 -> 1787831013 00002000:00010000:2.0:1787831014.275948:0:8406:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb atime from disk: 0 -> 1787831013 00002000:00010000:2.0:1787831014.275951:0:8406:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb ctime from disk: 1787831014 -> 1787831013 00002000:00010000:2.0:1787831014.275954:0:8406:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1787831014.276026:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220395ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+8:2396:x1874676433390848:12345-192.168.203.31@tcp:2:lhsmtool_posix.0 Request processed in 421us (720us total) trans 4294967324 rc 0/0 00000100:00100000:2.0:1787831014.276032:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 78 00000100:00100000:1.0:1787831014.281555:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831014.282021:0:13771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433391104 00000100:00100000:3.0:1787831014.282034:0:13771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433391104 00000100:00100000:3.0:1787831014.282112:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 245 00000100:00100000:3.0:1787831014.282125:0:13771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204401e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47d7f0ed-283f-4b70-a741-6e74c5e52619+22:12437:x1874676433391104:12345-192.168.203.31@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787831014.282233:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d298fb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831014.282256:0:13771:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0200/0x95459fb9d1d298b5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994240cb expref: 22 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831014.282292:0:13771:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d298fb lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831014.282339:0:13771:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0200/0x95459fb9d1d298b5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0xe558a92a994240cb expref: 22 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831014.282355:0:13771:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0200/0x95459fb9d1d298b5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a994240cb expref: 22 pid: 6491 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787831014.282372:0:13771:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22039a2940 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13771:1874676443902336:192.168.203.31@tcp:104: 00000100:00100000:3.0:1787831014.282481:0:13771:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d233be68540 going to sleep for 11 seconds 00000100:00100000:3.0:1787831014.286387:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831014.286696:0:13771:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22039a2940 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13771:1874676443902336:192.168.203.31@tcp:104: 00010000:00010000:1.0:1787831014.286735:0:13771:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d298fb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831014.286811:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433391232 00000100:00100000:2.0:1787831014.286819:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433391232 00010000:00010000:2.0:1787831014.286870:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0200/0x95459fb9d1d298b5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a994240cb expref: 23 pid: 6491 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831014.286917:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 104 00000100:00100000:2.0:1787831014.286928:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22038ec780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+23:2397:x1874676433391232:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787831014.286947:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787831014.286954:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0200/0x95459fb9d1d298b5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a994240cb expref: 23 pid: 6491 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831014.286968:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0200/0x95459fb9d1d298b5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a994240cb expref: 23 pid: 6491 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831014.286995:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0200/0x95459fb9d1d298b5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a994240cb expref: 23 pid: 6491 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831014.287025:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8d2203615a00) 00010000:00010000:2.0:1787831014.287031:0:6477:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d298fb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831014.287042:0:6477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d298fb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831014.287052:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d298fb lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831014.287080:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787831014.287140:0:13771:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d298fb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831014.287151:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d298fb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831014.287178:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22038ec780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+22:2397:x1874676433391232:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 251us (805us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831014.287188:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 104 00010000:00010000:1.0:1787831014.287206:0:13771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d298fb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831014.287216:0:13771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d298fb lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831014.287225:0:13771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d298fb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831014.287232:0:13771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2307c77a00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:1.0:1787831014.287237:0:13771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d298fb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831014.287246:0:13771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d298fb lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831014.287257:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8d2203615a00) 00010000:00010000:1.0:1787831014.287260:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787831014.287266:0:13771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d298fb lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831014.287273:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d298fb lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831014.287325:0:13771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204401e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47d7f0ed-283f-4b70-a741-6e74c5e52619+21:12437:x1874676433391104:12345-192.168.203.31@tcp:55:lhsmtool_posix.0 Request processed in 5203us (5785us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787831014.287341:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 245 00000100:00100000:2.0:1787831014.296579:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831014.296673:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433391360 00000100:00100000:1.0:1787831014.296686:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433391360 00000100:00100000:1.0:1787831014.296762:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 79 00000100:00100000:1.0:1787831014.296772:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22045b52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+8:2397:x1874676433391360:12345-192.168.203.31@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787831014.296834:0:8408:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000903060dd/0x95459fb9d1d29902 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831014.296858:0:8408:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007304afea/0x95459fb9d1d298df lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xe558a92a994240e7 expref: 8 pid: 8631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831014.296868:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787831014.296873:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787831014.296878:0:8408:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000903060dd/0x95459fb9d1d29902 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831014.296917:0:8408:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007304afea/0x95459fb9d1d298df lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.31@tcp remote: 0xe558a92a994240e7 expref: 8 pid: 8631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831014.296932:0:8408:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007304afea/0x95459fb9d1d298df lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.31@tcp remote: 0xe558a92a994240e7 expref: 8 pid: 8631 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831014.296949:0:8408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204401a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8408:1874676443902464:192.168.203.31@tcp:104: 00000100:00100000:1.0:1787831014.297050:0:8408:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2202852540 going to sleep for 11 seconds 00000100:00100000:0.0:1787831014.299925:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831014.300005:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433391488 00000100:00100000:2.0:1787831014.300018:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433391488 00010000:00010000:2.0:1787831014.300076:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007304afea/0x95459fb9d1d298df lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0xe558a92a994240e7 expref: 9 pid: 8631 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831014.300125:0:8408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204401a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8408:1874676443902464:192.168.203.31@tcp:104: 00000100:00100000:2.0:1787831014.300169:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 105 00010000:00010000:1.0:1787831014.300171:0:8408:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000903060dd/0x95459fb9d1d29902 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831014.300183:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204645e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+9:2396:x1874676433391488:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787831014.300206:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787831014.300232:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007304afea/0x95459fb9d1d298df lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0xe558a92a994240e7 expref: 9 pid: 8631 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831014.300246:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007304afea/0x95459fb9d1d298df lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.31@tcp remote: 0xe558a92a994240e7 expref: 9 pid: 8631 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831014.300288:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007304afea/0x95459fb9d1d298df lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.31@tcp remote: 0xe558a92a994240e7 expref: 9 pid: 8631 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831014.300309:0:6475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787831014.300314:0:6475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787831014.300321:0:6475:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000903060dd/0x95459fb9d1d29902 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831014.300332:0:6475:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000903060dd/0x95459fb9d1d29902 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831014.300421:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787831014.300490:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204645e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+8:2396:x1874676433391488:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 311us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831014.300500:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 105 00010000:00010000:1.0:1787831014.300829:0:8408:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000903060dd/0x95459fb9d1d29902 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831014.300908:0:8408:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000903060dd/0x95459fb9d1d29902 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831014.300938:0:8408:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000903060dd/0x95459fb9d1d29902 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831014.300947:0:8408:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000903060dd/0x95459fb9d1d29902 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831014.300957:0:8408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000903060dd/0x95459fb9d1d29902 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831014.300966:0:8408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d23344b6a00 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:1.0:1787831014.300971:0:8408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000903060dd/0x95459fb9d1d29902 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831014.300982:0:8408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000903060dd/0x95459fb9d1d29902 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831014.300997:0:8408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000903060dd/0x95459fb9d1d29902 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831014.301016:0:8408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000903060dd/0x95459fb9d1d29902 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831014.301122:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22045b52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+7:2397:x1874676433391360:12345-192.168.203.31@tcp:1:lhsmtool_posix.0 Request processed in 4349us (4557us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831014.301131:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 79 00000100:00100000:0.0:1787831014.303724:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831014.303964:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433391744 00000100:00100000:3.0:1787831014.303976:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433391744 00000100:00100000:3.0:1787831014.304048:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 246 00000100:00100000:3.0:1787831014.304060:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204645a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+21:12437:x1874676433391744:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787831014.304153:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77800/0x95459fb9d1d29909 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831014.304170:0:6490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2a00/0x95459fb9d1d297f8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424093 expref: 21 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831014.304177:0:6490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77800/0x95459fb9d1d29909 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831014.304215:0:6490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2a00/0x95459fb9d1d297f8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424093 expref: 21 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831014.304254:0:6490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2a00/0x95459fb9d1d297f8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424093 expref: 21 pid: 13771 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787831014.304274:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22039b9e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6490:1874676443902592:192.168.203.31@tcp:104: 00000100:00100000:3.0:1787831014.304477:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d233be683c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787831014.307143:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22039b9e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6490:1874676443902592:192.168.203.31@tcp:104: 00000100:00100000:2.0:1787831014.307162:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00010000:00010000:3.0:1787831014.307186:0:6490:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77800/0x95459fb9d1d29909 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831014.307713:0:7432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433391872 00000100:00100000:1.0:1787831014.307723:0:7432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433391872 00010000:00010000:1.0:1787831014.307800:0:7432:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2a00/0x95459fb9d1d297f8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424093 expref: 22 pid: 13771 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831014.307977:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 106 00000100:00100000:1.0:1787831014.307989:0:7432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2305ff9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+22:2396:x1874676433391872:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787831014.308009:0:7432:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787831014.308018:0:7432:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2a00/0x95459fb9d1d297f8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424093 expref: 22 pid: 13771 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831014.308032:0:7432:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2a00/0x95459fb9d1d297f8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424093 expref: 22 pid: 13771 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831014.308061:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2a00/0x95459fb9d1d297f8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424093 expref: 22 pid: 13771 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831014.308079:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d2309e00800) 00010000:00010000:1.0:1787831014.308086:0:7432:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2e00/0x95459fb9d1d2985a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994240b6 expref: 21 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831014.308115:0:7432:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77800/0x95459fb9d1d29909 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831014.308124:0:7432:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77800/0x95459fb9d1d29909 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831014.308132:0:7432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77800/0x95459fb9d1d29909 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831014.308166:0:7432:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787831014.308242:0:7432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2305ff9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+21:2396:x1874676433391872:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 255us (1081us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831014.308251:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 106 00010000:00010000:3.0:1787831014.308344:0:6490:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77800/0x95459fb9d1d29909 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831014.308352:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77800/0x95459fb9d1d29909 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831014.308587:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d29910 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831014.308601:0:6490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d298c3 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994240d2 expref: 21 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831014.308610:0:6490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d29910 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831014.308673:0:6490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d298c3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.31@tcp remote: 0xe558a92a994240d2 expref: 21 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831014.308689:0:6490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d298c3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a994240d2 expref: 21 pid: 13771 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787831014.308713:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22039b9e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6490:1874676443902720:192.168.203.31@tcp:104: 00000100:00100000:3.0:1787831014.308794:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d233be68900 going to sleep for 11 seconds 00000100:00100000:2.0:1787831014.318924:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831014.319152:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433392000 00000100:00100000:0.0:1787831014.319164:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433392000 00010000:00010000:0.0:1787831014.319232:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d298c3 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a994240d2 expref: 22 pid: 13771 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831014.319281:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 107 00000100:00100000:0.0:1787831014.319293:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22045b4f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+22:2397:x1874676433392000:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787831014.319313:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787831014.319335:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d298c3 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a994240d2 expref: 22 pid: 13771 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831014.319350:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d298c3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a994240d2 expref: 22 pid: 13771 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831014.319390:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8d2203615a00) 00010000:00010000:0.0:1787831014.319545:0:6476:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d29910 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831014.319559:0:6476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d29910 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831014.319568:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d29910 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831014.319592:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787831014.319696:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22045b4f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+22:2397:x1874676433392000:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 404us (786us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831014.319705:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 107 00010000:00010000:3.0:1787831014.320270:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d298c3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a994240d2 expref: 21 pid: 13771 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787831014.320296:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22039b9e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6490:1874676443902720:192.168.203.31@tcp:104: 00010000:00010000:3.0:1787831014.320321:0:6490:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d29910 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831014.320331:0:6490:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d29910 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831014.320337:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d29910 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787831014.320803:0:6490:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:3.0:1787831014.320951:0:6490:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:3.0:1787831014.320994:0:6490:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:3.0:1787831014.321095:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22039b9e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6490:1874676443902848:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1787831014.321177:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831014.321333:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443902848 00000100:00100000:0.0:1787831014.321342:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443902848 00000100:00100000:0.0:1787831014.321567:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1787831014.321579:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22039ba940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6490:x1874676443902848:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1787831014.321653:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d233be68300 going to sleep for 11 seconds 00000100:00100000:0.0:1787831014.321812:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22039ba940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6490:x1874676443902848:12345-0@lo:1000:mdt00_000.0 Request processed in 233us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831014.321821:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1787831014.321901:0:6490:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:3.0:1787831014.321909:0:6490:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967322 00000004:00080000:3.0:1787831014.321935:0:6490:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d2203765e00, transno 4294967322 00000100:00100000:3.0:1787831014.321961:0:6490:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8d2203764b40 x1874676443901824/t4294967323(4294967323) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787831030 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787831014.321975:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22039b9e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6490:1874676443902848:0@lo:1000:mdt00_000.0 00000001:00080000:3.0:1787831014.322143:0:6490:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:3.0:1787831014.322235:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22039b9e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6490:1874676443902976:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1787831014.322278:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831014.322305:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d233be68540 going to sleep for 11 seconds 00000100:00100000:2.0:1787831014.322616:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443902976 00000100:00100000:2.0:1787831014.322641:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443902976 00000100:00100000:2.0:1787831014.322688:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1787831014.322697:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220442de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6490:x1874676443902976:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787831014.322857:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220442de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6490:x1874676443902976:12345-0@lo:1000:mdt00_000.0 Request processed in 161us (581us total) trans 4294967325 rc 0/0 00000100:00100000:2.0:1787831014.322865:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787831014.322995:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22039b9e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6490:1874676443902976:0@lo:1000:mdt00_000.0 00010000:00010000:3.0:1787831014.323040:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d29910 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831014.323055:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d29910 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831014.323063:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d29910 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831014.323071:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2307c76400 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:3.0:1787831014.323076:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d29910 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831014.323084:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d29910 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831014.323104:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8d2203615a00) 00010000:00010000:3.0:1787831014.323107:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787831014.323113:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d29910 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831014.323120:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d29910 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831014.323158:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3200/0x95459fb9d1d29853 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831014.323177:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3200/0x95459fb9d1d29853 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831014.323183:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3200/0x95459fb9d1d29853 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831014.323187:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2303aa3200 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:3.0:1787831014.323189:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3200/0x95459fb9d1d29853 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831014.323194:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3200/0x95459fb9d1d29853 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831014.323256:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d2309e00800) 00010000:00010000:3.0:1787831014.323258:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787831014.323264:0:6490:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2e00/0x95459fb9d1d2985a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994240b6 expref: 24 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831014.323273:0:6490:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2e00/0x95459fb9d1d2985a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994240b6 expref: 24 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831014.323280:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2e00/0x95459fb9d1d2985a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994240b6 expref: 24 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831014.323306:0:6490:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2e00/0x95459fb9d1d2985a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994240b6 expref: 24 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787831014.323315:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a20f00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6490:1874676443903104:192.168.203.31@tcp:105: 00000100:00100000:3.0:1787831014.325068:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2303e72540 going to sleep for 11 seconds 00000100:00100000:1.0:1787831014.326885:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831014.327038:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a20f00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6490:1874676443903104:192.168.203.31@tcp:105: 00010000:00010000:0.0:1787831014.327073:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3200/0x95459fb9d1d29853 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831014.327104:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3200/0x95459fb9d1d29853 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831014.327145:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2000/0x95459fb9d1d29917 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831014.327163:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2000/0x95459fb9d1d29917 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831014.327176:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2000/0x95459fb9d1d29917 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831014.327188:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2000/0x95459fb9d1d29917 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831014.327302:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2000/0x95459fb9d1d29917 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831014.327311:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2000/0x95459fb9d1d29917 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831014.327317:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2303aa2000 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:0.0:1787831014.327321:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2000/0x95459fb9d1d29917 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831014.327330:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2000/0x95459fb9d1d29917 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831014.327347:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d2309e00800) 00010000:00010000:0.0:1787831014.327350:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787831014.327354:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2000/0x95459fb9d1d29917 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831014.327368:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2000/0x95459fb9d1d29917 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831014.327389:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77800/0x95459fb9d1d29909 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831014.327402:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77800/0x95459fb9d1d29909 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831014.327408:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77800/0x95459fb9d1d29909 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831014.327413:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2307c77800 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:0.0:1787831014.327417:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77800/0x95459fb9d1d29909 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831014.327422:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77800/0x95459fb9d1d29909 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831014.327432:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d2309e00800) 00010000:00010000:0.0:1787831014.327433:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787831014.327436:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77800/0x95459fb9d1d29909 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831014.327441:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77800/0x95459fb9d1d29909 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831014.327679:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204645a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+24:12437:x1874676433391744:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 Request processed in 23621us (24219us total) trans 4294967514 rc 0/0 00000100:00100000:0.0:1787831014.327689:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 246 00000020:00080000:0.0:1787831014.327700:0:6490:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1787831014.328353:0:13758:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000100:00100000:2.0:1787831014.328353:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433392128 00000040:00080000:3.0:1787831014.328361:0:13758:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:2.0:1787831014.328370:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433392128 00000100:00100000:2.0:1787831014.328422:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 61 00000100:00100000:2.0:1787831014.328433:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204401a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+24:12436:x1874676433392128:12345-192.168.203.31@tcp:49:lfs.0 00000100:00100000:2.0:1787831014.328660:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204401a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+24:12436:x1874676433392128:12345-192.168.203.31@tcp:49:lfs.0 Request processed in 229us (1788us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831014.328668:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 61 00000040:00080000:3.0:1787831014.330532:0:13758:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 5 00000040:00080000:3.0:1787831014.330557:0:13758:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787831014.333494:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831014.333556:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831014.333663:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433392640 00000100:00100000:1.0:1787831014.333677:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433392640 00000100:00100000:2.0:1787831014.333695:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433392384 00000100:00100000:2.0:1787831014.333700:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433392384 00000100:00100000:2.0:1787831014.333743:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 247 00000100:00100000:1.0:1787831014.333743:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 62 00000100:00100000:1.0:1787831014.333767:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d23066c9050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+25:12437:x1874676433392640:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787831014.333770:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204644780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+25:12436:x1874676433392384:12345-192.168.203.31@tcp:58:lfs.0 00000040:00080000:2.0:1787831014.334253:0:8620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000004:00080000:1.0:1787831014.334363:0:6494:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000100:00100000:2.0:1787831014.334399:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204644780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+26:12436:x1874676433392384:12345-192.168.203.31@tcp:58:lfs.0 Request processed in 628us (931us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831014.334408:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 247 00000001:00080000:1.0:1787831014.334427:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967515 00010000:00010000:1.0:1787831014.334465:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7200/0x95459fb9d1d2991e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831014.334484:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7200/0x95459fb9d1d2991e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831014.334497:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7200/0x95459fb9d1d2991e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831014.334527:0:6494:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7200/0x95459fb9d1d2991e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831014.334534:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7200/0x95459fb9d1d2991e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831014.334540:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7200/0x95459fb9d1d2991e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831014.334608:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787831014.334700:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d23066c9050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+26:12437:x1874676433392640:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 Request processed in 948us (1142us total) trans 4294967516 rc 0/0 00000100:00100000:1.0:1787831014.334709:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 62 00000020:00080000:1.0:1787831014.334712:0:6494:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787831014.335126:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787831014.335135:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7200/0x95459fb9d1d2991e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831014.335143:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d23344b7200 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:2.0:1787831014.335148:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7200/0x95459fb9d1d2991e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831014.335158:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7200/0x95459fb9d1d2991e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831014.335175:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8d2203615a00) 00010000:00010000:2.0:1787831014.335178:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787831014.335184:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7200/0x95459fb9d1d2991e lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831014.335199:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7200/0x95459fb9d1d2991e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831014.335214:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787831014.335216:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787831014.335218:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787831014.357533:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831014.357701:0:13771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433392768 00000100:00100000:1.0:1787831014.357715:0:13771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433392768 00000100:00100000:1.0:1787831014.357963:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 248 00000100:00100000:1.0:1787831014.357975:0:13771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204646940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47d7f0ed-283f-4b70-a741-6e74c5e52619+26:12439:x1874676433392768:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:1.0:1787831014.358010:0:13771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787831014.358038:0:13771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7c00/0x95459fb9d1d29925 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a994240ee expref: -99 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831014.358125:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6c00/0x95459fb9d1d2992c lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831014.358143:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6c00/0x95459fb9d1d2992c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831014.358158:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6c00/0x95459fb9d1d2992c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831014.358594:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6800/0x95459fb9d1d29933 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831014.358605:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6800/0x95459fb9d1d29933 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831014.358613:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6800/0x95459fb9d1d29933 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831014.359041:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6000/0x95459fb9d1d2993a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831014.359057:0:13771:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d29845 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994240af expref: 27 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831014.359286:0:13771:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6000/0x95459fb9d1d2993a lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831014.359384:0:13771:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d29845 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0xe558a92a994240af expref: 27 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831014.359517:0:13771:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d29845 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a994240af expref: 27 pid: 6491 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831014.360475:0:13771:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204401a40 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13771:1874676443903232:192.168.203.31@tcp:104: 00000100:00100000:1.0:1787831014.360599:0:13771:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d22028529c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787831014.362690:0:13771:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204401a40 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13771:1874676443903232:192.168.203.31@tcp:104: 00010000:00010000:1.0:1787831014.362727:0:13771:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6000/0x95459fb9d1d2993a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831014.364066:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831014.364487:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433393024 00000100:00100000:3.0:1787831014.364500:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433393024 00000100:00100000:3.0:1787831014.364604:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 63 00000100:00100000:3.0:1787831014.364617:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204644b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+28:6626:x1874676433393024:12345-192.168.203.31@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787831014.364960:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204644b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+29:6626:x1874676433393024:12345-192.168.203.31@tcp:35:ldlm_bl.0 Request processed in 345us (901us total) trans 4294967517 rc 0/0 00000100:00100000:3.0:1787831014.364970:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 63 00000100:00100000:0.0:1787831014.371035:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831014.371434:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433393152 00000100:00100000:2.0:1787831014.371447:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433393152 00010000:00010000:2.0:1787831014.371504:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d29845 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a994240af expref: 29 pid: 6491 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831014.371550:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 108 00000100:00100000:2.0:1787831014.371562:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204647480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+29:2396:x1874676433393152:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787831014.371582:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787831014.371589:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d29845 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a994240af expref: 29 pid: 6491 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831014.371603:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d29845 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a994240af expref: 29 pid: 6491 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831014.371644:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d29845 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a994240af expref: 29 pid: 6491 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831014.371671:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d2309e00800) 00010000:00010000:2.0:1787831014.371676:0:6477:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6000/0x95459fb9d1d2993a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831014.371685:0:6477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6000/0x95459fb9d1d2993a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831014.371707:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6000/0x95459fb9d1d2993a lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831014.371733:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787831014.371812:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204647480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+28:2396:x1874676433393152:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 252us (792us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831014.371820:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 108 00010000:00010000:1.0:1787831014.371825:0:13771:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6000/0x95459fb9d1d2993a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831014.371834:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6000/0x95459fb9d1d2993a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787831014.371906:0:13771:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:1.0:1787831014.371912:0:13771:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787831014.371941:0:13771:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6000/0x95459fb9d1d2993a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831014.371957:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6000/0x95459fb9d1d2993a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831014.371969:0:13771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6c00/0x95459fb9d1d2992c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831014.371976:0:13771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6c00/0x95459fb9d1d2992c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831014.371982:0:13771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6c00/0x95459fb9d1d2992c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831014.371989:0:13771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d23344b6c00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:1.0:1787831014.371994:0:13771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6c00/0x95459fb9d1d2992c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831014.372002:0:13771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6c00/0x95459fb9d1d2992c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831014.372012:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d233a6f8e00) 00010000:00010000:1.0:1787831014.372022:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787831014.372027:0:13771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6c00/0x95459fb9d1d2992c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831014.372034:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6c00/0x95459fb9d1d2992c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831014.372046:0:13771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6800/0x95459fb9d1d29933 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831014.372052:0:13771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6800/0x95459fb9d1d29933 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831014.372059:0:13771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6800/0x95459fb9d1d29933 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831014.372065:0:13771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d23344b6800 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:1.0:1787831014.372068:0:13771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6800/0x95459fb9d1d29933 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831014.372074:0:13771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6800/0x95459fb9d1d29933 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831014.372082:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8d232b9c6600) 00010000:00010000:1.0:1787831014.372084:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787831014.372087:0:13771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6800/0x95459fb9d1d29933 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831014.372093:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6800/0x95459fb9d1d29933 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831014.372135:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7c00/0x95459fb9d1d29925 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994240ee expref: 28 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831014.372164:0:13771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6000/0x95459fb9d1d2993a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994240ee expref: 27 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831014.372172:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d2309e00800) 00010000:00010000:1.0:1787831014.372174:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787831014.372177:0:13771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d23344b6000, rc 0) 00000100:00100000:1.0:1787831014.372500:0:13771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204646940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47d7f0ed-283f-4b70-a741-6e74c5e52619+27:12439:x1874676433392768:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 14523us (14974us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831014.372509:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 248 00010000:00010000:1.0:1787831014.375687:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787831015.143268:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a21a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1874676443903360:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787831015.143366:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831015.143479:0:11489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443903360 00000100:00100000:2.0:1787831015.143489:0:11489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443903360 00000100:00100000:2.0:1787831015.143573:0:11489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787831015.143583:0:11489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22045b7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3620:x1874676443903360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787831015.143619:0:11489:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1787831015.143702:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787831015.143928:0:11489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22045b7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3620:x1874676443903360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 345us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831015.143936:0:11489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787831015.144006:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a21a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1874676443903360:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787831015.144259:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787831015.144270:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a203c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676443903488:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787831015.144302:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831015.144338:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443903488 00000100:00100000:3.0:1787831015.144342:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443903488 00000100:00100000:3.0:1787831015.144374:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787831015.144381:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a21a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676443903488:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787831015.144393:0:8410:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787831015.144425:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a21a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676443903488:12345-0@lo:13:osp-pre-0-1.0 Request processed in 44us (121us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831015.144432:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:3.0:1787831015.144446:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787831015.144467:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a203c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676443903488:0@lo:13:osp-pre-0-1.0 00000040:00080000:1.0:1787831015.245680:0:14669:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787831015.245693:0:14669:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787831015.246525:0:14669:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 6 00000040:00080000:1.0:1787831015.246535:0:14669:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1787831015.334844:0:13758:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787831015.334855:0:13758:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787831015.334885:0:13758:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 6 00000040:00080000:1.0:1787831015.334896:0:13758:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787831015.335074:0:13758:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204401a40 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13758:1874676443903616:192.168.203.31@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787831015.335200:0:13758:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d22027139c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787831015.339402:0:13758:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204401a40 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13758:1874676443903616:192.168.203.31@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787831015.340285:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831015.340354:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433393280 00000100:00100000:1.0:1787831015.340363:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433393280 00000100:00100000:1.0:1787831015.340466:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 249 00000100:00100000:1.0:1787831015.340475:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22046443c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+27:12451:x1874676433393280:12345-192.168.203.31@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787831015.340529:0:6490:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787831015.340703:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22046443c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+27:12451:x1874676433393280:12345-192.168.203.31@tcp:53:lhsmtool_posix.0 Request processed in 228us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831015.340712:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 249 00000100:00080000:0.0:1787831015.340965:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787831015.344489:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831015.344588:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433393536 00000100:00100000:2.0:1787831015.344602:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433393536 00000100:00100000:2.0:1787831015.344696:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 250 00000100:00100000:2.0:1787831015.344709:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204647840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+27:12451:x1874676433393536:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787831015.344736:0:8620:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787831015.344898:0:8620:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0c00/0x95459fb9d1d29941 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a994240f5 expref: -99 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831015.345057:0:8620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1800/0x95459fb9d1d29948 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831015.345075:0:8620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1800/0x95459fb9d1d29948 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831015.345091:0:8620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1800/0x95459fb9d1d29948 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787831015.345103:0:8620:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1787831015.345234:0:8620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0c00/0x95459fb9d1d29941 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994240f5 expref: 30 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831015.345252:0:8620:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1800/0x95459fb9d1d29948 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994240f5 expref: 29 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831015.345261:0:8620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d2309e00800) 00010000:00010000:2.0:1787831015.345265:0:8620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787831015.345269:0:8620:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22039c1800, rc 0) 00000100:00100000:2.0:1787831015.345349:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204647840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+29:12451:x1874676433393536:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 643us (873us total) trans 4294967518 rc 0/0 00000100:00100000:2.0:1787831015.345357:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 250 00000100:00100000:1.0:1787831015.350724:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831015.350993:0:13771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433393792 00000100:00100000:0.0:1787831015.351005:0:13771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433393792 00000100:00100000:0.0:1787831015.351080:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 251 00000100:00100000:0.0:1787831015.351089:0:13771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204401a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47d7f0ed-283f-4b70-a741-6e74c5e52619+29:12451:x1874676433393792:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787831015.351188:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2200/0x95459fb9d1d29956 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831015.351210:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2200/0x95459fb9d1d29956 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831015.351223:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2200/0x95459fb9d1d29956 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831015.351408:0:13771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2200/0x95459fb9d1d29956 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831015.351416:0:13771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2200/0x95459fb9d1d29956 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831015.351424:0:13771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2200/0x95459fb9d1d29956 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831015.351453:0:13771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2303aa2200 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:0.0:1787831015.351458:0:13771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2200/0x95459fb9d1d29956 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831015.351467:0:13771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2200/0x95459fb9d1d29956 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831015.351481:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d2309e00800) 00010000:00010000:0.0:1787831015.351484:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787831015.351489:0:13771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2200/0x95459fb9d1d29956 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831015.351495:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2200/0x95459fb9d1d29956 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831015.351648:0:13771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204401a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47d7f0ed-283f-4b70-a741-6e74c5e52619+30:12451:x1874676433393792:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 Request processed in 558us (937us total) trans 4294967519 rc 0/0 00000100:00100000:0.0:1787831015.351656:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 251 00000040:00080000:0.0:1787831015.351914:0:13758:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787831015.351920:0:13758:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787831015.352406:0:13758:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 6 00000040:00080000:0.0:1787831015.352416:0:13758:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787831015.352527:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831015.352558:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433393920 00000100:00100000:0.0:1787831015.352565:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433393920 00000100:00100000:0.0:1787831015.352622:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 19 00000100:00100000:0.0:1787831015.352652:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204646580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+30:2395:x1874676433393920:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787831015.352668:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787831015.352702:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1800/0x95459fb9d1d29948 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994240f5 expref: 30 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831015.352717:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d2309e00800) 00010000:00010000:0.0:1787831015.352722:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787831015.352783:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204646580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+29:2395:x1874676433393920:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 132us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831015.352790:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 19 00000100:00100000:0.0:1787831015.355470:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831015.355617:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433394176 00000100:00100000:1.0:1787831015.355652:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433394176 00000100:00100000:1.0:1787831015.355718:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 64 00000100:00100000:1.0:1787831015.355730:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204646d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+29:12451:x1874676433394176:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787831015.356023:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204646d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+30:12451:x1874676433394176:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 Request processed in 294us (566us total) trans 4294967520 rc 0/0 00000100:00100000:1.0:1787831015.356034:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 64 00010000:00010000:1.0:1787831015.398836:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787831015.658022:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22045b61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676443903744:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787831015.658147:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831015.658340:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443903744 00000100:00100000:0.0:1787831015.658349:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443903744 00000100:00100000:0.0:1787831015.658414:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1787831015.658425:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a203c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1874676443903744:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787831015.658469:0:7448:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787831015.658575:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a203c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1874676443903744:12345-0@lo:41:osp-pre-1-0.0 Request processed in 152us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831015.658583:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787831015.660507:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22045b61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676443903744:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787831016.168432:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204400780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443903872:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787831016.168536:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831016.168768:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443903872 00000100:00100000:1.0:1787831016.168780:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443903872 00000100:00100000:1.0:1787831016.168855:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787831016.168870:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22045b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443903872:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787831016.168924:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1787831016.169213:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22045b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443903872:12345-0@lo:41:osp-pre-0-1.0 Request processed in 345us (675us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831016.169222:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1787831016.169321:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204400780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443903872:0@lo:41:osp-pre-0-1.0 00000040:00080000:2.0:1787831016.361431:0:13763:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1787831016.362221:0:13758:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787831016.362230:0:13758:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787831016.362339:0:13758:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1787831016.362346:0:13758:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787831016.426155:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787831016.899530:0:14721:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787831016.899540:0:14721:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787831016.899572:0:14721:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1787831016.899578:0:14721:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787831017.075284:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831017.075356:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433394432 00000100:00100000:0.0:1787831017.075365:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433394432 00000100:00100000:0.0:1787831017.075452:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 252 00000100:00100000:0.0:1787831017.075461:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204402940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+30:12471:x1874676433394432:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:0.0:1787831017.075485:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787831017.075505:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3c00/0x95459fb9d1d2995d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a994240fc expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831017.075607:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2800/0x95459fb9d1d29964 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831017.075639:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2800/0x95459fb9d1d29964 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831017.075652:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2800/0x95459fb9d1d29964 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787831017.075662:0:6490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:0.0:1787831017.075772:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3c00/0x95459fb9d1d2995d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994240fc expref: 33 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831017.075789:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2800/0x95459fb9d1d29964 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994240fc expref: 32 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831017.075797:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d2309e00800) 00010000:00010000:0.0:1787831017.075800:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787831017.075803:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2303aa2800, rc 0) 00000100:00100000:0.0:1787831017.075859:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204402940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+32:12471:x1874676433394432:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 398us (581us total) trans 4294967521 rc 0/0 00000100:00100000:0.0:1787831017.075866:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 252 00000100:00080000:3.0:1787831017.076823:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787831017.085914:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831017.086019:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433394560 00000100:00100000:2.0:1787831017.086029:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433394560 00000100:00100000:2.0:1787831017.086087:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 253 00000100:00100000:2.0:1787831017.086097:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204400b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+32:12471:x1874676433394560:12345-192.168.203.31@tcp:54:lfs.0 00010000:00010000:2.0:1787831017.086162:0:8620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0c00/0x95459fb9d1d29972 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831017.086191:0:8620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0c00/0x95459fb9d1d29972 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831017.086204:0:8620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0c00/0x95459fb9d1d29972 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831017.086241:0:8620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0c00/0x95459fb9d1d29972 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831017.086249:0:8620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0c00/0x95459fb9d1d29972 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831017.086256:0:8620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0c00/0x95459fb9d1d29972 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831017.086262:0:8620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22039c0c00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:2.0:1787831017.086266:0:8620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0c00/0x95459fb9d1d29972 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831017.086274:0:8620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0c00/0x95459fb9d1d29972 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831017.086287:0:8620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d2309e00800) 00010000:00010000:2.0:1787831017.086291:0:8620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787831017.086295:0:8620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0c00/0x95459fb9d1d29972 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831017.086310:0:8620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0c00/0x95459fb9d1d29972 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831017.086377:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204400b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+32:12471:x1874676433394560:12345-192.168.203.31@tcp:54:lfs.0 Request processed in 281us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831017.086385:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 253 00000100:00100000:2.0:1787831017.190861:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787831017.190884:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22045b5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443904000:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787831017.190959:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831017.191034:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443904000 00000100:00100000:2.0:1787831017.191041:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443904000 00000100:00100000:2.0:1787831017.191094:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787831017.191103:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22045b61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443904000:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787831017.191131:0:8409:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1787831017.191255:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a20f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a45944b-32e3-4193-a2a5-46f84222bc14:3621:1874676443904128:0@lo:400:kworker.0 00000100:00100000:3.0:1787831017.191346:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22047ec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3622:1874676443904256:0@lo:400:kworker.0 00000100:00100000:0.0:1787831017.191372:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22047ecb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3620:1874676443904512:0@lo:400:kworker.0 00000100:00100000:1.0:1787831017.191601:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831017.191665:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22047ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443904640:0@lo:400:kworker.0 00000100:00100000:1.0:1787831017.191691:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831017.191709:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22047eed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443905152:0@lo:400:kworker.0 00000100:00100000:1.0:1787831017.191742:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831017.191760:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204645680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443905664:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787831017.191781:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831017.191808:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443904128 00000100:00100000:1.0:1787831017.191812:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443904128 00000100:00100000:1.0:1787831017.191841:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:1.0:1787831017.191848:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d231859f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+24:3621:x1874676443904128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787831017.191882:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d231859f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+24:3621:x1874676443904128:12345-0@lo:400:kworker.0 Request processed in 35us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831017.191889:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:1.0:1787831017.191918:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443905152 00000100:00100000:1.0:1787831017.191921:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443905152 00000100:00100000:1.0:1787831017.191944:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787831017.191950:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22044003c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3621:x1874676443905152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787831017.191980:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22044003c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3621:x1874676443905152:12345-0@lo:400:kworker.0 Request processed in 30us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831017.191986:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787831017.192003:0:11489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443905664 00000100:00100000:1.0:1787831017.192006:0:11489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443905664 00000100:00100000:1.0:1787831017.192023:0:11489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787831017.192028:0:11489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204403840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3621:x1874676443905664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787831017.192039:0:11489:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1787831017.192064:0:11489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204403840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3621:x1874676443905664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 36us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831017.192077:0:11489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787831017.192117:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22047eed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443905152:0@lo:400:kworker.0 00000100:00100000:1.0:1787831017.192132:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204645680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443905664:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787831017.192140:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a20f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a45944b-32e3-4193-a2a5-46f84222bc14:3621:1874676443904128:0@lo:400:kworker.0 00000100:00100000:2.0:1787831017.192482:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22045b61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443904000:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1379us (1522us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831017.192490:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:2.0:1787831017.192514:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787831017.192517:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787831017.192644:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443904640 00000100:00100000:1.0:1787831017.192649:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443904640 00000100:00100000:1.0:1787831017.192685:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787831017.192692:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204403480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1874676443904640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787831017.192747:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204403480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1874676443904640:12345-0@lo:400:kworker.0 Request processed in 56us (1054us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831017.192753:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787831017.192782:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22047ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443904640:0@lo:400:kworker.0 00000100:00100000:3.0:1787831017.192974:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831017.193012:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22047ec3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3622:1874676443904768:0@lo:400:kworker.0 00000100:00100000:2.0:1787831017.193017:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443904256 00000100:00100000:2.0:1787831017.193021:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443904256 00000100:00100000:3.0:1787831017.193037:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831017.193957:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22047ed680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3622:1874676443905280:0@lo:400:kworker.0 00000100:00100000:3.0:1787831017.193992:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831017.194012:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443904768 00000100:00100000:2.0:1787831017.194017:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443904768 00000100:00100000:2.0:1787831017.194061:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1787831017.194069:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22047ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1874676443904256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787831017.194113:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22047ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1874676443904256:12345-0@lo:400:kworker.0 Request processed in 46us (1140us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831017.194137:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1787831017.194153:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1787831017.194520:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22047ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1874676443904768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787831017.194552:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22047ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1874676443904768:12345-0@lo:400:kworker.0 Request processed in 394us (1515us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831017.194558:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00080000:2.0:1787831017.194580:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787831017.195048:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22047ee940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443904384:0@lo:400:kworker.0 00000100:00100000:2.0:1787831017.195083:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831017.195193:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22047ef840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3619:1874676443904896:0@lo:400:kworker.0 00000100:00100000:0.0:1787831017.195361:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443904384 00000100:00100000:0.0:1787831017.195367:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443904384 00000100:00100000:0.0:1787831017.195436:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1787831017.195444:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22045b70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443904384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787831017.195539:0:13771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443905280 00000100:00100000:2.0:1787831017.195543:0:13771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443905280 00000100:00100000:2.0:1787831017.195597:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1787831017.195604:0:13771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22047efc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1874676443905280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787831017.195677:0:13771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22047efc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1874676443905280:12345-0@lo:400:kworker.0 Request processed in 74us (1685us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831017.195684:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1787831017.195706:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831017.195724:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22047ed2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3619:1874676443905408:0@lo:400:kworker.0 00000100:00100000:2.0:1787831017.195774:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831017.195812:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22045b5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443904000:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787831017.195841:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443904896 00000100:00100000:2.0:1787831017.195844:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443904896 00000100:00100000:2.0:1787831017.195867:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443905408 00000100:00100000:2.0:1787831017.195869:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443905408 00000100:00100000:2.0:1787831017.195893:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1787831017.195899:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22045b7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874676443904896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787831017.195930:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22045b7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874676443904896:12345-0@lo:400:kworker.0 Request processed in 31us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831017.195936:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1787831017.195947:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1787831017.195953:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22047070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874676443905408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787831017.195976:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22047070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874676443905408:12345-0@lo:400:kworker.0 Request processed in 23us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831017.195981:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00010000:00080000:2.0:1787831017.196009:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d22047ef840 x1874676443904896/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787831033 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787831017.196021:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22047ef840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3619:1874676443904896:0@lo:400:kworker.0 00010000:00080000:2.0:1787831017.196030:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d22047ed2c0 x1874676443905408/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787831033 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787831017.196038:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22047ed2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3619:1874676443905408:0@lo:400:kworker.0 00000100:00100000:0.0:1787831017.196740:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22045b70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443904384:12345-0@lo:400:kworker.0 Request processed in 1287us (1645us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831017.196749:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00080000:3.0:1787831017.196812:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787831017.196817:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787831017.197035:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22047ee940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443904384:0@lo:400:kworker.0 00000100:00100000:0.0:1787831017.197422:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22047ed680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3622:1874676443905280:0@lo:400:kworker.0 00000100:00100000:0.0:1787831017.197447:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22047ec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3622:1874676443904256:0@lo:400:kworker.0 00000100:00100000:0.0:1787831017.197522:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22047ec3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3622:1874676443904768:0@lo:400:kworker.0 00000100:00100000:0.0:1787831017.197600:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831017.197696:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22047ee580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1874676443905024:0@lo:400:kworker.0 00000100:00100000:0.0:1787831017.197748:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831017.197774:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22047ecf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1874676443905536:0@lo:400:kworker.0 00000100:00100000:0.0:1787831017.197794:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831017.197873:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443905024 00000100:00100000:3.0:1787831017.197879:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443905024 00000100:00100000:3.0:1787831017.197928:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443905536 00000100:00100000:3.0:1787831017.197931:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443905536 00000100:00100000:3.0:1787831017.197948:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787831017.197956:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204645e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1874676443905024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787831017.197996:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204645e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1874676443905024:12345-0@lo:400:kworker.0 Request processed in 41us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831017.198002:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787831017.198015:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787831017.198021:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204647c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3620:x1874676443905536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787831017.198046:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204647c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3620:x1874676443905536:12345-0@lo:400:kworker.0 Request processed in 26us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831017.198052:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:0.0:1787831017.198115:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787831017.198136:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22047ee580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1874676443905024:0@lo:400:kworker.0 00000100:00100000:0.0:1787831017.198146:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22047ecf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1874676443905536:0@lo:400:kworker.0 00000100:00100000:2.0:1787831017.198383:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443904512 00000100:00100000:2.0:1787831017.198387:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443904512 00000100:00100000:2.0:1787831017.199517:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1787831017.199531:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204644000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1874676443904512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787831017.199609:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204644000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1874676443904512:12345-0@lo:400:kworker.0 Request processed in 82us (2008us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831017.199616:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1787831017.199741:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22047ecb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3620:1874676443904512:0@lo:400:kworker.0 00000100:00100000:0.0:1787831017.206118:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831017.206371:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433394688 00000100:00100000:3.0:1787831017.206393:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433394688 00000100:00100000:3.0:1787831017.206618:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 80 00000100:00100000:3.0:1787831017.206668:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204644f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+7:2397:x1874676433394688:12345-192.168.203.31@tcp:101:cat.0 00010000:00010000:3.0:1787831017.206685:0:8407:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787831017.206705:0:8407:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000030a0b447/0x95459fb9d1d29979 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99424103 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787831017.206740:0:8407:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 13, mtime: 0x6a9022e5, atime: 0x6a9022e5, ctime: 0x6a9022e5, blocks: 0x8 00010000:00010000:3.0:1787831017.206763:0:8407:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=308s v=(0 0) 00010000:00010000:3.0:1787831017.206767:0:8407:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787831017.206777:0:8407:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000030a0b447/0x95459fb9d1d29979 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424103 expref: 8 pid: 8407 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831017.206796:0:8407:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000030a0b447/0x95459fb9d1d29979 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424103 expref: 8 pid: 8407 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831017.206808:0:8407:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2307c76600, rc 0) 00000100:00100000:3.0:1787831017.206859:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204644f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+8:2397:x1874676433394688:12345-192.168.203.31@tcp:101:cat.0 Request processed in 195us (751us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831017.206867:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 80 00000100:00080000:0.0:1787831017.211120:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787831017.221792:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831017.222150:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433394816 00000100:00100000:0.0:1787831017.222171:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433394816 00002000:00100000:0.0:1787831017.222220:0:8411:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6:0x0] (0->4095) req@ffff8d22047061c0 x1874676433394816/t0(0) o3->47d7f0ed-283f-4b70-a741-6e74c5e52619@192.168.203.31@tcp:88/0 lens 488/0 e 0 to 0 dl 1787831028 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787831017.222251:0:8411:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d22047061c0 with x1874676433394816 ext(0->4095) 00002000:00010000:0.0:1787831017.222256:0:8411:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d22047061c0 00000100:00100000:0.0:1787831017.222298:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 8 00000100:00100000:0.0:1787831017.222307:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22047061c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+8:2396:x1874676433394816:12345-192.168.203.31@tcp:3:cat.0 00000100:00100000:0.0:1787831017.222718:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22047061c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+8:2396:x1874676433394816:12345-192.168.203.31@tcp:3:cat.0 Request processed in 411us (934us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787831017.222726:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 8 00002000:00100000:0.0:1787831017.222742:0:8411:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6:0x0] (0->4095) req@ffff8d22047061c0 x1874676433394816/t0(0) o3->47d7f0ed-283f-4b70-a741-6e74c5e52619@192.168.203.31@tcp:88/0 lens 488/4536 e 0 to 0 dl 1787831028 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787831017.222751:0:8411:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d22047061c0 with x1874676433394816 ext(0->4095) 00002000:00010000:0.0:1787831017.222754:0:8411:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d22047061c0 00010000:00010000:1.0:1787831017.450099:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787831018.472139:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787831018.578852:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831018.578894:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831018.578924:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831018.578949:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831018.578969:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831018.578987:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831018.579015:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831018.579058:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433395456 00000100:00100000:2.0:1787831018.579067:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433395456 00000100:00100000:2.0:1787831018.579111:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433395328 00000100:00100000:2.0:1787831018.579115:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433395328 00000100:00100000:2.0:1787831018.579147:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 96 00000100:00100000:2.0:1787831018.579157:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204704000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+8:2397:x1874676433395456:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1787831018.579239:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204704000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+8:2397:x1874676433395456:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 84us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831018.579247:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 96 00000100:00100000:2.0:1787831018.579265:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 97 00000100:00100000:2.0:1787831018.579271:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204704780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:2397:x1874676433395328:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1787831018.579296:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204704780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:2397:x1874676433395328:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 25us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831018.579303:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 97 00000100:00100000:2.0:1787831018.579320:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433395200 00000100:00100000:2.0:1787831018.579323:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433395200 00000100:00100000:2.0:1787831018.579348:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433395712 00000100:00100000:2.0:1787831018.579351:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433395712 00000100:00100000:2.0:1787831018.579363:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433395072 00000100:00100000:2.0:1787831018.579378:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433395072 00000100:00100000:2.0:1787831018.579392:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433395584 00000100:00100000:2.0:1787831018.579395:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433395584 00000100:00100000:2.0:1787831018.579411:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 251 00000100:00100000:2.0:1787831018.579417:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204707c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:2397:x1874676433395200:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1787831018.579447:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204707c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:2397:x1874676433395200:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 29us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831018.579453:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 251 00000100:00100000:2.0:1787831018.579466:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 252 00000100:00100000:2.0:1787831018.579482:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204705e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c901c2b2-479b-44dc-8fa8-34fbacf02f07+5:2397:x1874676433395712:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1787831018.579505:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204705e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c901c2b2-479b-44dc-8fa8-34fbacf02f07+5:2397:x1874676433395712:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 34us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831018.579511:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 252 00000100:00100000:2.0:1787831018.579522:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 253 00000100:00100000:2.0:1787831018.579529:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204705a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+32:2397:x1874676433395072:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1787831018.579552:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204705a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+32:2397:x1874676433395072:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 24us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831018.579559:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 253 00000100:00100000:2.0:1787831018.579570:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 254 00000100:00100000:2.0:1787831018.579575:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204706940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c901c2b2-479b-44dc-8fa8-34fbacf02f07+5:2397:x1874676433395584:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1787831018.579616:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204706940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c901c2b2-479b-44dc-8fa8-34fbacf02f07+5:2397:x1874676433395584:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 40us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831018.579646:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 254 00000100:00100000:3.0:1787831018.580091:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433394944 00000100:00100000:3.0:1787831018.580097:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433394944 00000100:00100000:3.0:1787831018.580142:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 371 00000100:00100000:3.0:1787831018.580150:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d231859e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+13:2397:x1874676433394944:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1787831018.580197:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d231859e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+13:2397:x1874676433394944:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 48us (1356us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831018.580213:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 371 00000100:00080000:0.0:1787831018.580507:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787831018.580512:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787831018.580516:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1787831018.735945:0:8401:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00010000:00010000:0.0:1787831019.495205:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787831019.754450:0:9484:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967325 is committed 00000001:00080000:0.0:1787831019.754464:0:9484:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:3.0:1787831019.763955:0:6469:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:3.0:1787831019.763993:0:6469:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d233be68300 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:3.0:1787831019.764009:0:6469:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d232f5f2900 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d233be68000 00000020:00080000:3.0:1787831019.764013:0:6469:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d232f5f2f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d2203a4f800 00000020:00080000:3.0:1787831019.764030:0:6469:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:3.0:1787831019.764042:0:6522:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:3.0:1787831019.764103:0:6522:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:2.0:1787831019.767321:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0e00/0x95459fb9d1d298f4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831019.767343:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0e00/0x95459fb9d1d298f4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831019.767351:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0e00/0x95459fb9d1d298f4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831019.767358:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22039c0e00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:2.0:1787831019.767362:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0e00/0x95459fb9d1d298f4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831019.767371:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0e00/0x95459fb9d1d298f4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831019.767388:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8d2203615a00) 00010000:00010000:2.0:1787831019.767391:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787831019.767396:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0e00/0x95459fb9d1d298f4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831019.767403:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0e00/0x95459fb9d1d298f4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8620 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831020.262940:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22047ede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676443905792:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787831020.263015:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831020.263176:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787831020.263187:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204402d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1874676443905920:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787831020.263217:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831020.263259:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443905792 00000100:00100000:1.0:1787831020.263266:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443905792 00000100:00100000:1.0:1787831020.263312:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443905920 00000100:00100000:1.0:1787831020.263315:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443905920 00000100:00100000:1.0:1787831020.263332:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787831020.263340:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204645680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1874676443905792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787831020.263385:0:8409:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787831020.263429:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204645680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1874676443905792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831020.263436:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787831020.263453:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787831020.263461:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204401680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1874676443905920:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787831020.263470:0:8409:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787831020.263495:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204401680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1874676443905920:12345-0@lo:13:osp-pre-0-1.0 Request processed in 37us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831020.263501:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787831020.263534:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204402d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1874676443905920:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1787831020.263606:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787831020.263648:0:3622:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:0.0:1787831020.263654:0:3622:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967311 00000004:00080000:0.0:1787831020.263669:0:3622:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d22045b6d00, transno 4294967311 00000100:00100000:0.0:1787831020.263684:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22047ede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676443905792:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787831020.519281:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787831020.774903:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1874676443906048:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787831020.775053:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831020.777243:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443906048 00000100:00100000:2.0:1787831020.777255:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443906048 00000100:00100000:2.0:1787831020.777357:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1787831020.777368:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204402d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1874676443906048:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787831020.777405:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787831020.777498:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204402d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1874676443906048:12345-0@lo:41:osp-pre-1-0.0 Request processed in 130us (2444us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831020.777505:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787831020.777598:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1874676443906048:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787831021.286883:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787831021.286918:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676443906176:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787831021.286996:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831021.287178:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443906176 00000100:00100000:2.0:1787831021.287185:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443906176 00000100:00100000:2.0:1787831021.287248:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1787831021.287258:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220442c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676443906176:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787831021.287291:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1787831021.287353:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220442c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676443906176:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831021.287361:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787831021.288383:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676443906176:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787831021.549004:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787831022.032994:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831022.033070:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433395840 00000100:00100000:1.0:1787831022.033081:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433395840 00000100:00100000:1.0:1787831022.033161:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 254 00000100:00100000:1.0:1787831022.033170:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204707840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+18:12125:x1874676433395840:12345-192.168.203.31@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1787831022.033281:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204707840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+18:12125:x1874676433395840:12345-192.168.203.31@tcp:60:lhsmtool_posix.0 Request processed in 112us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831022.033289:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 254 00000100:00080000:0.0:1787831022.033596:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787831022.044796:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831022.044970:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433395968 00000100:00100000:0.0:1787831022.044980:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433395968 00000100:00100000:0.0:1787831022.045063:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 255 00000100:00080000:2.0:1787831022.045074:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787831022.045075:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22047eda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:12125:x1874676433395968:12345-192.168.203.31@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1787831022.045185:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22047eda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:12125:x1874676433395968:12345-192.168.203.31@tcp:60:lhsmtool_posix.0 Request processed in 112us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831022.045193:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 255 00000100:00100000:3.0:1787831022.057125:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831022.057673:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433396224 00000100:00100000:2.0:1787831022.057683:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433396224 00000100:00100000:2.0:1787831022.057869:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 65 00000100:00100000:2.0:1787831022.057880:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22047ede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+18:12125:x1874676433396224:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787831022.058155:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22047ede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+19:12125:x1874676433396224:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 Request processed in 275us (1038us total) trans 4294967522 rc 0/0 00000100:00100000:2.0:1787831022.058163:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 65 00000100:00100000:3.0:1787831022.311091:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787831022.311126:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22044012c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443906304:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787831022.313552:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831022.313818:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443906304 00000100:00100000:1.0:1787831022.313835:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443906304 00000100:00100000:1.0:1787831022.313945:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787831022.313979:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22047ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1874676443906304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787831022.314023:0:8409:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1787831022.314116:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22047ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1874676443906304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 142us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831022.314125:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:3.0:1787831022.314298:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787831022.314350:0:3621:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:3.0:1787831022.314358:0:3621:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d2203764b40, transno 4294967323 00000004:00080000:3.0:1787831022.314375:0:3621:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967325 committed transno 4294967325 00000100:00100000:3.0:1787831022.314411:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22044012c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443906304:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787831022.315082:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204627480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3620:1874676443906560:0@lo:400:kworker.0 00000100:00100000:3.0:1787831022.315155:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831022.315205:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204626d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3620:1874676443907072:0@lo:400:kworker.0 00000100:00100000:3.0:1787831022.315231:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831022.315263:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22046270c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3620:1874676443907584:0@lo:400:kworker.0 00000100:00100000:3.0:1787831022.315288:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831022.315310:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1787831022.315316:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204624b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a45944b-32e3-4193-a2a5-46f84222bc14:3620:1874676443906432:0@lo:400:kworker.0 00000100:00100000:3.0:1787831022.315344:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831022.315364:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204626580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1874676443906944:0@lo:400:kworker.0 00000100:00100000:3.0:1787831022.315387:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831022.315402:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204624f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1874676443907456:0@lo:400:kworker.0 00000100:00100000:3.0:1787831022.315422:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831022.315444:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22046243c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443906688:0@lo:400:kworker.0 00000100:00100000:3.0:1787831022.315480:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831022.315497:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204625680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3621:1874676443907200:0@lo:400:kworker.0 00000100:00100000:3.0:1787831022.315518:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831022.315532:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22046261c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3621:1874676443907712:0@lo:400:kworker.0 00000100:00100000:3.0:1787831022.315554:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831022.315571:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1787831022.315577:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204627840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3621:1874676443906816:0@lo:400:kworker.0 00000100:00100000:3.0:1787831022.315600:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831022.315611:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22046252c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443907328:0@lo:400:kworker.0 00000100:00100000:3.0:1787831022.315660:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831022.315677:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204627c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443907840:0@lo:400:kworker.0 00000100:00100000:3.0:1787831022.315708:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831022.315977:0:13771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443906560 00000100:00100000:0.0:1787831022.315985:0:13771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443906560 00000100:00100000:0.0:1787831022.316025:0:13771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443907072 00000100:00100000:0.0:1787831022.316028:0:13771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443907072 00000100:00100000:0.0:1787831022.316056:0:13771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443907584 00000100:00100000:0.0:1787831022.316060:0:13771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443907584 00000100:00100000:0.0:1787831022.316073:0:13771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443907200 00000100:00100000:0.0:1787831022.316076:0:13771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443907200 00000100:00100000:0.0:1787831022.316090:0:13771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443907712 00000100:00100000:0.0:1787831022.316093:0:13771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443907712 00000100:00100000:0.0:1787831022.316109:0:13771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443906816 00000100:00100000:0.0:1787831022.316112:0:13771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443906816 00000100:00100000:0.0:1787831022.316128:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00080000:3.0:1787831022.316537:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787831022.316544:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787831022.316582:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1787831022.316603:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22047ecf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1874676443907072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787831022.316715:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22047ecf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1874676443907072:12345-0@lo:400:kworker.0 Request processed in 115us (1483us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831022.316722:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1787831022.316744:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1787831022.316751:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22047ee580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1874676443907584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787831022.316781:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22047ee580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1874676443907584:12345-0@lo:400:kworker.0 Request processed in 31us (1493us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831022.316787:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1787831022.316801:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1787831022.316808:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22047ee940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1874676443907200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787831022.316844:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22047ee940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1874676443907200:12345-0@lo:400:kworker.0 Request processed in 38us (1325us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831022.316851:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1787831022.316863:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1787831022.316870:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22047ed2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1874676443907712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787831022.316898:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22047ed2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1874676443907712:12345-0@lo:400:kworker.0 Request processed in 29us (1344us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831022.316904:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1787831022.316917:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1787831022.316923:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22047ef840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1874676443906816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787831022.316969:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22047ef840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1874676443906816:12345-0@lo:400:kworker.0 Request processed in 46us (1367us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831022.316976:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1787831022.317023:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204626d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3620:1874676443907072:0@lo:400:kworker.0 00000100:00100000:3.0:1787831022.317045:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22046270c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3620:1874676443907584:0@lo:400:kworker.0 00000100:00100000:3.0:1787831022.317081:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204627840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3621:1874676443906816:0@lo:400:kworker.0 00010000:00080000:3.0:1787831022.317098:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2204625680 x1874676443907200/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787831038 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787831022.317109:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204625680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3621:1874676443907200:0@lo:400:kworker.0 00010000:00080000:3.0:1787831022.317121:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d22046261c0 x1874676443907712/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787831038 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787831022.317130:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22046261c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3621:1874676443907712:0@lo:400:kworker.0 00000100:00100000:0.0:1787831022.317340:0:13771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22047ecb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1874676443906560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787831022.317394:0:13771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22047ecb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1874676443906560:12345-0@lo:400:kworker.0 Request processed in 1258us (2238us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831022.317401:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1787831022.317470:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204627480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3620:1874676443906560:0@lo:400:kworker.0 00000100:00100000:1.0:1787831022.318034:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443906432 00000100:00100000:1.0:1787831022.318043:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443906432 00000100:00100000:1.0:1787831022.318088:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:1.0:1787831022.318098:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d231859f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+24:3620:x1874676443906432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787831022.318161:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d231859f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a45944b-32e3-4193-a2a5-46f84222bc14+24:3620:x1874676443906432:12345-0@lo:400:kworker.0 Request processed in 66us (2816us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831022.318168:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:1.0:1787831022.318233:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204624b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a45944b-32e3-4193-a2a5-46f84222bc14:3620:1874676443906432:0@lo:400:kworker.0 00000100:00100000:1.0:1787831022.318287:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443906944 00000100:00100000:1.0:1787831022.318292:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443906944 00000100:00100000:2.0:1787831022.318316:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443907456 00000100:00100000:1.0:1787831022.318320:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443906688 00000100:00100000:2.0:1787831022.318323:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443907456 00000100:00100000:1.0:1787831022.318326:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443906688 00000100:00100000:1.0:1787831022.318347:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1787831022.318356:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22047ec3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1874676443906944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787831022.318363:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443907328 00000100:00100000:2.0:1787831022.318366:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443907328 00000100:00100000:2.0:1787831022.318381:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443907840 00000100:00100000:2.0:1787831022.318383:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443907840 00000100:00100000:2.0:1787831022.318396:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787831022.318403:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22047ec780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1874676443907456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787831022.318411:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22047ec3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1874676443906944:12345-0@lo:400:kworker.0 Request processed in 56us (3021us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831022.318419:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1787831022.318434:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787831022.318443:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22047ed680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443906688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787831022.318492:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22047ed680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443906688:12345-0@lo:400:kworker.0 Request processed in 52us (3012us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831022.318514:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787831022.318555:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204626580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1874676443906944:0@lo:400:kworker.0 00000100:00100000:1.0:1787831022.318660:0:8631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787831022.318668:0:8631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22047ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443907328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787831022.318720:0:8631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22047ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443907328:12345-0@lo:400:kworker.0 Request processed in 53us (3059us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831022.318728:0:8631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787831022.318748:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22047ec780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1874676443907456:12345-0@lo:400:kworker.0 Request processed in 343us (3322us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831022.318750:0:8631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787831022.318759:0:8631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22047eed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443907840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787831022.318789:0:8631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22047eed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443907840:12345-0@lo:400:kworker.0 Request processed in 31us (3080us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831022.318795:0:8631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787831022.318825:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204400f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443907968:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787831022.318863:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831022.318904:0:11489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443907968 00000100:00100000:1.0:1787831022.318908:0:11489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443907968 00000100:00100000:1.0:1787831022.318935:0:11489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787831022.318942:0:11489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22044012c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443907968:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787831022.318958:0:11489:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1787831022.318995:0:11489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22044012c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443907968:12345-0@lo:13:osp-pre-1-1.0 Request processed in 54us (132us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831022.319001:0:11489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787831022.319032:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204400f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443907968:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787831022.319067:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204624f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1874676443907456:0@lo:400:kworker.0 00000100:00080000:1.0:1787831022.319104:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787831022.319109:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787831022.319128:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787831022.319410:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22046252c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443907328:0@lo:400:kworker.0 00000100:00100000:3.0:1787831022.319421:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204627c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443907840:0@lo:400:kworker.0 00000100:00100000:3.0:1787831022.319434:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22046243c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443906688:0@lo:400:kworker.0 00000100:00100000:2.0:1787831022.379007:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831022.379135:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433396352 00000100:00100000:3.0:1787831022.379149:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433396352 00000100:00100000:3.0:1787831022.379482:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 256 00000100:00100000:3.0:1787831022.379509:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204706580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c901c2b2-479b-44dc-8fa8-34fbacf02f07+5:12928:x1874676433396352:12345-192.168.203.31@tcp:101:lsof.0 00010000:00010000:3.0:1787831022.379549:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787831022.379837:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d29980 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a9942410a expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831022.379917:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d29987 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831022.379931:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d29987 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831022.379959:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d29987 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787831022.380003:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787831022.380006:0:6492:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787831022.380028:0:6492:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d29987 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831022.380053:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d29980 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a9942410a expref: 7 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831022.380073:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d29987 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a9942410a expref: 6 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831022.380082:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2303e42700) 00010000:00010000:3.0:1787831022.380085:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787831022.380088:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2307c77600, rc 0) 00000100:00100000:3.0:1787831022.380376:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204706580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c901c2b2-479b-44dc-8fa8-34fbacf02f07+6:12928:x1874676433396352:12345-192.168.203.31@tcp:101:lsof.0 Request processed in 882us (1384us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831022.380386:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 256 00000100:00080000:1.0:1787831022.382565:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787831022.566860:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787831023.591156:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787831023.696279:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831023.697444:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831023.697492:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831023.697562:0:8631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433396864 00000100:00100000:2.0:1787831023.697572:0:8631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433396864 00000100:00100000:2.0:1787831023.697702:0:8631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 101 00000100:00100000:2.0:1787831023.697712:0:8631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22038fbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:2397:x1874676433396864:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1787831023.697783:0:8631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22038fbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:2397:x1874676433396864:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 72us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831023.697790:0:8631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 101 00000100:00080000:0.0:1787831023.698348:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787831023.700185:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831023.700210:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831023.700269:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433396480 00000100:00100000:2.0:1787831023.700278:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433396480 00000100:00100000:2.0:1787831023.700337:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 373 00000100:00100000:2.0:1787831023.700351:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d231859fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+13:2397:x1874676433396480:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1787831023.700417:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d231859fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+13:2397:x1874676433396480:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 72us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831023.700425:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 373 00000100:00100000:2.0:1787831023.705315:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433396736 00000100:00100000:2.0:1787831023.705329:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433396736 00000100:00100000:2.0:1787831023.705387:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 261 00000100:00100000:2.0:1787831023.705396:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22038f9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:2397:x1874676433396736:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1787831023.705467:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22038f9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:2397:x1874676433396736:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 71us (5254us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831023.705473:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 261 00000100:00100000:0.0:1787831023.706002:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433396608 00000100:00100000:0.0:1787831023.706009:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433396608 00000100:00100000:0.0:1787831023.706045:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 262 00000100:00100000:0.0:1787831023.706232:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22039b9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+19:2397:x1874676433396608:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1787831023.706278:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22039b9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+19:2397:x1874676433396608:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 225us (10010us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831023.706286:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 262 00000100:00100000:1.0:1787831023.706422:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433397120 00000100:00100000:1.0:1787831023.706427:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433397120 00000100:00100000:1.0:1787831023.706467:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 263 00000100:00100000:1.0:1787831023.706474:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22038f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c901c2b2-479b-44dc-8fa8-34fbacf02f07+6:2397:x1874676433397120:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1787831023.706502:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22038f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c901c2b2-479b-44dc-8fa8-34fbacf02f07+6:2397:x1874676433397120:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 29us (9010us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831023.706521:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 263 00000100:00100000:3.0:1787831023.709093:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831023.709147:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831023.709150:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433396992 00000100:00100000:2.0:1787831023.709160:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433396992 00000100:00100000:0.0:1787831023.709205:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433397248 00000100:00100000:0.0:1787831023.709209:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433397248 00000100:00100000:0.0:1787831023.709258:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 264 00000100:00100000:0.0:1787831023.709269:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22038f8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c901c2b2-479b-44dc-8fa8-34fbacf02f07+5:2397:x1874676433397248:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1787831023.709335:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22038f8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c901c2b2-479b-44dc-8fa8-34fbacf02f07+5:2397:x1874676433397248:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 69us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831023.709343:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 264 00000100:00080000:1.0:1787831023.709480:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787831023.709485:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787831023.709984:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 102 00000100:00100000:2.0:1787831023.709996:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22038f9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+7:2397:x1874676433396992:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1787831023.710057:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22038f9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:47d7f0ed-283f-4b70-a741-6e74c5e52619+7:2397:x1874676433396992:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 64us (972us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831023.710068:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 102 00010000:00010000:1.0:1787831024.615232:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787831025.383073:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204400f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1874676443908096:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787831025.383161:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831025.383237:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443908096 00000100:00100000:1.0:1787831025.383244:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443908096 00000100:00100000:1.0:1787831025.383660:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787831025.383683:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204402580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1874676443908096:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787831025.383847:0:8410:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787831025.384174:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204402580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1874676443908096:12345-0@lo:13:osp-pre-0-1.0 Request processed in 232us (739us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831025.384184:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:1.0:1787831025.384208:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787831025.384273:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204400f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1874676443908096:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787831025.386213:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787831025.386245:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676443908224:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787831025.386362:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831025.386424:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443908224 00000100:00100000:2.0:1787831025.386431:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443908224 00000100:00100000:2.0:1787831025.386493:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787831025.386502:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204400f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1874676443908224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787831025.386522:0:8409:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787831025.386579:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204400f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1874676443908224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831025.386586:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00080000:1.0:1787831025.389273:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787831025.389343:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676443908224:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787831025.639569:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787831025.809332:0:14918:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 07:43:45 (1787831025) 00000100:00100000:1.0:1787831025.896403:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676443908352:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787831025.896469:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831025.896554:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443908352 00000100:00100000:0.0:1787831025.896562:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443908352 00000100:00100000:0.0:1787831025.896604:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1787831025.896612:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204400780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1874676443908352:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787831025.896663:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000001:00080000:2.0:1787831025.899882:0:6469:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:2.0:1787831025.899896:0:6469:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:2.0:1787831025.899915:0:6522:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:2.0:1787831025.899923:0:6522:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00100000:0.0:1787831025.903875:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204400780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1874676443908352:12345-0@lo:41:osp-pre-1-0.0 Request processed in 7254us (7396us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831025.903892:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1787831025.904136:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676443908352:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787831026.409535:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787831026.409557:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204625e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1874676443908480:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787831026.409641:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831026.409711:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443908480 00000100:00100000:0.0:1787831026.409717:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443908480 00000100:00100000:0.0:1787831026.409754:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1787831026.409761:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204625a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1874676443908480:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787831026.409793:0:7448:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1787831026.409832:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204625a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1874676443908480:12345-0@lo:41:osp-pre-0-1.0 Request processed in 71us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831026.409839:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1787831026.409878:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204625e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1874676443908480:0@lo:41:osp-pre-0-1.0 00000040:00080000:2.0:1787831026.603240:0:13763:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1787831026.603413:0:13758:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787831026.603419:0:13758:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787831026.603522:0:13758:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:3.0:1787831026.603528:0:13758:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1787831026.662911:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787831027.430832:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22038f8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a45944b-32e3-4193-a2a5-46f84222bc14:3620:1874676443908608:0@lo:400:kworker.0 00000100:00100000:0.0:1787831027.430913:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831027.431061:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787831027.431069:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22038fb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3620:1874676443908992:0@lo:400:kworker.0 00000100:00100000:0.0:1787831027.431108:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831027.431148:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443908608 00000100:00100000:0.0:1787831027.431155:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443908608 00000100:00100000:0.0:1787831027.431202:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:0.0:1787831027.431212:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d231859c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+24:3620:x1874676443908608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787831027.431278:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d231859c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a45944b-32e3-4193-a2a5-46f84222bc14+24:3620:x1874676443908608:12345-0@lo:400:kworker.0 Request processed in 67us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831027.431286:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:0.0:1787831027.431331:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443908992 00000100:00100000:0.0:1787831027.431334:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443908992 00000100:00100000:0.0:1787831027.431391:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1787831027.431400:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2320751450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1874676443908992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787831027.431437:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2320751450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1874676443908992:12345-0@lo:400:kworker.0 Request processed in 40us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831027.431444:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1787831027.431858:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22038fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3621:1874676443908736:0@lo:400:kworker.0 00000100:00100000:2.0:1787831027.431895:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831027.432105:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787831027.432115:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22038f83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443908864:0@lo:400:kworker.0 00000100:00100000:2.0:1787831027.432145:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831027.432308:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443908736 00000100:00100000:1.0:1787831027.432314:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443908736 00000100:00100000:1.0:1787831027.432388:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1787831027.432397:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204704f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1874676443908736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787831027.432451:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204704f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1874676443908736:12345-0@lo:400:kworker.0 Request processed in 55us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831027.432459:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1787831027.432520:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443908864 00000100:00100000:1.0:1787831027.432577:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443908864 00000100:00100000:1.0:1787831027.432672:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1787831027.432683:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22047070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443908864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787831027.432725:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22047070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443908864:12345-0@lo:400:kworker.0 Request processed in 45us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831027.432732:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1787831027.432832:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22038f83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443908864:0@lo:400:kworker.0 00000100:00100000:1.0:1787831027.432852:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22038fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3621:1874676443908736:0@lo:400:kworker.0 00000100:00100000:0.0:1787831027.433481:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22047052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1874676443909120:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787831027.433518:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831027.433562:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22038fb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3620:1874676443908992:0@lo:400:kworker.0 00000100:00100000:0.0:1787831027.433573:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22038f8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a45944b-32e3-4193-a2a5-46f84222bc14:3620:1874676443908608:0@lo:400:kworker.0 00000100:00100000:2.0:1787831027.433956:0:11489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443909120 00000100:00100000:2.0:1787831027.433962:0:11489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443909120 00000100:00100000:2.0:1787831027.434017:0:11489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787831027.434027:0:11489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204625e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1874676443909120:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787831027.434030:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22038f9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3619:1874676443909504:0@lo:400:kworker.0 00002000:00000024:2.0:1787831027.434056:0:11489:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1787831027.434067:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831027.434090:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22038fa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3619:1874676443910016:0@lo:400:kworker.0 00000100:00100000:3.0:1787831027.434123:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831027.434145:0:11489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204625e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1874676443909120:12345-0@lo:13:osp-pre-1-1.0 Request processed in 118us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831027.434148:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787831027.434154:0:11489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787831027.434158:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22038f92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443909632:0@lo:400:kworker.0 00000100:00080000:2.0:1787831027.434182:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787831027.434187:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831027.434212:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22038f8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443910144:0@lo:400:kworker.0 00000100:00100000:3.0:1787831027.434231:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831027.434254:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22038fad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3622:1874676443909376:0@lo:400:kworker.0 00000100:00100000:3.0:1787831027.434275:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831027.434294:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22038fb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3622:1874676443909888:0@lo:400:kworker.0 00000100:00100000:3.0:1787831027.434313:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831027.434332:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787831027.434336:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22038fa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676443909248:0@lo:400:kworker.0 00000100:00100000:3.0:1787831027.434523:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831027.434550:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22038f8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676443909760:0@lo:400:kworker.0 00000100:00100000:3.0:1787831027.434576:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831027.434725:0:13771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443909504 00000100:00100000:3.0:1787831027.434729:0:13771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443909504 00000100:00100000:0.0:1787831027.434842:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22047052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1874676443909120:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787831027.435073:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220442cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443910272:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787831027.435278:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831027.435314:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443910272 00000100:00100000:1.0:1787831027.435318:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443910272 00000100:00100000:2.0:1787831027.435380:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443910016 00000100:00100000:2.0:1787831027.435384:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443910016 00000100:00100000:3.0:1787831027.435913:0:13771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443909376 00000100:00100000:3.0:1787831027.435918:0:13771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443909376 00000100:00100000:1.0:1787831027.436009:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787831027.436018:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204401e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1874676443910272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787831027.436036:0:8410:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1787831027.436097:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204401e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1874676443910272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (818us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831027.436106:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787831027.436108:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443909888 00000100:00100000:0.0:1787831027.436114:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443909888 00000100:00100000:0.0:1787831027.436145:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1787831027.436153:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22038fb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874676443909504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787831027.436173:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220442cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443910272:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787831027.436202:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22038fb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874676443909504:12345-0@lo:400:kworker.0 Request processed in 49us (2133us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831027.436210:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1787831027.436226:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1787831027.436232:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22038f8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1874676443909888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787831027.436259:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22038f8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1874676443909888:12345-0@lo:400:kworker.0 Request processed in 27us (1944us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831027.436264:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1787831027.436642:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1787831027.436731:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22038fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874676443910016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787831027.436853:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22038fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874676443910016:12345-0@lo:400:kworker.0 Request processed in 203us (2729us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831027.436861:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1787831027.436941:0:8631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443909632 00000100:00100000:2.0:1787831027.436947:0:8631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443909632 00000100:00100000:2.0:1787831027.436983:0:8631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443910144 00000100:00100000:2.0:1787831027.436987:0:8631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443910144 00000100:00100000:2.0:1787831027.437003:0:8631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443909760 00000100:00100000:2.0:1787831027.437006:0:8631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443909760 00000100:00100000:2.0:1787831027.437028:0:8631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787831027.437037:0:8631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22038f83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443909632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787831027.437143:0:8631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22038f83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443909632:12345-0@lo:400:kworker.0 Request processed in 107us (2956us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831027.437151:0:8631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787831027.437167:0:8631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787831027.437174:0:8631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22038f9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676443910144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787831027.437278:0:8631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22038f9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676443910144:12345-0@lo:400:kworker.0 Request processed in 104us (3045us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831027.437285:0:8631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787831027.437298:0:8631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787831027.437319:0:8631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220442d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3622:x1874676443909760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787831027.437356:0:8631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220442d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3622:x1874676443909760:12345-0@lo:400:kworker.0 Request processed in 40us (2779us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831027.437362:0:8631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00080000:2.0:1787831027.437469:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787831027.437474:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787831027.437476:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787831027.437479:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787831027.438002:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443909248 00000100:00100000:2.0:1787831027.438010:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443909248 00000100:00100000:2.0:1787831027.438046:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1787831027.438054:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220442e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1874676443909248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787831027.438638:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1787831027.438649:0:13771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22038f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1874676443909376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787831027.438725:0:13771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22038f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1874676443909376:12345-0@lo:400:kworker.0 Request processed in 79us (4449us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831027.438732:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1787831027.438796:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22038f8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676443909760:0@lo:400:kworker.0 00000100:00100000:3.0:1787831027.438811:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22038fad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3622:1874676443909376:0@lo:400:kworker.0 00000100:00100000:3.0:1787831027.438823:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22038fb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3622:1874676443909888:0@lo:400:kworker.0 00000100:00100000:3.0:1787831027.438858:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22038f92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443909632:0@lo:400:kworker.0 00000100:00100000:3.0:1787831027.438871:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22038f8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443910144:0@lo:400:kworker.0 00010000:00080000:3.0:1787831027.438885:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d22038f9680 x1874676443909504/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787831043 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787831027.438896:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22038f9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3619:1874676443909504:0@lo:400:kworker.0 00010000:00080000:3.0:1787831027.438906:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d22038fa1c0 x1874676443910016/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787831043 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787831027.438914:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22038fa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3619:1874676443910016:0@lo:400:kworker.0 00000100:00100000:2.0:1787831027.440147:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220442e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1874676443909248:12345-0@lo:400:kworker.0 Request processed in 2088us (5778us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831027.440160:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1787831027.440469:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22038fa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676443909248:0@lo:400:kworker.0 00010000:00010000:1.0:1787831027.686892:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787831028.458817:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831028.459088:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433397504 00000100:00100000:2.0:1787831028.459099:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433397504 00000100:00100000:2.0:1787831028.459217:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 66 00000100:00100000:2.0:1787831028.459228:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204624780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+18:13151:x1874676433397504:12345-192.168.203.31@tcp:35:umount.0 00000100:00100000:2.0:1787831028.459501:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204624780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+19:13151:x1874676433397504:12345-192.168.203.31@tcp:35:umount.0 Request processed in 275us (695us total) trans 4294967523 rc 0/0 00000100:00100000:2.0:1787831028.459508:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 66 00000100:00080000:3.0:1787831028.459566:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787831028.465064:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831028.465364:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433397760 00000100:00100000:1.0:1787831028.465374:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433397760 00000100:00100000:1.0:1787831028.465434:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 67 00000100:00100000:1.0:1787831028.465445:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204626940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+19:13151:x1874676433397760:12345-192.168.203.31@tcp:35:umount.0 00000100:00100000:1.0:1787831028.465821:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204626940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+20:13151:x1874676433397760:12345-192.168.203.31@tcp:35:umount.0 Request processed in 377us (767us total) trans 4294967524 rc 0/0 00000100:00100000:1.0:1787831028.465830:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 67 00000100:00100000:0.0:1787831028.471738:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831028.471905:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433398016 00000100:00100000:1.0:1787831028.471918:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433398016 00000100:00100000:1.0:1787831028.472002:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 68 00000100:00100000:1.0:1787831028.472014:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d23066c8050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+20:13151:x1874676433398016:12345-192.168.203.31@tcp:35:umount.0 00000100:00100000:1.0:1787831028.472355:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d23066c8050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+21:13151:x1874676433398016:12345-192.168.203.31@tcp:35:umount.0 Request processed in 342us (634us total) trans 4294967525 rc 0/0 00000100:00100000:1.0:1787831028.472363:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 68 00000100:00100000:0.0:1787831028.475984:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831028.476283:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433398272 00000100:00100000:1.0:1787831028.476294:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433398272 00000100:00100000:1.0:1787831028.476546:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 69 00000100:00100000:1.0:1787831028.476557:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204624780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+21:13151:x1874676433398272:12345-192.168.203.31@tcp:35:umount.0 00000100:00100000:1.0:1787831028.477548:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204624780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+22:13151:x1874676433398272:12345-192.168.203.31@tcp:35:umount.0 Request processed in 990us (1571us total) trans 4294967526 rc 0/0 00000100:00100000:1.0:1787831028.477560:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 69 00000100:00100000:0.0:1787831028.481261:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831028.481297:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831028.481327:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831028.481400:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433398528 00000100:00100000:3.0:1787831028.481409:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433398528 00000100:00100000:2.0:1787831028.481427:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433398400 00000100:00100000:2.0:1787831028.481434:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433398400 00000100:00100000:1.0:1787831028.481473:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433398656 00000100:00100000:1.0:1787831028.481480:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433398656 00000100:00100000:2.0:1787831028.481484:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 20 00000100:00100000:2.0:1787831028.481496:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204626940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+15:2396:x1874676433398528:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787831028.481512:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787831028.481545:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d233bf10800/0x95459fb9d1d287eb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423c1e expref: 15 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831028.481563:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787831028.481612:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204626940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+14:2396:x1874676433398528:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 120us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831028.483256:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 21 00000100:00100000:3.0:1787831028.483317:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204627480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+14:2397:x1874676433398400:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787831028.483336:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787831028.483368:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d233bf11800/0x95459fb9d1d288e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423c5d expref: 14 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831028.483387:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787831028.483434:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204627480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+13:2397:x1874676433398400:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 152us (2134us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831028.483443:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 21 00000100:00100000:3.0:1787831028.483481:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 22 00000100:00100000:3.0:1787831028.483490:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204624000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+12:2397:x1874676433398656:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787831028.483499:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787831028.483510:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d233be94400/0x95459fb9d1d28baa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423d36 expref: 12 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831028.483520:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787831028.483547:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204624000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+11:2397:x1874676433398656:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 59us (2219us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831028.483553:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 22 00000100:00100000:1.0:1787831028.484526:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831028.484641:0:8631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433399040 00000100:00100000:3.0:1787831028.484648:0:8631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433399040 00000100:00100000:2.0:1787831028.484693:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 20 00000100:00100000:3.0:1787831028.484714:0:8631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 81 00000100:00100000:3.0:1787831028.484724:0:8631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204401a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+7:2393:x1874676433399040:12345-192.168.203.31@tcp:9:umount.0 00000020:00000080:3.0:1787831028.484752:0:8631:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x95459fb9d1d28eeb 00000020:00010000:3.0:1787831028.484760:0:8631:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8d232029c000: total 0 00000100:00080000:3.0:1787831028.484764:0:8631:0:(import.c:65:import_set_state_nolock()) ffff8d232029f800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787831028.484815:0:8631:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00080000:1.0:1787831028.484964:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787831028.484971:0:8631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204401a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:2393:x1874676433399040:12345-192.168.203.31@tcp:9:umount.0 Request processed in 247us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831028.484980:0:8631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 81 00000020:00010000:2.0:1787831028.485012:0:6478:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8d232029c000: total 0 00010000:00010000:2.0:1787831028.485062:0:6478:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8d232029c000, canceled 0 locks, left on hash table 2. 00010000:00010000:2.0:1787831028.485117:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000030a0b447/0x95459fb9d1d29979 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424103 expref: 4 pid: 8407 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831028.485151:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cb7b975b/0x95459fb9d1d292aa lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f20 expref: 3 pid: 8631 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831028.485166:0:6478:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8d232029c000, canceled 2 locks, left on hash table 0. 00010000:00010000:2.0:1787831028.485179:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787831028.485182:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787831028.485184:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787831028.489261:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831028.489385:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433399168 00000100:00100000:0.0:1787831028.489399:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433399168 00000100:00100000:0.0:1787831028.489531:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 82 00000100:00080000:1.0:1787831028.489535:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787831028.489545:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220442d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:2393:x1874676433399168:12345-192.168.203.31@tcp:9:umount.0 00000020:00000080:0.0:1787831028.489576:0:8407:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x95459fb9d1d28c7c 00000100:00080000:0.0:1787831028.489586:0:8407:0:(import.c:65:import_set_state_nolock()) ffff8d233bda4000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787831028.489674:0:8407:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:0.0:1787831028.489837:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220442d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+2:2393:x1874676433399168:12345-192.168.203.31@tcp:9:umount.0 Request processed in 296us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831028.489845:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 82 00010000:00010000:3.0:1787831028.489941:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787831028.500276:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831028.500379:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433400192 00000100:00100000:1.0:1787831028.500392:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433400192 00000100:00100000:1.0:1787831028.500463:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 257 00000100:00100000:1.0:1787831028.500472:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220442c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+22:2393:x1874676433400192:12345-192.168.203.31@tcp:39:umount.0 00000020:00000080:1.0:1787831028.500506:0:6491:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x95459fb9d1d287f9 00000020:00010000:1.0:1787831028.500525:0:6491:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8d2203517000: total 0 00000100:00080000:1.0:1787831028.500531:0:6491:0:(import.c:65:import_set_state_nolock()) ffff8d2203515000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787831028.500569:0:6491:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000020:00010000:2.0:1787831028.500604:0:7431:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8d2203517000: total 0 00000100:00100000:1.0:1787831028.500774:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220442c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47d7f0ed-283f-4b70-a741-6e74c5e52619+21:2393:x1874676433400192:12345-192.168.203.31@tcp:39:umount.0 Request processed in 301us (513us total) trans 4294967527 rc 0/0 00010000:00010000:2.0:1787831028.500778:0:7431:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8d2203517000, canceled 0 locks, left on hash table 13. 00000100:00100000:1.0:1787831028.500784:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 257 00010000:00010000:2.0:1787831028.500817:0:7431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d2318594f00) 00010000:00010000:2.0:1787831028.500822:0:7431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787831028.500832:0:7431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3400/0x95459fb9d1d29295 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f19 expref: 20 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831028.500867:0:7431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d2203615700) 00010000:00010000:2.0:1787831028.500871:0:7431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787831028.501100:0:7431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76a00/0x95459fb9d1d28f4d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423e39 expref: 19 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831028.501123:0:7431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d2318594400) 00010000:00010000:2.0:1787831028.501126:0:7431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787831028.501132:0:7431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76c00/0x95459fb9d1d28bf7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423d4b expref: 18 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831028.501205:0:7431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d2309e00800) 00010000:00010000:2.0:1787831028.501208:0:7431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787831028.501213:0:7431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2e00/0x95459fb9d1d2985a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994240b6 expref: 17 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831028.501227:0:7431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d233a6f8e00) 00010000:00010000:2.0:1787831028.501230:0:7431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787831028.501234:0:7431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0400/0x95459fb9d1d2932f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f43 expref: 16 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831028.501245:0:7431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d2318594f00) 00010000:00010000:2.0:1787831028.501248:0:7431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787831028.501252:0:7431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6e00/0x95459fb9d1d2918b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423ed3 expref: 15 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831028.501275:0:7431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8d2203615100) 00010000:00010000:2.0:1787831028.501278:0:7431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787831028.501282:0:7431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0600/0x95459fb9d1d28bdb lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423d44 expref: 14 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831028.501299:0:7431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d2309e00800) 00010000:00010000:2.0:1787831028.501308:0:7431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787831028.501313:0:7431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6000/0x95459fb9d1d2993a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994240ee expref: 13 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831028.501329:0:7431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d2309e00800) 00010000:00010000:2.0:1787831028.501332:0:7431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787831028.501335:0:7431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2800/0x95459fb9d1d29964 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994240fc expref: 12 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831028.501349:0:7431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d2203615700) 00010000:00010000:2.0:1787831028.501351:0:7431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787831028.501354:0:7431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76200/0x95459fb9d1d28c52 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423d60 expref: 11 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831028.501366:0:7431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d233a6f8e00) 00010000:00010000:2.0:1787831028.501368:0:7431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787831028.501371:0:7431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3e00/0x95459fb9d1d2961c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a9942401c expref: 10 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831028.501382:0:7431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2303e42700) 00010000:00010000:2.0:1787831028.501384:0:7431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787831028.501387:0:7431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1600/0x95459fb9d1d29313 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f3c expref: 9 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831028.501396:0:7431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d2318594f00) 00010000:00010000:2.0:1787831028.501398:0:7431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787831028.501401:0:7431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2c00/0x95459fb9d1d2926b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423f0b expref: 8 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831028.501425:0:7431:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8d2203517000, canceled 13 locks, left on hash table 0. 00010000:00010000:2.0:1787831028.501442:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787831028.501445:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787831028.501449:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787831028.514716:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831028.514824:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433400320 00000100:00100000:3.0:1787831028.514832:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433400320 00000100:00100000:3.0:1787831028.514903:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 258 00000100:00100000:3.0:1787831028.514914:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204402940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+5:2393:x1874676433400320:12345-192.168.203.31@tcp:39:umount.0 00000020:00000080:3.0:1787831028.514945:0:6490:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x95459fb9d1d28800 00000100:00080000:3.0:1787831028.514961:0:6490:0:(import.c:65:import_set_state_nolock()) ffff8d2203606800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787831028.514984:0:6490:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1787831028.515422:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204402940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47d7f0ed-283f-4b70-a741-6e74c5e52619+3:2393:x1874676433400320:12345-192.168.203.31@tcp:39:umount.0 Request processed in 508us (713us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1787831028.515431:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 258 00000100:00080000:1.0:1787831028.515518:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1787831028.515583:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787831028.711070:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787831028.819877:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831028.819928:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831028.820195:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433400448 00000100:00100000:2.0:1787831028.820205:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433400448 00000100:00100000:1.0:1787831028.820260:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433400576 00000100:00100000:1.0:1787831028.820266:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433400576 00000100:00100000:2.0:1787831028.820352:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 271 00000100:00100000:2.0:1787831028.820363:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22046243c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c901c2b2-479b-44dc-8fa8-34fbacf02f07+6:2394:x1874676433400448:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1787831028.820437:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22046243c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c901c2b2-479b-44dc-8fa8-34fbacf02f07+6:2394:x1874676433400448:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 76us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831028.820444:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 271 00000100:00100000:1.0:1787831028.820590:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 272 00000100:00100000:1.0:1787831028.820615:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204627c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c901c2b2-479b-44dc-8fa8-34fbacf02f07+5:2394:x1874676433400576:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1787831028.820750:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204627c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c901c2b2-479b-44dc-8fa8-34fbacf02f07+5:2394:x1874676433400576:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 138us (821us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831028.820758:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 272 00000100:00080000:3.0:1787831028.820802:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787831028.820808:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787831029.583321:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831029.583358:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831029.583394:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831029.583469:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433400832 00000100:00100000:1.0:1787831029.583478:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433400832 00000100:00100000:1.0:1787831029.583531:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433401088 00000100:00100000:1.0:1787831029.583534:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433401088 00000100:00100000:1.0:1787831029.583548:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433400960 00000100:00100000:1.0:1787831029.583550:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433400960 00000100:00100000:1.0:1787831029.583565:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 23 00000100:00100000:1.0:1787831029.583574:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2305ff8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+12:2396:x1874676433400832:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787831029.583589:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787831029.583660:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d233bf11600/0x95459fb9d1d289b2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423c72 expref: 12 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831029.583680:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787831029.583732:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2305ff8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+11:2396:x1874676433400832:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 159us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831029.583745:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 23 00000100:00100000:1.0:1787831029.583790:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 24 00000100:00100000:1.0:1787831029.583797:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22046252c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+10:2396:x1874676433401088:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787831029.583805:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787831029.583814:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d233be94e00/0x95459fb9d1d28ba3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423d2f expref: 10 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831029.583823:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787831029.583848:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22046252c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+9:2396:x1874676433401088:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 52us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831029.583854:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 24 00000100:00100000:3.0:1787831029.584377:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 25 00000100:00100000:3.0:1787831029.584387:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204624f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+8:2396:x1874676433400960:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787831029.584396:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787831029.584405:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d233bf10a00/0x95459fb9d1d289b9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423ca3 expref: 8 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831029.584416:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787831029.584435:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204624f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+7:2396:x1874676433400960:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 51us (1040us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831029.584447:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 25 00000100:00100000:3.0:1787831029.585104:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831029.585130:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433401216 00000100:00100000:3.0:1787831029.585136:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433401216 00000100:00100000:3.0:1787831029.585167:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 259 00000100:00100000:3.0:1787831029.585173:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220442f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c901c2b2-479b-44dc-8fa8-34fbacf02f07+6:2393:x1874676433401216:12345-192.168.203.31@tcp:39:umount.0 00000020:00000080:3.0:1787831029.585202:0:6490:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x95459fb9d1d289c7 00000020:00010000:3.0:1787831029.585209:0:6490:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8d233f524000: total 0 00000100:00080000:3.0:1787831029.585214:0:6490:0:(import.c:65:import_set_state_nolock()) ffff8d233f525800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787831029.585234:0:6490:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00100000:3.0:1787831029.585345:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220442f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c901c2b2-479b-44dc-8fa8-34fbacf02f07+5:2393:x1874676433401216:12345-192.168.203.31@tcp:39:umount.0 Request processed in 172us (244us total) trans 4294967528 rc 0/0 00000100:00100000:3.0:1787831029.585351:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 259 00000020:00010000:3.0:1787831029.585387:0:7431:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8d233f524000: total 0 00010000:00010000:3.0:1787831029.585390:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787831029.585429:0:7431:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8d233f524000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1787831029.585456:0:7431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2303e42700) 00010000:00010000:3.0:1787831029.585459:0:7431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787831029.585465:0:7431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77600/0x95459fb9d1d29987 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a9942410a expref: 4 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831029.585486:0:7431:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8d233f524000, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1787831029.585496:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787831029.585498:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787831029.585499:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787831029.592490:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831029.592529:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433401344 00000100:00100000:0.0:1787831029.592539:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433401344 00000100:00100000:0.0:1787831029.592637:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 260 00000100:00100000:0.0:1787831029.592657:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204626580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c901c2b2-479b-44dc-8fa8-34fbacf02f07+5:2393:x1874676433401344:12345-192.168.203.31@tcp:39:umount.0 00000020:00000080:0.0:1787831029.593729:0:8620:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x95459fb9d1d289ce 00000100:00080000:0.0:1787831029.593742:0:8620:0:(import.c:65:import_set_state_nolock()) ffff8d2202a81000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787831029.593778:0:8620:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1787831029.594481:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204626580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c901c2b2-479b-44dc-8fa8-34fbacf02f07+3:2393:x1874676433401344:12345-192.168.203.31@tcp:39:umount.0 Request processed in 1822us (1997us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1787831029.594492:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 260 00010000:00010000:2.0:1787831029.595812:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787831029.623583:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831029.623815:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433401600 00000100:00100000:2.0:1787831029.623824:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433401600 00000100:00100000:2.0:1787831029.623920:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 375 00000100:00100000:2.0:1787831029.623932:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d231859c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+7:2393:x1874676433401600:12345-192.168.203.31@tcp:251:umount.0 00000020:00000080:2.0:1787831029.623977:0:6485:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x95459fb9d1d287d6 00000020:00010000:2.0:1787831029.623985:0:6485:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8d2203511000: total 0 00000100:00080000:2.0:1787831029.623989:0:6485:0:(import.c:65:import_set_state_nolock()) ffff8d2203514800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1787831029.624065:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d231859c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:507e0a9e-e0a5-4f06-89fa-c916e7c0c1da+3:2393:x1874676433401600:12345-192.168.203.31@tcp:251:umount.0 Request processed in 136us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831029.624073:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 375 00000020:00010000:3.0:1787831029.624138:0:6479:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8d2203511000: total 0 00010000:00010000:3.0:1787831029.624206:0:6479:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8d2203511000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1787831029.624255:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d233837a000/0x95459fb9d1d288e7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99423c64 expref: 2 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831029.624271:0:6479:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8d2203511000, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1787831029.624282:0:6479:0:(genops.c:885:class_export_put()) final put ffff8d2203511000/507e0a9e-e0a5-4f06-89fa-c916e7c0c1da 00010000:00010000:3.0:1787831029.624300:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787831029.624302:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787831029.624304:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787831029.624330:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2203511000/507e0a9e-e0a5-4f06-89fa-c916e7c0c1da for MGS 00000020:00000080:1.0:1787831029.624372:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d2203514800 for MGS 00010000:00010000:3.0:1787831029.735373:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787831030.502778:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204403c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676443910400:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787831030.502960:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443910528:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787831030.505087:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831030.505261:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443910400 00000100:00100000:2.0:1787831030.505271:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443910400 00000100:00100000:2.0:1787831030.505335:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787831030.505344:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a21680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676443910400:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787831030.505387:0:8409:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787831030.505452:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a21680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676443910400:12345-0@lo:13:osp-pre-0-1.0 Request processed in 101us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831030.505459:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00080000:1.0:1787831030.505552:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787831030.505588:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204403c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676443910400:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787831030.508384:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831030.508467:0:11489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443910528 00000100:00100000:3.0:1787831030.508476:0:11489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443910528 00000100:00100000:3.0:1787831030.508542:0:11489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1787831030.508552:0:11489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220442cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676443910528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787831030.508576:0:11489:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787831030.508648:0:11489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220442cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676443910528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831030.508656:0:11489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1787831030.508723:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443910528:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787831030.512263:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787831030.760125:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787831030.832975:0:15113:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1787831030.851420:0:15113:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1787831030.851470:0:15113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233be95c00/0x95459fb9d1d28942 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d28949 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831030.851484:0:15113:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233be95c00/0x95459fb9d1d28942 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d28949 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831030.851492:0:15113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233be95c00/0x95459fb9d1d28942 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x95459fb9d1d28949 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831030.851498:0:15113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.131@tcp lock: ffff8d233be95c00/0x95459fb9d1d28942 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x95459fb9d1d28949 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831030.851519:0:15113:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787831030.851524:0:15113:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1787831030.851545:0:15113:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787831030.851548:0:15113:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787831030.851553:0:15113:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787831030.851573:0:15113:0:(import.c:65:import_set_state_nolock()) ffff8d232b964000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1787831030.851656:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787831030.851664:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8d233be95c00/0x95459fb9d1d28942 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x95459fb9d1d28949 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831030.851672:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233be95c00 already unused, calling callback (ffffffffc14f9c20) 10000000:00010000:2.0:1787831030.851675:0:6479:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8d233be95c00/0x95459fb9d1d28942 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x95459fb9d1d28949 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831030.851683:0:6479:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8d233be95c00/0x95459fb9d1d28942 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x95459fb9d1d28949 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787831030.851691:0:6479:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8d233be95c00/0x95459fb9d1d28942 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x95459fb9d1d28949 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787831030.851697:0:6479:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787831030.851700:0:6479:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1787831030.851702:0:6479:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1787831030.851726:0:6479:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8d233be95c00/0x95459fb9d1d28942 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x95459fb9d1d28949 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831030.851732:0:6479:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787831030.851752:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8d233be95c00/0x95459fb9d1d28942 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x95459fb9d1d28949 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831030.851759:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8d233be95c00/0x95459fb9d1d28942 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x95459fb9d1d28949 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787831030.851761:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:2.0:1787831030.851782:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787831030.851784:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787831030.851787:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787831030.851788:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a45944b-32e3-4193-a2a5-46f84222bc14:3619:1874676443910784:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787831030.851800:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22046261c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874676443910656:0@lo:39:umount.0 00000100:00100000:3.0:1787831030.852019:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831030.852054:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831030.852103:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443910656 00000100:00100000:2.0:1787831030.852109:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443910656 00000100:00100000:0.0:1787831030.852162:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443910784 00000100:00100000:0.0:1787831030.852165:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443910784 00000100:00100000:0.0:1787831030.852195:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787831030.852202:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203afe940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a45944b-32e3-4193-a2a5-46f84222bc14+24:3619:x1874676443910784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787831030.852214:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787831030.852239:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d233837a800/0x95459fb9d1d28949 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x95459fb9d1d28942 expref: 24 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831030.852251:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787831030.852286:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203afe940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a45944b-32e3-4193-a2a5-46f84222bc14+23:3619:x1874676443910784:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831030.852293:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787831030.852369:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1787831030.852378:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204707840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874676443910656:12345-0@lo:39:umount.0 00000020:00000080:2.0:1787831030.852400:0:6492:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x95459fb9d1d284a3 00000100:00080000:2.0:1787831030.852407:0:6492:0:(import.c:65:import_set_state_nolock()) ffff8d232f733000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1787831030.852453:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204707840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3618:x1874676443910656:12345-0@lo:39:umount.0 Request processed in 77us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831030.852460:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00010000:00010000:3.0:1787831030.852465:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787831030.852469:0:6492:0:(genops.c:885:class_export_put()) final put ffff8d232f737000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1787831030.852495:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d232f737000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000100:00100000:3.0:1787831030.852496:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a45944b-32e3-4193-a2a5-46f84222bc14:3619:1874676443910784:0@lo:103:ldlm_bl.0 00000020:00000080:2.0:1787831030.852540:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d232f733000 for lustre-MDT0000 00000100:00080000:2.0:1787831030.852560:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8d232b964000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1787831030.853584:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22046261c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874676443910656:0@lo:39:umount.0 00000100:00080000:3.0:1787831030.853675:0:15113:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787831030.853679:0:15113:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787831030.853683:0:15113:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1787831030.856307:0:15113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233be94600/0x95459fb9d1d28950 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d28957 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831030.856765:0:15113:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233be94600/0x95459fb9d1d28950 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d28957 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831030.856774:0:15113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233be94600/0x95459fb9d1d28950 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x95459fb9d1d28957 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831030.856795:0:15113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.131@tcp lock: ffff8d233be94600/0x95459fb9d1d28950 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x95459fb9d1d28957 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831030.856817:0:15113:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787831030.856824:0:15113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233bf11e00/0x95459fb9d1d28877 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2887e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831030.856831:0:15113:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233bf11e00/0x95459fb9d1d28877 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d2887e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831030.856842:0:15113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233bf11e00/0x95459fb9d1d28877 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x95459fb9d1d2887e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831030.856849:0:15113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.131@tcp lock: ffff8d233bf11e00/0x95459fb9d1d28877 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x95459fb9d1d2887e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831030.856857:0:15113:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787831030.856863:0:15113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233be94000/0x95459fb9d1d28b95 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d28b9c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831030.856870:0:15113:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233be94000/0x95459fb9d1d28b95 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d28b9c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831030.856877:0:15113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233be94000/0x95459fb9d1d28b95 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x95459fb9d1d28b9c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831030.856883:0:15113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.131@tcp lock: ffff8d233be94000/0x95459fb9d1d28b95 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x95459fb9d1d28b9c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831030.856903:0:15113:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1787831030.856967:0:7431:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787831030.856976:0:7431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8d233be94600/0x95459fb9d1d28950 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x95459fb9d1d28957 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831030.856986:0:7431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233be94600 already unused, calling callback (ffffffffc14f9c20) 10000000:00010000:3.0:1787831030.856991:0:7431:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8d233be94600/0x95459fb9d1d28950 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x95459fb9d1d28957 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831030.857000:0:7431:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8d233be94600/0x95459fb9d1d28950 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x95459fb9d1d28957 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787831030.857009:0:7431:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8d233be94600/0x95459fb9d1d28950 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x95459fb9d1d28957 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787831030.857016:0:7431:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787831030.857019:0:7431:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:3.0:1787831030.857061:0:7431:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8d233be94600/0x95459fb9d1d28950 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x95459fb9d1d28957 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831030.857068:0:7431:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787831030.857092:0:7431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8d233be94600/0x95459fb9d1d28950 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x95459fb9d1d28957 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831030.857100:0:7431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8d233be94600/0x95459fb9d1d28950 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x95459fb9d1d28957 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831030.857114:0:7431:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787831030.857124:0:7431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8d233bf11e00/0x95459fb9d1d28877 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x95459fb9d1d2887e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831030.857130:0:7431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233bf11e00 already unused, calling callback (ffffffffc14f9c20) 00010000:00010000:0.0:1787831030.857236:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787831030.857242:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8d233be94000/0x95459fb9d1d28b95 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x95459fb9d1d28b9c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831030.857250:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233be94000 already unused, calling callback (ffffffffc14f9c20) 10000000:00010000:0.0:1787831030.857253:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8d233be94000/0x95459fb9d1d28b95 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x95459fb9d1d28b9c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831030.857261:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8d233be94000/0x95459fb9d1d28b95 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x95459fb9d1d28b9c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787831030.857268:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8d233be94000/0x95459fb9d1d28b95 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x95459fb9d1d28b9c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787831030.857273:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1787831030.857276:0:6478:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1787831030.857278:0:6478:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1787831030.857297:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8d233be94000/0x95459fb9d1d28b95 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x95459fb9d1d28b9c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831030.857315:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787831030.857323:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8d233be94000/0x95459fb9d1d28b95 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x95459fb9d1d28b9c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831030.857330:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8d233be94000/0x95459fb9d1d28b95 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x95459fb9d1d28b9c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831030.857347:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787831030.857348:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787831030.857350:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:3.0:1787831030.857609:0:7431:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8d233bf11e00/0x95459fb9d1d28877 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x95459fb9d1d2887e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831030.857620:0:7431:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8d233bf11e00/0x95459fb9d1d28877 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x95459fb9d1d2887e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787831030.857656:0:7431:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8d233bf11e00/0x95459fb9d1d28877 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x95459fb9d1d2887e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787831030.858226:0:7431:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1787831030.858229:0:7431:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1787831030.858232:0:7431:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1787831030.858271:0:7431:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8d233bf11e00/0x95459fb9d1d28877 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x95459fb9d1d2887e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831030.858279:0:7431:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787831030.858313:0:7431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8d233bf11e00/0x95459fb9d1d28877 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x95459fb9d1d2887e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831030.858320:0:7431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8d233bf11e00/0x95459fb9d1d28877 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x95459fb9d1d2887e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831030.858334:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787831030.858337:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787831030.858339:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787831030.858367:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203afc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a45944b-32e3-4193-a2a5-46f84222bc14:3621:1874676443910912:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787831030.858401:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203afe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a45944b-32e3-4193-a2a5-46f84222bc14:3619:1874676443911168:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787831030.858441:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831030.858521:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443910912 00000100:00100000:0.0:1787831030.858528:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443910912 00000100:00100000:3.0:1787831030.858531:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787831030.858540:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204625680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a45944b-32e3-4193-a2a5-46f84222bc14:3621:1874676443911040:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787831030.858567:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831030.858580:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443911040 00000100:00100000:0.0:1787831030.858585:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443911040 00000100:00100000:3.0:1787831030.858608:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831030.858617:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787831030.858654:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203aff840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2a45944b-32e3-4193-a2a5-46f84222bc14+24:3621:x1874676443910912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787831030.858668:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787831030.858686:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d233837a600/0x95459fb9d1d28957 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x95459fb9d1d28950 expref: 24 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787831030.858698:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443911168 00010000:00010000:0.0:1787831030.858701:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787831030.858704:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443911168 00000100:00100000:3.0:1787831030.858739:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787831030.858748:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203afed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a45944b-32e3-4193-a2a5-46f84222bc14+24:3621:x1874676443911040:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787831030.858753:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203aff840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2a45944b-32e3-4193-a2a5-46f84222bc14+24:3621:x1874676443910912:12345-0@lo:103:ldlm_bl.0 Request processed in 100us (310us total) trans 0 rc 0/0 00010000:00010000:3.0:1787831030.858760:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1787831030.858764:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:3.0:1787831030.858776:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d233be95400/0x95459fb9d1d28b9c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x95459fb9d1d28b95 expref: 24 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831030.858792:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787831030.858792:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787831030.858804:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203afd680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2a45944b-32e3-4193-a2a5-46f84222bc14+22:3619:x1874676443911168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787831030.858813:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787831030.858825:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2307c76800/0x95459fb9d1d2887e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x95459fb9d1d28877 expref: 22 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787831030.858832:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203afed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a45944b-32e3-4193-a2a5-46f84222bc14+22:3621:x1874676443911040:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (261us total) trans 0 rc 0/0 00010000:00010000:0.0:1787831030.858839:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787831030.858844:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:3.0:1787831030.858871:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787831030.858905:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204625680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a45944b-32e3-4193-a2a5-46f84222bc14:3621:1874676443911040:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787831030.859208:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203afd680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2a45944b-32e3-4193-a2a5-46f84222bc14+20:3619:x1874676443911168:12345-0@lo:103:ldlm_bl.0 Request processed in 406us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831030.859227:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787831030.860109:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203afc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a45944b-32e3-4193-a2a5-46f84222bc14:3621:1874676443910912:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787831030.860471:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203afe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a45944b-32e3-4193-a2a5-46f84222bc14:3619:1874676443911168:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787831030.860693:0:15113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d2301669c00/0x95459fb9d1d28402 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d28409 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831030.860710:0:15113:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d2301669c00/0x95459fb9d1d28402 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d28409 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831030.860719:0:15113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d2301669c00/0x95459fb9d1d28402 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x95459fb9d1d28409 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831030.860725:0:15113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.131@tcp lock: ffff8d2301669c00/0x95459fb9d1d28402 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x95459fb9d1d28409 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831030.860752:0:15113:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787831030.860759:0:15113:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:2.0:1787831030.860763:0:15113:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:2.0:1787831030.860798:0:15113:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1787831030.860803:0:15113:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1787831030.860807:0:15113:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787831030.860814:0:15113:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:2.0:1787831030.860821:0:15113:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8d233f438800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787831030.860827:0:15113:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8d232f72e000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787831030.860832:0:15113:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8d232f6b4800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787831030.860836:0:15113:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8d232f6b2800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000020:00080000:2.0:1787831030.860843:0:15113:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff8d233f524000 c901c2b2-479b-44dc-8fa8-34fbacf02f07 192.168.203.31@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787831030.860848:0:15113:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff8d2203517000 47d7f0ed-283f-4b70-a741-6e74c5e52619 192.168.203.31@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967522 stale:0 00000020:00080000:2.0:1787831030.860864:0:15113:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff8d23088a3370) has exports, disconnecting them 00000020:00080000:2.0:1787831030.860869:0:15113:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8d233f438800), last request at 1787831027 00000020:00000080:2.0:1787831030.860876:0:15113:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x95459fb9d1d287b3 00000100:00080000:2.0:1787831030.860894:0:15113:0:(import.c:65:import_set_state_nolock()) ffff8d2203604800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1787831030.860942:0:15113:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d233f438800): rc 0 00000020:00000080:2.0:1787831030.860945:0:15113:0:(genops.c:885:class_export_put()) final put ffff8d233f438800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1787831030.860951:0:15113:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8d232f72e000), last request at 1787831027 00000020:00000080:2.0:1787831030.860954:0:15113:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x95459fb9d1d2868d 00000100:00080000:2.0:1787831030.860959:0:15113:0:(import.c:65:import_set_state_nolock()) ffff8d232f728800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1787831030.860969:0:15113:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d232f72e000): rc 0 00000020:00000080:2.0:1787831030.860971:0:15113:0:(genops.c:885:class_export_put()) final put ffff8d232f72e000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:2.0:1787831030.860975:0:15113:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8d232f6b4800), last request at 1787830857 00000020:00000080:2.0:1787831030.860977:0:15113:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x95459fb9d1d2858a 00000100:00080000:2.0:1787831030.860980:0:15113:0:(import.c:65:import_set_state_nolock()) ffff8d232f6b3000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1787831030.860985:0:15113:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d232f6b4800): rc 0 00000020:00000080:2.0:1787831030.860986:0:15113:0:(genops.c:885:class_export_put()) final put ffff8d232f6b4800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:2.0:1787831030.860989:0:15113:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8d232f6b2800), last request at 1787830857 00000020:00000080:2.0:1787831030.860992:0:15113:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x95459fb9d1d28559 00000100:00080000:2.0:1787831030.860995:0:15113:0:(import.c:65:import_set_state_nolock()) ffff8d232f6b7000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787831030.861001:0:15113:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00010000:00010000:3.0:1787831030.861045:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787831030.861054:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8d2301669c00/0x95459fb9d1d28402 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x95459fb9d1d28409 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831030.861063:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2301669c00 already unused, calling callback (ffffffffc14f9c20) 10000000:00010000:3.0:1787831030.861067:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8d2301669c00/0x95459fb9d1d28402 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x95459fb9d1d28409 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1787831030.861081:0:15113:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d232f6b2800): rc 0 00000004:00000080:2.0:1787831030.861091:0:15113:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffae38c85ffae0 00010000:00010000:3.0:1787831030.861092:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8d2301669c00/0x95459fb9d1d28402 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x95459fb9d1d28409 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787831030.861102:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8d2301669c00/0x95459fb9d1d28402 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x95459fb9d1d28409 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787831030.861107:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1787831030.861110:0:6478:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 00000100:00080000:2.0:1787831030.861112:0:15113:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 10000000:01000000:3.0:1787831030.861113:0:6478:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00000100:00100000:2.0:1787831030.861118:0:15113:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00010000:00010000:3.0:1787831030.861450:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8d2301669c00/0x95459fb9d1d28402 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x95459fb9d1d28409 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831030.861459:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787831030.861479:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8d2301669c00/0x95459fb9d1d28402 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x95459fb9d1d28409 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831030.861486:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8d2301669c00/0x95459fb9d1d28402 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x95459fb9d1d28409 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831030.861496:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787831030.861498:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787831030.861500:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787831030.861515:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203afe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a45944b-32e3-4193-a2a5-46f84222bc14:3620:1874676443911296:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787831030.861571:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787831030.861620:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787831030.861673:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443911296 00000100:00100000:3.0:1787831030.861678:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443911296 00000100:00100000:3.0:1787831030.861720:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787831030.861729:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2305ff9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a45944b-32e3-4193-a2a5-46f84222bc14+20:3620:x1874676443911296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787831030.861750:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787831030.861763:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d233837b400/0x95459fb9d1d28409 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x95459fb9d1d28402 expref: 20 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831030.861775:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787831030.861821:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2305ff9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a45944b-32e3-4193-a2a5-46f84222bc14+19:3620:x1874676443911296:12345-0@lo:103:ldlm_bl.0 Request processed in 94us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831030.861829:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787831030.861896:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203afe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a45944b-32e3-4193-a2a5-46f84222bc14:3620:1874676443911296:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787831030.861913:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787831030.862039:0:15113:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1787831030.862055:0:15113:0:(import.c:65:import_set_state_nolock()) ffff8d233bc5c000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000020:00000080:0.0:1787831030.862246:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d233f438800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1787831030.862282:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d232f72e000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1787831030.862301:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d232f6b4800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1787831030.862322:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d2203604800 for lustre-MDT0000 00000020:00000080:0.0:1787831030.862327:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d232f728800 for lustre-MDT0000 00000020:00000080:0.0:1787831030.862330:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d232f6b3000 for lustre-MDT0000 00000100:00100000:3.0:1787831030.863019:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1874676443911424:0@lo:39:umount.0 00000100:00080000:0.0:1787831030.863032:0:15113:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787831030.863038:0:15113:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:0.0:1787831030.863052:0:15113:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787831030.863063:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831030.863109:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443911424 00000100:00100000:3.0:1787831030.863114:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443911424 00000100:00080000:0.0:1787831030.863121:0:15113:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1787831030.863138:0:15113:0:(import.c:65:import_set_state_nolock()) ffff8d233f43d000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1787831030.863152:0:15113:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787831030.863154:0:15113:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000100:00100000:3.0:1787831030.863166:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000004:00080000:0.0:1787831030.863167:0:15113:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787831030.863177:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203afe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1874676443911424:12345-0@lo:39:umount.0 00000020:00000080:3.0:1787831030.863203:0:6495:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x95459fb9d1d285fa 00000100:00080000:3.0:1787831030.863211:0:6495:0:(import.c:65:import_set_state_nolock()) ffff8d233bc5e000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787831030.863232:0:6495:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00080000:0.0:1787831030.863239:0:15113:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1787831030.863250:0:15113:0:(import.c:65:import_set_state_nolock()) ffff8d233f547800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1787831030.863277:0:15113:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8d23088a3370) has no exports 00000100:00100000:3.0:1787831030.863379:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203afe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+3:3618:x1874676443911424:12345-0@lo:39:umount.0 Request processed in 204us (316us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1787831030.863387:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1787831030.863420:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204627840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1874676443911552:0@lo:9:umount.0 00000100:00100000:3.0:1787831030.863452:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831030.863482:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22046270c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1874676443911680:0@lo:9:umount.0 00000100:00100000:3.0:1787831030.863505:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787831030.863560:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8d233bc5c000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1787831030.863567:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1874676443911424:0@lo:39:umount.0 00010000:00010000:3.0:1787831030.863586:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787831030.864087:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443911552 00000100:00100000:2.0:1787831030.864104:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443911552 00000100:00100000:2.0:1787831030.864164:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443911680 00000100:00100000:2.0:1787831030.864167:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443911680 00000100:00100000:2.0:1787831030.864200:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787831030.864208:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203afe940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1874676443911552:12345-0@lo:9:umount.0 00000020:00000080:2.0:1787831030.864229:0:8408:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x95459fb9d1d28735 00000100:00080000:2.0:1787831030.864234:0:8408:0:(import.c:65:import_set_state_nolock()) ffff8d233f424000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787831030.864270:0:8408:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:2.0:1787831030.864369:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203afe940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3618:x1874676443911552:12345-0@lo:9:umount.0 Request processed in 162us (918us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831030.864376:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787831030.864390:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787831030.864395:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203aff840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1874676443911680:12345-0@lo:9:umount.0 00000020:00000080:2.0:1787831030.864406:0:8408:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x95459fb9d1d288a8 00000100:00080000:2.0:1787831030.864411:0:8408:0:(import.c:65:import_set_state_nolock()) ffff8d2202a86000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787831030.864429:0:8408:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:2.0:1787831030.864485:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203aff840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3618:x1874676443911680:12345-0@lo:9:umount.0 Request processed in 90us (979us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831030.864491:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:2.0:1787831030.864506:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787831030.864726:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787831030.864751:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8d233f43d000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1787831030.864764:0:3618:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1787831030.864766:0:3618:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787831030.864769:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204627840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1874676443911552:0@lo:9:umount.0 00000100:00080000:2.0:1787831030.864781:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8d233f547800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1787831030.864795:0:3618:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1787831030.864797:0:3618:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787831030.864799:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22046270c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1874676443911680:0@lo:9:umount.0 00010000:00010000:0.0:1787831030.866719:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1787831030.871902:0:15113:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8d23088a3370) has no exports 00000020:00000080:0.0:1787831030.930787:0:15113:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x95459fb9d1d2845d 00000020:00000080:0.0:1787831030.930804:0:15113:0:(genops.c:885:class_export_put()) final put ffff8d232f510800/lustre-QMT0000_UUID 00000020:01000000:0.0:1787831030.930871:0:15113:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1787831030.931718:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d232f510800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1787831030.933049:0:15113:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787831030.933106:0:15113:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787831030.933111:0:15113:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff8d232f4cb370) has no exports 00000020:00000080:1.0:1787831030.933453:0:15113:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x95459fb9d1d28456 00000020:00000080:1.0:1787831030.933463:0:15113:0:(genops.c:885:class_export_put()) final put ffff8d232f4bc000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787831030.933524:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d232f4bc000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787831030.933591:0:15113:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787831030.933600:0:15113:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1787831030.933602:0:15113:0:(genops.c:885:class_export_put()) final put ffff8d232f4be000/lustre-QMT0000_UUID 00000020:00000080:1.0:1787831030.933605:0:15113:0:(genops.c:844:class_export_destroy()) destroying export ffff8d232f4be000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1787831030.933818:0:15113:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000100:00100000:3.0:1787831031.526905:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204626d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443911808:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787831031.526983:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831031.527228:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443911808 00000100:00100000:2.0:1787831031.527238:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443911808 00000100:00100000:2.0:1787831031.527287:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1787831031.527296:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203afed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3621:x1874676443911808:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:2.0:1787831031.527304:0:7448:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:02020000:0.0:1787831031.527468:0:3621:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00100000:2.0:1787831031.528340:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203afed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3621:x1874676443911808:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1041us (1355us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787831031.528350:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00080000:0.0:1787831031.533092:0:3621:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1787831031.533101:0:3621:0:(import.c:65:import_set_state_nolock()) ffff8d232f69b000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1787831031.533106:0:3621:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1787831031.539909:0:3621:0:(import.c:65:import_set_state_nolock()) ffff8d232f69b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787831031.539923:0:3621:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 148 00000100:00080000:0.0:1787831031.539934:0:3621:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8d232f69b000 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:0.0:1787831031.539997:0:3621:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d22046270c0 x1874676443911936/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787831031.540220:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22046270c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1874676443911936:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1787831031.540294:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831031.540815:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443911936 00000100:00100000:0.0:1787831031.540823:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443911936 00000100:00100000:0.0:1787831031.540867:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1787831031.540875:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204705680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3618:x1874676443911936:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:0.0:1787831031.540893:0:6496:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1787831031.544485:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204705680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3618:x1874676443911936:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 3600us (4182us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787831031.544501:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00080000:2.0:1787831031.544580:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8d232f69b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787831031.544585:0:3618:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787831031.544590:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22046270c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1874676443911936:0@lo:38:ptlrpcd_00_02.0 00010000:00010000:3.0:1787831031.782929:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787831032.040752:0:6469:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1787831032.040763:0:6469:0:(genops.c:885:class_export_put()) final put ffff8d232f6b2800/lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1787831032.040790:0:6469:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of c901c2b2-479b-44dc-8fa8-34fbacf02f07 00000001:00080000:2.0:1787831032.040799:0:6469:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:2.0:1787831032.040802:0:6469:0:(genops.c:885:class_export_put()) final put ffff8d233f524000/c901c2b2-479b-44dc-8fa8-34fbacf02f07 00000001:00100000:2.0:1787831032.040807:0:6469:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 47d7f0ed-283f-4b70-a741-6e74c5e52619 00000001:00080000:2.0:1787831032.040813:0:6469:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:2.0:1787831032.040819:0:6469:0:(genops.c:885:class_export_put()) final put ffff8d2203517000/47d7f0ed-283f-4b70-a741-6e74c5e52619 00000020:00000080:0.0:1787831032.040873:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d232f6b2800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:0.0:1787831032.041536:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d233f524000/c901c2b2-479b-44dc-8fa8-34fbacf02f07 for lustre-MDT0000 00000020:00000080:0.0:1787831032.041734:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2203517000/47d7f0ed-283f-4b70-a741-6e74c5e52619 for lustre-MDT0000 00000020:00000080:0.0:1787831032.041843:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d232f6b7000 for lustre-MDT0000 00000020:00000080:0.0:1787831032.041849:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d233f525800 for lustre-MDT0000 00000020:00000080:0.0:1787831032.041854:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d2203515000 for lustre-MDT0000 00000100:00080000:0.0:1787831032.550876:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787831032.550883:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787831032.550886:0:38:0:(import.c:65:import_set_state_nolock()) ffff8d232f69b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787831032.550894:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 322 00000100:00080000:0.0:1787831032.550909:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787831032.550916:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8d232f69b000 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:0.0:1787831032.550937:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d22046252c0 x1874676443912192/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787831032.551035:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204627840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a45944b-32e3-4193-a2a5-46f84222bc14:3622:1874676443912064:0@lo:400:kworker.0 00000100:00100000:0.0:1787831032.551107:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831032.551315:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204624b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676443912704:0@lo:400:kworker.0 00000100:00100000:0.0:1787831032.551341:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831032.551365:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787831032.551369:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22046261c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3622:1874676443912576:0@lo:400:kworker.0 00000100:00100000:0.0:1787831032.551393:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831032.551408:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204626940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676443913088:0@lo:400:kworker.0 00000100:00100000:0.0:1787831032.551427:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831032.551473:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443912704 00000100:00100000:0.0:1787831032.551479:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443912704 00000100:00100000:0.0:1787831032.551526:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443913088 00000100:00100000:0.0:1787831032.551528:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443913088 00000100:00100000:0.0:1787831032.551546:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787831032.551554:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22046270c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676443912704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787831032.551604:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22046270c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676443912704:12345-0@lo:400:kworker.0 Request processed in 51us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831032.551611:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787831032.551658:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787831032.551664:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22038fa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676443913088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787831032.551689:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22038fa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676443913088:12345-0@lo:400:kworker.0 Request processed in 26us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831032.551694:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787831032.551731:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204626940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676443913088:0@lo:400:kworker.0 00000100:00100000:0.0:1787831032.551740:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204624b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676443912704:0@lo:400:kworker.0 00000100:00100000:0.0:1787831032.551773:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22046252c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1874676443912192:0@lo:38:kworker.0 00000100:00100000:3.0:1787831032.551776:0:13771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443912576 00000100:00100000:3.0:1787831032.551782:0:13771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443912576 00000100:00100000:0.0:1787831032.551804:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831032.551827:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1787831032.551838:0:13771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22038fa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1874676443912576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787831032.551850:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204624f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874676443912320:0@lo:400:kworker.0 00000100:00100000:0.0:1787831032.551883:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831032.551943:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443912064 00000100:00100000:1.0:1787831032.551949:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443912064 00000100:00100000:1.0:1787831032.551985:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:0.0:1787831032.551993:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204627480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3619:1874676443912832:0@lo:400:kworker.0 00000100:00100000:0.0:1787831032.552016:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831032.552032:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787831032.552038:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204625680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3619:1874676443912448:0@lo:400:kworker.0 00000100:00100000:0.0:1787831032.552054:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831032.552068:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204624000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3619:1874676443912960:0@lo:400:kworker.0 00000100:00100000:3.0:1787831032.552079:0:13771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22038fa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1874676443912576:12345-0@lo:400:kworker.0 Request processed in 242us (683us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831032.552087:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831032.552091:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1787831032.552110:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443912320 00000100:00100000:3.0:1787831032.552112:0:13771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443912832 00000100:00100000:0.0:1787831032.552114:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443912320 00000100:00100000:3.0:1787831032.552118:0:13771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443912832 00000100:00100000:0.0:1787831032.552133:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443912448 00000100:00100000:3.0:1787831032.552138:0:13771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443912960 00000100:00100000:0.0:1787831032.552138:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443912448 00000100:00100000:3.0:1787831032.552143:0:13771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443912960 00000100:00100000:3.0:1787831032.552161:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1787831032.552166:0:13771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22038fad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874676443912960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787831032.552215:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1787831032.552220:0:13771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22038fad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874676443912960:12345-0@lo:400:kworker.0 Request processed in 52us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831032.552224:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22038f8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3619:x1874676443912320:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1787831032.552234:0:8620:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1787831032.552246:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1787831032.552265:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22038f8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3619:x1874676443912320:12345-0@lo:400:kworker.0 Request processed in 41us (381us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787831032.552273:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1787831032.552279:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1787831032.552287:0:13771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22038f92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3619:x1874676443912832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787831032.552290:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000020:00080000:3.0:1787831032.552299:0:13771:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1787831032.552300:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22038fb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3619:x1874676443912448:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1787831032.552308:0:8620:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1787831032.552347:0:13771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22038f92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3619:x1874676443912832:12345-0@lo:400:kworker.0 Request processed in 58us (328us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787831032.552348:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22038fb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3619:x1874676443912448:12345-0@lo:400:kworker.0 Request processed in 47us (291us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787831032.552377:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1787831032.552404:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443912192 00000100:00100000:0.0:1787831032.552408:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443912192 00000100:00100000:0.0:1787831032.552429:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1787831032.552434:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22038f9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3618:x1874676443912192:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1787831032.552445:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00010000:02000000:0.0:1787831032.552451:0:6495:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:3.0:1787831032.552484:0:3619:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787831032.552489:0:3619:0:(import.c:65:import_set_state_nolock()) ffff8d2334551800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1787831032.552493:0:3619:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:1.0:1787831032.552515:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d231859dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+19:3622:x1874676443912064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787831032.552568:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d231859dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a45944b-32e3-4193-a2a5-46f84222bc14+19:3622:x1874676443912064:12345-0@lo:400:kworker.0 Request processed in 575us (1462us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831032.552575:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00080000:1.0:1787831032.552675:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787831032.552680:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787831032.552683:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787831032.552727:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d22046261c0 x1874676443912576/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787831048 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787831032.552739:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22046261c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3622:1874676443912576:0@lo:400:kworker.0 00000100:00100000:1.0:1787831032.552749:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204627840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a45944b-32e3-4193-a2a5-46f84222bc14:3622:1874676443912064:0@lo:400:kworker.0 00000100:00100000:2.0:1787831032.554929:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787831032.554948:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443913216:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787831032.555360:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831032.555470:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443913216 00000100:00100000:1.0:1787831032.555479:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443913216 00000100:00100000:1.0:1787831032.555543:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1787831032.555553:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22047043c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443913216:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787831032.555584:0:8410:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1787831032.555670:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22047043c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443913216:12345-0@lo:13:osp-pre-1-1.0 Request processed in 119us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831032.555677:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1787831032.558294:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443913216:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787831032.558381:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22038f9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3618:x1874676443912192:12345-0@lo:38:kworker.0 Request processed in 5943us (6575us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787831032.558393:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00080000:2.0:1787831032.560401:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8d232f69b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787831032.560410:0:3618:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787831032.560415:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22046252c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1874676443912192:0@lo:38:kworker.0 00000100:00080000:3.0:1787831032.579347:0:3619:0:(import.c:65:import_set_state_nolock()) ffff8d2334551800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787831032.579362:0:3619:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 164 00000100:00080000:3.0:1787831032.579372:0:3619:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8d2334551800 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:3.0:1787831032.579411:0:3619:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2203afd680 x1874676443913344/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787831032.579453:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204625680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3619:1874676443912448:0@lo:400:kworker.0 00010000:00080000:3.0:1787831032.579489:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2204624000 x1874676443912960/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787831048 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787831032.579502:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204624000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3619:1874676443912960:0@lo:400:kworker.0 00000100:00080000:3.0:1787831032.579517:0:3619:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787831032.579521:0:3619:0:(import.c:65:import_set_state_nolock()) ffff8d233bc5d800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1787831032.579524:0:3619:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1787831032.579528:0:3619:0:(import.c:65:import_set_state_nolock()) ffff8d233bc5d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787831032.579532:0:3619:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 148 00000100:00080000:3.0:1787831032.579536:0:3619:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8d233bc5d800 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:3.0:1787831032.579550:0:3619:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2203afc3c0 x1874676443913472/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787831032.579561:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204624f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874676443912320:0@lo:400:kworker.0 00000100:00080000:3.0:1787831032.579590:0:3619:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787831032.579594:0:3619:0:(import.c:65:import_set_state_nolock()) ffff8d233bda1800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1787831032.579597:0:3619:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1787831032.579600:0:3619:0:(import.c:65:import_set_state_nolock()) ffff8d233bda1800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787831032.579604:0:3619:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 182 00000100:00080000:3.0:1787831032.579608:0:3619:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8d233bda1800 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:3.0:1787831032.579621:0:3619:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2203aff0c0 x1874676443913600/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787831032.579698:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203afd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3618:1874676443913344:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1787831032.579761:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831032.579806:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203afc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3618:1874676443913472:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1787831032.579828:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831032.580058:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204627480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3619:1874676443912832:0@lo:400:kworker.0 00000100:00100000:0.0:1787831032.580115:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443913344 00000100:00100000:0.0:1787831032.580122:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443913344 00000100:00100000:0.0:1787831032.580171:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1787831032.580179:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204706d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3618:x1874676443913344:12345-0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1787831032.580213:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203aff0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3618:1874676443913600:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1787831032.580242:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831032.580271:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443913472 00010000:02000000:0.0:1787831032.580273:0:8620:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1787831032.580274:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443913472 00000100:00100000:2.0:1787831032.580295:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443913600 00000100:00100000:2.0:1787831032.580298:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443913600 00000100:00100000:0.0:1787831032.580318:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204706d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3618:x1874676443913344:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 139us (556us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787831032.580321:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1787831032.580326:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204707480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3618:x1874676443913472:12345-0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1787831032.580326:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00010000:02000000:2.0:1787831032.580334:0:6490:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1787831032.580342:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1787831032.580346:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204704b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3618:x1874676443913600:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:0.0:1787831032.580352:0:8620:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1787831032.580359:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204707480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3618:x1874676443913472:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 32us (530us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787831032.580365:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1787831032.580370:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204704b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3618:x1874676443913600:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 24us (129us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787831032.580375:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00080000:2.0:1787831032.580395:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8d233bda1800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787831032.580399:0:3618:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787831032.580402:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203aff0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3618:1874676443913600:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:2.0:1787831032.580410:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8d2334551800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787831032.580413:0:3618:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787831032.580425:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203afd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3618:1874676443913344:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:2.0:1787831032.580435:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8d233bc5d800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787831032.580545:0:3618:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787831032.580550:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203afc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3618:1874676443913472:0@lo:38:ptlrpcd_00_00.0 00010000:00010000:2.0:1787831032.806785:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1787831032.935059:0:15113:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d2203668cc0 - data ffff8d220200b870/ffff8d2203648c00 00000020:01000000:2.0:1787831032.935346:0:15113:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d232f5ec1e0 - data ffff8d23309880d8/ffff8d232f666c00 00000001:00000004:2.0:1787831032.942700:0:15113:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00080000:3.0:1787831032.972899:0:15113:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1787831032.972909:0:15113:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:3.0:1787831032.972926:0:15113:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8d2204706580 x1874676443911424/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787831040 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787831032.972949:0:15113:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1787831032.974345:0:15113:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787831032.974352:0:15113:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:3.0:1787831032.974375:0:15113:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787831032.974377:0:15113:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1787831032.974657:0:8625:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1787831032.974662:0:8625:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:1.0:1787831032.974672:0:8625:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1787831032.975705:0:15113:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787831032.975710:0:15113:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:3.0:1787831032.975721:0:15113:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787831032.975724:0:15113:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1787831032.975984:0:10067:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1787831032.975988:0:10067:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:1.0:1787831032.975996:0:10067:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1787831032.976898:0:15113:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x95459fb9d1d28425 00000020:00000080:3.0:1787831032.976909:0:15113:0:(genops.c:885:class_export_put()) final put ffff8d232b9ec800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787831032.978439:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d232b9ec800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787831032.978913:0:15113:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x95459fb9d1d2843a 00000020:00000080:3.0:1787831032.978923:0:15113:0:(genops.c:885:class_export_put()) final put ffff8d232b9ef800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1787831032.978943:0:15113:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1787831032.978949:0:15113:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787831032.978959:0:15113:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787831032.978965:0:15113:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff8d23088a0000) has no exports 00000004:01000000:3.0:1787831032.979197:0:15113:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1787831032.979206:0:15113:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x95459fb9d1d288a1 00000020:00000080:3.0:1787831032.979211:0:15113:0:(genops.c:885:class_export_put()) final put ffff8d233f526800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1787831032.979216:0:15113:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1787831032.979219:0:15113:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787831032.979230:0:15113:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787831032.979232:0:15113:0:(genops.c:1558:class_disconnect_exports()) OBD device 28 (ffff8d23344a0000) has no exports 00000020:00000080:3.0:1787831032.979239:0:15113:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x95459fb9d1d2889a 00000020:00000080:3.0:1787831032.979243:0:15113:0:(genops.c:885:class_export_put()) final put ffff8d233f544000/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1787831032.979592:0:15113:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1787831032.979596:0:15113:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787831032.979600:0:15113:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:3.0:1787831032.979606:0:15113:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787831032.979608:0:15113:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787831032.979713:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d232b9ef800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:1.0:1787831032.979721:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d233f526800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1787831032.979725:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d233f544000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787831032.979731:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d233f547800 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1787831032.979792:0:15113:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787831032.979802:0:15113:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787831032.979806:0:15113:0:(genops.c:885:class_export_put()) final put ffff8d233bd96000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787831032.979808:0:15113:0:(genops.c:844:class_export_destroy()) destroying export ffff8d233bd96000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1787831032.979813:0:15113:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787831032.979896:0:15113:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x95459fb9d1d2872e 00000020:00000080:3.0:1787831032.979902:0:15113:0:(genops.c:885:class_export_put()) final put ffff8d233f43a800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1787831032.979916:0:15113:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1787831032.979919:0:15113:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787831032.979924:0:15113:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787831032.979927:0:15113:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff8d233f430000) has no exports 00000020:00000080:3.0:1787831032.979931:0:15113:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x95459fb9d1d28727 00000020:00000080:3.0:1787831032.979934:0:15113:0:(genops.c:885:class_export_put()) final put ffff8d233bda0800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787831032.980159:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d233f43a800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1787831032.980165:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d233bda0800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1787831032.980411:0:15113:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1787831032.980421:0:15113:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787831032.980424:0:15113:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:3.0:1787831032.980427:0:15113:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787831032.980429:0:15113:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787831032.980493:0:15113:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787831032.980500:0:15113:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:3.0:1787831032.980510:0:15113:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1787831032.980515:0:15113:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x95459fb9d1d285f3 00000020:00000080:3.0:1787831032.980520:0:15113:0:(genops.c:885:class_export_put()) final put ffff8d233be40000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787831032.980909:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d233f43d000 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1787831032.980922:0:37:0:(genops.c:885:class_export_put()) final put ffff8d233bda7000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787831032.980924:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d233bda7000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1787831032.980930:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1787831032.981056:0:15113:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:3.0:1787831032.981062:0:15113:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787831032.981139:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d233be40000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1787831032.981166:0:15113:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787831032.981171:0:15113:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8d232f77cd28) has no exports 00000020:00000080:3.0:1787831032.981176:0:15113:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x95459fb9d1d285ec 00000020:00000080:3.0:1787831032.981181:0:15113:0:(genops.c:885:class_export_put()) final put ffff8d233bc59800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787831032.981699:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d233bc59800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1787831032.983711:0:15113:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1787831032.983721:0:15113:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1787831032.983725:0:15113:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:0.0:1787831032.983735:0:15113:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787831032.983791:0:15113:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787831032.983803:0:15113:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787831032.983832:0:15113:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787831032.983836:0:15113:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787831032.983841:0:15113:0:(genops.c:885:class_export_put()) final put ffff8d23100b8800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787831032.983845:0:15113:0:(genops.c:844:class_export_destroy()) destroying export ffff8d23100b8800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1787831032.983857:0:15113:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787831032.983952:0:15113:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x95459fb9d1d28441 00000020:00000080:0.0:1787831032.983959:0:15113:0:(genops.c:885:class_export_put()) final put ffff8d232b9ec000/lustre-MDD0000_UUID 00000020:01000000:0.0:1787831032.983965:0:15113:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1787831032.983969:0:15113:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787831032.983973:0:15113:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787831032.983976:0:15113:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff8d23088a4d28) has no exports 00000020:00000080:0.0:1787831032.983995:0:15113:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787831032.983998:0:15113:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1787831032.984002:0:15113:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x95459fb9d1d28448 00000020:00000080:0.0:1787831032.984005:0:15113:0:(genops.c:885:class_export_put()) final put ffff8d232b9e9800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1787831032.984014:0:15113:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d2303f2e000 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1787831032.984017:0:15113:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d2303f2e000 3 00000020:01000004:0.0:1787831032.984020:0:15113:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8d2303f2e000 from lustre-MDT0000 00000020:00000080:0.0:1787831032.984035:0:15113:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787831032.984039:0:15113:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1787831032.984041:0:15113:0:(genops.c:885:class_export_put()) final put ffff8d232b9e9000/lustre-MDT0000_UUID 00000020:00000080:0.0:1787831032.984043:0:15113:0:(genops.c:844:class_export_destroy()) destroying export ffff8d232b9e9000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1787831032.984048:0:15113:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1787831032.984086:0:15113:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1787831032.984090:0:15113:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1787831032.984093:0:15113:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1787831032.984095:0:15113:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787831032.984098:0:15113:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787831032.984104:0:15113:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8d230884a800 2a45944b-32e3-4193-a2a5-46f84222bc14 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787831032.984110:0:15113:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff8d23088a19b8) has exports, disconnecting them 00000020:00080000:0.0:1787831032.984121:0:15113:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8d230884a800), last request at 1787830838 00000020:00000080:0.0:1787831032.984137:0:15113:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x95459fb9d1d283e6 00000020:00010000:0.0:1787831032.984141:0:15113:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8d230884a800: total 2 00000100:00080000:0.0:1787831032.984145:0:15113:0:(import.c:65:import_set_state_nolock()) ffff8d230884a000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1787831032.984160:0:15113:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d230884a800): rc 0 00000020:00080000:0.0:1787831032.984164:0:15113:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff8d23088a19b8) has no exports 00000020:00010000:0.0:1787831032.984175:0:7431:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8d230884a800: total 2 00010000:00010000:0.0:1787831032.984199:0:7431:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8d230884a800, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1787831032.984228:0:7431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d233837b800/0x95459fb9d1d28965 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x95459fb9d1d2895e expref: 14 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831032.984245:0:7431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d233be95a00/0x95459fb9d1d28838 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x95459fb9d1d28831 expref: 13 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831032.984260:0:7431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d233837b200/0x95459fb9d1d288f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x95459fb9d1d288ee expref: 12 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831032.984269:0:7431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d22039c1a00/0x95459fb9d1d28b72 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x95459fb9d1d28b6b expref: 11 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831032.984279:0:7431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d233837bc00/0x95459fb9d1d28903 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x95459fb9d1d288fc expref: 10 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831032.984289:0:7431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2307c76000/0x95459fb9d1d28b80 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x95459fb9d1d28b79 expref: 9 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831032.984300:0:7431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d22039c1000/0x95459fb9d1d28b8e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x95459fb9d1d28b87 expref: 8 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831032.984311:0:7431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d233837aa00/0x95459fb9d1d2891f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x95459fb9d1d28918 expref: 7 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831032.984333:0:7431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d233bf10000/0x95459fb9d1d2892d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x95459fb9d1d28926 expref: 6 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831032.984345:0:7431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d233bf10c00/0x95459fb9d1d28911 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x95459fb9d1d2890a expref: 5 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831032.984355:0:7431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2301669800/0x95459fb9d1d284f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x95459fb9d1d284e9 expref: 4 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831032.984368:0:7431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2307c77200/0x95459fb9d1d284e2 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x95459fb9d1d284db expref: 3 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831032.984379:0:7431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d233837b000/0x95459fb9d1d2893b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x95459fb9d1d28934 expref: 2 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831032.984388:0:7431:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8d230884a800, canceled 13 locks, left on hash table 0. 00000020:00000080:0.0:1787831032.984402:0:7431:0:(genops.c:885:class_export_put()) final put ffff8d230884a800/2a45944b-32e3-4193-a2a5-46f84222bc14 00010000:00010000:0.0:1787831032.984407:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787831032.984410:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787831032.984411:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787831032.984483:0:6485:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff8d23380bda00:6485] 2 exiting: rc = 0 00000100:00100000:1.0:1787831032.984786:0:6483:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff8d233a6e4e00:6483] 0 exiting: rc = 1 00000100:00100000:1.0:1787831032.984845:0:6484:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff8d23061c7600:6484] 1 exiting: rc = 0 00000020:00000080:1.0:1787831032.984895:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d233bc5c000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1787831032.984902:0:37:0:(genops.c:885:class_export_put()) final put ffff8d233bc5a000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787831032.984905:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d233bc5a000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1787831032.984909:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787831032.984969:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d232b9ec000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1787831032.984973:0:37:0:(genops.c:885:class_export_put()) final put ffff8d232b9e8800/lustre-MDD0000_UUID 00000020:00000080:1.0:1787831032.984975:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d232b9e8800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1787831032.984979:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1787831032.985003:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d232b9e9800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787831032.985007:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d230884a800/2a45944b-32e3-4193-a2a5-46f84222bc14 for MGS 00000020:00000080:1.0:1787831032.985033:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d230884a000 for MGS 00000100:00100000:0.0:1787831032.985104:0:15113:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831032.985126:0:15113:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831032.985132:0:15113:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831032.985138:0:15113:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831032.985144:0:15113:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831032.985151:0:15113:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831032.985157:0:15113:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831032.985163:0:15113:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831032.985169:0:15113:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831032.985185:0:15113:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831032.985191:0:15113:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831032.985197:0:15113:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831032.985203:0:15113:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831032.985209:0:15113:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831032.985215:0:15113:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831032.985221:0:15113:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831032.985226:0:15113:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831032.985232:0:15113:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831032.985237:0:15113:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831032.985243:0:15113:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831032.985249:0:15113:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831032.985255:0:15113:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831032.985261:0:15113:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831032.985266:0:15113:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831032.985271:0:15113:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831032.985276:0:15113:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831032.985282:0:15113:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831032.985287:0:15113:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831032.985293:0:15113:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831032.985298:0:15113:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831032.985303:0:15113:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831032.985308:0:15113:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831032.985313:0:15113:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831032.985319:0:15113:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831032.985324:0:15113:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831032.985329:0:15113:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831032.985335:0:15113:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831032.985340:0:15113:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831032.985345:0:15113:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831032.985350:0:15113:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831032.985355:0:15113:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831032.985361:0:15113:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831032.985367:0:15113:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831032.985372:0:15113:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831032.985383:0:15113:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831032.985390:0:15113:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831032.985396:0:15113:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831032.985400:0:15113:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831032.985405:0:15113:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831032.985410:0:15113:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831032.985415:0:15113:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831032.985420:0:15113:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831032.985425:0:15113:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831032.985429:0:15113:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831032.985434:0:15113:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831032.985440:0:15113:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831032.985445:0:15113:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831032.985450:0:15113:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831032.985455:0:15113:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831032.985460:0:15113:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831032.985465:0:15113:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831032.985469:0:15113:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831032.985474:0:15113:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831032.985479:0:15113:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:0.0:1787831032.986316:0:15113:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d2203668b40 - data ffff8d2330b375e8/ffff8d2203649800 00000020:01000000:0.0:1787831032.986432:0:15113:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d231000a540 - data ffff8d23308a7870/ffff8d231009bc00 00000020:00000080:0.0:1787831032.986891:0:15113:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x95459fb9d1d283ca 00000020:00000080:0.0:1787831032.986900:0:15113:0:(genops.c:885:class_export_put()) final put ffff8d23100b8000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1787831032.986915:0:15113:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d2303f2e000 from MGS, refs=2 00000020:01000004:0.0:1787831032.986918:0:15113:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d2303f2e000 2 00000020:01000004:0.0:1787831032.986921:0:15113:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8d2303f2e000 from MGS 00000020:00000080:0.0:1787831032.986944:0:15113:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787831032.986949:0:15113:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1787831032.986952:0:15113:0:(genops.c:885:class_export_put()) final put ffff8d23100bc000/MGS 00000020:00000080:0.0:1787831032.986954:0:15113:0:(genops.c:844:class_export_destroy()) destroying export ffff8d23100bc000/MGS for MGS 00000020:01000000:0.0:1787831032.986959:0:15113:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1787831032.987015:0:15113:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1787831032.987019:0:15113:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787831032.987034:0:15113:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787831032.987039:0:15113:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8d232b967800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787831032.987045:0:15113:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff8d2303338000) has exports, disconnecting them 00000020:00080000:0.0:1787831032.987048:0:15113:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8d232b967800), last request at 1787830838 00000020:00000080:0.0:1787831032.987052:0:15113:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x95459fb9d1d28495 00000020:00080000:0.0:1787831032.987062:0:15113:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d232b967800): rc 0 00000020:00000080:0.0:1787831032.987079:0:15113:0:(genops.c:885:class_export_put()) final put ffff8d232b967800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1787831032.987701:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d23100b8000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787831032.987711:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d232b967800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1787831032.988851:0:15113:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1787831032.988859:0:15113:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787831032.988863:0:15113:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1787831032.988869:0:15113:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787831032.988896:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d232b964000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1787831032.989085:0:15113:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787831032.989094:0:15113:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1787831032.989098:0:15113:0:(genops.c:885:class_export_put()) final put ffff8d232b966000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1787831032.989110:0:15113:0:(genops.c:844:class_export_destroy()) destroying export ffff8d232b966000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1787831032.989115:0:15113:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1787831032.989189:0:15113:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d2303f2e000 1 00000020:00000080:1.0:1787831032.989194:0:15113:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x95459fb9d1d283bc 00000020:00000080:1.0:1787831032.989202:0:15113:0:(genops.c:885:class_export_put()) final put ffff8d23100b9800/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1787831032.989210:0:15113:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1787831032.989217:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d23100b9800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787831032.989225:0:15113:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787831032.989229:0:15113:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787831032.989234:0:15113:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff8d23033399b8) has no exports 00000020:00000080:3.0:1787831033.046689:0:15113:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787831033.046701:0:15113:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1787831033.046707:0:15113:0:(genops.c:885:class_export_put()) final put ffff8d2310853000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787831033.046713:0:15113:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2310853000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1787831033.046719:0:15113:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1787831033.046832:0:15113:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8d2310852800 00000020:02000400:3.0:1787831033.046896:0:15113:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1787831033.830885:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787831034.092193:0:8401:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787831034.092203:0:8401:0:(genops.c:885:class_export_put()) final put ffff8d233f421800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1787831034.092224:0:8401:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 47d7f0ed-283f-4b70-a741-6e74c5e52619 00000020:00000080:1.0:1787831034.092226:0:8401:0:(genops.c:885:class_export_put()) final put ffff8d233bda0000/47d7f0ed-283f-4b70-a741-6e74c5e52619 00000020:00000080:2.0:1787831034.092407:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d233f421800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1787831034.092454:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d233bda0000/47d7f0ed-283f-4b70-a741-6e74c5e52619 for lustre-OST0000 00000020:00000080:2.0:1787831034.092471:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d233f424000 for lustre-OST0000 00000020:00000080:2.0:1787831034.092475:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d233bda4000 for lustre-OST0000 00000001:00100000:2.0:1787831034.094709:0:7421:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1787831034.094724:0:7421:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:2.0:1787831034.094728:0:7421:0:(genops.c:885:class_export_put()) final put ffff8d233bc5e800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1787831034.094743:0:7421:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of c901c2b2-479b-44dc-8fa8-34fbacf02f07 00000001:00080000:2.0:1787831034.094747:0:7421:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:2.0:1787831034.094749:0:7421:0:(genops.c:885:class_export_put()) final put ffff8d2202a80800/c901c2b2-479b-44dc-8fa8-34fbacf02f07 00000001:00100000:2.0:1787831034.094754:0:7421:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 47d7f0ed-283f-4b70-a741-6e74c5e52619 00000001:00080000:2.0:1787831034.094757:0:7421:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:2.0:1787831034.094758:0:7421:0:(genops.c:885:class_export_put()) final put ffff8d2203602800/47d7f0ed-283f-4b70-a741-6e74c5e52619 00000001:00100000:1.0:1787831034.095034:0:9484:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787831034.095039:0:9484:0:(genops.c:885:class_export_put()) final put ffff8d2202a83000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1787831034.095048:0:9484:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 47d7f0ed-283f-4b70-a741-6e74c5e52619 00000020:00000080:1.0:1787831034.095050:0:9484:0:(genops.c:885:class_export_put()) final put ffff8d232029c000/47d7f0ed-283f-4b70-a741-6e74c5e52619 00000020:00000080:0.0:1787831034.095087:0:478:0:(genops.c:844:class_export_destroy()) destroying export ffff8d233bc5e800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:0.0:1787831034.095139:0:478:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2202a80800/c901c2b2-479b-44dc-8fa8-34fbacf02f07 for lustre-MDT0001 00000020:00000080:0.0:1787831034.095161:0:478:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2203602800/47d7f0ed-283f-4b70-a741-6e74c5e52619 for lustre-MDT0001 00000020:00000080:0.0:1787831034.095181:0:478:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2202a83000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1787831034.095196:0:478:0:(genops.c:844:class_export_destroy()) destroying export ffff8d232029c000/47d7f0ed-283f-4b70-a741-6e74c5e52619 for lustre-OST0001 00000020:00000080:0.0:1787831034.095215:0:478:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d233bc5e000 for lustre-MDT0001 00000020:00000080:0.0:1787831034.095219:0:478:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d2202a81000 for lustre-MDT0001 00000020:00000080:0.0:1787831034.095222:0:478:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d2203606800 for lustre-MDT0001 00000020:00000080:0.0:1787831034.095224:0:478:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d2202a86000 for lustre-OST0001 00000020:00000080:0.0:1787831034.095228:0:478:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d232029f800 for lustre-OST0001 00010000:00010000:2.0:1787831034.854790:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787831035.622988:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a20b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443913728:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787831035.623057:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831035.623161:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443913728 00000100:00100000:1.0:1787831035.623176:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443913728 00000100:00100000:1.0:1787831035.623253:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1787831035.623263:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203afcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443913728:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787831035.623287:0:8409:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787831035.623329:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203afcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443913728:12345-0@lo:13:osp-pre-0-1.0 Request processed in 68us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831035.623336:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00080000:3.0:1787831035.623440:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787831035.623474:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a20b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443913728:0@lo:13:osp-pre-0-1.0 00000020:01000004:2.0:1787831035.625308:0:15314:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1787831035.641005:0:15314:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:3.0:1787831035.641174:0:15314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233837b600/0x95459fb9d1d28926 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2892d expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831035.641190:0:15314:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233837b600/0x95459fb9d1d28926 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d2892d expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831035.641208:0:15314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233837b600/0x95459fb9d1d28926 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x95459fb9d1d2892d expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831035.641214:0:15314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.131@tcp lock: ffff8d233837b600/0x95459fb9d1d28926 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x95459fb9d1d2892d expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831035.641276:0:15314:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787831035.641282:0:15314:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1787831035.641307:0:15314:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787831035.641311:0:15314:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787831035.641316:0:15314:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787831035.641322:0:15314:0:(import.c:65:import_set_state_nolock()) ffff8d233bc5d800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1787831035.641326:0:15314:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787831035.641328:0:15314:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787831035.641331:0:15314:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1787831035.642332:0:15314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233bf10200/0x95459fb9d1d28934 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2893b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831035.642345:0:15314:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233bf10200/0x95459fb9d1d28934 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d2893b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831035.642353:0:15314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233bf10200/0x95459fb9d1d28934 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x95459fb9d1d2893b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831035.642359:0:15314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.131@tcp lock: ffff8d233bf10200/0x95459fb9d1d28934 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x95459fb9d1d2893b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831035.642641:0:7431:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787831035.642650:0:7431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8d233837b600/0x95459fb9d1d28926 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x95459fb9d1d2892d expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831035.642670:0:7431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233837b600 already unused, calling callback (ffffffffc14f9c20) 10000000:00010000:2.0:1787831035.642674:0:7431:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8d233837b600/0x95459fb9d1d28926 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x95459fb9d1d2892d expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831035.642683:0:7431:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8d233837b600/0x95459fb9d1d28926 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x95459fb9d1d2892d expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787831035.642690:0:7431:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8d233837b600/0x95459fb9d1d28926 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x95459fb9d1d2892d expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787831035.642696:0:7431:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787831035.642699:0:7431:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1787831035.642701:0:7431:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1787831035.642737:0:7431:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8d233837b600/0x95459fb9d1d28926 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x95459fb9d1d2892d expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831035.642744:0:7431:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787831035.642771:0:7431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8d233837b600/0x95459fb9d1d28926 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x95459fb9d1d2892d expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831035.642778:0:7431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8d233837b600/0x95459fb9d1d28926 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x95459fb9d1d2892d expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831035.642792:0:7431:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787831035.642795:0:7431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8d233bf10200/0x95459fb9d1d28934 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x95459fb9d1d2893b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831035.642800:0:7431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233bf10200 already unused, calling callback (ffffffffc14f9c20) 10000000:00010000:2.0:1787831035.642803:0:7431:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8d233bf10200/0x95459fb9d1d28934 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x95459fb9d1d2893b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831035.642817:0:7431:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8d233bf10200/0x95459fb9d1d28934 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x95459fb9d1d2893b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787831035.642823:0:7431:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8d233bf10200/0x95459fb9d1d28934 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x95459fb9d1d2893b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787831035.642828:0:7431:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787831035.642830:0:7431:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:2.0:1787831035.642847:0:7431:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8d233bf10200/0x95459fb9d1d28934 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x95459fb9d1d2893b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831035.642853:0:7431:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787831035.642871:0:7431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8d233bf10200/0x95459fb9d1d28934 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x95459fb9d1d2893b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831035.642880:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787831035.642882:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787831035.642885:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787831035.642894:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787831035.642982:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a45944b-32e3-4193-a2a5-46f84222bc14:3619:1874676443913856:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787831035.643114:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831035.643182:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a45944b-32e3-4193-a2a5-46f84222bc14:3621:1874676443913984:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787831035.643208:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831035.643247:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443913856 00000100:00100000:2.0:1787831035.643253:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443913856 00000100:00100000:2.0:1787831035.643287:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443913984 00000100:00100000:2.0:1787831035.643290:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443913984 00000100:00100000:2.0:1787831035.643307:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787831035.643314:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204705e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3619:x1874676443913856:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1787831035.643326:0:6476:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787831035 with bad export cookie 10756178905482298342 00000100:00100000:0.0:1787831035.643560:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787831035.643567:0:7432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204707c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3621:x1874676443913984:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1787831035.643572:0:7432:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787831035 with bad export cookie 10756178905482298342 00010000:00010000:3.0:1787831035.643643:0:15314:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787831035.643657:0:15314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8d233bf10200/0x95459fb9d1d28934 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x95459fb9d1d2893b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831035.643662:0:7432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204707c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3621:x1874676443913984:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (451us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787831035.643675:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:3.0:1787831035.643699:0:15314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d2307c77000/0x95459fb9d1d28831 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d28838 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831035.643702:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787831035.643710:0:15314:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d2307c77000/0x95459fb9d1d28831 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d28838 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831035.643717:0:15314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d2307c77000/0x95459fb9d1d28831 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x95459fb9d1d28838 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831035.643723:0:15314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.131@tcp lock: ffff8d2307c77000/0x95459fb9d1d28831 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x95459fb9d1d28838 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831035.643737:0:15314:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787831035.643743:0:15314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d22039c0000/0x95459fb9d1d28b87 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d28b8e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831035.643750:0:15314:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d22039c0000/0x95459fb9d1d28b87 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d28b8e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831035.643755:0:15314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d22039c0000/0x95459fb9d1d28b87 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x95459fb9d1d28b8e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831035.643761:0:15314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.131@tcp lock: ffff8d22039c0000/0x95459fb9d1d28b87 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x95459fb9d1d28b8e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831035.643772:0:15314:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787831035.643778:0:15314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233837a400/0x95459fb9d1d284e9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d284f0 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831035.643792:0:15314:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233837a400/0x95459fb9d1d284e9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d284f0 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831035.643799:0:15314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233837a400/0x95459fb9d1d284e9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x95459fb9d1d284f0 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831035.643805:0:15314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.131@tcp lock: ffff8d233837a400/0x95459fb9d1d284e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x95459fb9d1d284f0 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831035.643815:0:15314:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:3.0:1787831035.643819:0:15314:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:3.0:1787831035.643823:0:15314:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00010000:00010000:0.0:1787831035.643831:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787831035.643838:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8d2307c77000/0x95459fb9d1d28831 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x95459fb9d1d28838 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787831035.643853:0:15314:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0001 00000020:01000000:3.0:1787831035.643857:0:15314:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:3.0:1787831035.643862:0:15314:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787831035.643867:0:15314:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:3.0:1787831035.643873:0:15314:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff8d2203510800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787831035.643878:0:15314:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff8d232f4be800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787831035.643883:0:15314:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff8d2334548000) has exports, disconnecting them 00000020:00080000:3.0:1787831035.643887:0:15314:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8d2203510800), last request at 1787831032 00000020:00000080:3.0:1787831035.643893:0:15314:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x95459fb9d1d287c8 00010000:00010000:0.0:1787831035.643923:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2307c77000 already unused, calling callback (ffffffffc14f9c20) 10000000:00010000:0.0:1787831035.643927:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8d2307c77000/0x95459fb9d1d28831 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x95459fb9d1d28838 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831035.643935:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8d2307c77000/0x95459fb9d1d28831 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x95459fb9d1d28838 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787831035.643943:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8d2307c77000/0x95459fb9d1d28831 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x95459fb9d1d28838 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787831035.643948:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1787831035.643950:0:6478:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1787831035.643952:0:6478:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1787831035.643971:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8d2307c77000/0x95459fb9d1d28831 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x95459fb9d1d28838 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831035.643977:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00080000:3.0:1787831035.643980:0:15314:0:(import.c:65:import_set_state_nolock()) ffff8d2203516000 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1787831035.643990:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8d2307c77000/0x95459fb9d1d28831 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x95459fb9d1d28838 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831035.643998:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8d2307c77000/0x95459fb9d1d28831 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x95459fb9d1d28838 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831035.644018:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787831035.644022:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8d22039c0000/0x95459fb9d1d28b87 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x95459fb9d1d28b8e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831035.644028:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22039c0000 already unused, calling callback (ffffffffc14f9c20) 00000020:00080000:3.0:1787831035.644030:0:15314:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d2203510800): rc 0 10000000:00010000:0.0:1787831035.644033:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8d22039c0000/0x95459fb9d1d28b87 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x95459fb9d1d28b8e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1787831035.644035:0:15314:0:(genops.c:885:class_export_put()) final put ffff8d2203510800/lustre-MDT0001-lwp-OST0001_UUID 00010000:00010000:0.0:1787831035.644049:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8d22039c0000/0x95459fb9d1d28b87 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x95459fb9d1d28b8e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787831035.644056:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8d22039c0000/0x95459fb9d1d28b87 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x95459fb9d1d28b8e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787831035.644060:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1787831035.644062:0:6478:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1787831035.644064:0:6478:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1787831035.644078:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8d22039c0000/0x95459fb9d1d28b87 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x95459fb9d1d28b8e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831035.644084:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787831035.644096:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8d22039c0000/0x95459fb9d1d28b87 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x95459fb9d1d28b8e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831035.644101:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8d22039c0000/0x95459fb9d1d28b87 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x95459fb9d1d28b8e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831035.644111:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787831035.644114:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8d233837a400/0x95459fb9d1d284e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x95459fb9d1d284f0 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831035.644119:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233837a400 already unused, calling callback (ffffffffc14f9c20) 10000000:00010000:0.0:1787831035.644121:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8d233837a400/0x95459fb9d1d284e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x95459fb9d1d284f0 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831035.644127:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8d233837a400/0x95459fb9d1d284e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x95459fb9d1d284f0 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787831035.644142:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8d233837a400/0x95459fb9d1d284e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x95459fb9d1d284f0 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787831035.644147:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1787831035.644150:0:6478:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1787831035.644151:0:6478:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1787831035.644222:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8d233837a400/0x95459fb9d1d284e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x95459fb9d1d284f0 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831035.644289:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787831035.644296:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8d233837a400/0x95459fb9d1d284e9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x95459fb9d1d284f0 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831035.644302:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8d233837a400/0x95459fb9d1d284e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x95459fb9d1d284f0 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831035.644314:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787831035.644315:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787831035.644317:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787831035.644326:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2203510800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:0.0:1787831035.644363:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d2203516000 for lustre-MDT0001 00000020:00080000:3.0:1787831035.644597:0:15314:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8d232f4be800), last request at 1787831032 00000020:00000080:3.0:1787831035.644612:0:15314:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x95459fb9d1d286a2 00000100:00080000:3.0:1787831035.644620:0:15314:0:(import.c:65:import_set_state_nolock()) ffff8d232f4b9800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1787831035.644656:0:15314:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d232f4be800): rc 0 00000020:00000080:3.0:1787831035.644665:0:15314:0:(genops.c:885:class_export_put()) final put ffff8d232f4be800/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:3.0:1787831035.644679:0:15314:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffae38c1d1bae0 00000100:00080000:3.0:1787831035.644697:0:15314:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787831035.644706:0:15314:0:(client.c:3601:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff8d2204626d00 x1874676443911808/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787831047 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787831035.644717:0:15314:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00000020:00000080:0.0:1787831035.646110:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d232f4be800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:0.0:1787831035.646151:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d232f4b9800 for lustre-MDT0001 00010000:00010000:0.0:1787831035.646294:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787831035.646388:0:15314:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787831035.646395:0:15314:0:(import.c:65:import_set_state_nolock()) ffff8d232f69b000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1787831035.647108:0:15314:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787831035.647114:0:15314:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:3.0:1787831035.647135:0:15314:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1787831035.647194:0:15314:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1787831035.647216:0:15314:0:(import.c:65:import_set_state_nolock()) ffff8d233be47000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1787831035.647234:0:15314:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787831035.647236:0:15314:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:3.0:1787831035.647245:0:15314:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1787831035.647304:0:15314:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1787831035.647314:0:15314:0:(import.c:65:import_set_state_nolock()) ffff8d233bd97800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1787831035.647340:0:15314:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff8d2334548000) has no exports 00010000:00010000:3.0:1787831035.649021:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787831035.649082:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204624f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a45944b-32e3-4193-a2a5-46f84222bc14:3620:1874676443914368:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787831035.649154:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831035.649212:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787831035.649219:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204627480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a45944b-32e3-4193-a2a5-46f84222bc14:3620:1874676443914240:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787831035.649241:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831035.649336:0:7432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443914368 00000100:00100000:3.0:1787831035.649338:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443914240 00000100:00100000:1.0:1787831035.649344:0:7432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443914368 00000100:00100000:3.0:1787831035.649345:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443914240 00000100:00100000:3.0:1787831035.649384:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787831035.649399:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203afc780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3620:x1874676443914240:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1787831035.649405:0:6477:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787831035 with bad export cookie 10756178905482298342 00000100:00100000:3.0:1787831035.649459:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203afc780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3620:x1874676443914240:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (217us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787831035.649467:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:1.0:1787831035.649485:0:3620:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.131@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00100000:3.0:1787831035.649487:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00080000:1.0:1787831035.649492:0:3620:0:(import.c:65:import_set_state_nolock()) ffff8d2303f2b000 MGS: changing import state from FULL to DISCONN 00000100:00100000:3.0:1787831035.649494:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203afde00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3620:x1874676443914368:12345-0@lo:103:ldlm_bl.0 00000100:02020000:1.0:1787831035.649501:0:3620:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.131@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00020000:3.0:1787831035.649503:0:6477:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787831035 with bad export cookie 10756178905482298342 00000100:00100000:3.0:1787831035.649850:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203afde00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3620:x1874676443914368:12345-0@lo:103:ldlm_bl.0 Request processed in 37us (378us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787831035.649859:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:3.0:1787831035.649893:0:3621:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.131@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00100000:2.0:1787831035.654937:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203afda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1874676443914496:0@lo:9:umount.0 00000100:00100000:2.0:1787831035.655013:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831035.655055:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203afcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1874676443914624:0@lo:9:umount.0 00000100:00100000:2.0:1787831035.655078:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831035.663301:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443914496 00000100:00100000:0.0:1787831035.663316:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443914496 00000100:00100000:0.0:1787831035.663382:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443914624 00000100:00100000:0.0:1787831035.663386:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443914624 00000100:00100000:0.0:1787831035.663425:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787831035.663435:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22047052c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1874676443914496:12345-0@lo:9:umount.0 00000020:00000080:0.0:1787831035.663480:0:8408:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x95459fb9d1d286ef 00000100:00080000:0.0:1787831035.663493:0:8408:0:(import.c:65:import_set_state_nolock()) ffff8d233bda7800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787831035.663537:0:8408:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:0.0:1787831035.663748:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22047052c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+2:3618:x1874676443914496:12345-0@lo:9:umount.0 Request processed in 314us (8734us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831035.663755:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787831035.663773:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787831035.663780:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204705a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1874676443914624:12345-0@lo:9:umount.0 00000020:00000080:0.0:1787831035.663793:0:8408:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x95459fb9d1d28862 00000100:00080000:0.0:1787831035.663798:0:8408:0:(import.c:65:import_set_state_nolock()) ffff8d233bd1f800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787831035.663820:0:8408:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:0.0:1787831035.665224:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204705a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+2:3618:x1874676443914624:12345-0@lo:9:umount.0 Request processed in 1377us (10076us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831035.665953:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:0.0:1787831035.665998:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787831035.666013:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787831035.666122:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8d233be47000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1787831035.666143:0:3618:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1787831035.666145:0:3618:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787831035.666150:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203afda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1874676443914496:0@lo:9:umount.0 00000100:00080000:0.0:1787831035.666300:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8d233bd97800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1787831035.666313:0:3618:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1787831035.666315:0:3618:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787831035.666319:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203afcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1874676443914624:0@lo:9:umount.0 00010000:00010000:0.0:1787831035.666354:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787831035.668970:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204705e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3619:x1874676443913856:12345-0@lo:103:ldlm_bl.0 Request processed in 25647us (25913us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787831035.668983:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:0.0:1787831035.669039:0:3619:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.131@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787831035.670350:0:3620:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.131@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1787831035.670355:0:3620:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1787831035.670364:0:3620:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d2204706580 x1874676443913856/t0(0) o103->MGC192.168.203.131@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787831051 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787831035.670378:0:3620:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d2204706940 x1874676443913984/t0(0) o103->MGC192.168.203.131@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787831051 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787831035.670388:0:3620:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d2204624f00 x1874676443914368/t0(0) o103->MGC192.168.203.131@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787831051 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787831035.670396:0:3620:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d2204627480 x1874676443914240/t0(0) o103->MGC192.168.203.131@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787831051 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787831035.670431:0:3621:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8d2303f2b000 already not connected (conn 1, was 1): DISCONN 00000100:00100000:3.0:1787831035.670446:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204626d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443911808:0@lo:41:osp-pre-0-1.0 10000000:01000000:1.0:1787831035.670463:0:3620:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1787831035.670467:0:3620:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1787831035.670469:0:3620:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1787831035.670473:0:3620:0:(import.c:65:import_set_state_nolock()) ffff8d2303f2b000 MGS: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1787831035.670478:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a45944b-32e3-4193-a2a5-46f84222bc14:3621:1874676443913984:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1787831035.670479:0:3620:0:(import.c:510:import_select_connection()) MGC192.168.203.131@tcp: connect to NID 0@lo last attempt 129 00000100:00080000:1.0:1787831035.670491:0:3620:0:(import.c:624:import_select_connection()) MGC192.168.203.131@tcp: import ffff8d2303f2b000 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:1.0:1787831035.670523:0:3620:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2203a20780 x1874676443914752/t0(0) o250->MGC192.168.203.131@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787831035.670564:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a20780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2a45944b-32e3-4193-a2a5-46f84222bc14:3618:1874676443914752:0@lo:250:ptlrpcd_00_01.0 00000400:00000100:1.0:1787831035.670619:0:3618:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874676443914752 offset 0 length 520: 4 00000100:00100000:1.0:1787831035.670691:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204624f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a45944b-32e3-4193-a2a5-46f84222bc14:3620:1874676443914368:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787831035.670707:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204627480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a45944b-32e3-4193-a2a5-46f84222bc14:3620:1874676443914240:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787831035.670906:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787831035.671000:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22038f8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a45944b-32e3-4193-a2a5-46f84222bc14:0:1874676443914112:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1787831035.671310:0:3619:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8d2303f2b000 already not connected (conn 2, was 1): CONNECTING 00000100:00100000:0.0:1787831035.671324:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a45944b-32e3-4193-a2a5-46f84222bc14:3619:1874676443913856:0@lo:103:ldlm_bl.0 00000020:00080000:3.0:1787831035.677435:0:15314:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff8d2334548000) has no exports 00000020:01000000:2.0:1787831035.726456:0:15314:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d2202a33660 - data ffff8d2318aa9a20/ffff8d22035fc800 00000020:01000000:2.0:1787831035.727067:0:15314:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d233bc60780 - data ffff8d233089f948/ffff8d233b6d5c00 00000001:00000004:2.0:1787831035.742710:0:15314:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:2.0:1787831035.779731:0:15314:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787831035.779740:0:15314:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:2.0:1787831035.779747:0:15314:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1787831035.781202:0:15314:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787831035.781208:0:15314:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:2.0:1787831035.781255:0:15314:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787831035.781258:0:15314:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1787831035.781611:0:8617:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1787831035.781730:0:8617:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:1.0:1787831035.781740:0:8617:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1787831035.782942:0:15314:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787831035.782948:0:15314:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:2.0:1787831035.782956:0:15314:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787831035.782958:0:15314:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1787831035.786791:0:10063:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1787831035.786800:0:10063:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:0.0:1787831035.786817:0:10063:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1787831035.789214:0:15314:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x95459fb9d1d2850c 00000020:00000080:2.0:1787831035.789226:0:15314:0:(genops.c:885:class_export_put()) final put ffff8d232f4bd800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1787831035.794491:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d232f4bd800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1787831035.796769:0:15314:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x95459fb9d1d28521 00000020:00000080:0.0:1787831035.796785:0:15314:0:(genops.c:885:class_export_put()) final put ffff8d2334552000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1787831035.796799:0:15314:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:0.0:1787831035.796803:0:15314:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787831035.796811:0:15314:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787831035.796815:0:15314:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff8d23345499b8) has no exports 00000020:00000080:2.0:1787831035.796949:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2334552000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000004:01000000:0.0:1787831035.797046:0:15314:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1787831035.797054:0:15314:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x95459fb9d1d2885b 00000020:00000080:0.0:1787831035.799040:0:15314:0:(genops.c:885:class_export_put()) final put ffff8d220276e000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1787831035.799069:0:15314:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:0.0:1787831035.799079:0:15314:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787831035.799090:0:15314:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1787831035.799095:0:15314:0:(genops.c:1558:class_disconnect_exports()) OBD device 27 (ffff8d23344a19b8) has no exports 00000020:00000080:0.0:1787831035.799103:0:15314:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x95459fb9d1d28854 00000020:00000080:0.0:1787831035.799111:0:15314:0:(genops.c:885:class_export_put()) final put ffff8d233bd94000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1787831035.799616:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d220276e000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:1.0:1787831035.799647:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d233bd94000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1787831035.799900:0:15314:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:0.0:1787831035.799904:0:15314:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787831035.799908:0:15314:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:0.0:1787831035.799914:0:15314:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787831035.799916:0:15314:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787831035.799961:0:15314:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787831035.799972:0:15314:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787831035.799978:0:15314:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x95459fb9d1d286e8 00000020:00000080:0.0:1787831035.799984:0:15314:0:(genops.c:885:class_export_put()) final put ffff8d2201e0d800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1787831035.799999:0:15314:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:0.0:1787831035.800003:0:15314:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787831035.800008:0:15314:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1787831035.800011:0:15314:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff8d2201e1b370) has no exports 00000020:00000080:0.0:1787831035.800018:0:15314:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x95459fb9d1d286e1 00000020:00000080:0.0:1787831035.800021:0:15314:0:(genops.c:885:class_export_put()) final put ffff8d2201e0f000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1787831035.800755:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d233bd97800 for lustre-OST0001-osc-MDT0001 00000020:00000080:1.0:1787831035.800764:0:38:0:(genops.c:885:class_export_put()) final put ffff8d2203605800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787831035.800767:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2203605800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:1.0:1787831035.800772:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787831035.800854:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2201e0d800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1787831035.800858:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2201e0f000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1787831035.800907:0:15314:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:0.0:1787831035.800910:0:15314:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787831035.800913:0:15314:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:0.0:1787831035.800917:0:15314:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787831035.800919:0:15314:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787831035.800982:0:15314:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787831035.800989:0:15314:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:0.0:1787831035.801002:0:15314:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1787831035.801007:0:15314:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x95459fb9d1d28544 00000020:00000080:0.0:1787831035.801012:0:15314:0:(genops.c:885:class_export_put()) final put ffff8d2334554800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787831035.801048:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d233be47000 for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1787831035.801053:0:38:0:(genops.c:885:class_export_put()) final put ffff8d2201e0e800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787831035.801055:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2201e0e800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:1.0:1787831035.801058:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1787831035.801433:0:15314:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:0.0:1787831035.801438:0:15314:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787831035.801443:0:15314:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1787831035.801446:0:15314:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff8d232f4ccd28) has no exports 00000020:00000080:0.0:1787831035.801451:0:15314:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x95459fb9d1d2853d 00000020:00000080:0.0:1787831035.801454:0:15314:0:(genops.c:885:class_export_put()) final put ffff8d232f69c800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1787831035.801470:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2334554800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1787831035.802472:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d232f69c800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:1.0:1787831035.802709:0:15314:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:1.0:1787831035.802714:0:15314:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787831035.802717:0:15314:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:1.0:1787831035.802723:0:15314:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787831035.802804:0:15314:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787831035.802813:0:15314:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787831035.802837:0:15314:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787831035.802840:0:15314:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787831035.802844:0:15314:0:(genops.c:885:class_export_put()) final put ffff8d23100ba000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787831035.802847:0:15314:0:(genops.c:844:class_export_destroy()) destroying export ffff8d23100ba000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:1.0:1787831035.802854:0:15314:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787831035.802998:0:15314:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x95459fb9d1d28528 00000020:00000080:1.0:1787831035.803013:0:15314:0:(genops.c:885:class_export_put()) final put ffff8d2334552800/lustre-MDD0001_UUID 00000020:00000080:2.0:1787831035.803033:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d232f69b000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:2.0:1787831035.803040:0:38:0:(genops.c:885:class_export_put()) final put ffff8d232f69e000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1787831035.803042:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d232f69e000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:2.0:1787831035.803048:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1787831035.803237:0:15314:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:1.0:1787831035.803242:0:15314:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787831035.803246:0:15314:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787831035.803250:0:15314:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff8d233454b370) has no exports 00000020:00000080:1.0:1787831035.803267:0:15314:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787831035.803270:0:15314:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:1.0:1787831035.803274:0:15314:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x95459fb9d1d2852f 00000020:00000080:1.0:1787831035.803279:0:15314:0:(genops.c:885:class_export_put()) final put ffff8d2334557000/lustre-MDT0001-osd_UUID 00000020:01000004:1.0:1787831035.803286:0:15314:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d232f730000 from lustre-MDT0001, refs=2 00000020:01000004:1.0:1787831035.803289:0:15314:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d232f730000 2 00000020:01000004:1.0:1787831035.803291:0:15314:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8d232f730000 from lustre-MDT0001 00000020:00000080:1.0:1787831035.803306:0:15314:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787831035.803308:0:15314:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:1.0:1787831035.803311:0:15314:0:(genops.c:885:class_export_put()) final put ffff8d232f4b8800/lustre-MDT0001_UUID 00000020:00000080:1.0:1787831035.803313:0:15314:0:(genops.c:844:class_export_destroy()) destroying export ffff8d232f4b8800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:1.0:1787831035.803319:0:15314:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:1.0:1787831035.803354:0:15314:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:1.0:1787831035.803359:0:15314:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:1.0:1787831035.803362:0:15314:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787831035.803365:0:15314:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787831035.803372:0:15314:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff8d233bc5b800 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787831035.803377:0:15314:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff8d233454cd28) has exports, disconnecting them 00000020:00080000:1.0:1787831035.803382:0:15314:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff8d233bc5b800), last request at 1787830857 00000020:00000080:1.0:1787831035.803385:0:15314:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x95459fb9d1d28583 00000020:00080000:1.0:1787831035.803395:0:15314:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d233bc5b800): rc 0 00000020:00000080:1.0:1787831035.803398:0:15314:0:(genops.c:885:class_export_put()) final put ffff8d233bc5b800/lustre-MDT0000-lwp-MDT0001 00000020:00000080:2.0:1787831035.804072:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2334552800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:2.0:1787831035.804080:0:38:0:(genops.c:885:class_export_put()) final put ffff8d2334553800/lustre-MDD0001_UUID 00000020:00000080:2.0:1787831035.804083:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2334553800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:2.0:1787831035.804086:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:2.0:1787831035.804262:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2334557000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1787831035.804267:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d233bc5b800/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:2.0:1787831035.822708:0:15314:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:2.0:1787831035.822717:0:15314:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787831035.822721:0:15314:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787831035.822730:0:15314:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787831035.822761:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d233bc5d800 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:2.0:1787831035.822938:0:15314:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787831035.822945:0:15314:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:2.0:1787831035.822951:0:15314:0:(genops.c:885:class_export_put()) final put ffff8d233452d800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:2.0:1787831035.822954:0:15314:0:(genops.c:844:class_export_destroy()) destroying export ffff8d233452d800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:2.0:1787831035.822959:0:15314:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:2.0:1787831035.823021:0:15314:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d232f730000 1 00000020:00000080:2.0:1787831035.823026:0:15314:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x95459fb9d1d284bf 00000020:00000080:2.0:1787831035.823032:0:15314:0:(genops.c:885:class_export_put()) final put ffff8d232f69d800/lustre-MDT0001-osd_UUID 00000020:01000000:2.0:1787831035.823039:0:15314:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:2.0:1787831035.823046:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d232f69d800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1787831035.823054:0:15314:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787831035.823058:0:15314:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787831035.823061:0:15314:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff8d230333b370) has no exports 00010000:00010000:1.0:1787831035.879754:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787831035.913138:0:15314:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787831035.913152:0:15314:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:2.0:1787831035.913158:0:15314:0:(genops.c:885:class_export_put()) final put ffff8d232f731000/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1787831035.913162:0:15314:0:(genops.c:844:class_export_destroy()) destroying export ffff8d232f731000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:2.0:1787831035.913175:0:15314:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:3.0:1787831035.914689:0:15314:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8d232f734000 00000020:01000000:3.0:1787831035.914723:0:15314:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1787831035.914730:0:15314:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787831035.914737:0:15314:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787831035.914743:0:15314:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff8d2312954d28) has no exports 00000100:00100000:0.0:1787831035.914898:0:8620:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff8d2202466a00:8620] 3 exiting: rc = 0 00000100:00100000:0.0:1787831035.915132:0:13771:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff8d220394bc00:13771] 4 exiting: rc = 0 00000100:00100000:1.0:1787831035.915787:0:6492:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff8d233a7f8600:6492] 2 exiting: rc = 0 00000100:00100000:2.0:1787831035.916118:0:6490:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff8d233820e800:6490] 0 exiting: rc = 1 00000100:00100000:2.0:1787831035.916219:0:6491:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff8d233820fe00:6491] 1 exiting: rc = 0 00000100:00100000:3.0:1787831035.916319:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.916332:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.916342:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.916353:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.916362:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.916369:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.916386:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.916391:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.916397:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.916407:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.916412:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.916418:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.916424:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.916430:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.916436:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.916442:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.916448:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.916453:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.916459:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.916465:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.916471:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.916477:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.916483:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.916489:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.916495:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.916501:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.916506:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.916512:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.916518:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.916524:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.916529:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.916534:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.916540:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.916545:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.916551:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.916556:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.916562:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.916567:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.916574:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.916580:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.916585:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.916596:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.916614:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.916620:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.916643:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.916649:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.916656:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.916664:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.916671:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.916678:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.916684:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.916690:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.916695:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.916700:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.916705:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.916711:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.916716:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.916721:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.916727:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.916732:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.916737:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.916741:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.916746:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.916761:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.919454:0:6493:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff8d233a7f8e00:6493] 0 exiting: rc = 1 00000100:00100000:1.0:1787831035.919612:0:6494:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8d233a7f8400:6494] 1 exiting: rc = 0 00000100:00100000:2.0:1787831035.919848:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.919857:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.919865:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.919871:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.919877:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.919883:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.919889:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.919894:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.919899:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.919906:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.919911:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.919917:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.919923:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.919928:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.919934:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.919939:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.919944:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.919949:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.919954:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.919960:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.919964:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.919969:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.919974:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.919978:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.919984:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.919990:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.919995:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.920000:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.920004:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.920009:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.920014:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.920019:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.920024:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.920039:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.920045:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.920050:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.920055:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.920060:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.920066:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.920071:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.920077:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.920081:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.920086:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.920091:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.920096:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.920100:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.920105:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.920110:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.920115:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.920120:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.920232:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.920241:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.920245:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.920250:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.920256:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.920261:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.920266:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.920271:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.920276:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.920281:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.920286:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.920290:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.920295:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.920300:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.920733:0:6495:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff8d2307ca3800:6495] 0 exiting: rc = 1 00000100:00100000:0.0:1787831035.920923:0:6496:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff8d23046c9400:6496] 1 exiting: rc = 0 00000100:00100000:1.0:1787831035.920937:0:7448:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff8d233bce0c00:7448] 2 exiting: rc = 0 00000100:00100000:2.0:1787831035.921011:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.921020:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.921027:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.921034:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.921047:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.921055:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.921064:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.921071:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.921077:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.921099:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.921106:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.921113:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.921119:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.921330:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.921340:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.921345:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.921352:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.921359:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.921365:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.921371:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.921377:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.921396:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.921402:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.921408:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.921414:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.921419:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.921425:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.921431:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.921437:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.921442:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.921448:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.921454:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.921459:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.921476:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.921483:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.921488:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.921494:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.921499:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.921505:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.921516:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.921522:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.921527:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.921533:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.921539:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.921544:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.921561:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.921567:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.921573:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.921579:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.921585:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.921591:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.921597:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.921613:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.921618:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.921645:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.921653:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.921659:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.921680:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.921687:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.921693:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.921698:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.921703:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.921707:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.921720:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831035.932743:0:6498:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8d2338215a00:6498] 1 exiting: rc = 0 00000100:00100000:0.0:1787831035.932772:0:6497:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8d2338214000:6497] 0 exiting: rc = 1 00000100:00100000:3.0:1787831035.932956:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.932963:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.932969:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.932974:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.932979:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.932983:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.932986:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.932990:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.932993:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.932997:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.933011:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.933014:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.933017:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.933020:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.933024:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.933030:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.933035:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.933040:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.933045:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.933050:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.933055:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.933060:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.933064:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.933068:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.933073:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.933077:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.933082:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.933086:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.933091:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.933097:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.933101:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.933107:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.933111:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.933116:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.933121:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.933138:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.933143:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.933148:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.933152:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.933157:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.933162:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.933166:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.933171:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.933176:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.933181:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.933193:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.933198:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.933203:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.933208:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.933214:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.933219:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.933224:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.933229:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.933234:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.933238:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.933243:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.933247:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.933251:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.933256:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.933261:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.933265:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.933271:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.933276:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.933281:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831035.933670:0:6500:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8d2338215200:6500] 1 exiting: rc = 0 00000100:00100000:2.0:1787831035.933868:0:6499:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8d2338215400:6499] 0 exiting: rc = 1 00000100:00100000:0.0:1787831035.934078:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.934084:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.934090:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.934095:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.934100:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.934105:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.934123:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.934139:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.934146:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.934150:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.934155:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.934160:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.934165:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.934171:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.934177:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.934182:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.934188:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.934194:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.934200:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.934205:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.934211:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.934216:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.934221:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.934227:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.934232:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.934236:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.934240:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.934245:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.934249:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.934254:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.934259:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.934264:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.934268:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.934273:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.934279:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.934285:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.934290:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.934297:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.934302:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.934307:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.934312:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.934325:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.934330:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.934335:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.934339:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.934344:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.934349:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.934354:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.934358:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.934363:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.934368:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.934373:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.934378:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.934382:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.934388:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.934393:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.934398:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.934403:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.934408:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.934413:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.934419:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.934424:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.934429:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.934435:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831035.935319:0:6501:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff8d2338214400:6501] 0 exiting: rc = 1 00000100:00100000:2.0:1787831035.935413:0:6502:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff8d2338541400:6502] 1 exiting: rc = 0 00000100:00100000:0.0:1787831035.935523:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.935530:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.935535:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.935541:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.935547:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.935552:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.935557:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.935562:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.935567:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.935572:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.935577:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.935583:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.935610:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.935616:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.935863:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.935873:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.935878:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.935883:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.935888:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.935893:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.935898:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.935903:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.935908:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.935913:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.935918:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.935923:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.935928:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.935933:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.935939:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.935944:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.935949:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.935954:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.935959:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.935964:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.935970:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.935976:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.935981:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.935987:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.935993:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.935998:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.936003:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.936008:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.936014:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.936019:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.936025:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.936030:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.936035:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.936051:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.936056:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.936060:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.936065:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.936070:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.936074:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.936079:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.936085:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.936089:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.936094:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.936099:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.936103:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.936109:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.936115:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.936120:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.936126:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.936132:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831035.936677:0:6503:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff8d2321946000:6503] 0 exiting: rc = 1 00000100:00100000:3.0:1787831035.936981:0:6505:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff8d2338541800:6505] 2 exiting: rc = 0 00000100:00100000:1.0:1787831035.937010:0:6504:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff8d2338540a00:6504] 1 exiting: rc = 0 00000100:00100000:0.0:1787831035.937130:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.937137:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.937143:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.937148:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.937153:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.937174:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.937182:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.937187:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.937192:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.937197:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.937203:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.937207:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.937212:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.937218:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.937224:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.937230:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.937235:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.937240:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.937258:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.937263:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.937270:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.937275:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.937281:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.937286:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.937291:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.937296:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.937301:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.937306:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.937312:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.937334:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.937342:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.937347:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.937354:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.937359:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.937365:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.937370:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.937376:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.937382:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.937387:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.937393:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.937400:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.937406:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.937412:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.937419:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.937425:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.937431:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.937436:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.937441:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.937447:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.937452:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.937458:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.937463:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.937468:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.937496:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.937503:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.937509:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.937515:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.937520:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.937526:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.937531:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.937537:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.937542:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.937548:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831035.937554:0:15314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1787831035.941549:0:15314:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787831035.941563:0:15314:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1787831035.941568:0:15314:0:(genops.c:885:class_export_put()) final put ffff8d2303f29000/MDS_uuid 00000020:00000080:0.0:1787831035.941572:0:15314:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2303f29000/MDS_uuid for MDS 00000020:01000000:0.0:1787831035.941582:0:15314:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1787831035.941910:0:15314:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:0.0:1787831036.903737:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787831037.672320:0:478:0:(pinger.c:229:ptlrpc_pinger_process_import()) 2a45944b-32e3-4193-a2a5-46f84222bc14->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787831037.672330:0:478:0:(pinger.c:247:ptlrpc_pinger_process_import()) 2a45944b-32e3-4193-a2a5-46f84222bc14->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787831037.672333:0:478:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787831037.672337:0:478:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787831037.672342:0:478:0:(import.c:65:import_set_state_nolock()) ffff8d2334551800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787831037.672350:0:478:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 323 00000100:00080000:3.0:1787831037.672356:0:478:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787831037.672362:0:478:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8d2334551800 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:3.0:1787831037.672397:0:478:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2203afc000 x1874676443914880/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787831037.672456:0:478:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787831037.672460:0:478:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787831037.672462:0:478:0:(import.c:65:import_set_state_nolock()) ffff8d233bda1800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787831037.672466:0:478:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 323 00000100:00080000:3.0:1787831037.672468:0:478:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787831037.672472:0:478:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8d233bda1800 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:3.0:1787831037.672483:0:478:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2203afe580 x1874676443915136/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787831037.672521:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203aff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3621:1874676443915008:0@lo:400:kworker.0 00000400:00000100:3.0:1787831037.672572:0:3621:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874676443915008 offset 0 length 224: 4 00000100:00100000:3.0:1787831037.672660:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787831037.672668:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203afed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3621:1874676443915264:0@lo:400:kworker.0 00000400:00000100:3.0:1787831037.672690:0:3621:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874676443915264 offset 0 length 224: 4 00000100:00100000:1.0:1787831037.672696:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203afc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3618:1874676443914880:0@lo:38:kworker.0 00000400:00000100:1.0:1787831037.672728:0:3618:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874676443914880 offset 0 length 520: 4 00000100:00100000:1.0:1787831037.672746:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203afe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3618:1874676443915136:0@lo:38:kworker.0 00000400:00000100:1.0:1787831037.672767:0:3618:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874676443915136 offset 0 length 520: 4 00010000:00010000:0.0:1787831037.927891:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787831038.798030:0:15515:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1787831038.812874:0:15515:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1787831038.812952:0:15515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233837ac00/0x95459fb9d1d2890a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d28911 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831038.812970:0:15515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233837ac00/0x95459fb9d1d2890a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d28911 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831038.812978:0:15515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233837ac00/0x95459fb9d1d2890a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x95459fb9d1d28911 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831038.812985:0:15515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.131@tcp lock: ffff8d233837ac00/0x95459fb9d1d2890a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x95459fb9d1d28911 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831038.813031:0:15515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787831038.813037:0:15515:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1787831038.813071:0:15515:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787831038.813086:0:15515:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d2203afc000 x1874676443914880/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787831052 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787831038.813116:0:15515:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787831038.813124:0:15515:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787831038.813132:0:15515:0:(import.c:65:import_set_state_nolock()) ffff8d2334551800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1787831038.813138:0:15515:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787831038.813141:0:15515:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d2203afc000 x1874676443914880/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787831052 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787831038.813148:0:15515:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787831038.813151:0:15515:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 18s for inflight to error out 00010000:00010000:1.0:1787831038.813392:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787831038.813402:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8d233837ac00/0x95459fb9d1d2890a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x95459fb9d1d28911 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831038.813410:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233837ac00 already unused, calling callback (ffffffffc14f9c20) 10000000:00010000:1.0:1787831038.813413:0:6479:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8d233837ac00/0x95459fb9d1d2890a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x95459fb9d1d28911 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831038.813421:0:6479:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8d233837ac00/0x95459fb9d1d2890a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x95459fb9d1d28911 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787831038.813426:0:6479:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8d233837ac00/0x95459fb9d1d2890a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x95459fb9d1d28911 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787831038.813430:0:6479:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787831038.813432:0:6479:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1787831038.813434:0:6479:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1787831038.813449:0:6479:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d2303f2b000 00010000:00010000:1.0:1787831038.813451:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8d233837ac00/0x95459fb9d1d2890a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x95459fb9d1d28911 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831038.813457:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8d233837ac00/0x95459fb9d1d2890a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x95459fb9d1d28911 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831038.813473:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787831038.813475:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787831038.813476:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787831038.813946:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203afc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3618:1874676443914880:0@lo:38:kworker.0 00000100:00080000:3.0:1787831038.816390:0:15515:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1787831038.816413:0:15515:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d2203aff480 x1874676443915008/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787831053 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787831038.816443:0:15515:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787831038.816451:0:15515:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1787831038.816485:0:15515:0:(import.c:65:import_set_state_nolock()) ffff8d232f69b800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1787831038.816489:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203aff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3621:1874676443915008:0@lo:400:kworker.0 00000100:00100000:2.0:1787831038.816566:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203afda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3618:1874676443915392:0@lo:39:umount.0 00000400:00000100:2.0:1787831038.816706:0:3618:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874676443915392 offset 0 length 224: 4 00010000:00010000:0.0:1787831038.951304:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787831039.975434:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787831040.679788:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 2a45944b-32e3-4193-a2a5-46f84222bc14->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787831040.679827:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 2a45944b-32e3-4193-a2a5-46f84222bc14->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787831040.679831:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787831040.679834:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787831040.680004:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22047070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3619:1874676443915520:0@lo:400:kworker.0 00000400:00000100:1.0:1787831040.680087:0:3619:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874676443915520 offset 0 length 224: 4 00000001:00100000:2.0:1787831040.747159:0:8401:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1787831040.747171:0:8401:0:(genops.c:885:class_export_put()) final put ffff8d233bda6800/lustre-MDT0001-mdtlov_UUID 00000001:00100000:1.0:1787831040.747737:0:9484:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787831040.747742:0:9484:0:(genops.c:885:class_export_put()) final put ffff8d233bd1e000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787831040.748712:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d233bda6800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1787831040.751295:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d233bd1e000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1787831040.751373:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d233bda7800 for lustre-OST0000 00000020:00000080:3.0:1787831040.751380:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d233bd1f800 for lustre-OST0001 00010000:00010000:1.0:1787831041.000986:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787831042.023000:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787831042.727102:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 2a45944b-32e3-4193-a2a5-46f84222bc14->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787831042.727113:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 2a45944b-32e3-4193-a2a5-46f84222bc14->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787831042.727132:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787831042.727135:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787831042.727265:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787831042.727285:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203afd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3619:1874676443915648:0@lo:400:kworker.0 00000400:00000100:0.0:1787831042.727336:0:3619:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874676443915648 offset 0 length 224: 4 00010000:00010000:0.0:1787831043.047807:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787831044.070850:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787831045.094856:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787831045.990758:0:3618:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787831035/real 1787831035] req@ffff8d2203a20780 x1874676443914752/t0(0) o250->MGC192.168.203.131@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787831045 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787831045.990792:0:3618:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d2203a20780 x1874676443914752/t0(0) o250->MGC192.168.203.131@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787831045 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787831045.990815:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8d2303f2b000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787831045.990842:0:3618:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1787831045.990846:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a20780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2a45944b-32e3-4193-a2a5-46f84222bc14:3618:1874676443914752:0@lo:250:ptlrpcd_00_01.0 00000100:00080000:3.0:1787831045.990961:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 2a45944b-32e3-4193-a2a5-46f84222bc14->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787831045.990966:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1787831045.990969:0:8:0:(import.c:65:import_set_state_nolock()) ffff8d2303f2b000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787831045.990974:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.131@tcp: connect to NID 0@lo last attempt 326 00000100:00080000:3.0:1787831045.990979:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.131@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787831045.990985:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.131@tcp: import ffff8d2303f2b000 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:3.0:1787831045.991016:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2203afc3c0 x1874676443915776/t0(0) o250->MGC192.168.203.131@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787831045.991080:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203afc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2a45944b-32e3-4193-a2a5-46f84222bc14:3618:1874676443915776:0@lo:250:kworker.0 00000400:00000100:2.0:1787831045.991140:0:3618:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874676443915776 offset 0 length 520: 4 00000100:00080000:3.0:1787831045.991380:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787831045.991385:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787831045.991559:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203afd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3621:1874676443915904:0@lo:400:kworker.0 00000400:00000100:0.0:1787831045.991587:0:3621:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874676443915904 offset 0 length 224: 4 00010000:00010000:0.0:1787831046.118808:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787831047.144251:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787831048.038796:0:3618:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787831038/real 1787831038] req@ffff8d2203afda40 x1874676443915392/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787831048 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787831048.038829:0:3618:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d2203afda40 x1874676443915392/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787831048 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787831048.038850:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8d232f69b800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1787831048.038873:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203afda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3618:1874676443915392:0@lo:39:umount.0 00000100:00080000:3.0:1787831048.038987:0:15515:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1787831048.038993:0:15515:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787831048.038997:0:15515:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1787831048.039902:0:15515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d2307c77e00/0x95459fb9d1d28918 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2891f expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831048.039919:0:15515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d2307c77e00/0x95459fb9d1d28918 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d2891f expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831048.039927:0:15515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d2307c77e00/0x95459fb9d1d28918 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x95459fb9d1d2891f expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831048.039934:0:15515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.131@tcp lock: ffff8d2307c77e00/0x95459fb9d1d28918 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x95459fb9d1d2891f expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831048.039982:0:15515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787831048.039990:0:15515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233bf11200/0x95459fb9d1d28b79 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d28b80 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831048.039997:0:15515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233bf11200/0x95459fb9d1d28b79 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d28b80 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831048.040002:0:15515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233bf11200/0x95459fb9d1d28b79 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x95459fb9d1d28b80 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831048.040008:0:15515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.131@tcp lock: ffff8d233bf11200/0x95459fb9d1d28b79 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x95459fb9d1d28b80 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831048.040028:0:15515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1787831048.040033:0:15515:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:3.0:1787831048.040060:0:15515:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1787831048.040064:0:15515:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:3.0:1787831048.040069:0:15515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787831048.040074:0:15515:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787831048.040078:0:15515:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff8d2201e18000) has no exports 00000020:00080000:3.0:1787831048.040100:0:15515:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff8d2201e18000) has no exports 00000020:01000000:3.0:1787831048.041779:0:15515:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d2203668060 - data ffff8d2330acc1b0/ffff8d2203733800 00000020:01000000:3.0:1787831048.041937:0:15515:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d22025b6a80 - data ffff8d2330a7e360/ffff8d22025d0c00 00010000:00010000:0.0:1787831048.045816:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787831048.045833:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8d2307c77e00/0x95459fb9d1d28918 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x95459fb9d1d2891f expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831048.045846:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2307c77e00 already unused, calling callback (ffffffffc14f9c20) 10000000:00010000:0.0:1787831048.045850:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8d2307c77e00/0x95459fb9d1d28918 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x95459fb9d1d2891f expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831048.045861:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8d2307c77e00/0x95459fb9d1d28918 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x95459fb9d1d2891f expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787831048.045868:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8d2307c77e00/0x95459fb9d1d28918 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x95459fb9d1d2891f expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787831048.045874:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787831048.045877:0:6478:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:0.0:1787831048.045880:0:6478:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:0.0:1787831048.045899:0:6478:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d2303f2b000 00010000:00010000:0.0:1787831048.045903:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8d2307c77e00/0x95459fb9d1d28918 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x95459fb9d1d2891f expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831048.045912:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8d2307c77e00/0x95459fb9d1d28918 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x95459fb9d1d2891f expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831048.045928:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787831048.045933:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8d233bf11200/0x95459fb9d1d28b79 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x95459fb9d1d28b80 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831048.045940:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233bf11200 already unused, calling callback (ffffffffc14f9c20) 10000000:00010000:0.0:1787831048.045943:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8d233bf11200/0x95459fb9d1d28b79 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x95459fb9d1d28b80 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831048.045982:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8d233bf11200/0x95459fb9d1d28b79 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x95459fb9d1d28b80 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787831048.045989:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8d233bf11200/0x95459fb9d1d28b79 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x95459fb9d1d28b80 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787831048.045994:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1787831048.045996:0:6478:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1787831048.045998:0:6478:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1787831048.046003:0:6478:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d2303f2b000 00010000:00010000:0.0:1787831048.046007:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8d233bf11200/0x95459fb9d1d28b79 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x95459fb9d1d28b80 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831048.046012:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8d233bf11200/0x95459fb9d1d28b79 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x95459fb9d1d28b80 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831048.046023:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787831048.046025:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787831048.046026:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787831048.046216:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1787831048.054660:0:15515:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1787831048.068212:0:15515:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x95459fb9d1d2865c 00000020:00000080:0.0:1787831048.068223:0:15515:0:(genops.c:885:class_export_put()) final put ffff8d2201e0a000/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1787831048.068236:0:15515:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d232f6b0800 from lustre-OST0000, refs=2 00000020:01000004:0.0:1787831048.068303:0:15515:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d232f6b0800 2 00000020:01000004:0.0:1787831048.068307:0:15515:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8d232f6b0800 from lustre-OST0000 00000020:00000080:0.0:1787831048.068329:0:15515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787831048.068339:0:15515:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1787831048.068342:0:15515:0:(genops.c:885:class_export_put()) final put ffff8d2201e0c800/lustre-OST0000_UUID 00000020:00000080:0.0:1787831048.068345:0:15515:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2201e0c800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1787831048.068352:0:15515:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1787831048.068401:0:15515:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1787831048.068415:0:15515:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1787831048.068418:0:15515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787831048.068424:0:15515:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787831048.068430:0:15515:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8d2334529800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787831048.068436:0:15515:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff8d232f4c99b8) has exports, disconnecting them 00000020:00080000:0.0:1787831048.068441:0:15515:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8d2334529800), last request at 1787830873 00000020:00000080:0.0:1787831048.068445:0:15515:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x95459fb9d1d28686 00000020:00080000:0.0:1787831048.068455:0:15515:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d2334529800): rc 0 00000020:00000080:0.0:1787831048.068460:0:15515:0:(genops.c:885:class_export_put()) final put ffff8d2334529800/lustre-MDT0000-lwp-OST0000 00010000:01000000:1.0:1787831048.072936:0:15515:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:1.0:1787831048.072946:0:15515:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787831048.072950:0:15515:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1787831048.072957:0:15515:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787831048.073120:0:15515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787831048.073129:0:15515:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:1.0:1787831048.073135:0:15515:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1787831048.073140:0:15515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787831048.073144:0:15515:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787831048.073151:0:15515:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff8d232f4bd000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787831048.073158:0:15515:0:(genops.c:1553:class_disconnect_exports()) OBD device 20 (ffff8d232f4c8000) has exports, disconnecting them 00000020:00080000:1.0:1787831048.073162:0:15515:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff8d232f4bd000), last request at 1787830873 00000020:00000080:1.0:1787831048.073166:0:15515:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x95459fb9d1d2869b 00000020:00080000:1.0:1787831048.073179:0:15515:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d232f4bd000): rc 0 00000020:00000080:1.0:1787831048.073184:0:15515:0:(genops.c:885:class_export_put()) final put ffff8d232f4bd000/lustre-MDT0001-lwp-OST0000 00000020:00000080:2.0:1787831048.076368:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2201e0a000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1787831048.076392:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2334529800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1787831048.076412:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d2334551800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1787831048.076422:0:8:0:(genops.c:885:class_export_put()) final put ffff8d233be41800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:2.0:1787831048.076425:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d233be41800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:2.0:1787831048.076432:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:2.0:1787831048.076498:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d232f4bd000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:2.0:1787831048.086781:0:15515:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:2.0:1787831048.086793:0:15515:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787831048.086798:0:15515:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787831048.086806:0:15515:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787831048.086837:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d232f69b800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:2.0:1787831048.087009:0:15515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787831048.087017:0:15515:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:2.0:1787831048.087022:0:15515:0:(genops.c:885:class_export_put()) final put ffff8d23100bf000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:2.0:1787831048.087026:0:15515:0:(genops.c:844:class_export_destroy()) destroying export ffff8d23100bf000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:2.0:1787831048.087031:0:15515:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:2.0:1787831048.087094:0:15515:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d232f6b0800 1 00000020:00000080:2.0:1787831048.087099:0:15515:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x95459fb9d1d28624 00000020:00000080:2.0:1787831048.087106:0:15515:0:(genops.c:885:class_export_put()) final put ffff8d2335349000/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1787831048.087114:0:15515:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1787831048.087122:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2335349000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1787831048.087130:0:15515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787831048.087135:0:15515:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787831048.087138:0:15515:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff8d23129519b8) has no exports 00000020:00000080:2.0:1787831048.130320:0:15515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787831048.130336:0:15515:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1787831048.130342:0:15515:0:(genops.c:885:class_export_put()) final put ffff8d232f6b6800/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1787831048.130347:0:15515:0:(genops.c:844:class_export_destroy()) destroying export ffff8d232f6b6800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1787831048.130360:0:15515:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1787831048.130486:0:15515:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8d232f6b3800 00000020:02000400:2.0:1787831048.132041:0:15515:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1787831048.169044:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787831049.192504:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787831050.219587:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787831050.803438:0:15717:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1787831050.819872:0:15717:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1787831050.819968:0:15717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233be95200/0x95459fb9d1d288ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d288f5 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831050.819984:0:15717:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233be95200/0x95459fb9d1d288ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d288f5 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831050.819992:0:15717:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233be95200/0x95459fb9d1d288ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x95459fb9d1d288f5 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831050.820000:0:15717:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.131@tcp lock: ffff8d233be95200/0x95459fb9d1d288ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x95459fb9d1d288f5 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831050.820022:0:15717:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787831050.820027:0:15717:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1787831050.820054:0:15717:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787831050.820067:0:15717:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d2203afe580 x1874676443915136/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787831052 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787831050.820097:0:15717:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787831050.820118:0:15717:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787831050.820124:0:15717:0:(import.c:65:import_set_state_nolock()) ffff8d233bda1800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1787831050.820129:0:15717:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787831050.820134:0:15717:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d2203afe580 x1874676443915136/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787831052 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787831050.820142:0:15717:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787831050.820145:0:15717:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 2s for inflight to error out 00000100:00100000:2.0:1787831050.820296:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203afe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3618:1874676443915136:0@lo:38:kworker.0 00010000:00010000:1.0:1787831050.820585:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787831050.820595:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8d233be95200/0x95459fb9d1d288ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x95459fb9d1d288f5 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831050.820605:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233be95200 already unused, calling callback (ffffffffc14f9c20) 10000000:00010000:1.0:1787831050.820609:0:6479:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8d233be95200/0x95459fb9d1d288ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x95459fb9d1d288f5 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831050.820620:0:6479:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8d233be95200/0x95459fb9d1d288ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x95459fb9d1d288f5 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787831050.820846:0:6479:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8d233be95200/0x95459fb9d1d288ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x95459fb9d1d288f5 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787831050.820852:0:6479:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787831050.820855:0:6479:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1787831050.820858:0:6479:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1787831050.820871:0:6479:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d2303f2b000 00010000:00010000:1.0:1787831050.820875:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8d233be95200/0x95459fb9d1d288ee lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x95459fb9d1d288f5 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831050.820883:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8d233be95200/0x95459fb9d1d288ee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x95459fb9d1d288f5 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831050.820894:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787831050.820896:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787831050.820898:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787831050.821251:0:15717:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1787831050.821260:0:15717:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d2203afed00 x1874676443915264/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787831053 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787831050.821350:0:15717:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d22047070c0 x1874676443915520/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787831056 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787831050.821370:0:15717:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d2203afd2c0 x1874676443915648/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787831058 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787831050.821379:0:15717:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d2203afd680 x1874676443915904/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787831061 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787831050.821387:0:15717:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787831050.821391:0:15717:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1787831050.821416:0:15717:0:(import.c:65:import_set_state_nolock()) ffff8d2203513800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1787831050.821737:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204627840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3618:1874676443916032:0@lo:39:umount.0 00000400:00000100:2.0:1787831050.821789:0:3618:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874676443916032 offset 0 length 224: 4 00000100:00100000:1.0:1787831050.821899:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203afd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3619:1874676443915648:0@lo:400:kworker.0 00000100:00100000:1.0:1787831050.821909:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22047070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3619:1874676443915520:0@lo:400:kworker.0 00000100:00100000:3.0:1787831050.824283:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203afed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3621:1874676443915264:0@lo:400:kworker.0 00000100:00100000:3.0:1787831050.824314:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203afd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3621:1874676443915904:0@lo:400:kworker.0 00010000:00010000:0.0:1787831051.239533:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787831051.494920:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 2a45944b-32e3-4193-a2a5-46f84222bc14->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787831051.494935:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 2a45944b-32e3-4193-a2a5-46f84222bc14->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:1.0:1787831052.263260:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787831053.287737:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787831054.310961:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787831055.334873:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787831056.358854:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787831056.614909:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 2a45944b-32e3-4193-a2a5-46f84222bc14->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787831056.614930:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 2a45944b-32e3-4193-a2a5-46f84222bc14->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1787831057.382889:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787831058.407977:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787831059.431089:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787831060.071190:0:3618:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787831050/real 1787831050] req@ffff8d2204627840 x1874676443916032/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787831060 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787831060.071222:0:3618:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d2204627840 x1874676443916032/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787831060 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787831060.071232:0:3618:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787831045/real 1787831045] req@ffff8d2203afc3c0 x1874676443915776/t0(0) o250->MGC192.168.203.131@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787831060 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787831060.071243:0:3618:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d2203afc3c0 x1874676443915776/t0(0) o250->MGC192.168.203.131@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787831060 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787831060.071260:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8d2203513800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1787831060.071281:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204627840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3618:1874676443916032:0@lo:39:umount.0 00000100:00080000:2.0:1787831060.071287:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8d2303f2b000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787831060.071308:0:3618:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1787831060.071311:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203afc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2a45944b-32e3-4193-a2a5-46f84222bc14:3618:1874676443915776:0@lo:250:kworker.0 00000100:00080000:0.0:1787831060.071400:0:15717:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1787831060.071405:0:15717:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787831060.071410:0:15717:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1787831060.071476:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 2a45944b-32e3-4193-a2a5-46f84222bc14->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787831060.071483:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1787831060.071486:0:37:0:(import.c:65:import_set_state_nolock()) ffff8d2303f2b000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787831060.071491:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.131@tcp: connect to NID 0@lo last attempt 336 00000100:00080000:1.0:1787831060.071496:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.131@tcp: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787831060.071502:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.131@tcp: import ffff8d2303f2b000 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:1.0:1787831060.071533:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2203a22940 x1874676443916160/t0(0) o250->MGC192.168.203.131@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787831060.071621:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a22940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2a45944b-32e3-4193-a2a5-46f84222bc14:3618:1874676443916160:0@lo:250:kworker.0 00000400:00000100:2.0:1787831060.071686:0:3618:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874676443916160 offset 0 length 520: 4 00010000:00010000:0.0:1787831060.072568:0:15717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233be95600/0x95459fb9d1d288fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d28903 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831060.072583:0:15717:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233be95600/0x95459fb9d1d288fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d28903 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831060.072591:0:15717:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233be95600/0x95459fb9d1d288fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x95459fb9d1d28903 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831060.072598:0:15717:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.131@tcp lock: ffff8d233be95600/0x95459fb9d1d288fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x95459fb9d1d28903 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831060.072653:0:15717:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787831060.072661:0:15717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233bf10e00/0x95459fb9d1d28b6b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d28b72 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831060.072668:0:15717:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233bf10e00/0x95459fb9d1d28b6b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d28b72 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831060.072675:0:15717:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233bf10e00/0x95459fb9d1d28b6b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x95459fb9d1d28b72 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831060.072681:0:15717:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.131@tcp lock: ffff8d233bf10e00/0x95459fb9d1d28b6b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x95459fb9d1d28b72 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831060.072691:0:15717:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1787831060.072695:0:15717:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:0.0:1787831060.072716:0:15717:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1787831060.072720:0:15717:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:0.0:1787831060.072725:0:15717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787831060.072731:0:15717:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787831060.072743:0:15717:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff8d233f433370) has no exports 00000020:00080000:0.0:1787831060.072766:0:15717:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff8d233f433370) has no exports 00010000:00010000:1.0:1787831060.073068:0:7431:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787831060.073075:0:7431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8d233be95600/0x95459fb9d1d288fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x95459fb9d1d28903 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831060.073084:0:7431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233be95600 already unused, calling callback (ffffffffc14f9c20) 10000000:00010000:1.0:1787831060.073088:0:7431:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8d233be95600/0x95459fb9d1d288fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x95459fb9d1d28903 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831060.073097:0:7431:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8d233be95600/0x95459fb9d1d288fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x95459fb9d1d28903 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787831060.073105:0:7431:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8d233be95600/0x95459fb9d1d288fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x95459fb9d1d28903 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787831060.073111:0:7431:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787831060.073120:0:7431:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:1.0:1787831060.073123:0:7431:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:1.0:1787831060.073137:0:7431:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d2303f2b000 00010000:00010000:1.0:1787831060.073141:0:7431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8d233be95600/0x95459fb9d1d288fc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x95459fb9d1d28903 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831060.073148:0:7431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8d233be95600/0x95459fb9d1d288fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x95459fb9d1d28903 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831060.073163:0:7431:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787831060.073167:0:7431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8d233bf10e00/0x95459fb9d1d28b6b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x95459fb9d1d28b72 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831060.073173:0:7431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233bf10e00 already unused, calling callback (ffffffffc14f9c20) 10000000:00010000:1.0:1787831060.073175:0:7431:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8d233bf10e00/0x95459fb9d1d28b6b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x95459fb9d1d28b72 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831060.073182:0:7431:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8d233bf10e00/0x95459fb9d1d28b6b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x95459fb9d1d28b72 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787831060.073189:0:7431:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8d233bf10e00/0x95459fb9d1d28b6b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x95459fb9d1d28b72 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787831060.073194:0:7431:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1787831060.073196:0:7431:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1787831060.073197:0:7431:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1787831060.073201:0:7431:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d2303f2b000 00010000:00010000:1.0:1787831060.073204:0:7431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8d233bf10e00/0x95459fb9d1d28b6b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x95459fb9d1d28b72 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831060.073210:0:7431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8d233bf10e00/0x95459fb9d1d28b6b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x95459fb9d1d28b72 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831060.073230:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787831060.073232:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787831060.073234:0:7431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787831060.074826:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1787831060.077311:0:15717:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d2203668420 - data ffff8d22020b8a20/ffff8d2203731000 00000020:01000000:0.0:1787831060.082097:0:15717:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d2201d32de0 - data ffff8d2330b30948/ffff8d2203526000 00100000:10000000:0.0:1787831060.093669:0:15717:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1787831060.103589:0:15717:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x95459fb9d1d28782 00000020:00000080:3.0:1787831060.103609:0:15717:0:(genops.c:885:class_export_put()) final put ffff8d2201e09000/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1787831060.103662:0:15717:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d2334556800 from lustre-OST0001, refs=2 00000020:01000004:3.0:1787831060.103666:0:15717:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d2334556800 2 00000020:01000004:3.0:1787831060.103670:0:15717:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8d2334556800 from lustre-OST0001 00000020:00000080:3.0:1787831060.103692:0:15717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787831060.103702:0:15717:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1787831060.103705:0:15717:0:(genops.c:885:class_export_put()) final put ffff8d233bda2800/lustre-OST0001_UUID 00000020:00000080:3.0:1787831060.103708:0:15717:0:(genops.c:844:class_export_destroy()) destroying export ffff8d233bda2800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1787831060.103716:0:15717:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:3.0:1787831060.103843:0:15717:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 2a45944b-32e3-4193-a2a5-46f84222bc14->MGS 00010000:00010000:3.0:1787831060.103859:0:15717:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8d233837a200/0x95459fb9d1d284db lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x95459fb9d1d284e2 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787831060.103871:0:15717:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8d233837a200/0x95459fb9d1d284db lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x95459fb9d1d284e2 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1787831060.104049:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2201e09000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 10000000:01000000:3.0:1787831060.104096:0:15717:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1787831060.104099:0:15717:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1787831060.104102:0:15717:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1787831060.104124:0:15717:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d2303f2b000 00010000:00010000:3.0:1787831060.104128:0:15717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8d233837a200/0x95459fb9d1d284db lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x95459fb9d1d284e2 expref: -99 pid: 7419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831060.104142:0:15717:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8d233be95800/0x95459fb9d1d2895e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x95459fb9d1d28965 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787831060.104149:0:15717:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8d233be95800/0x95459fb9d1d2895e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x95459fb9d1d28965 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787831060.104153:0:15717:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787831060.104156:0:15717:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1787831060.104157:0:15717:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1787831060.104171:0:15717:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d2303f2b000 00010000:00010000:3.0:1787831060.104174:0:15717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8d233be95800/0x95459fb9d1d2895e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x95459fb9d1d28965 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787831060.104191:0:15717:0:(import.c:65:import_set_state_nolock()) ffff8d2303f2b000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1787831060.104195:0:15717:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1787831060.104198:0:15717:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1787831060.104199:0:15717:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1787831060.104203:0:15717:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1787831060.104214:0:15717:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d2203a22940 x1874676443916160/t0(0) o250->MGC192.168.203.131@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1787831080 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1787831060.104273:0:15717:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1787831060.104277:0:15717:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 26s for inflight to error out 00000100:00100000:2.0:1787831060.104601:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a22940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2a45944b-32e3-4193-a2a5-46f84222bc14:3618:1874676443916160:0@lo:250:kworker.0 10000000:01000000:3.0:1787831060.104739:0:15717:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1787831060.104748:0:15717:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x95459fb9d1d283d8 00000020:00000080:3.0:1787831060.104753:0:15717:0:(genops.c:885:class_export_put()) final put ffff8d2303f2a000/2a45944b-32e3-4193-a2a5-46f84222bc14 00000020:01000000:3.0:1787831060.104770:0:15717:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.131@tcp (flags='') 00000020:00000080:3.0:1787831060.104776:0:15717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787831060.104782:0:15717:0:(obd_config.c:956:class_cleanup()) MGC192.168.203.131@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787831060.104785:0:15717:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff8d2312953370) has no exports 00000020:00000080:1.0:1787831060.104837:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2303f2a000/2a45944b-32e3-4193-a2a5-46f84222bc14 for MGC192.168.203.131@tcp 10000000:01000000:2.0:1787831060.104888:0:6487:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:3.0:1787831060.105064:0:15717:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.203.131@tcp: client import never connected 00000100:00080000:3.0:1787831060.105067:0:15717:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1787831060.105069:0:15717:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1787831060.105072:0:15717:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1787831060.105073:0:15717:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1787831060.105115:0:15717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787831060.105120:0:15717:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.131@tcp (uuid 2a45944b-32e3-4193-a2a5-46f84222bc14) 00000020:01000000:3.0:1787831060.105125:0:15717:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1787831060.105128:0:15717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787831060.105132:0:15717:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787831060.105137:0:15717:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8d233bda1000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787831060.105142:0:15717:0:(genops.c:1553:class_disconnect_exports()) OBD device 25 (ffff8d2312950000) has exports, disconnecting them 00000020:00080000:3.0:1787831060.105152:0:15717:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8d233bda1000), last request at 1787830891 00000020:00000080:3.0:1787831060.105157:0:15717:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x95459fb9d1d287ac 00000020:00080000:3.0:1787831060.105167:0:15717:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d233bda1000): rc 0 00000020:00000080:3.0:1787831060.105171:0:15717:0:(genops.c:885:class_export_put()) final put ffff8d233bda1000/lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1787831060.105871:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d2303f2b000 for MGC192.168.203.131@tcp 00000020:00000080:1.0:1787831060.105891:0:37:0:(genops.c:885:class_export_put()) final put ffff8d2303f2a800/2a45944b-32e3-4193-a2a5-46f84222bc14 00000020:00000080:1.0:1787831060.105893:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2303f2a800/2a45944b-32e3-4193-a2a5-46f84222bc14 for MGC192.168.203.131@tcp 00000020:01000000:1.0:1787831060.105899:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.131@tcp (2a45944b-32e3-4193-a2a5-46f84222bc14) 00000020:00000080:1.0:1787831060.106148:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d233bda1000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1787831060.106606:0:15717:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1787831060.106611:0:15717:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787831060.106615:0:15717:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787831060.106620:0:15717:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787831060.106804:0:15717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787831060.106811:0:15717:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:2.0:1787831060.106816:0:15717:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1787831060.106820:0:15717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787831060.106824:0:15717:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787831060.106830:0:15717:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff8d2203510000 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787831060.106835:0:15717:0:(genops.c:1553:class_disconnect_exports()) OBD device 26 (ffff8d233f434d28) has exports, disconnecting them 00000020:00080000:2.0:1787831060.106839:0:15717:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff8d2203510000), last request at 1787830891 00000020:00000080:2.0:1787831060.106843:0:15717:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x95459fb9d1d287c1 00000020:00080000:2.0:1787831060.106854:0:15717:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d2203510000): rc 0 00000020:00000080:2.0:1787831060.106859:0:15717:0:(genops.c:885:class_export_put()) final put ffff8d2203510000/lustre-MDT0001-lwp-OST0001 00000020:00000080:1.0:1787831060.107859:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d233bda1800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1787831060.107880:0:37:0:(genops.c:885:class_export_put()) final put ffff8d220276b000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1787831060.107883:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d220276b000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1787831060.107889:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1787831060.107945:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2203510000/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:3.0:1787831060.126693:0:15717:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:3.0:1787831060.126701:0:15717:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1787831060.126706:0:15717:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1787831060.126713:0:15717:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1787831060.126793:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00000020:00000080:1.0:1787831060.126917:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d2203513800 for lustre-MDT0001-lwp-OST0001 00010000:00010000:1.0:1787831060.127068:0:7431:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:1.0:1787831060.127175:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:3.0:1787831060.127307:0:9493:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff8d220271c200:9493] 2 exiting: rc = 0 00000100:00100000:3.0:1787831060.127356:0:6474:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff8d23066bea00:6474] 1 exiting: rc = 0 00000100:00100000:1.0:1787831060.127424:0:6473:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff8d23066be800:6473] 0 exiting: rc = 1 00000100:00100000:3.0:1787831060.127578:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.127889:0:6475:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff8d2311914e00:6475] 0 exiting: rc = 1 00000100:00100000:1.0:1787831060.128286:0:6477:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8d2311915800:6477] 2 exiting: rc = 0 00000100:00100000:1.0:1787831060.128358:0:7432:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff8d2338534200:7432] 3 exiting: rc = 0 00000100:00100000:3.0:1787831060.128727:0:6476:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff8d2311914a00:6476] 1 exiting: rc = 0 00000100:00100000:1.0:1787831060.128821:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831060.128828:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831060.128834:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831060.128840:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831060.128861:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831060.128867:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831060.128989:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831060.128998:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831060.129004:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831060.129010:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831060.129017:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831060.129022:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831060.129027:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831060.129034:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831060.129040:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831060.129046:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831060.129051:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831060.129057:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831060.129063:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831060.129069:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831060.129074:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831060.129079:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831060.129084:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831060.129088:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831060.129093:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831060.129098:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831060.129103:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831060.129109:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831060.129115:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831060.129121:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831060.129126:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831060.129131:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831060.129135:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831060.129140:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831060.129145:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831060.129150:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831060.129155:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831060.129160:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831060.129165:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831060.129178:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831060.129184:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831060.129189:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831060.129194:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831060.129200:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831060.129206:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831060.129211:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831060.129216:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831060.129221:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831060.129226:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831060.129231:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831060.129237:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831060.129242:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831060.129247:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831060.129253:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831060.129258:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831060.129263:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831060.129267:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831060.129272:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831060.129277:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831060.129283:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831060.129288:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831060.129293:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831060.129299:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831060.129305:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1787831060.130494:0:15717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787831060.130504:0:15717:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:1.0:1787831060.130509:0:15717:0:(genops.c:885:class_export_put()) final put ffff8d2203515800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:1.0:1787831060.130513:0:15717:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2203515800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:1.0:1787831060.130519:0:15717:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:1.0:1787831060.130566:0:15717:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d2334556800 1 00000020:00000080:1.0:1787831060.130572:0:15717:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x95459fb9d1d28751 00000020:00000080:1.0:1787831060.130579:0:15717:0:(genops.c:885:class_export_put()) final put ffff8d233bda4800/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1787831060.130598:0:15717:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1787831060.130609:0:15717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787831060.130615:0:15717:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787831060.130618:0:15717:0:(genops.c:1558:class_disconnect_exports()) OBD device 23 (ffff8d232f7799b8) has no exports 00000020:00000080:3.0:1787831060.131250:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d233bda4800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1787831060.184299:0:15717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787831060.184314:0:15717:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1787831060.184319:0:15717:0:(genops.c:885:class_export_put()) final put ffff8d2201e0e000/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1787831060.184323:0:15717:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2201e0e000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1787831060.184333:0:15717:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1787831060.184653:0:15717:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8d2201e08800 00000020:01000000:2.0:1787831060.184683:0:15717:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1787831060.184688:0:15717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787831060.184693:0:15717:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787831060.184697:0:15717:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff8d230333cd28) has no exports 00000020:00000080:2.0:1787831060.184726:0:15717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787831060.184732:0:15717:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1787831060.184734:0:15717:0:(genops.c:885:class_export_put()) final put ffff8d233534c800/OSS_uuid 00000020:00000080:2.0:1787831060.184745:0:15717:0:(genops.c:844:class_export_destroy()) destroying export ffff8d233534c800/OSS_uuid for OSS 00000020:01000000:2.0:1787831060.184749:0:15717:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:2.0:1787831060.184812:0:8408:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff8d232f5f1000:8408] 2 exiting: rc = 0 00000100:00080000:0.0:1787831060.184919:0:6486:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1787831060.185388:0:8631:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff8d2201deba00:8631] 3 exiting: rc = 0 00000100:00100000:2.0:1787831060.185479:0:8407:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff8d232f5f0200:8407] 1 exiting: rc = 0 00000100:00100000:2.0:1787831060.185542:0:8406:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff8d233bcc7800:8406] 0 exiting: rc = 1 00000100:00100000:0.0:1787831060.185599:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831060.185609:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831060.185615:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831060.185709:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831060.185718:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831060.185724:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831060.185729:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831060.185734:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831060.185738:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831060.185743:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831060.185747:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831060.185751:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831060.185756:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831060.185761:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831060.185766:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831060.185771:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831060.185776:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831060.185781:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831060.185786:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831060.185791:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831060.185796:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831060.185801:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831060.185806:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831060.185811:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831060.185817:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831060.185822:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831060.185827:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831060.185846:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831060.185858:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831060.185863:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831060.185867:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831060.185872:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831060.185878:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831060.185884:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831060.185889:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831060.185894:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831060.185899:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831060.185904:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831060.185909:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831060.185914:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831060.185919:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831060.185923:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831060.185928:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831060.185933:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831060.185938:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831060.185943:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831060.185947:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831060.185952:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831060.185962:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831060.185968:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831060.185973:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831060.185978:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831060.185983:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831060.185989:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831060.185994:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831060.185999:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831060.186004:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831060.186008:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831060.186013:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831060.186017:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831060.186023:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831060.186028:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831060.186042:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831060.186046:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831060.186975:0:11489:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff8d2201e6a000:11489] 2 exiting: rc = 0 00000100:00100000:0.0:1787831060.186993:0:8409:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff8d232f5f0c00:8409] 0 exiting: rc = 1 00000100:00100000:0.0:1787831060.187079:0:8410:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff8d232f5f1e00:8410] 1 exiting: rc = 0 00000100:00100000:2.0:1787831060.187283:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831060.187294:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831060.187303:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831060.187312:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831060.187322:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831060.187332:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831060.187343:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831060.187454:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831060.187464:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831060.187474:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831060.187485:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831060.187494:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831060.187503:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831060.187514:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831060.187523:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831060.187534:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831060.187544:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831060.187553:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831060.187560:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831060.187569:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831060.187575:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831060.187584:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831060.187594:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831060.187601:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831060.187608:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831060.187614:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831060.187621:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831060.187817:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831060.187834:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831060.187839:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831060.187845:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831060.187850:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831060.187855:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831060.187859:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831060.187864:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831060.187877:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831060.187884:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831060.187889:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831060.190652:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831060.190674:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831060.191270:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831060.191282:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831060.191289:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831060.191296:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831060.191301:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831060.191305:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831060.191313:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831060.191318:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831060.191324:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831060.191390:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831060.191400:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831060.191406:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831060.191411:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831060.191416:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831060.191423:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831060.191440:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831060.191451:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831060.191462:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831060.191471:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831060.191478:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831060.191484:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831060.191491:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831060.191497:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831060.191587:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831060.194187:0:8412:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff8d2310865200:8412] 1 exiting: rc = 0 00000100:00100000:0.0:1787831060.195063:0:8411:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8d23351fa400:8411] 0 exiting: rc = 1 00000100:00100000:3.0:1787831060.195318:0:8413:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8d231123da00:8413] 2 exiting: rc = 0 00000100:00100000:3.0:1787831060.195385:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.195394:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.195400:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.195406:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.195424:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.195444:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.195451:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.195457:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.195462:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.195468:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.195479:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.195485:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.195494:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.195512:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.195519:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.195525:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.195541:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.195546:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.195552:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.195557:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.195563:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.195568:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.195574:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.195579:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.195585:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.195590:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.195596:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.195601:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.195606:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.195613:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.195618:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.195652:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.195659:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.195664:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.195680:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.195687:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.195694:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.195714:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.195721:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.195727:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.195734:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.195740:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.195746:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.195751:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.195757:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.195763:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.195769:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.195774:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.195780:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.195786:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.195792:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.195807:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.195813:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.196139:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.196150:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.196219:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.196226:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.196231:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.196238:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.196244:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.196249:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.196255:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.196277:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.196285:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831060.202303:0:8414:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8d233bce1000:8414] 0 exiting: rc = 1 00000100:00100000:1.0:1787831060.202470:0:8415:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8d23351fb400:8415] 1 exiting: rc = 0 00000100:00100000:3.0:1787831060.203028:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.203036:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.203042:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.203047:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.203052:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.203057:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.203062:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.203067:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.203071:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.203077:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.203082:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.203087:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.203091:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.203101:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.203107:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.203111:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.203116:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.203120:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.203126:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.203130:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.203136:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.203141:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.203168:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.203284:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.203289:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.203294:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.203299:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.203304:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.203310:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.203315:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.203320:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.203326:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.203330:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.203335:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.203340:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.203345:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.203349:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.203353:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.203357:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.203362:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.203367:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.203372:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.203378:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.203382:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.203386:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.203390:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.203395:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.203400:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.203404:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.203409:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.203414:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.203419:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.203438:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.203446:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.203451:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.203455:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.203460:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.203473:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.203488:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.203494:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.203502:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.203507:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.203512:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.203516:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831060.205340:0:8416:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8d233bc48600:8416] 0 exiting: rc = 1 00000100:00100000:2.0:1787831060.206209:0:8417:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8d23352b4600:8417] 1 exiting: rc = 0 00000100:00100000:3.0:1787831060.206545:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.206553:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.206559:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.206566:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.206571:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.206577:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.206583:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.206589:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.206610:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.206616:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.206775:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.206784:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.206790:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.206796:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.206802:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.206808:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.206814:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.206820:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.206827:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.206833:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.206854:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.206860:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.206869:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.206874:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.206893:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.206900:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.206907:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.206913:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.206930:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.206936:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.206943:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.206951:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.206973:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.206982:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.206988:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.206995:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.207001:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.207008:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.207014:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.207021:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.207027:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.207034:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.207040:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.207047:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.207075:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.207082:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.207089:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.207095:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.207102:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.207109:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.207115:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.207121:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.207127:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.207132:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.207139:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.207145:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.207340:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.207347:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.207352:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.207358:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.207366:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.207373:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.207379:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831060.207392:0:15717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1787831060.219849:0:15717:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1787831075.210130:0:16484:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg331-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1787831082.795327:0:17083:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787831082.795332:0:17083:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1787831082.795333:0:17083:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1787831082.795409:0:17083:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8d23115b5000 00000020:01000004:3.0:1787831082.795421:0:17083:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1787831082.795426:0:17083:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1787831082.795438:0:17083:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8d23344a0000) 00000020:00000080:3.0:1787831082.795449:0:17083:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1787831082.869263:0:17083:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1787831082.870160:0:17083:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:0.0:1787831082.873583:0:17083:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:0.0:1787831082.874705:0:17083:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:0.0:1787831082.874942:0:17083:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:0.0:1787831082.875256:0:17083:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:0.0:1787831082.875449:0:17083:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:0.0:1787831082.875712:0:17083:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:0.0:1787831082.875967:0:17083:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:0.0:1787831082.876314:0:17083:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:0.0:1787831082.876501:0:17083:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:0.0:1787831082.876723:0:17083:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:0.0:1787831082.876926:0:17083:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:0.0:1787831082.877264:0:17083:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:0.0:1787831082.877495:0:17083:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:0.0:1787831082.877856:0:17083:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:0.0:1787831082.878147:0:17083:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:0.0:1787831082.878334:0:17083:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:0.0:1787831082.878508:0:17083:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:0.0:1787831082.878745:0:17083:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:0.0:1787831082.878979:0:17083:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:0.0:1787831082.879356:0:17083:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:0.0:1787831082.879596:0:17083:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1787831082.879945:0:17083:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:0.0:1787831082.880310:0:17083:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:0.0:1787831082.880529:0:17083:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:0.0:1787831082.880810:0:17083:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:0.0:1787831082.880990:0:17083:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:0.0:1787831082.881403:0:17083:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:0.0:1787831082.881716:0:17083:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:0.0:1787831082.881953:0:17083:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:0.0:1787831082.882215:0:17083:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:0.0:1787831082.882449:0:17083:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:0.0:1787831082.882667:0:17083:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:0.0:1787831082.882898:0:17083:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:0.0:1787831082.883383:0:17083:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:0.0:1787831082.883563:0:17083:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:0.0:1787831082.883978:0:17083:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:0.0:1787831082.884267:0:17083:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:0.0:1787831082.884461:0:17083:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1787831082.884673:0:17083:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:0.0:1787831082.884908:0:17083:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:0.0:1787831082.885211:0:17083:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:0.0:1787831082.885440:0:17083:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1787831082.885771:0:17083:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:0.0:1787831082.885954:0:17083:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:0.0:1787831082.886222:0:17083:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1787831082.887646:0:17083:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:0.0:1787831082.888129:0:17083:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:0.0:1787831082.888331:0:17083:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:0.0:1787831082.888819:0:17083:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:0.0:1787831082.889012:0:17083:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:0.0:1787831082.889311:0:17083:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:01000000:0.0:1787831082.890074:0:17083:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1787831082.890314:0:17083:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1787831082.890322:0:17083:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787831082.890334:0:17083:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x95459fb9d1d29995 00000020:01000004:0.0:1787831082.890341:0:17083:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:0.0:1787831082.890346:0:17083:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1787831082.890352:0:17083:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d23115b5000 from MGS 00000020:01000004:0.0:1787831082.890356:0:17083:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1787831082.890366:0:17083:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8d233f4319b8) 00000020:00000080:0.0:1787831082.890379:0:17083:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1787831082.890442:0:17083:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d23115b5000 from MGS, refs=2 00080000:01000000:0.0:1787831082.890447:0:17083:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787831082.890451:0:17083:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x95459fb9d1d299a3 00000100:00100000:0.0:1787831082.890547:0:17083:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1787831082.890726:0:17083:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1787831082.890732:0:17083:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1787831082.892123:0:17083:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1787831082.892134:0:17083:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1787831082.892911:0:17083:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787831082.893455:0:17083:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1787831082.893461:0:17083:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1787831082.894553:0:17083:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1787831082.894563:0:17083:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1787831082.902461:0:17083:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1787831082.902727:0:17083:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1787831082.903884:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787831082.903889:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787831082.903891:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787831082.904208:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787831082.904211:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787831082.904213:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787831082.904703:0:17083:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1787831082.908249:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1787831082.909357:0:17083:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:0.0:1787831082.910335:0:17095:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1787831082.910376:0:17083:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1787831082.910409:0:17083:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787831082.910908:0:17083:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1787831082.911224:0:17083:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787831082.911385:0:17083:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1787831082.911391:0:17083:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1787831082.912121:0:17083:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1787831082.912130:0:17083:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1787831082.912441:0:17083:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1787831082.912447:0:17083:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:3.0:1787831082.913098:0:17099:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:2.0:1787831082.913238:0:17083:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1787831082.913259:0:17083:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.131@tcp' 00000020:01000004:2.0:1787831082.913260:0:17083:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1787831082.913301:0:17083:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.131@tcp (typ=mgc) 00000020:00000080:2.0:1787831082.913314:0:17083:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.131@tcp (ffff8d2201e1cd28) 00000020:00000080:2.0:1787831082.913328:0:17083:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1787831082.913407:0:17083:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d22045a8000@MGC192.168.203.131@tcp: add connection 192.168.203.131@tcp at head 00010000:00010000:2.0:1787831082.913552:0:17083:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.131@tcp-0 is initialized 00000040:01000000:2.0:1787831082.913558:0:17083:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.131@tcp ctxt 1 is initialized 10000000:01000000:2.0:1787831082.922659:0:17102:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1787831082.922856:0:17083:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.131@tcp (uuid be45932f-3bcb-4e49-b61c-a2395180b0ee) 00000020:00000080:3.0:1787831082.922878:0:17083:0:(genops.c:1385:class_connect()) connect: client be45932f-3bcb-4e49-b61c-a2395180b0ee, cookie 0x95459fb9d1d299b1 00000100:00080000:3.0:1787831082.922891:0:17083:0:(import.c:510:import_select_connection()) MGC192.168.203.131@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787831082.922898:0:17083:0:(import.c:624:import_select_connection()) MGC192.168.203.131@tcp: import ffff8d22045a8000 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:3.0:1787831082.922927:0:17083:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2203aff480 x1874676443916288/t0(0) o250->MGC192.168.203.131@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787831082.922954:0:17083:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import be45932f-3bcb-4e49-b61c-a2395180b0ee->MGS 00000020:01000004:3.0:1787831082.922975:0:17083:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1787831082.922980:0:17083:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1787831082.923002:0:17083:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8d23344a3370) 00000020:00000080:3.0:1787831082.923016:0:17083:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1787831082.923259:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203aff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:be45932f-3bcb-4e49-b61c-a2395180b0ee:3618:1874676443916288:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1787831082.923344:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831082.923408:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443916288 00000100:00100000:2.0:1787831082.923413:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443916288 00000100:00100000:2.0:1787831082.923461:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787831082.923467:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233be91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3618:x1874676443916288:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1787831082.923491:0:17096:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from be45932f-3bcb-4e49-b61c-a2395180b0ee@0@lo t0 exp 0000000000000000 cur 373 last 0 00000020:00000080:2.0:1787831082.923513:0:17096:0:(genops.c:1385:class_connect()) connect: client be45932f-3bcb-4e49-b61c-a2395180b0ee, cookie 0x95459fb9d1d299bf 00000100:00080000:2.0:1787831082.923653:0:17096:0:(import.c:65:import_set_state_nolock()) ffff8d22045ad800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787831082.923702:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233be91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be45932f-3bcb-4e49-b61c-a2395180b0ee+5:3618:x1874676443916288:12345-0@lo:250:mount.lustre.0 Request processed in 234us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831082.923709:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787831082.923762:0:3618:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.203.131@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1787831082.923769:0:3618:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.131@tcp: connect to target with instance 0 00000100:00080000:2.0:1787831082.923776:0:3618:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.131@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1787831082.923780:0:3618:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1787831082.923784:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8d22045a8000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1787831082.923787:0:3618:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1787831082.923793:0:3618:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1787831082.923798:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203aff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:be45932f-3bcb-4e49-b61c-a2395180b0ee:3618:1874676443916288:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1787831082.943827:0:17083:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787831082.944081:0:17083:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1787831082.944087:0:17083:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1787831082.945055:0:17083:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1787831082.945067:0:17083:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1787831082.945364:0:17083:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1787831082.945370:0:17083:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1787831082.946375:0:17083:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787831082.946554:0:17083:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1787831082.946559:0:17083:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1787831082.947338:0:17083:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1787831082.947347:0:17083:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1787831082.995491:0:17083:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787831082.995896:0:17083:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1787831082.995903:0:17083:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1787831082.997057:0:17083:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1787831082.997069:0:17083:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1787831082.997588:0:17083:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787831082.997926:0:17083:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787831082.997932:0:17083:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1787831082.998424:0:17083:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787831082.998431:0:17083:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1787831082.999363:0:17083:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787831082.999519:0:17083:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787831082.999526:0:17083:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1787831083.000163:0:17083:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787831083.000170:0:17083:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1787831083.000924:0:17083:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787831083.001148:0:17083:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787831083.001154:0:17083:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1787831083.001864:0:17083:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787831083.001872:0:17083:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1787831083.017233:0:17083:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787831083.017466:0:17083:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1787831083.017473:0:17083:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1787831083.019157:0:17083:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1787831083.019173:0:17083:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1787831083.020122:0:17083:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1787831083.020132:0:17083:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1787831083.021581:0:17083:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1787831083.021617:0:17083:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:1.0:1787831083.021830:0:17083:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.131@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1787831083.021939:0:17083:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.131@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787831083.021977:0:17083:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.131@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1787831083.021981:0:17083:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787831083.021983:0:17083:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787831083.021985:0:17083:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787831083.021986:0:17083:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787831083.021987:0:17083:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787831083.021988:0:17083:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787831083.021989:0:17083:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787831083.022064:0:17083:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787831083.022066:0:17083:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787831083.022067:0:17083:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787831083.022069:0:17083:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1787831083.022072:0:17083:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787831083.022073:0:17083:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787831083.022073:0:17083:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787831083.022074:0:17083:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787831083.022075:0:17083:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787831083.022076:0:17083:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787831083.022077:0:17083:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787831083.022078:0:17083:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787831083.022078:0:17083:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787831083.022080:0:17083:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787831083.022109:0:17083:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1787831083.022130:0:17083:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a21680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:17083:1874676443916416:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787831083.022217:0:17083:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831083.022321:0:17083:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d23079d8d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787831083.022447:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443916416 00000100:00100000:3.0:1787831083.022454:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443916416 00000100:00100000:3.0:1787831083.022538:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787831083.022548:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233be90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be45932f-3bcb-4e49-b61c-a2395180b0ee+5:17083:x1874676443916416:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787831083.022594:0:17098:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787831083.022601:0:17098:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1787831083.022605:0:17098:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1787831083.023020:0:17120:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1787831083.023529:0:17098:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:0.0:1787831083.025081:0:17121:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1787831083.025088:0:17121:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:0.0:1787831083.025091:0:17121:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1787831083.025094:0:17121:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1787831083.025262:0:17121:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:3.0:1787831083.025544:0:17098:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787831083.025555:0:17098:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1787831083.027242:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233be90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be45932f-3bcb-4e49-b61c-a2395180b0ee+5:17083:x1874676443916416:12345-0@lo:253:mount.lustre.0 Request processed in 4688us (5017us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831083.027256:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787831083.027346:0:17083:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a21680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:17083:1874676443916416:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787831083.027362:0:17083:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1787831083.027366:0:17083:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787831083.027367:0:17083:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787831083.027369:0:17083:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787831083.027370:0:17083:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787831083.027371:0:17083:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787831083.027372:0:17083:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787831083.027373:0:17083:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787831083.027374:0:17083:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787831083.027376:0:17083:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787831083.027377:0:17083:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787831083.027400:0:17083:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d23115b5000 from lustre-MDT0000 10000000:01000000:1.0:1787831083.027430:0:17083:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1787831083.027433:0:17083:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787831083.027437:0:17083:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8d2201e1cd28 10000000:01000000:1.0:1787831083.027442:0:17083:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787831083.027449:0:17083:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8d2201e1cd28 from 1 10000000:01000000:1.0:1787831083.027462:0:17083:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787831083.027503:0:17083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d23344b7200/0x95459fb9d1d299c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831083.027515:0:17083:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8d23344b7200/0x95459fb9d1d299c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831083.027525:0:17083:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8d23344b7200/0x95459fb9d1d299c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831083.027545:0:17083:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a21680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:17083:1874676443916544:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787831083.027580:0:17083:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831083.027673:0:17083:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2305268c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787831083.027820:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443916544 00000100:00100000:0.0:1787831083.027825:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443916544 00000100:00100000:0.0:1787831083.027914:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787831083.027923:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2308753c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be45932f-3bcb-4e49-b61c-a2395180b0ee+5:17083:x1874676443916544:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787831083.027936:0:17097:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787831083.027950:0:17097:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2303aa3a00/0x95459fb9d1d299cd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d299c6 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831083.027972:0:17097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2303aa3a00/0x95459fb9d1d299cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d299c6 expref: 6 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831083.027983:0:17097:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2303aa3a00/0x95459fb9d1d299cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d299c6 expref: 6 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831083.027991:0:17097:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2303aa3a00, rc 0) 00000100:00100000:0.0:1787831083.028041:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2308753c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be45932f-3bcb-4e49-b61c-a2395180b0ee+6:17083:x1874676443916544:12345-0@lo:101:mount.lustre.0 Request processed in 120us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831083.028047:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787831083.028105:0:17083:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a21680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:17083:1874676443916544:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787831083.028120:0:17083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8d23344b7200/0x95459fb9d1d299c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d299cd expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831083.028129:0:17083:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8d23344b7200/0x95459fb9d1d299c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d299cd expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831083.028194:0:17083:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a21680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:17083:1874676443916672:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787831083.028220:0:17083:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831083.028383:0:17083:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2305268c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787831083.028445:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443916672 00000100:00100000:2.0:1787831083.028450:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443916672 00000100:00100000:2.0:1787831083.028473:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787831083.028480:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2308752c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be45932f-3bcb-4e49-b61c-a2395180b0ee+6:17083:x1874676443916672:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787831083.028556:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2308752c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be45932f-3bcb-4e49-b61c-a2395180b0ee+6:17083:x1874676443916672:12345-0@lo:501:mount.lustre.0 Request processed in 76us (334us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787831083.028563:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787831083.028669:0:17083:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a21680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:17083:1874676443916672:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1787831083.028695:0:17083:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787831083.028705:0:17083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d23344b7200/0x95459fb9d1d299c6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d299cd expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831083.028737:0:17083:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8d23344b7200/0x95459fb9d1d299c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d299cd expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787831083.028745:0:17083:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d23115b5000 10000000:01000000:1.0:1787831083.028749:0:17083:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787831083.028754:0:17083:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8d23115b5000 10000000:01000000:1.0:1787831083.028756:0:17083:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1787831083.028759:0:17083:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8d23115b5000 from 1 10000000:01000000:1.0:1787831083.028761:0:17083:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1787831083.028779:0:17083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d23344b7c00/0x95459fb9d1d299d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831083.028786:0:17083:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8d23344b7c00/0x95459fb9d1d299d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831083.028795:0:17083:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8d23344b7c00/0x95459fb9d1d299d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831083.028807:0:17083:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a21680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:17083:1874676443916800:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787831083.028832:0:17083:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831083.028843:0:17083:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2305268c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787831083.028971:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443916800 00000100:00100000:2.0:1787831083.028976:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443916800 00000100:00100000:2.0:1787831083.029054:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787831083.029063:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2308753450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be45932f-3bcb-4e49-b61c-a2395180b0ee+6:17083:x1874676443916800:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787831083.029071:0:17096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787831083.029083:0:17096:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d22039c1e00/0x95459fb9d1d299db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d299d4 expref: -99 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831083.029099:0:17096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22039c1e00/0x95459fb9d1d299db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d299d4 expref: 7 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831083.029108:0:17096:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d22039c1e00/0x95459fb9d1d299db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d299d4 expref: 7 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831083.029115:0:17096:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22039c1e00, rc 0) 00000100:00100000:2.0:1787831083.029153:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2308753450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be45932f-3bcb-4e49-b61c-a2395180b0ee+7:17083:x1874676443916800:12345-0@lo:101:mount.lustre.0 Request processed in 92us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831083.029168:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787831083.029244:0:17083:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a21680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:17083:1874676443916800:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787831083.029255:0:17083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8d23344b7c00/0x95459fb9d1d299d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d299db expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831083.029263:0:17083:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8d23344b7c00/0x95459fb9d1d299d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d299db expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787831083.029295:0:17083:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1787831083.029308:0:17083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d23344b7c00/0x95459fb9d1d299d4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d299db expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831083.029315:0:17083:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8d23344b7c00/0x95459fb9d1d299d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d299db expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787831083.029321:0:17083:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787831083.029324:0:17083:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787831083.029329:0:17083:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8d23115b5000 10000000:01000000:1.0:1787831083.029331:0:17083:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1787831083.029334:0:17083:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1787831083.029335:0:17083:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787831083.029349:0:17083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d23344b6800/0x95459fb9d1d299e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831083.029355:0:17083:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8d23344b6800/0x95459fb9d1d299e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831083.029361:0:17083:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8d23344b6800/0x95459fb9d1d299e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831083.029373:0:17083:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a21680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:17083:1874676443916928:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787831083.029397:0:17083:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831083.029415:0:17083:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2305268c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787831083.029485:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443916928 00000100:00100000:0.0:1787831083.029490:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443916928 00000100:00100000:0.0:1787831083.029518:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787831083.029525:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2308751850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be45932f-3bcb-4e49-b61c-a2395180b0ee+7:17083:x1874676443916928:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787831083.029532:0:17097:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787831083.029541:0:17097:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2303aa2000/0x95459fb9d1d299e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d299e2 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831083.029556:0:17097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2303aa2000/0x95459fb9d1d299e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d299e2 expref: 8 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831083.029565:0:17097:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2303aa2000/0x95459fb9d1d299e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d299e2 expref: 8 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831083.029571:0:17097:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2303aa2000, rc 0) 00000100:00100000:0.0:1787831083.029599:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2308751850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be45932f-3bcb-4e49-b61c-a2395180b0ee+8:17083:x1874676443916928:12345-0@lo:101:mount.lustre.0 Request processed in 75us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831083.029605:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787831083.029693:0:17083:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a21680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:17083:1874676443916928:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787831083.029704:0:17083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8d23344b6800/0x95459fb9d1d299e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d299e9 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831083.029730:0:17083:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8d23344b6800/0x95459fb9d1d299e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d299e9 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831083.029780:0:17083:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a21680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:17083:1874676443917056:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787831083.029807:0:17083:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831083.029834:0:17083:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2305268c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787831083.029934:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443917056 00000100:00100000:0.0:1787831083.029938:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443917056 00000100:00100000:0.0:1787831083.029958:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787831083.029964:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2308753850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be45932f-3bcb-4e49-b61c-a2395180b0ee+8:17083:x1874676443917056:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787831083.030161:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2308753850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be45932f-3bcb-4e49-b61c-a2395180b0ee+9:17083:x1874676443917056:12345-0@lo:501:mount.lustre.0 Request processed in 195us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831083.030168:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787831083.030296:0:17083:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a21680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:17083:1874676443917056:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787831083.030326:0:17083:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a21680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:17083:1874676443917184:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787831083.030365:0:17083:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831083.030389:0:17083:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2305268c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787831083.030436:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443917184 00000100:00100000:0.0:1787831083.030441:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443917184 00000100:00100000:0.0:1787831083.030470:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787831083.030476:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2308752850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be45932f-3bcb-4e49-b61c-a2395180b0ee+9:17083:x1874676443917184:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787831083.031356:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2308752850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be45932f-3bcb-4e49-b61c-a2395180b0ee+9:17083:x1874676443917184:12345-0@lo:503:mount.lustre.0 Request processed in 876us (986us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831083.031370:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787831083.031469:0:17083:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a21680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:17083:1874676443917184:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787831083.031926:0:17122:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204625e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be45932f-3bcb-4e49-b61c-a2395180b0ee:17122:1874676443917312:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787831083.031975:0:17122:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831083.032081:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443917312 00000100:00100000:2.0:1787831083.032087:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443917312 00000100:00100000:2.0:1787831083.032123:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787831083.032130:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2308751c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be45932f-3bcb-4e49-b61c-a2395180b0ee+9:17122:x1874676443917312:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787831083.032474:0:17122:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2303d10f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787831083.032838:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2308751c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be45932f-3bcb-4e49-b61c-a2395180b0ee+9:17122:x1874676443917312:12345-0@lo:502:llog_process_th.0 Request processed in 705us (860us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831083.032847:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787831083.033067:0:17122:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204625e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be45932f-3bcb-4e49-b61c-a2395180b0ee:17122:1874676443917312:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787831083.033097:0:17122:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787831083.033107:0:17122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787831083.033110:0:17122:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787831083.033114:0:17122:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1787831083.033117:0:17122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787831083.033133:0:17122:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8d233f434d28) 00000020:00000080:0.0:1787831083.033148:0:17122:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1787831083.033153:0:17122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1787831083.033235:0:17122:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:0.0:1787831083.033243:0:17122:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x95459fb9d1d299f7 00000020:00000080:0.0:1787831083.033437:0:17122:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1787831083.033442:0:17122:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787831083.033445:0:17122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787831083.033447:0:17122:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787831083.033450:0:17122:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787831083.033453:0:17122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787831083.033455:0:17122:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1787831083.033458:0:17122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787831083.033465:0:17122:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8d233f433370) 00000020:00000080:0.0:1787831083.033475:0:17122:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1787831083.033479:0:17122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1787831083.033481:0:17122:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1787831083.033484:0:17122:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1787831083.033490:0:17122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787831083.033529:0:17122:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d23115b5000 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1787831083.033543:0:17122:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8d233f430000) 00000020:00000080:0.0:1787831083.033551:0:17122:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1787831083.033598:0:17122:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1787831083.033609:0:17122:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x95459fb9d1d29a0c 00000020:00000080:0.0:1787831083.034056:0:17122:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1787831083.034065:0:17122:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1787831083.034071:0:17122:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x95459fb9d1d29a13 00080000:01000000:0.0:1787831083.034076:0:17122:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:0.0:1787831083.034080:0:17122:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x95459fb9d1d29a1a 00010000:00010000:1.0:1787831083.101804:0:17122:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:1.0:1787831083.102734:0:17122:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967528 00000001:00080000:1.0:1787831083.103675:0:17122:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1787831083.104670:0:17122:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8d232f77cd28) 00000020:00000080:1.0:1787831083.104692:0:17122:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1787831083.104865:0:17122:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:1.0:1787831083.104873:0:17122:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x95459fb9d1d29a28 00000020:00000080:0.0:1787831083.105616:0:17122:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1787831083.112003:0:17122:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x95459fb9d1d29a2f 00000020:00000080:1.0:1787831083.112502:0:17122:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1787831083.112514:0:17122:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787831083.112521:0:17122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787831083.112523:0:17122:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1787831083.112526:0:17122:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787831083.112534:0:17122:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:1.0:1787831083.112535:0:17122:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787831083.112537:0:17122:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787831083.112538:0:17122:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787831083.112541:0:17122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787831083.112542:0:17122:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787831083.112545:0:17122:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787831083.112549:0:17122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787831083.112550:0:17122:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1787831083.112555:0:17122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1787831083.112590:0:17122:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1787831083.112603:0:17122:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787831083.112606:0:17122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787831083.112607:0:17122:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1787831083.112609:0:17122:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787831083.112612:0:17122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787831083.112613:0:17122:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1787831083.112615:0:17122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787831083.112620:0:17122:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.131@tcp to nid 0x20000c0a8cb83 (192.168.203.131@tcp) 00000020:00000080:1.0:1787831083.112669:0:17122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787831083.112684:0:17122:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff8d232f778000) 00000020:00000080:1.0:1787831083.112697:0:17122:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1787831083.112701:0:17122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787831083.112750:0:17122:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1787831083.112755:0:17122:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:1.0:1787831083.112763:0:17122:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x95459fb9d1d29a3d 00010000:00080000:1.0:1787831083.112799:0:17122:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d2201e0b000@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.131@tcp at head 00010000:00010000:1.0:1787831083.115096:0:17122:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:0.0:1787831083.118510:0:17122:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787831083.118527:0:17122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1787831083.118565:0:17122:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:0.0:1787831083.118586:0:17122:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x95459fb9d1d29a44 00000100:00080000:0.0:1787831083.118597:0:17122:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787831083.118603:0:17122:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8d2201e0b000 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:0.0:1787831083.118693:0:17122:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2204625e00 x1874676443917440/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787831083.118716:0:17122:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:0.0:1787831083.118765:0:17122:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787831083.118769:0:17122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787831083.118771:0:17122:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:0.0:1787831083.118774:0:17122:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787831083.118777:0:17122:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:0.0:1787831083.118778:0:17122:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787831083.118780:0:17122:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787831083.118781:0:17122:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787831083.118783:0:17122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787831083.118785:0:17122:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787831083.118788:0:17122:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787831083.118792:0:17122:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1787831083.118796:0:17122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787831083.118797:0:17122:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1787831083.118800:0:17122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787831083.118803:0:17122:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.131@tcp to nid 0x20000c0a8cb83 (192.168.203.131@tcp) 00000020:01000000:0.0:1787831083.118834:0:17122:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1787831083.118837:0:17122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787831083.118849:0:17122:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8d2312950000) 00000020:00000080:0.0:1787831083.118860:0:17122:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1787831083.118865:0:17122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787831083.118921:0:17122:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1787831083.118927:0:17122:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:0.0:1787831083.118932:0:17122:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x95459fb9d1d29a52 00010000:00080000:0.0:1787831083.118966:0:17122:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d233be52000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.131@tcp at head 00010000:00010000:0.0:1787831083.119227:0:17122:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:3.0:1787831083.119618:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204625e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1874676443917440:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787831083.119815:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831083.119933:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443917440 00000100:00100000:0.0:1787831083.119940:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443917440 00000100:00100000:0.0:1787831083.120008:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787831083.120015:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203afc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3618:x1874676443917440:12345-0@lo:38:llog_process_th.0 00010000:00020000:0.0:1787831083.120029:0:17109:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787831083.120073:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203afc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3618:x1874676443917440:12345-0@lo:38:llog_process_th.0 Request processed in 58us (259us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787831083.120080:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1787831083.120897:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8d2201e0b000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787831083.120903:0:3618:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787831083.120907:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204625e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1874676443917440:0@lo:38:llog_process_th.0 00000040:01000000:2.0:1787831083.121712:0:17122:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1787831083.121987:0:17122:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1787831083.123928:0:17122:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787831083.124193:0:17122:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1787831083.128395:0:17122:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1787831083.129009:0:17128:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787831083.129015:0:17128:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1787831083.129912:0:17122:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787831083.129926:0:17122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787831083.129964:0:17122:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1787831083.129986:0:17122:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x95459fb9d1d29a59 00000100:00080000:2.0:1787831083.129996:0:17122:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787831083.130001:0:17122:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d233be52000 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:2.0:1787831083.130033:0:17122:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2204704b40 x1874676443917568/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787831083.130087:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1874676443917568:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1787831083.130209:0:3618:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874676443917568 offset 0 length 520: 4 00000100:00080000:2.0:1787831083.130262:0:17122:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1787831083.130330:0:17122:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787831083.130334:0:17122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787831083.130336:0:17122:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1787831083.130339:0:17122:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787831083.130350:0:17122:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:2.0:1787831083.130352:0:17122:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787831083.130354:0:17122:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787831083.130356:0:17122:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787831083.130359:0:17122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787831083.130361:0:17122:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787831083.130363:0:17122:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787831083.130367:0:17122:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1787831083.130371:0:17122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787831083.130372:0:17122:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1787831083.130375:0:17122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787831083.130379:0:17122:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.131@tcp to nid 0x20000c0a8cb83 (192.168.203.131@tcp) 00000020:01000000:2.0:1787831083.130412:0:17122:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1787831083.130415:0:17122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787831083.130427:0:17122:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8d2201e199b8) 00000020:00000080:2.0:1787831083.130439:0:17122:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:2.0:1787831083.130444:0:17122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787831083.130512:0:17122:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1787831083.130520:0:17122:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:2.0:1787831083.130526:0:17122:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x95459fb9d1d29a67 00010000:00080000:2.0:1787831083.130554:0:17122:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d2303f2a800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.131@tcp at head 00010000:00010000:2.0:1787831083.130784:0:17122:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:2.0:1787831083.130847:0:17122:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1787831083.130862:0:17122:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1787831083.132897:0:17122:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787831083.133178:0:17122:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1787831083.133313:0:17122:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:1.0:1787831083.133953:0:17130:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787831083.133958:0:17130:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1787831083.134709:0:17122:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787831083.134933:0:17122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787831083.134973:0:17122:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1787831083.134993:0:17122:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x95459fb9d1d29a6e 00000100:00080000:2.0:1787831083.135004:0:17122:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787831083.135018:0:17122:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d2303f2a800 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:2.0:1787831083.135056:0:17122:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2204707480 x1874676443917696/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787831083.135084:0:17122:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1787831083.135250:0:17122:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787831083.135254:0:17122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787831083.135256:0:17122:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1787831083.135259:0:17122:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787831083.135263:0:17122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787831083.135264:0:17122:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787831083.135267:0:17122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787831083.135280:0:17122:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787831083.135283:0:17122:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787831083.135286:0:17122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787831083.135287:0:17122:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787831083.135289:0:17122:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787831083.135292:0:17122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787831083.135293:0:17122:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787831083.135296:0:17122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1787831083.135329:0:17122:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204706d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be45932f-3bcb-4e49-b61c-a2395180b0ee:17122:1874676443917824:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787831083.135409:0:17122:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831083.135447:0:17122:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d233be68cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787831083.135506:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1874676443917696:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1787831083.135539:0:3618:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874676443917696 offset 0 length 520: 4 00000100:00100000:2.0:1787831083.135692:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443917824 00000100:00100000:2.0:1787831083.135700:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443917824 00000100:00100000:2.0:1787831083.135754:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787831083.135763:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2308750c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be45932f-3bcb-4e49-b61c-a2395180b0ee+9:17122:x1874676443917824:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787831083.136029:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2308750c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be45932f-3bcb-4e49-b61c-a2395180b0ee+9:17122:x1874676443917824:12345-0@lo:502:llog_process_th.0 Request processed in 266us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831083.136038:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787831083.136287:0:17122:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204706d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be45932f-3bcb-4e49-b61c-a2395180b0ee:17122:1874676443917824:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787831083.136320:0:17122:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787831083.136325:0:17122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787831083.136327:0:17122:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787831083.136336:0:17122:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:2.0:1787831083.136515:0:17083:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:2.0:1787831083.136546:0:17083:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787831083.136597:0:17083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d23344b6800/0x95459fb9d1d299e2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d299e9 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831083.136607:0:17083:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8d23344b6800/0x95459fb9d1d299e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d299e9 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787831083.136614:0:17083:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d23115b5000 from 1 10000000:01000000:2.0:1787831083.136617:0:17083:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787831083.136666:0:17083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d22039c0e00/0x95459fb9d1d29a75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831083.136674:0:17083:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8d22039c0e00/0x95459fb9d1d29a75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831083.136683:0:17083:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8d22039c0e00/0x95459fb9d1d29a75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831083.136697:0:17083:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204707840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:17083:1874676443917952:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787831083.136743:0:17083:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831083.136815:0:17083:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d233be683c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787831083.136991:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443917952 00000100:00100000:3.0:1787831083.136997:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443917952 00000100:00100000:3.0:1787831083.137034:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787831083.137042:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2308750450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be45932f-3bcb-4e49-b61c-a2395180b0ee+9:17083:x1874676443917952:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787831083.137052:0:17098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787831083.137066:0:17098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2307c77400/0x95459fb9d1d29a7c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d29a75 expref: -99 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831083.137087:0:17098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2307c77400/0x95459fb9d1d29a7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d29a75 expref: 10 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831083.137110:0:17098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2307c77400/0x95459fb9d1d29a7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d29a75 expref: 10 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831083.137119:0:17098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2307c77400, rc 0) 00000100:00100000:3.0:1787831083.137165:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2308750450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be45932f-3bcb-4e49-b61c-a2395180b0ee+10:17083:x1874676443917952:12345-0@lo:101:mount.lustre.0 Request processed in 124us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831083.137179:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787831083.137242:0:17083:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204707840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:17083:1874676443917952:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787831083.137254:0:17083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8d22039c0e00/0x95459fb9d1d29a75 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d29a7c expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831083.137263:0:17083:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8d22039c0e00/0x95459fb9d1d29a75 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d29a7c expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831083.137834:0:17083:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204627840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:17083:1874676443918080:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1787831083.137875:0:17083:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831083.137904:0:17083:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d230879a000 going to sleep for 11 seconds 00000100:00100000:2.0:1787831083.138077:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443918080 00000100:00100000:2.0:1787831083.138083:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443918080 00000100:00100000:2.0:1787831083.138124:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787831083.138132:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2308751450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be45932f-3bcb-4e49-b61c-a2395180b0ee+10:17083:x1874676443918080:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1787831083.138145:0:17096:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1787831083.138151:0:17096:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1787831083.138215:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2308751450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be45932f-3bcb-4e49-b61c-a2395180b0ee+10:17083:x1874676443918080:12345-0@lo:256:mount.lustre.0 Request processed in 84us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831083.138231:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787831083.138430:0:17083:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204627840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:17083:1874676443918080:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1787831083.139068:0:17083:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787831083.139090:0:17083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d22039c0e00/0x95459fb9d1d29a75 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d29a7c expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831083.139165:0:17083:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8d22039c0e00/0x95459fb9d1d29a75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d29a7c expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787831083.139172:0:17083:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d23115b5000 from 1 10000000:01000000:0.0:1787831083.139175:0:17083:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787831083.139202:0:17083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d2303aa3e00/0x95459fb9d1d29a83 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831083.139210:0:17083:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8d2303aa3e00/0x95459fb9d1d29a83 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831083.139218:0:17083:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8d2303aa3e00/0x95459fb9d1d29a83 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831083.139243:0:17083:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204627840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:17083:1874676443918208:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787831083.139291:0:17083:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831083.139320:0:17083:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d230879a000 going to sleep for 11 seconds 00000100:00100000:3.0:1787831083.139390:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443918208 00000100:00100000:3.0:1787831083.139396:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443918208 00000100:00100000:3.0:1787831083.139434:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787831083.139441:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2308752450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be45932f-3bcb-4e49-b61c-a2395180b0ee+10:17083:x1874676443918208:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787831083.139451:0:17096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787831083.139464:0:17096:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2307c76e00/0x95459fb9d1d29a8a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d29a83 expref: -99 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831083.139485:0:17096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2307c76e00/0x95459fb9d1d29a8a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d29a83 expref: 11 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831083.139494:0:17096:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2307c76e00/0x95459fb9d1d29a8a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d29a83 expref: 11 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831083.139503:0:17096:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2307c76e00, rc 0) 00000100:00100000:3.0:1787831083.139536:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2308752450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be45932f-3bcb-4e49-b61c-a2395180b0ee+11:17083:x1874676443918208:12345-0@lo:101:mount.lustre.0 Request processed in 95us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831083.139542:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787831083.139611:0:17083:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204627840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:17083:1874676443918208:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787831083.139685:0:17083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8d2303aa3e00/0x95459fb9d1d29a83 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d29a8a expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831083.139695:0:17083:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8d2303aa3e00/0x95459fb9d1d29a83 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d29a8a expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831083.139813:0:17083:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204627840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:17083:1874676443918336:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787831083.139841:0:17083:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831083.139901:0:17083:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d230879a000 going to sleep for 11 seconds 00000100:00100000:3.0:1787831083.140047:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443918336 00000100:00100000:3.0:1787831083.140052:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443918336 00000100:00100000:3.0:1787831083.140190:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787831083.140198:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220377e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be45932f-3bcb-4e49-b61c-a2395180b0ee+11:17083:x1874676443918336:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787831083.140390:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220377e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be45932f-3bcb-4e49-b61c-a2395180b0ee+11:17083:x1874676443918336:12345-0@lo:501:mount.lustre.0 Request processed in 192us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831083.140398:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787831083.140466:0:17083:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204627840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:17083:1874676443918336:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787831083.140499:0:17083:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204627840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:17083:1874676443918464:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787831083.140539:0:17083:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831083.140599:0:17083:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d230879a000 going to sleep for 11 seconds 00000100:00100000:3.0:1787831083.140654:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443918464 00000100:00100000:3.0:1787831083.140664:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443918464 00000100:00100000:3.0:1787831083.140737:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787831083.140746:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220377cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be45932f-3bcb-4e49-b61c-a2395180b0ee+11:17083:x1874676443918464:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787831083.140829:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220377cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be45932f-3bcb-4e49-b61c-a2395180b0ee+11:17083:x1874676443918464:12345-0@lo:503:mount.lustre.0 Request processed in 85us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831083.140836:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787831083.140914:0:17083:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204627840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:17083:1874676443918464:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787831083.141342:0:17132:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204704f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be45932f-3bcb-4e49-b61c-a2395180b0ee:17132:1874676443918592:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787831083.141385:0:17132:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831083.141406:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443918592 00000100:00100000:2.0:1787831083.141410:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443918592 00000100:00100000:2.0:1787831083.141430:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787831083.141436:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220377d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be45932f-3bcb-4e49-b61c-a2395180b0ee+11:17132:x1874676443918592:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787831083.141876:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220377d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be45932f-3bcb-4e49-b61c-a2395180b0ee+11:17132:x1874676443918592:12345-0@lo:502:llog_process_th.0 Request processed in 438us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831083.141884:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787831083.141927:0:17132:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d233be68540 going to sleep for 11 seconds 00000100:00100000:2.0:1787831083.141941:0:17132:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204704f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be45932f-3bcb-4e49-b61c-a2395180b0ee:17132:1874676443918592:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787831083.141964:0:17132:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787831083.141973:0:17132:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787831083.141975:0:17132:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787831083.141983:0:17132:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d23115b5000 00000020:00000080:2.0:1787831083.141985:0:17132:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787831083.141992:0:17132:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787831083.141995:0:17132:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787831083.141996:0:17132:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1787831083.141998:0:17132:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787831083.142001:0:17132:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787831083.142002:0:17132:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787831083.142005:0:17132:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d23115b5000 00000020:00000080:2.0:1787831083.142007:0:17132:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787831083.142184:0:17132:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787831083.142189:0:17132:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787831083.142190:0:17132:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1787831083.142199:0:17132:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787831083.142203:0:17132:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787831083.142204:0:17132:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787831083.142209:0:17132:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d23115b5000 00000020:00000080:2.0:1787831083.142211:0:17132:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787831083.150207:0:17132:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787831083.150221:0:17132:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787831083.150223:0:17132:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787831083.150227:0:17132:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787831083.150231:0:17132:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787831083.150233:0:17132:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1787831083.150238:0:17132:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d23115b5000 00000020:00000080:2.0:1787831083.150240:0:17132:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787831083.150345:0:17132:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204704f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be45932f-3bcb-4e49-b61c-a2395180b0ee:17132:1874676443918720:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787831083.150429:0:17132:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831083.150469:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443918720 00000100:00100000:2.0:1787831083.150475:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443918720 00000100:00100000:2.0:1787831083.150517:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787831083.150526:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220377dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be45932f-3bcb-4e49-b61c-a2395180b0ee+11:17132:x1874676443918720:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787831083.150661:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220377dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be45932f-3bcb-4e49-b61c-a2395180b0ee+11:17132:x1874676443918720:12345-0@lo:502:llog_process_th.0 Request processed in 134us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831083.150669:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787831083.150801:0:17132:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d233be68540 going to sleep for 11 seconds 00000100:00100000:2.0:1787831083.150824:0:17132:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204704f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be45932f-3bcb-4e49-b61c-a2395180b0ee:17132:1874676443918720:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787831083.150850:0:17132:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787831083.150855:0:17132:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787831083.150856:0:17132:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1787831083.150860:0:17132:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1787831083.151194:0:17083:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1787831083.151224:0:17083:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787831083.151244:0:17083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d2303aa3e00/0x95459fb9d1d29a83 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d29a8a expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831083.151370:0:17083:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8d2303aa3e00/0x95459fb9d1d29a83 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d29a8a expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787831083.151437:0:17083:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787831083.151440:0:17083:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d23115b5000 10000000:01000000:0.0:1787831083.151443:0:17083:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d23115b5000 10000000:01000000:0.0:1787831083.151447:0:17083:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787831083.151453:0:17083:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d23115b5000 from 1 10000000:01000000:0.0:1787831083.151456:0:17083:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787831083.151487:0:17083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d2303aa2800/0x95459fb9d1d29a91 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831083.151495:0:17083:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8d2303aa2800/0x95459fb9d1d29a91 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831083.151505:0:17083:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8d2303aa2800/0x95459fb9d1d29a91 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831083.151521:0:17083:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204627840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:17083:1874676443918848:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787831083.151664:0:17083:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831083.151693:0:17083:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d230879a180 going to sleep for 11 seconds 00000100:00100000:3.0:1787831083.152218:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443918848 00000100:00100000:3.0:1787831083.152226:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443918848 00000100:00100000:3.0:1787831083.152283:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787831083.152292:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220377c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be45932f-3bcb-4e49-b61c-a2395180b0ee+11:17083:x1874676443918848:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787831083.152302:0:17098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787831083.152317:0:17098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2307c77600/0x95459fb9d1d29a98 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d29a91 expref: -99 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831083.152344:0:17098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2307c77600/0x95459fb9d1d29a98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d29a91 expref: 12 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831083.152355:0:17098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2307c77600/0x95459fb9d1d29a98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d29a91 expref: 12 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831083.152365:0:17098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2307c77600, rc 0) 00000100:00100000:3.0:1787831083.152422:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220377c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be45932f-3bcb-4e49-b61c-a2395180b0ee+12:17083:x1874676443918848:12345-0@lo:101:mount.lustre.0 Request processed in 130us (757us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831083.152429:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787831083.152449:0:17083:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204627840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:17083:1874676443918848:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787831083.152468:0:17083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8d2303aa2800/0x95459fb9d1d29a91 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d29a98 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831083.152478:0:17083:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8d2303aa2800/0x95459fb9d1d29a91 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d29a98 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831083.152615:0:17083:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204627840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:17083:1874676443918976:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787831083.152842:0:17083:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831083.152893:0:17083:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d230879a180 going to sleep for 11 seconds 00000100:00100000:3.0:1787831083.153196:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443918976 00000100:00100000:3.0:1787831083.153201:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443918976 00000100:00100000:3.0:1787831083.153232:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787831083.153239:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220377d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be45932f-3bcb-4e49-b61c-a2395180b0ee+12:17083:x1874676443918976:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787831083.153387:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220377d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be45932f-3bcb-4e49-b61c-a2395180b0ee+12:17083:x1874676443918976:12345-0@lo:501:mount.lustre.0 Request processed in 147us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831083.153395:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787831083.153797:0:17083:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204627840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:17083:1874676443918976:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787831083.153836:0:17083:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a22940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:17083:1874676443919104:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787831083.153878:0:17083:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831083.154841:0:17083:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2305268d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787831083.162226:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443919104 00000100:00100000:3.0:1787831083.162240:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443919104 00000100:00100000:3.0:1787831083.162303:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787831083.162312:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220377e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be45932f-3bcb-4e49-b61c-a2395180b0ee+12:17083:x1874676443919104:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787831083.162467:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220377e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be45932f-3bcb-4e49-b61c-a2395180b0ee+12:17083:x1874676443919104:12345-0@lo:503:mount.lustre.0 Request processed in 155us (8587us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831083.162475:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787831083.163043:0:17083:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a22940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:17083:1874676443919104:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787831083.163472:0:17137:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204704f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be45932f-3bcb-4e49-b61c-a2395180b0ee:17137:1874676443919232:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787831083.163528:0:17137:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831083.163594:0:17137:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d233be68600 going to sleep for 11 seconds 00000100:00100000:3.0:1787831083.163825:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443919232 00000100:00100000:3.0:1787831083.163830:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443919232 00000100:00100000:3.0:1787831083.163896:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787831083.163904:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220377f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be45932f-3bcb-4e49-b61c-a2395180b0ee+12:17137:x1874676443919232:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787831083.164008:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220377f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be45932f-3bcb-4e49-b61c-a2395180b0ee+12:17137:x1874676443919232:12345-0@lo:502:llog_process_th.0 Request processed in 104us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831083.164015:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787831083.164079:0:17137:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204704f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be45932f-3bcb-4e49-b61c-a2395180b0ee:17137:1874676443919232:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1787831083.164151:0:17137:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1787831083.164167:0:17137:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8d2201e18000) 00000020:00000080:2.0:1787831083.164186:0:17137:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:2.0:1787831083.164280:0:17137:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d23115b5000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787831083.164284:0:17137:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d23115b5000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787831083.164287:0:17137:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d23115b5000 4 00010000:00080000:2.0:1787831083.164316:0:17137:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d2202a83800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.131@tcp at head 00010000:00010000:2.0:1787831083.166425:0:17137:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:2.0:1787831083.167462:0:17137:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1787831083.167509:0:17137:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787831083.167524:0:17137:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x95459fb9d1d29aa6 00000100:00080000:2.0:1787831083.167535:0:17137:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787831083.167542:0:17137:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8d2202a83800 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:2.0:1787831083.167577:0:17137:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2204704f00 x1874676443919360/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787831083.167614:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204704f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874676443919360:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787831083.167698:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831083.167838:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443919360 00000100:00100000:2.0:1787831083.167845:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443919360 00000100:00100000:2.0:1787831083.167877:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787831083.167884:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22047043c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3618:x1874676443919360:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787831083.167929:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22047043c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3618:x1874676443919360:12345-0@lo:38:llog_process_th.0 Request processed in 45us (232us total) trans 0 rc -11/-11 00000100:00100000:2.0:1787831083.167937:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787831083.167972:0:3618:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787831083.167979:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8d2202a83800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787831083.167991:0:3618:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1787831083.167995:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204704f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874676443919360:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1787831083.168026:0:17137:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787831083.168446:0:17137:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204704f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be45932f-3bcb-4e49-b61c-a2395180b0ee:17137:1874676443919488:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787831083.168496:0:17137:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831083.168522:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443919488 00000100:00100000:2.0:1787831083.168527:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443919488 00000100:00100000:2.0:1787831083.168556:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787831083.168564:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233f45a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be45932f-3bcb-4e49-b61c-a2395180b0ee+12:17137:x1874676443919488:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787831083.168690:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233f45a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be45932f-3bcb-4e49-b61c-a2395180b0ee+12:17137:x1874676443919488:12345-0@lo:502:llog_process_th.0 Request processed in 126us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831083.168697:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787831083.168903:0:17137:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d233be68480 going to sleep for 11 seconds 00000100:00100000:2.0:1787831083.168918:0:17137:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204704f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be45932f-3bcb-4e49-b61c-a2395180b0ee:17137:1874676443919488:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787831083.168955:0:17137:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204704f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be45932f-3bcb-4e49-b61c-a2395180b0ee:17137:1874676443919616:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787831083.168985:0:17137:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831083.169006:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443919616 00000100:00100000:2.0:1787831083.169010:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443919616 00000100:00100000:2.0:1787831083.169031:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787831083.169037:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233f459450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be45932f-3bcb-4e49-b61c-a2395180b0ee+12:17137:x1874676443919616:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787831083.169168:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233f459450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be45932f-3bcb-4e49-b61c-a2395180b0ee+12:17137:x1874676443919616:12345-0@lo:502:llog_process_th.0 Request processed in 59us (110us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831083.169175:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787831083.169209:0:17137:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d233be68480 going to sleep for 11 seconds 00000100:00100000:2.0:1787831083.169219:0:17137:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204704f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be45932f-3bcb-4e49-b61c-a2395180b0ee:17137:1874676443919616:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1787831083.169236:0:17137:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1787831083.171085:0:17083:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1787831083.171202:0:17083:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787831083.171229:0:17083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d2303aa2800/0x95459fb9d1d29a91 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d29a98 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831083.171241:0:17083:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8d2303aa2800/0x95459fb9d1d29a91 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d29a98 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787831083.171307:0:17083:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787831083.171309:0:17083:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787831083.171310:0:17083:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787831083.171311:0:17083:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787831083.171313:0:17083:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787831083.171314:0:17083:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787831083.171316:0:17083:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787831083.171317:0:17083:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787831083.171319:0:17083:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787831083.171320:0:17083:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787831083.171324:0:17083:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1787831083.171326:0:17083:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787831083.171328:0:17083:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787831083.171329:0:17083:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787831083.171330:0:17083:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787831083.171331:0:17083:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787831083.171332:0:17083:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787831083.171333:0:17083:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787831083.171334:0:17083:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787831083.171335:0:17083:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787831083.171340:0:17083:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787831083.171366:0:17083:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1787831083.171384:0:17083:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a22940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:17083:1874676443919744:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787831083.171444:0:17083:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831083.171477:0:17083:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2305268540 going to sleep for 11 seconds 00000100:00100000:2.0:1787831083.171564:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443919744 00000100:00100000:2.0:1787831083.171570:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443919744 00000100:00100000:2.0:1787831083.171609:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787831083.171616:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233f45ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be45932f-3bcb-4e49-b61c-a2395180b0ee+12:17083:x1874676443919744:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787831083.171681:0:17096:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1787831083.171695:0:17096:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1787831083.175010:0:17096:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787831083.175025:0:17096:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1787831083.175244:0:17120:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787831083.175249:0:17120:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787831083.175282:0:17120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d2307c76400/0x95459fb9d1d29aad lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831083.175300:0:17120:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2307c77400/0x95459fb9d1d29a7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d29a75 expref: 12 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831083.175308:0:17120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d2307c76400/0x95459fb9d1d29aad lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831083.175356:0:17120:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2307c77400/0x95459fb9d1d29a7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x95459fb9d1d29a75 expref: 12 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831083.175372:0:17120:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d2307c77400/0x95459fb9d1d29a7c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x95459fb9d1d29a75 expref: 12 pid: 17098 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787831083.175385:0:17120:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203afe1c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17120:1874676443919872:0@lo:104: 00000100:00100000:3.0:1787831083.175459:0:17120:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831083.175500:0:17120:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2338238780 going to sleep for 11 seconds 00000100:00100000:3.0:1787831083.175567:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233f45ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be45932f-3bcb-4e49-b61c-a2395180b0ee+12:17083:x1874676443919744:12345-0@lo:253:mount.lustre.0 Request processed in 3950us (4122us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831083.175576:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787831083.176841:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443919872 00000100:00100000:3.0:1787831083.176851:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443919872 00000100:00100000:3.0:1787831083.176890:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787831083.176897:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203aff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:be45932f-3bcb-4e49-b61c-a2395180b0ee+3:17120:x1874676443919872:12345-0@lo:104: 00010000:00010000:3.0:1787831083.176909:0:17087:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff8d22039c0e00/0x95459fb9d1d29a75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d29a7c expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831083.176960:0:17087:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787831083.176963:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203aff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:be45932f-3bcb-4e49-b61c-a2395180b0ee+3:17120:x1874676443919872:12345-0@lo:104: Request processed in 68us (1506us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831083.176967:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787831083.176995:0:17120:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203afe1c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17120:1874676443919872:0@lo:104: 00010000:00010000:3.0:1787831083.177011:0:17120:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d2307c76400/0x95459fb9d1d29aad lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831083.177185:0:17083:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a22940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:17083:1874676443919744:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787831083.177198:0:17083:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1787831083.177201:0:17083:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787831083.177203:0:17083:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787831083.177204:0:17083:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787831083.177205:0:17083:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787831083.177206:0:17083:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787831083.177207:0:17083:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787831083.177209:0:17083:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787831083.177210:0:17083:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787831083.177211:0:17083:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787831083.177213:0:17083:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787831083.177223:0:17083:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:0.0:1787831083.180679:0:17093:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787831083.180693:0:17093:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8d22039c0e00/0x95459fb9d1d29a75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d29a7c expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831083.180706:0:17093:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22039c0e00 already unused, calling callback (ffffffffc14f9c20) 10000000:00010000:0.0:1787831083.180710:0:17093:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8d22039c0e00/0x95459fb9d1d29a75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x95459fb9d1d29a7c expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831083.180719:0:17093:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8d22039c0e00/0x95459fb9d1d29a75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x95459fb9d1d29a7c expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787831083.180727:0:17093:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8d22039c0e00/0x95459fb9d1d29a75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x95459fb9d1d29a7c expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787831083.180733:0:17093:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787831083.180786:0:17093:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8d22039c0e00/0x95459fb9d1d29a75 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d29a7c expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831083.180793:0:17093:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787831083.180817:0:17093:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8d22039c0e00/0x95459fb9d1d29a75 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d29a7c expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831083.180824:0:17093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8d22039c0e00/0x95459fb9d1d29a75 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d29a7c expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831083.180839:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787831083.180840:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787831083.180842:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787831083.180885:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204625680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:be45932f-3bcb-4e49-b61c-a2395180b0ee:3622:1874676443920000:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787831083.180945:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831083.181048:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443920000 00000100:00100000:0.0:1787831083.181312:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443920000 00010000:00010000:0.0:1787831083.181343:0:17089:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2307c77400/0x95459fb9d1d29a7c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d29a75 expref: 12 pid: 17098 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831083.181381:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787831083.181390:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22046252c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:be45932f-3bcb-4e49-b61c-a2395180b0ee+12:3622:x1874676443920000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787831083.181461:0:17089:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787831083.181468:0:17089:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2307c77400/0x95459fb9d1d29a7c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d29a75 expref: 12 pid: 17098 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831083.181480:0:17089:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2307c77400/0x95459fb9d1d29a7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x95459fb9d1d29a75 expref: 12 pid: 17098 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831083.181496:0:17089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2307c77400/0x95459fb9d1d29a7c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x95459fb9d1d29a75 expref: 12 pid: 17098 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831083.181511:0:17089:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d2307c76400/0x95459fb9d1d29aad lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831083.181521:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2307c76400/0x95459fb9d1d29aad lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787831083.181536:0:17089:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006287325s 00010000:00010000:0.0:1787831083.181541:0:17089:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d2307c76400/0x95459fb9d1d29aad lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831083.181548:0:17089:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d2307c76400/0x95459fb9d1d29aad lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831083.181555:0:17089:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d2307c76400/0x95459fb9d1d29aad lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831083.181568:0:17089:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d2307c76400/0x95459fb9d1d29aad lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831083.181574:0:17089:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2307c76400 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:0.0:1787831083.181578:0:17089:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d2307c76400/0x95459fb9d1d29aad lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831083.181586:0:17089:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d2307c76400/0x95459fb9d1d29aad lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831083.181608:0:17089:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d2307c76400/0x95459fb9d1d29aad lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831083.181619:0:17089:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787831083.181642:0:17120:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d2307c76400/0x95459fb9d1d29aad lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831083.181651:0:17120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d2307c76400/0x95459fb9d1d29aad lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831083.181656:0:17120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2307c76400/0x95459fb9d1d29aad lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831083.181673:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22046252c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:be45932f-3bcb-4e49-b61c-a2395180b0ee+11:3622:x1874676443920000:12345-0@lo:103:ldlm_bl.0 Request processed in 284us (727us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831083.181680:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787831083.181721:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204625680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:be45932f-3bcb-4e49-b61c-a2395180b0ee:3622:1874676443920000:0@lo:103:ldlm_bl.0 00000020:00080000:3.0:1787831083.189088:0:17083:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:3.0:1787831083.189426:0:17083:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1787831083.189513:0:17143:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:0.0:1787831083.189518:0:17143:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:2.0:1787831083.189815:0:17144:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:2.0:1787831083.190106:0:17144:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:1.0:1787831083.191034:0:17083:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:2.0:1787831083.192317:0:17144:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1787831083.192392:0:17144:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000100:00080000:0.0:1787831083.194557:0:17145:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff8d2204625680 x1874676443920128/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787831083.194570:0:17145:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2202713600 going to sleep for 0 seconds 00000040:01000000:3.0:1787831083.194996:0:17083:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1787831083.195029:0:17083:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1787831083.195456:0:17083:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1787831083.195463:0:17083:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1787831083.195501:0:17083:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787831083.196736:0:17083:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1787831083.197249:0:17083:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1787831083.197284:0:17083:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:3.0:1787831083.198928:0:17083:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:3.0:1787831083.201077:0:17083:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1787831083.202578:0:17083:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1787831083.202610:0:17083:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffae38c1c6b988 00100000:10000000:1.0:1787831083.202617:0:17083:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1787831083.204768:0:17083:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787831083.204786:0:17083:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.131@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787831083.204805:0:17083:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=45 00000080:00000004:1.0:1787831083.204829:0:17083:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:1.0:1787831083.205576:0:17083:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787831083.205798:0:17083:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787831083.945383:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787831084.201325:0:17139:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787831084.201544:0:17145:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2202713600 going to sleep for 0 seconds 10000000:01000000:3.0:1787831084.262737:0:17102:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787831084.262746:0:17102:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d23115b5000 from 7 10000000:01000000:3.0:1787831084.262755:0:17102:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787831084.262817:0:17102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d2307c77800/0x95459fb9d1d29ab4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831084.262828:0:17102:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8d2307c77800/0x95459fb9d1d29ab4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831084.262839:0:17102:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8d2307c77800/0x95459fb9d1d29ab4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787831084.262882:0:17102:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203afcb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be45932f-3bcb-4e49-b61c-a2395180b0ee:17102:1874676443920256:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787831084.262963:0:17102:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831084.263160:0:17102:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2307235300 going to sleep for 11 seconds 00000100:00100000:2.0:1787831084.263175:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443920256 00000100:00100000:2.0:1787831084.263188:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443920256 00000100:00100000:2.0:1787831084.263247:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787831084.263256:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233f459050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be45932f-3bcb-4e49-b61c-a2395180b0ee+11:17102:x1874676443920256:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787831084.263279:0:17097:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787831084.263298:0:17097:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d22039c0200/0x95459fb9d1d29abb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d29ab4 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831084.263323:0:17097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22039c0200/0x95459fb9d1d29abb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d29ab4 expref: 12 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831084.263334:0:17097:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d22039c0200/0x95459fb9d1d29abb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d29ab4 expref: 12 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831084.263343:0:17097:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22039c0200, rc 0) 00000100:00100000:2.0:1787831084.263417:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233f459050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be45932f-3bcb-4e49-b61c-a2395180b0ee+12:17102:x1874676443920256:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 163us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831084.263438:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787831084.263479:0:17102:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203afcb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be45932f-3bcb-4e49-b61c-a2395180b0ee:17102:1874676443920256:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787831084.263502:0:17102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8d2307c77800/0x95459fb9d1d29ab4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d29abb expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831084.263518:0:17102:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8d2307c77800/0x95459fb9d1d29ab4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d29abb expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787831084.263576:0:17102:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203afcb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be45932f-3bcb-4e49-b61c-a2395180b0ee:17102:1874676443920384:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787831084.263615:0:17102:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831084.263670:0:17102:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2307235300 going to sleep for 11 seconds 00000100:00100000:2.0:1787831084.263912:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443920384 00000100:00100000:2.0:1787831084.263919:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443920384 00000100:00100000:2.0:1787831084.264001:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787831084.264009:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233f458050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be45932f-3bcb-4e49-b61c-a2395180b0ee+12:17102:x1874676443920384:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787831084.264024:0:17096:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787831084.264040:0:17096:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787831084.264043:0:17096:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1787831084.264162:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233f458050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be45932f-3bcb-4e49-b61c-a2395180b0ee+12:17102:x1874676443920384:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 154us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831084.264170:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787831084.264466:0:17102:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203afcb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be45932f-3bcb-4e49-b61c-a2395180b0ee:17102:1874676443920384:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787831084.264741:0:17102:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787831084.264754:0:17102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d2307c77800/0x95459fb9d1d29ab4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d29abb expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831084.264765:0:17102:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8d2307c77800/0x95459fb9d1d29ab4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d29abb expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831084.969040:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787831085.222820:0:17145:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2202713600 going to sleep for 0 seconds 00000040:00080000:3.0:1787831085.230730:0:17139:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787831085.990705:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787831086.250924:0:17145:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2202713600 going to sleep for 0 seconds 00000001:02000400:2.0:1787831086.738438:0:17387:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg331-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787831087.015793:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787831087.270926:0:17145:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2202713600 going to sleep for 0 seconds 00000020:00000004:3.0:1787831087.452894:0:17439:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787831087.453262:0:17439:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787831088.040795:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787831088.163142:0:17490:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787831088.163435:0:17490:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1787831088.297258:0:17145:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2202713600 going to sleep for 0 seconds 00000100:00080000:1.0:1787831088.358889:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1787831088.358896:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1787831088.358900:0:37:0:(import.c:65:import_set_state_nolock()) ffff8d2201e0b000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787831088.358908:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 374 00000100:00080000:1.0:1787831088.358914:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787831088.358921:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8d2201e0b000 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:1.0:1787831088.358942:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2203a230c0 x1874676443920640/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787831088.358960:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787831088.358964:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787831088.358967:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787831088.358969:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787831088.358972:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1787831088.358975:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787831088.358977:0:37:0:(import.c:65:import_set_state_nolock()) ffff8d2202a83800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787831088.358980:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8d2202a83800 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:1.0:1787831088.358990:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2203a20780 x1874676443920768/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787831088.359039:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787831088.359053:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a212c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:be45932f-3bcb-4e49-b61c-a2395180b0ee:3620:1874676443920512:0@lo:400:kworker.0 00000100:00100000:3.0:1787831088.359171:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831088.359309:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443920512 00000100:00100000:1.0:1787831088.359316:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443920512 00000100:00100000:1.0:1787831088.359358:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787831088.359366:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233f45b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be45932f-3bcb-4e49-b61c-a2395180b0ee+12:3620:x1874676443920512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787831088.359419:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a230c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1874676443920640:0@lo:38:kworker.0 00000100:00100000:2.0:1787831088.359485:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831088.359512:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a20780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874676443920768:0@lo:38:kworker.0 00000100:00100000:2.0:1787831088.359535:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831088.359597:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443920640 00000100:00100000:2.0:1787831088.359601:0:17110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443920640 00000100:00100000:2.0:1787831088.359621:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787831088.359648:0:17110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204704f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3618:x1874676443920640:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787831088.359665:0:17110:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787831088.359809:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233f45b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be45932f-3bcb-4e49-b61c-a2395180b0ee+12:3620:x1874676443920512:12345-0@lo:400:kworker.0 Request processed in 443us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831088.359817:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787831088.360011:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a212c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:be45932f-3bcb-4e49-b61c-a2395180b0ee:3620:1874676443920512:0@lo:400:kworker.0 00000100:00100000:0.0:1787831088.360224:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443920768 00000100:00100000:0.0:1787831088.360229:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443920768 00000100:00100000:0.0:1787831088.360271:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787831088.360286:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22047061c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3618:x1874676443920768:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1787831088.360305:0:17106:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 379 last 0 00000020:00000080:0.0:1787831088.360341:0:17106:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x95459fb9d1d29ac2 00000004:00100000:0.0:1787831088.360357:0:17106:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787831088.360493:0:17106:0:(import.c:65:import_set_state_nolock()) ffff8d233f438000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787831088.360551:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22047061c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874676443920768:12345-0@lo:38:kworker.0 Request processed in 265us (1014us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831088.360558:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787831088.362123:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8d2203a20780 x1874676443920768/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787831098 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787831088.362140:0:3618:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1787831088.362147:0:3618:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1787831088.362152:0:3618:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787831088.362154:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8d2202a83800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787831088.362160:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a20780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874676443920768:0@lo:38:kworker.0 00000100:00100000:2.0:1787831088.381140:0:17110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204704f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3618:x1874676443920640:12345-0@lo:38:kworker.0 Request processed in 21485us (21647us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787831088.381156:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1787831088.381369:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8d2201e0b000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787831088.381377:0:3618:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787831088.381381:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a230c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1874676443920640:0@lo:38:kworker.0 00010000:00010000:1.0:1787831089.063957:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787831089.318757:0:17145:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2202713600 going to sleep for 0 seconds 00010000:00010000:1.0:1787831090.087808:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787831090.342714:0:17145:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2202713600 going to sleep for 0 seconds 00010000:00010000:3.0:1787831091.113393:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787831091.366724:0:17145:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2202713600 going to sleep for 0 seconds 00010000:00010000:1.0:1787831092.134829:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787831092.390985:0:17145:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2202713600 going to sleep for 0 seconds 00000020:01000004:0.0:1787831093.157287:0:17834:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787831093.157291:0:17834:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:0.0:1787831093.157292:0:17834:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1787831093.157411:0:17834:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8d233f43f000 00000020:01000004:0.0:1787831093.157427:0:17834:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:0.0:1787831093.157440:0:17834:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1787831093.157454:0:17834:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff8d2312953370) 00000020:00000080:0.0:1787831093.157471:0:17834:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00010000:00010000:3.0:1787831093.159757:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1787831093.218458:0:17834:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1787831093.219601:0:17834:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:3.0:1787831093.221233:0:17834:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1787831093.221551:0:17834:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:3.0:1787831093.221787:0:17834:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1787831093.222322:0:17834:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:3.0:1787831093.222615:0:17834:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1787831093.223094:0:17834:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1787831093.223469:0:17834:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:3.0:1787831093.224047:0:17834:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1787831093.224261:0:17834:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1787831093.224684:0:17834:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1787831093.225061:0:17834:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1787831093.225296:0:17834:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1787831093.227568:0:17834:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1787831093.228457:0:17834:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1787831093.228807:0:17834:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1787831093.229075:0:17834:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:3.0:1787831093.229303:0:17834:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:3.0:1787831093.229787:0:17834:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:3.0:1787831093.230143:0:17834:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:3.0:1787831093.230459:0:17834:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:3.0:1787831093.230730:0:17834:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1787831093.231028:0:17834:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1787831093.231226:0:17834:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1787831093.231512:0:17834:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:3.0:1787831093.233152:0:17834:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1787831093.233602:0:17834:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1787831093.234094:0:17834:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1787831093.234543:0:17834:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1787831093.234913:0:17834:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1787831093.235146:0:17834:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1787831093.235432:0:17834:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1787831093.235771:0:17834:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:3.0:1787831093.236077:0:17834:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:3.0:1787831093.236280:0:17834:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1787831093.236581:0:17834:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:3.0:1787831093.236944:0:17834:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1787831093.237141:0:17834:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1787831093.237312:0:17834:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:3.0:1787831093.237491:0:17834:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:3.0:1787831093.237758:0:17834:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1787831093.237981:0:17834:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1787831093.238216:0:17834:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1787831093.238392:0:17834:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1787831093.238762:0:17834:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00080000:01000000:3.0:1787831093.241949:0:17834:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1787831093.242172:0:17834:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:3.0:1787831093.242186:0:17834:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787831093.242198:0:17834:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x95459fb9d1d29ad0 00000020:01000004:3.0:1787831093.242217:0:17834:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:3.0:1787831093.242236:0:17834:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.131@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787831093.242240:0:17834:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.131@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787831093.242246:0:17834:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:3.0:1787831093.242272:0:17834:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:3.0:1787831093.242276:0:17834:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.131@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:2.0:1787831093.246283:0:17834:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.131@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787831093.246329:0:17834:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.131@tcp, index=0001, flags=0x20001 00000020:01000004:2.0:1787831093.246333:0:17834:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787831093.246335:0:17834:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787831093.246336:0:17834:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787831093.246354:0:17834:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787831093.246356:0:17834:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787831093.246357:0:17834:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787831093.246359:0:17834:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787831093.246360:0:17834:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787831093.246361:0:17834:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787831093.246365:0:17834:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:2.0:1787831093.246367:0:17834:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787831093.246368:0:17834:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787831093.246370:0:17834:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787831093.246371:0:17834:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787831093.246372:0:17834:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787831093.246373:0:17834:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787831093.246373:0:17834:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787831093.246374:0:17834:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787831093.246375:0:17834:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787831093.246404:0:17834:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1787831093.246426:0:17834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204705a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:17834:1874676443920896:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787831093.246494:0:17834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831093.246549:0:17834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d23100e0e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787831093.246772:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443920896 00000100:00100000:3.0:1787831093.246779:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443920896 00000100:00100000:3.0:1787831093.246826:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787831093.246836:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233f45b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be45932f-3bcb-4e49-b61c-a2395180b0ee+12:17834:x1874676443920896:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787831093.246878:0:17096:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1787831093.246882:0:17096:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:3.0:1787831093.246889:0:17096:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1787831093.247163:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233f45b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be45932f-3bcb-4e49-b61c-a2395180b0ee+12:17834:x1874676443920896:12345-0@lo:253:mount.lustre.0 Request processed in 329us (668us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831093.247177:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787831093.247481:0:17834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204705a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:17834:1874676443920896:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787831093.247493:0:17834:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1787831093.247496:0:17834:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787831093.247497:0:17834:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787831093.247499:0:17834:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787831093.247511:0:17834:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787831093.247512:0:17834:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787831093.247513:0:17834:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787831093.247514:0:17834:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787831093.247516:0:17834:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787831093.247517:0:17834:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787831093.247542:0:17834:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d233f43f000 from lustre-MDT0001 10000000:01000000:2.0:1787831093.247573:0:17834:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:2.0:1787831093.247576:0:17834:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1787831093.247583:0:17834:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8d2201e1cd28 local copy 00010000:00010000:2.0:1787831093.247592:0:17834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d23344b7200/0x95459fb9d1d299c6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d299cd expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831093.247712:0:17834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204705a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:17834:1874676443921024:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787831093.247751:0:17834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831093.247776:0:17834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d23100e0600 going to sleep for 11 seconds 00000100:00100000:3.0:1787831093.247963:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443921024 00000100:00100000:3.0:1787831093.247969:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443921024 00000100:00100000:3.0:1787831093.248098:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787831093.248105:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233f459c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be45932f-3bcb-4e49-b61c-a2395180b0ee+12:17834:x1874676443921024:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787831093.248243:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233f459c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be45932f-3bcb-4e49-b61c-a2395180b0ee+12:17834:x1874676443921024:12345-0@lo:501:mount.lustre.0 Request processed in 136us (498us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787831093.248250:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787831093.248259:0:17834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204705a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:17834:1874676443921024:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1787831093.248273:0:17834:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.131@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787831093.248293:0:17834:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.131@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787831093.248300:0:17834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d23344b7200/0x95459fb9d1d299c6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d299cd expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831093.248310:0:17834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8d23344b7200/0x95459fb9d1d299c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d299cd expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787831093.248333:0:17834:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d233f43f000 10000000:01000000:1.0:1787831093.248417:0:17834:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787831093.248424:0:17834:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8d2201e1cd28 10000000:01000000:1.0:1787831093.248427:0:17834:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1787831093.248431:0:17834:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8d2201e1cd28 from 1 10000000:01000000:1.0:1787831093.248434:0:17834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1787831093.248518:0:17834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d23344b7000/0x95459fb9d1d29ad7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831093.248526:0:17834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8d23344b7000/0x95459fb9d1d29ad7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831093.248535:0:17834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8d23344b7000/0x95459fb9d1d29ad7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831093.248555:0:17834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a23840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:17834:1874676443921152:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787831093.248585:0:17834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831093.248746:0:17834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d220289ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1787831093.248820:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443921152 00000100:00100000:0.0:1787831093.248825:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443921152 00000100:00100000:0.0:1787831093.248861:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787831093.248869:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233f458c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be45932f-3bcb-4e49-b61c-a2395180b0ee+12:17834:x1874676443921152:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787831093.248877:0:17097:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787831093.248889:0:17097:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2303aa3400/0x95459fb9d1d29ade lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d29ad7 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831093.248910:0:17097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2303aa3400/0x95459fb9d1d29ade lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d29ad7 expref: 13 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831093.248930:0:17097:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2303aa3400/0x95459fb9d1d29ade lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d29ad7 expref: 13 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831093.248939:0:17097:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2303aa3400, rc 0) 00000100:00100000:0.0:1787831093.248978:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233f458c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be45932f-3bcb-4e49-b61c-a2395180b0ee+13:17834:x1874676443921152:12345-0@lo:101:mount.lustre.0 Request processed in 110us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831093.248984:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787831093.249392:0:17834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a23840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:17834:1874676443921152:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787831093.249407:0:17834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8d23344b7000/0x95459fb9d1d29ad7 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d29ade expref: -99 pid: 17834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831093.249415:0:17834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8d23344b7000/0x95459fb9d1d29ad7 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d29ade expref: -99 pid: 17834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787831093.249432:0:17834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1787831093.249599:0:17834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d23344b7000/0x95459fb9d1d29ad7 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d29ade expref: -99 pid: 17834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831093.249607:0:17834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8d23344b7000/0x95459fb9d1d29ad7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d29ade expref: -99 pid: 17834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787831093.249616:0:17834:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8d233f43f000 10000000:01000000:1.0:1787831093.249620:0:17834:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1787831093.249642:0:17834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8d233f43f000 from 1 10000000:01000000:1.0:1787831093.249644:0:17834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1787831093.249663:0:17834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d23344b6400/0x95459fb9d1d29ae5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831093.249671:0:17834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8d23344b6400/0x95459fb9d1d29ae5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831093.249679:0:17834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8d23344b6400/0x95459fb9d1d29ae5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831093.249700:0:17834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a23840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:17834:1874676443921280:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787831093.249731:0:17834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831093.249761:0:17834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d220289ce40 going to sleep for 11 seconds 00000100:00100000:2.0:1787831093.249824:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443921280 00000100:00100000:2.0:1787831093.249829:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443921280 00000100:00100000:2.0:1787831093.249865:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787831093.249873:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233f458850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be45932f-3bcb-4e49-b61c-a2395180b0ee+13:17834:x1874676443921280:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787831093.249880:0:17098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787831093.249890:0:17098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d22039c0400/0x95459fb9d1d29aec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d29ae5 expref: -99 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831093.249905:0:17098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22039c0400/0x95459fb9d1d29aec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d29ae5 expref: 14 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831093.249914:0:17098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d22039c0400/0x95459fb9d1d29aec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d29ae5 expref: 14 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831093.249921:0:17098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22039c0400, rc 0) 00000100:00100000:2.0:1787831093.249959:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233f458850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be45932f-3bcb-4e49-b61c-a2395180b0ee+14:17834:x1874676443921280:12345-0@lo:101:mount.lustre.0 Request processed in 88us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831093.249965:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787831093.250041:0:17834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a23840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:17834:1874676443921280:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787831093.250052:0:17834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8d23344b6400/0x95459fb9d1d29ae5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d29aec expref: -99 pid: 17834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831093.250059:0:17834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8d23344b6400/0x95459fb9d1d29ae5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d29aec expref: -99 pid: 17834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787831093.250069:0:17834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1787831093.250225:0:17834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d23344b6400/0x95459fb9d1d29ae5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d29aec expref: -99 pid: 17834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831093.250234:0:17834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8d23344b6400/0x95459fb9d1d29ae5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d29aec expref: -99 pid: 17834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787831093.250239:0:17834:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1787831093.250243:0:17834:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787831093.250248:0:17834:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8d233f43f000 10000000:01000000:1.0:1787831093.250251:0:17834:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1787831093.250254:0:17834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:1.0:1787831093.250257:0:17834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1787831093.250270:0:17834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d23344b7400/0x95459fb9d1d29af3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831093.250276:0:17834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8d23344b7400/0x95459fb9d1d29af3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831093.250289:0:17834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8d23344b7400/0x95459fb9d1d29af3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831093.250301:0:17834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a23840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:17834:1874676443921408:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787831093.250327:0:17834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831093.250352:0:17834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d220289ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1787831093.250396:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443921408 00000100:00100000:0.0:1787831093.250400:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443921408 00000100:00100000:0.0:1787831093.250430:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787831093.250445:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233f45b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be45932f-3bcb-4e49-b61c-a2395180b0ee+14:17834:x1874676443921408:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787831093.250453:0:17097:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787831093.250462:0:17097:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2303aa3200/0x95459fb9d1d29afa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d29af3 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831093.250476:0:17097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2303aa3200/0x95459fb9d1d29afa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d29af3 expref: 15 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831093.250488:0:17097:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2303aa3200/0x95459fb9d1d29afa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d29af3 expref: 15 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831093.250495:0:17097:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2303aa3200, rc 0) 00000100:00100000:0.0:1787831093.250530:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233f45b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be45932f-3bcb-4e49-b61c-a2395180b0ee+15:17834:x1874676443921408:12345-0@lo:101:mount.lustre.0 Request processed in 93us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831093.250536:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787831093.250603:0:17834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a23840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:17834:1874676443921408:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787831093.250612:0:17834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8d23344b7400/0x95459fb9d1d29af3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d29afa expref: -99 pid: 17834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831093.250620:0:17834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8d23344b7400/0x95459fb9d1d29af3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d29afa expref: -99 pid: 17834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787831093.252018:0:17834:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:1.0:1787831093.252796:0:17834:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787831093.259058:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1787831093.259110:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:1.0:1787831093.259119:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:1.0:1787831093.259128:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:1.0:1787831093.259154:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:1.0:1787831093.259168:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:1.0:1787831093.259182:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:1.0:1787831093.259192:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:1.0:1787831093.259212:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:1.0:1787831093.259228:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:1.0:1787831093.259242:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:1.0:1787831093.259255:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:1.0:1787831093.259270:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:1.0:1787831093.259283:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:1.0:1787831093.259324:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:1.0:1787831093.259341:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:1.0:1787831093.259369:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:1.0:1787831093.259386:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:1.0:1787831093.259400:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:1.0:1787831093.259414:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:1.0:1787831093.259434:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:1.0:1787831093.259447:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:1.0:1787831093.259460:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:1.0:1787831093.259493:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:1.0:1787831093.259499:0:17834:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:1.0:1787831093.259651:0:17834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a23840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:17834:1874676443921536:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787831093.259719:0:17834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831093.259822:0:17834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d220289c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787831093.260560:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443921536 00000100:00100000:0.0:1787831093.260570:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443921536 00000100:00100000:0.0:1787831093.262595:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787831093.262607:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203527850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be45932f-3bcb-4e49-b61c-a2395180b0ee+15:17834:x1874676443921536:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787831093.262904:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203527850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be45932f-3bcb-4e49-b61c-a2395180b0ee+15:17834:x1874676443921536:12345-0@lo:501:mount.lustre.0 Request processed in 297us (3183us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831093.262913:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787831093.262934:0:17834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a23840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:17834:1874676443921536:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787831093.262999:0:17834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a23840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:17834:1874676443921664:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787831093.263055:0:17834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831093.263092:0:17834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d220289c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787831093.263145:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443921664 00000100:00100000:2.0:1787831093.263158:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443921664 00000100:00100000:2.0:1787831093.263194:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787831093.263211:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203524050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be45932f-3bcb-4e49-b61c-a2395180b0ee+15:17834:x1874676443921664:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787831093.264339:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203524050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be45932f-3bcb-4e49-b61c-a2395180b0ee+15:17834:x1874676443921664:12345-0@lo:503:mount.lustre.0 Request processed in 1134us (1280us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831093.264350:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787831093.264444:0:17834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a23840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:17834:1874676443921664:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787831093.265025:0:17834:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787831093.265101:0:17834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a23840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:17834:1874676443921792:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787831093.265148:0:17834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831093.265185:0:17834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d220289ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1787831093.265216:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443921792 00000100:00100000:0.0:1787831093.265223:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443921792 00000100:00100000:0.0:1787831093.265267:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787831093.265274:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203524c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be45932f-3bcb-4e49-b61c-a2395180b0ee+15:17834:x1874676443921792:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787831093.266101:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203524c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be45932f-3bcb-4e49-b61c-a2395180b0ee+15:17834:x1874676443921792:12345-0@lo:502:mount.lustre.0 Request processed in 825us (950us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831093.266110:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787831093.266453:0:17834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a23840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:17834:1874676443921792:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787831093.267500:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1787831093.267541:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:2.0:1787831093.267557:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:2.0:1787831093.267571:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:2.0:1787831093.267583:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:2.0:1787831093.267595:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:2.0:1787831093.267607:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:2.0:1787831093.267619:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:2.0:1787831093.268508:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:2.0:1787831093.268530:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:2.0:1787831093.268545:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:2.0:1787831093.268558:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:2.0:1787831093.268572:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:2.0:1787831093.268586:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:2.0:1787831093.268599:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:2.0:1787831093.268612:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:2.0:1787831093.268925:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:2.0:1787831093.268947:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:2.0:1787831093.269034:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:2.0:1787831093.269048:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:2.0:1787831093.269061:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:2.0:1787831093.269074:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:2.0:1787831093.269086:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:2.0:1787831093.269120:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:2.0:1787831093.269211:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:2.0:1787831093.269308:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:2.0:1787831093.269322:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:2.0:1787831093.269448:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:2.0:1787831093.269465:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:2.0:1787831093.269478:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:2.0:1787831093.269491:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:2.0:1787831093.269503:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:2.0:1787831093.269516:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:2.0:1787831093.269530:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:2.0:1787831093.269541:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:2.0:1787831093.269554:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:2.0:1787831093.269567:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:2.0:1787831093.269578:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:2.0:1787831093.269591:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:2.0:1787831093.269605:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:2.0:1787831093.269617:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:2.0:1787831093.269745:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:2.0:1787831093.269829:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:2.0:1787831093.269851:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:2.0:1787831093.269899:0:17834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204707c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:17834:1874676443921920:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787831093.270056:0:17834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831093.270154:0:17834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d231008c480 going to sleep for 11 seconds 00000100:00100000:3.0:1787831093.270324:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443921920 00000100:00100000:3.0:1787831093.270391:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443921920 00000100:00100000:3.0:1787831093.270483:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787831093.270493:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203527c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be45932f-3bcb-4e49-b61c-a2395180b0ee+15:17834:x1874676443921920:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787831093.270649:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203527c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be45932f-3bcb-4e49-b61c-a2395180b0ee+15:17834:x1874676443921920:12345-0@lo:502:mount.lustre.0 Request processed in 134us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831093.270657:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787831093.270822:0:17834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204707c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:17834:1874676443921920:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787831093.270881:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:1.0:1787831093.270893:0:17834:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:1.0:1787831093.273829:0:17838:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787831093.273855:0:17838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787831093.273858:0:17838:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1787831093.273866:0:17838:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:1.0:1787831093.273869:0:17838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787831093.273885:0:17838:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff8d232f77b370) 00000020:00000080:1.0:1787831093.273907:0:17838:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:1.0:1787831093.273912:0:17838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1787831093.274125:0:17838:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787831093.274207:0:17838:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x95459fb9d1d29b08 00000020:00000080:1.0:1787831093.274556:0:17838:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1787831093.274562:0:17838:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787831093.274566:0:17838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787831093.274568:0:17838:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1787831093.274571:0:17838:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787831093.274574:0:17838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787831093.274576:0:17838:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:1.0:1787831093.274579:0:17838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787831093.274588:0:17838:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff8d232f7799b8) 00000020:00000080:1.0:1787831093.274599:0:17838:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:1.0:1787831093.274603:0:17838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1787831093.274604:0:17838:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:1.0:1787831093.274607:0:17838:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:1.0:1787831093.274612:0:17838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787831093.274870:0:17838:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d233f43f000 from lustre-MDT0001, refs=2 00000020:00000080:1.0:1787831093.274884:0:17838:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff8d233454cd28) 00000020:00000080:1.0:1787831093.274894:0:17838:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:1.0:1787831093.275077:0:17838:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1787831093.275084:0:17838:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x95459fb9d1d29b1d 00000020:00000080:1.0:1787831093.275325:0:17838:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:1.0:1787831093.275437:0:17838:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1787831093.275443:0:17838:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x95459fb9d1d29b24 00080000:01000000:1.0:1787831093.275450:0:17838:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:1.0:1787831093.275453:0:17838:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x95459fb9d1d29b2b 00010000:00010000:2.0:1787831093.343849:0:17838:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:2.0:1787831093.345654:0:17838:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:0.0:1787831093.347350:0:17838:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1787831093.351239:0:17838:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:0.0:1787831093.351253:0:17838:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787831093.351261:0:17838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787831093.351263:0:17838:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:0.0:1787831093.351267:0:17838:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787831093.351274:0:17838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787831093.351275:0:17838:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:0.0:1787831093.351279:0:17838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787831093.351284:0:17838:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.131@tcp to nid 0x20000c0a8cb83 (192.168.203.131@tcp) 00000020:00000080:0.0:1787831093.351314:0:17838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787831093.351333:0:17838:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff8d23129519b8) 00000020:00000080:0.0:1787831093.351357:0:17838:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:0.0:1787831093.351363:0:17838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787831093.351441:0:17838:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:0.0:1787831093.351449:0:17838:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:0.0:1787831093.351456:0:17838:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x95459fb9d1d29b39 00010000:00080000:0.0:1787831093.351570:0:17838:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d2201e09800@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.131@tcp at head 00010000:00010000:0.0:1787831093.355340:0:17838:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:0.0:1787831093.356702:0:17838:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787831093.356717:0:17838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1787831093.356754:0:17838:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:0.0:1787831093.356775:0:17838:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x95459fb9d1d29b40 00000100:00080000:0.0:1787831093.356785:0:17838:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787831093.356791:0:17838:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8d2201e09800 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:0.0:1787831093.356825:0:17838:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2204627c00 x1874676443922048/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787831093.356848:0:17838:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:0.0:1787831093.356895:0:17838:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787831093.356899:0:17838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787831093.356901:0:17838:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:0.0:1787831093.356904:0:17838:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787831093.356907:0:17838:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1787831093.356908:0:17838:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787831093.356910:0:17838:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787831093.356911:0:17838:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787831093.356914:0:17838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787831093.356915:0:17838:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787831093.356918:0:17838:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787831093.356921:0:17838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787831093.356923:0:17838:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:0.0:1787831093.356926:0:17838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1787831093.356955:0:17838:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1787831093.356965:0:17838:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787831093.356968:0:17838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787831093.356969:0:17838:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:0.0:1787831093.356971:0:17838:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787831093.356973:0:17838:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:0.0:1787831093.356979:0:17838:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787831093.356981:0:17838:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787831093.356982:0:17838:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787831093.356985:0:17838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787831093.356986:0:17838:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787831093.356988:0:17838:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787831093.356992:0:17838:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1787831093.356995:0:17838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787831093.356996:0:17838:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1787831093.356999:0:17838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787831093.357003:0:17838:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.131@tcp to nid 0x20000c0a8cb83 (192.168.203.131@tcp) 00000020:01000000:0.0:1787831093.357027:0:17838:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1787831093.357030:0:17838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787831093.357043:0:17838:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff8d2312954d28) 00000020:00000080:0.0:1787831093.357055:0:17838:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1787831093.357060:0:17838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787831093.357109:0:17838:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:0.0:1787831093.357116:0:17838:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:0.0:1787831093.357122:0:17838:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x95459fb9d1d29b4e 00010000:00080000:0.0:1787831093.357158:0:17838:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d232b962800@lustre-OST0000-osc-MDT0001: add connection 192.168.203.131@tcp at head 00010000:00010000:3.0:1787831093.357413:0:17838:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00100000:1.0:1787831093.358541:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204627c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1874676443922048:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787831093.358646:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787831093.358715:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1787831093.358720:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1787831093.358724:0:8:0:(import.c:65:import_set_state_nolock()) ffff8d2201e0b000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787831093.358730:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 379 00000100:00080000:1.0:1787831093.358735:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787831093.358741:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8d2201e0b000 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:1.0:1787831093.358767:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2203a20000 x1874676443922176/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787831093.358824:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1874676443922176:0@lo:38:kworker.0 00000100:00100000:2.0:1787831093.358855:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787831093.358947:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:0.0:1787831093.358948:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443922048 00000100:00080000:1.0:1787831093.358954:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787831093.358959:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443922048 00000100:00080000:1.0:1787831093.358960:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787831093.358965:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:01000000:3.0:1787831093.358981:0:17838:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1787831093.358996:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443922176 00000100:00100000:0.0:1787831093.359001:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443922176 00000100:00100000:1.0:1787831093.359009:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a203c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3620:1874676443922304:0@lo:400:kworker.0 00000100:00100000:0.0:1787831093.359018:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787831093.359027:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3618:x1874676443922048:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787831093.359044:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1787831093.359051:0:17109:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 384 last 0 00000100:00100000:1.0:1787831093.359095:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443922304 00000020:00000080:0.0:1787831093.359099:0:17109:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x95459fb9d1d29b55 00000100:00100000:1.0:1787831093.359101:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443922304 00000004:00100000:0.0:1787831093.359115:0:17109:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1787831093.359122:0:17109:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:1.0:1787831093.359136:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787831093.359145:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a20b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1874676443922304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787831093.359195:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a20b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1874676443922304:12345-0@lo:400:kworker.0 Request processed in 52us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831093.359214:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787831093.359226:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8d2203a203c0 x1874676443922304/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787831109 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787831093.359240:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a203c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3620:1874676443922304:0@lo:400:kworker.0 00000040:01000000:0.0:1787831093.359496:0:17838:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1787831093.362189:0:17838:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787831093.362938:0:17838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1787831093.363100:0:17838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000100:00080000:2.0:1787831093.364472:0:17109:0:(import.c:65:import_set_state_nolock()) ffff8d2202a82000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787831093.364575:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3618:x1874676443922048:12345-0@lo:38:llog_process_th.0 Request processed in 5546us (5948us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831093.364597:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787831093.364673:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787831093.364679:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204705e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3618:x1874676443922176:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1787831093.364724:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204705e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3618:x1874676443922176:12345-0@lo:38:kworker.0 Request processed in 44us (5868us total) trans 0 rc -11/-11 00000100:00100000:2.0:1787831093.364729:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787831093.365147:0:3618:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787831093.365156:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8d2201e0b000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787831093.365160:0:3618:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1787831093.365171:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1874676443922176:0@lo:38:kworker.0 00000100:00100000:3.0:1787831093.365189:0:3618:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787831093.365195:0:3618:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1787831093.365213:0:3618:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1787831093.365219:0:3618:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787831093.365221:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8d2201e09800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787831093.365232:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204627c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1874676443922048:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787831093.365560:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787831093.365575:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22046243c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676443922432:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787831093.365853:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1787831093.366141:0:17843:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787831093.366146:0:17843:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000100:00100000:0.0:1787831093.366234:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443922432 00000100:00100000:0.0:1787831093.366240:0:17110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443922432 00000100:00100000:0.0:1787831093.366283:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787831093.366292:0:17110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a221c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3622:x1874676443922432:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787831093.366318:0:17110:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1787831093.366417:0:17110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a221c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3622:x1874676443922432:12345-0@lo:41:osp-pre-0-1.0 Request processed in 126us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831093.366424:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787831093.366590:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22046243c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676443922432:0@lo:41:osp-pre-0-1.0 00000020:00000080:3.0:1787831093.367376:0:17838:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787831093.367390:0:17838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787831093.367432:0:17838:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1787831093.367452:0:17838:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x95459fb9d1d29b5c 00000100:00080000:3.0:1787831093.367460:0:17838:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787831093.367466:0:17838:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8d232b962800 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:3.0:1787831093.367496:0:17838:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2203aff840 x1874676443922560/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787831093.367527:0:17838:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1787831093.367588:0:17838:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787831093.367592:0:17838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787831093.367594:0:17838:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1787831093.367597:0:17838:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787831093.367600:0:17838:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:3.0:1787831093.367602:0:17838:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787831093.367603:0:17838:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787831093.367604:0:17838:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787831093.367606:0:17838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787831093.367608:0:17838:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787831093.367610:0:17838:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787831093.367614:0:17838:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1787831093.367617:0:17838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787831093.367661:0:17838:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1787831093.367667:0:17838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787831093.367671:0:17838:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.131@tcp to nid 0x20000c0a8cb83 (192.168.203.131@tcp) 00000020:01000000:3.0:1787831093.367697:0:17838:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1787831093.367701:0:17838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787831093.367712:0:17838:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff8d23344a4d28) 00000100:00080000:2.0:1787831093.367714:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787831093.367719:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787831093.367721:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787831093.367723:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:00000080:3.0:1787831093.367725:0:17838:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:3.0:1787831093.367732:0:17838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787831093.367801:0:17838:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:3.0:1787831093.367808:0:17838:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:3.0:1787831093.367815:0:17838:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x95459fb9d1d29b6a 00010000:00080000:3.0:1787831093.367842:0:17838:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d2303234000@lustre-OST0001-osc-MDT0001: add connection 192.168.203.131@tcp at head 00010000:00010000:3.0:1787831093.368043:0:17838:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:3.0:1787831093.368107:0:17838:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1787831093.368121:0:17838:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:1.0:1787831093.368759:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203aff840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1874676443922560:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1787831093.368811:0:3618:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874676443922560 offset 0 length 520: 4 00000040:00080000:3.0:1787831093.370230:0:17838:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787831093.370465:0:17838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1787831093.370582:0:17838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1787831093.371166:0:17845:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787831093.371171:0:17845:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1787831093.371984:0:17838:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787831093.371996:0:17838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787831093.372034:0:17838:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1787831093.372056:0:17838:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x95459fb9d1d29b71 00000100:00080000:3.0:1787831093.372066:0:17838:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787831093.372072:0:17838:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8d2303234000 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:3.0:1787831093.372108:0:17838:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2203afc780 x1874676443922688/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787831093.372168:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203afc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1874676443922688:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1787831093.372236:0:3618:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874676443922688 offset 0 length 520: 4 00000100:00080000:3.0:1787831093.372291:0:17838:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1787831093.372410:0:17838:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787831093.372414:0:17838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787831093.372416:0:17838:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1787831093.372425:0:17838:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787831093.372430:0:17838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787831093.372432:0:17838:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787831093.372434:0:17838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787831093.372437:0:17838:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787831093.372439:0:17838:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787831093.372441:0:17838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787831093.372442:0:17838:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:3.0:1787831093.372445:0:17838:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787831093.372447:0:17838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787831093.372448:0:17838:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787831093.372451:0:17838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1787831093.372476:0:17838:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787831093.372479:0:17838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787831093.372481:0:17838:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787831093.372484:0:17838:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000020:01000000:3.0:1787831093.372538:0:17834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:3.0:1787831093.372565:0:17834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1787831093.372579:0:17834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d23344b7400/0x95459fb9d1d29af3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d29afa expref: -99 pid: 17834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831093.372589:0:17834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8d23344b7400/0x95459fb9d1d29af3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d29afa expref: -99 pid: 17834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787831093.372597:0:17834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d233f43f000 from 1 10000000:01000000:3.0:1787831093.372600:0:17834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787831093.372644:0:17834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d2307c77a00/0x95459fb9d1d29b78 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831093.372664:0:17834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8d2307c77a00/0x95459fb9d1d29b78 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831093.372674:0:17834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8d2307c77a00/0x95459fb9d1d29b78 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787831093.372709:0:17834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203afde00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:17834:1874676443922816:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787831093.372747:0:17834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831093.372764:0:17834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2202713e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787831093.373032:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443922816 00000100:00100000:0.0:1787831093.373039:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443922816 00000100:00100000:0.0:1787831093.373090:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787831093.373098:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203527450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be45932f-3bcb-4e49-b61c-a2395180b0ee+15:17834:x1874676443922816:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787831093.373111:0:17096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787831093.373124:0:17096:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2303aa2a00/0x95459fb9d1d29b7f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d29b78 expref: -99 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831093.373146:0:17096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2303aa2a00/0x95459fb9d1d29b7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d29b78 expref: 16 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831093.373157:0:17096:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2303aa2a00/0x95459fb9d1d29b7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d29b78 expref: 16 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831093.373165:0:17096:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2303aa2a00, rc 0) 00000100:00100000:0.0:1787831093.373226:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203527450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be45932f-3bcb-4e49-b61c-a2395180b0ee+16:17834:x1874676443922816:12345-0@lo:101:mount.lustre.0 Request processed in 128us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831093.373233:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787831093.373333:0:17834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203afde00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:17834:1874676443922816:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787831093.373348:0:17834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8d2307c77a00/0x95459fb9d1d29b78 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d29b7f expref: -99 pid: 17834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831093.373356:0:17834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8d2307c77a00/0x95459fb9d1d29b78 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d29b7f expref: -99 pid: 17834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831093.373928:0:17834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a20000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:17834:1874676443922944:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1787831093.373971:0:17834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831093.373997:0:17834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d220289cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1787831093.374141:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443922944 00000100:00100000:0.0:1787831093.374146:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443922944 00000100:00100000:0.0:1787831093.374188:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787831093.374215:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203526c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be45932f-3bcb-4e49-b61c-a2395180b0ee+16:17834:x1874676443922944:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1787831093.374233:0:17098:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1787831093.374249:0:17098:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787831093.374252:0:17098:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1787831093.374337:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203526c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be45932f-3bcb-4e49-b61c-a2395180b0ee+16:17834:x1874676443922944:12345-0@lo:256:mount.lustre.0 Request processed in 125us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831093.374345:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787831093.374473:0:17834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a20000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:17834:1874676443922944:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1787831093.375190:0:17834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787831093.375221:0:17834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d2307c77a00/0x95459fb9d1d29b78 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d29b7f expref: -99 pid: 17834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831093.375232:0:17834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8d2307c77a00/0x95459fb9d1d29b78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d29b7f expref: -99 pid: 17834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787831093.375292:0:17834:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d233f43f000 from 1 10000000:01000000:1.0:1787831093.375295:0:17834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787831093.375324:0:17834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d23344b6e00/0x95459fb9d1d29b86 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831093.375331:0:17834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8d23344b6e00/0x95459fb9d1d29b86 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831093.375340:0:17834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8d23344b6e00/0x95459fb9d1d29b86 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831093.375355:0:17834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a20000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:17834:1874676443923072:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787831093.375392:0:17834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831093.375417:0:17834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d220289cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1787831093.375505:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443923072 00000100:00100000:0.0:1787831093.375511:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443923072 00000100:00100000:0.0:1787831093.375542:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787831093.375550:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203524450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be45932f-3bcb-4e49-b61c-a2395180b0ee+16:17834:x1874676443923072:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787831093.375560:0:17098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787831093.375571:0:17098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2303aa2400/0x95459fb9d1d29b8d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d29b86 expref: -99 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831093.375592:0:17098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2303aa2400/0x95459fb9d1d29b8d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d29b86 expref: 17 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831093.375602:0:17098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2303aa2400/0x95459fb9d1d29b8d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d29b86 expref: 17 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831093.375610:0:17098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2303aa2400, rc 0) 00000100:00100000:0.0:1787831093.375679:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203524450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be45932f-3bcb-4e49-b61c-a2395180b0ee+17:17834:x1874676443923072:12345-0@lo:101:mount.lustre.0 Request processed in 129us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831093.375685:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787831093.375958:0:17834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a20000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:17834:1874676443923072:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787831093.375972:0:17834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8d23344b6e00/0x95459fb9d1d29b86 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d29b8d expref: -99 pid: 17834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831093.375981:0:17834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8d23344b6e00/0x95459fb9d1d29b86 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d29b8d expref: -99 pid: 17834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787831093.376115:0:17834:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787831093.376145:0:17834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a20000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:17834:1874676443923200:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787831093.376176:0:17834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831093.376195:0:17834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d220289c780 going to sleep for 11 seconds 00000100:00100000:0.0:1787831093.376291:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443923200 00000100:00100000:0.0:1787831093.376296:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443923200 00000100:00100000:0.0:1787831093.376330:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787831093.376337:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203525450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be45932f-3bcb-4e49-b61c-a2395180b0ee+17:17834:x1874676443923200:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787831093.376432:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203525450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be45932f-3bcb-4e49-b61c-a2395180b0ee+17:17834:x1874676443923200:12345-0@lo:501:mount.lustre.0 Request processed in 95us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831093.376439:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787831093.376512:0:17834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a20000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:17834:1874676443923200:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787831093.376543:0:17834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22047070c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:17834:1874676443923328:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787831093.376581:0:17834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831093.376606:0:17834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d23100b7540 going to sleep for 11 seconds 00000100:00100000:1.0:1787831093.376781:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443923328 00000100:00100000:1.0:1787831093.376786:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443923328 00000100:00100000:1.0:1787831093.376816:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787831093.376822:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203526450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be45932f-3bcb-4e49-b61c-a2395180b0ee+17:17834:x1874676443923328:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787831093.376898:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203526450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be45932f-3bcb-4e49-b61c-a2395180b0ee+17:17834:x1874676443923328:12345-0@lo:503:mount.lustre.0 Request processed in 76us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831093.376905:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787831093.376945:0:17834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22047070c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:17834:1874676443923328:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787831093.377298:0:17834:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787831093.377369:0:17834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a203c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:17834:1874676443923456:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787831093.377409:0:17834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831093.377433:0:17834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d220289cf00 going to sleep for 11 seconds 00000100:00100000:1.0:1787831093.377450:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443923456 00000100:00100000:1.0:1787831093.377453:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443923456 00000100:00100000:1.0:1787831093.377483:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787831093.377490:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203525c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be45932f-3bcb-4e49-b61c-a2395180b0ee+17:17834:x1874676443923456:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787831093.377564:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203525c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be45932f-3bcb-4e49-b61c-a2395180b0ee+17:17834:x1874676443923456:12345-0@lo:502:mount.lustre.0 Request processed in 74us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831093.377571:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787831093.377611:0:17834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a203c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:17834:1874676443923456:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787831093.377833:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1787831093.377858:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:1.0:1787831093.377874:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:1.0:1787831093.377887:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:1.0:1787831093.377900:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:1.0:1787831093.377912:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:1.0:1787831093.377926:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:1.0:1787831093.377938:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:1.0:1787831093.377953:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1787831093.377979:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:1.0:1787831093.377995:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:1.0:1787831093.378017:0:17834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a203c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:17834:1874676443923584:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787831093.378052:0:17834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831093.378074:0:17834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d220289cf00 going to sleep for 11 seconds 00000100:00100000:1.0:1787831093.378098:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443923584 00000100:00100000:1.0:1787831093.378103:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443923584 00000100:00100000:1.0:1787831093.378122:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787831093.378128:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203526050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be45932f-3bcb-4e49-b61c-a2395180b0ee+17:17834:x1874676443923584:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787831093.378195:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203526050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be45932f-3bcb-4e49-b61c-a2395180b0ee+17:17834:x1874676443923584:12345-0@lo:502:mount.lustre.0 Request processed in 67us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831093.378213:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787831093.378253:0:17834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a203c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:17834:1874676443923584:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787831093.378288:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:1.0:1787831093.378296:0:17834:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000100:00080000:3.0:1787831093.378833:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787831093.378840:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787831093.378843:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787831093.378845:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:0.0:1787831093.379030:0:17847:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787831093.379038:0:17847:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787831093.379041:0:17847:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787831093.379048:0:17847:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d233f43f000 00000020:00000080:0.0:1787831093.379051:0:17847:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787831093.379058:0:17847:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787831093.379061:0:17847:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787831093.379062:0:17847:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1787831093.379065:0:17847:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787831093.379067:0:17847:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787831093.379068:0:17847:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787831093.379071:0:17847:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d233f43f000 00000020:00000080:0.0:1787831093.379074:0:17847:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787831093.379163:0:17847:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787831093.379167:0:17847:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787831093.379169:0:17847:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1787831093.379171:0:17847:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787831093.379173:0:17847:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787831093.379174:0:17847:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787831093.379178:0:17847:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d233f43f000 00000020:00000080:0.0:1787831093.379180:0:17847:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787831093.379774:0:17847:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787831093.379780:0:17847:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787831093.379781:0:17847:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787831093.379785:0:17847:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787831093.379788:0:17847:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787831093.379789:0:17847:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1787831093.379792:0:17847:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d233f43f000 00000020:00000080:0.0:1787831093.379794:0:17847:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787831093.379834:0:17847:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787831093.379837:0:17847:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787831093.379839:0:17847:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1787831093.379842:0:17847:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:1.0:1787831093.379984:0:17834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1787831093.380011:0:17834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787831093.380038:0:17834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d23344b6e00/0x95459fb9d1d29b86 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d29b8d expref: -99 pid: 17834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831093.380049:0:17834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8d23344b6e00/0x95459fb9d1d29b86 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d29b8d expref: -99 pid: 17834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787831093.380103:0:17834:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787831093.380107:0:17834:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d233f43f000 10000000:01000000:1.0:1787831093.380110:0:17834:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d233f43f000 10000000:01000000:1.0:1787831093.380114:0:17834:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787831093.380121:0:17834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d233f43f000 from 1 10000000:01000000:1.0:1787831093.380129:0:17834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787831093.380163:0:17834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d23344b6c00/0x95459fb9d1d29b94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831093.380172:0:17834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8d23344b6c00/0x95459fb9d1d29b94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831093.380182:0:17834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8d23344b6c00/0x95459fb9d1d29b94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831093.380213:0:17834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a203c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:17834:1874676443923712:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787831093.380275:0:17834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831093.383420:0:17834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d220289c6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787831093.389426:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443923712 00000100:00100000:2.0:1787831093.389444:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443923712 00000100:00100000:2.0:1787831093.389510:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787831093.389521:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203527050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be45932f-3bcb-4e49-b61c-a2395180b0ee+17:17834:x1874676443923712:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787831093.389538:0:17098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787831093.389558:0:17098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d22039c1c00/0x95459fb9d1d29b9b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d29b94 expref: -99 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831093.389598:0:17098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22039c1c00/0x95459fb9d1d29b9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d29b94 expref: 18 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831093.389609:0:17098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d22039c1c00/0x95459fb9d1d29b9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d29b94 expref: 18 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831093.389619:0:17098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22039c1c00, rc 0) 00000100:00100000:2.0:1787831093.389730:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203527050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be45932f-3bcb-4e49-b61c-a2395180b0ee+18:17834:x1874676443923712:12345-0@lo:101:mount.lustre.0 Request processed in 211us (9454us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831093.389737:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787831093.390799:0:17834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a203c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:17834:1874676443923712:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787831093.390824:0:17834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8d23344b6c00/0x95459fb9d1d29b94 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d29b9b expref: -99 pid: 17834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831093.390836:0:17834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8d23344b6c00/0x95459fb9d1d29b94 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d29b9b expref: -99 pid: 17834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787831093.392431:0:17834:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:0.0:1787831093.393373:0:17834:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787831093.393605:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:0.0:1787831093.393756:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:0.0:1787831093.393776:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:0.0:1787831093.393789:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:0.0:1787831093.393802:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:0.0:1787831093.393814:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:0.0:1787831093.393827:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:0.0:1787831093.393839:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:0.0:1787831093.393851:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:0.0:1787831093.393863:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:0.0:1787831093.393877:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:0.0:1787831093.393890:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:0.0:1787831093.393902:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:0.0:1787831093.393916:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:0.0:1787831093.393929:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:0.0:1787831093.393955:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:0.0:1787831093.393968:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:0.0:1787831093.393980:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:0.0:1787831093.393993:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:0.0:1787831093.394017:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:0.0:1787831093.394031:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:0.0:1787831093.394044:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:0.0:1787831093.394057:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:0.0:1787831093.394070:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:0.0:1787831093.394083:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:0.0:1787831093.394096:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:0.0:1787831093.394110:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:0.0:1787831093.394122:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:0.0:1787831093.394140:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:0.0:1787831093.394145:0:17834:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:0.0:1787831093.394245:0:17834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204626580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:17834:1874676443923840:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787831093.394317:0:17834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831093.394357:0:17834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d22027a7900 going to sleep for 11 seconds 00000100:00100000:0.0:1787831093.394390:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443923840 00000100:00100000:0.0:1787831093.394397:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443923840 00000100:00100000:0.0:1787831093.394443:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787831093.394454:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203524850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be45932f-3bcb-4e49-b61c-a2395180b0ee+18:17834:x1874676443923840:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787831093.394568:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203524850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be45932f-3bcb-4e49-b61c-a2395180b0ee+18:17834:x1874676443923840:12345-0@lo:501:mount.lustre.0 Request processed in 117us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831093.394576:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787831093.396081:0:17834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204626580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:17834:1874676443923840:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787831093.396138:0:17834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204626580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:17834:1874676443923968:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787831093.396214:0:17834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831093.396710:0:17834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d22027a7900 going to sleep for 11 seconds 00000100:00100000:2.0:1787831093.398805:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443923968 00000100:00100000:2.0:1787831093.398818:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443923968 00000100:00100000:3.0:1787831093.398952:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787831093.398962:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2309e26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be45932f-3bcb-4e49-b61c-a2395180b0ee+18:17834:x1874676443923968:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787831093.399114:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2309e26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be45932f-3bcb-4e49-b61c-a2395180b0ee+18:17834:x1874676443923968:12345-0@lo:503:mount.lustre.0 Request processed in 153us (2900us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831093.399122:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787831093.399263:0:17834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204626580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:17834:1874676443923968:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787831093.399867:0:17834:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787831093.399962:0:17834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204626580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:17834:1874676443924096:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787831093.400008:0:17834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831093.400038:0:17834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d22027a7b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787831093.400157:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443924096 00000100:00100000:2.0:1787831093.400163:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443924096 00000100:00100000:2.0:1787831093.400229:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787831093.400237:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233c007450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be45932f-3bcb-4e49-b61c-a2395180b0ee+18:17834:x1874676443924096:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787831093.400316:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233c007450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be45932f-3bcb-4e49-b61c-a2395180b0ee+18:17834:x1874676443924096:12345-0@lo:502:mount.lustre.0 Request processed in 79us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831093.400323:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787831093.400399:0:17834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204626580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:17834:1874676443924096:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787831093.400538:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:0.0:1787831093.400559:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:0.0:1787831093.400570:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:0.0:1787831093.400581:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:0.0:1787831093.400591:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:0.0:1787831093.400602:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:0.0:1787831093.400612:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:0.0:1787831093.400657:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:0.0:1787831093.400673:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:0.0:1787831093.400687:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:0.0:1787831093.400699:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:0.0:1787831093.400713:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:0.0:1787831093.400727:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:0.0:1787831093.400740:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:0.0:1787831093.400753:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:0.0:1787831093.400778:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:0.0:1787831093.400793:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:0.0:1787831093.400806:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:0.0:1787831093.400817:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:0.0:1787831093.400829:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:0.0:1787831093.400841:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:0.0:1787831093.400855:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:0.0:1787831093.400866:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:0.0:1787831093.400878:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:0.0:1787831093.400892:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:0.0:1787831093.400904:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:0.0:1787831093.400916:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:0.0:1787831093.400938:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:0.0:1787831093.400951:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:0.0:1787831093.400963:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:0.0:1787831093.400974:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:0.0:1787831093.400998:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:0.0:1787831093.401011:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:0.0:1787831093.401023:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:0.0:1787831093.401033:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:0.0:1787831093.401044:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:0.0:1787831093.401055:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:0.0:1787831093.401066:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:0.0:1787831093.401076:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:0.0:1787831093.401088:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:0.0:1787831093.401099:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:0.0:1787831093.401111:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:0.0:1787831093.401123:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:0.0:1787831093.401136:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:0.0:1787831093.401148:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:0.0:1787831093.401160:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:0.0:1787831093.401171:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:0.0:1787831093.401194:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:0.0:1787831093.401250:0:17834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204626580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:17834:1874676443924224:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787831093.401299:0:17834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831093.401320:0:17834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d22027a7b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787831093.404780:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443924224 00000100:00100000:1.0:1787831093.404795:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443924224 00000100:00100000:1.0:1787831093.404860:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787831093.404870:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233c006c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be45932f-3bcb-4e49-b61c-a2395180b0ee+18:17834:x1874676443924224:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787831093.405043:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233c006c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be45932f-3bcb-4e49-b61c-a2395180b0ee+18:17834:x1874676443924224:12345-0@lo:502:mount.lustre.0 Request processed in 175us (3743us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831093.405051:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787831093.405360:0:17834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204626580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:17834:1874676443924224:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787831093.405588:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:2.0:1787831093.405618:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:3.0:1787831093.406248:0:17834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203afc3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:17834:1874676443924352:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787831093.406316:0:17834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831093.406360:0:17834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2202713cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787831093.406412:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443924352 00000100:00100000:1.0:1787831093.406418:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443924352 00000100:00100000:1.0:1787831093.406464:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787831093.406472:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233c004c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be45932f-3bcb-4e49-b61c-a2395180b0ee+18:17834:x1874676443924352:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787831093.406577:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233c004c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be45932f-3bcb-4e49-b61c-a2395180b0ee+18:17834:x1874676443924352:12345-0@lo:502:mount.lustre.0 Request processed in 105us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831093.406584:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787831093.406807:0:17834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203afc3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:17834:1874676443924352:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787831093.406866:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:2.0:1787831093.406875:0:17834:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1787831093.407535:0:17852:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:2.0:1787831093.407556:0:17852:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff8d2201e1b370) 00000020:00000080:2.0:1787831093.407577:0:17852:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:3.0:1787831093.408066:0:17852:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d233f43f000 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1787831093.408071:0:17852:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d233f43f000 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1787831093.408074:0:17852:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d233f43f000 3 00010000:00080000:3.0:1787831093.408105:0:17852:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d2203601800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.131@tcp at head 00010000:00010000:3.0:1787831093.410563:0:17852:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:3.0:1787831093.412351:0:17852:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:3.0:1787831093.412404:0:17852:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787831093.412417:0:17852:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x95459fb9d1d29ba9 00000100:00080000:3.0:1787831093.412428:0:17852:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787831093.412443:0:17852:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8d2203601800 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:3.0:1787831093.412480:0:17852:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2203afd2c0 x1874676443924480/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787831093.412522:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203afd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3618:1874676443924480:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787831093.412591:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787831093.413758:0:17852:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787831093.413990:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443924480 00000100:00100000:3.0:1787831093.414000:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443924480 00000100:00100000:3.0:1787831093.414295:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787831093.414303:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203afe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3618:x1874676443924480:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1787831093.414332:0:17106:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 384 last 0 00000020:00000080:3.0:1787831093.414373:0:17106:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x95459fb9d1d29bb0 00000004:00100000:3.0:1787831093.414389:0:17106:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787831093.414419:0:17106:0:(import.c:65:import_set_state_nolock()) ffff8d220276f800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787831093.414509:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203afe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1874676443924480:12345-0@lo:38:llog_process_th.0 Request processed in 205us (1916us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831093.414516:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787831093.414825:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8d2203afd2c0 x1874676443924480/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787831103 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787831093.414837:0:3618:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787831093.414845:0:3618:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1787831093.414853:0:3618:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1787831093.414858:0:3618:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787831093.414859:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8d2203601800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787831093.414866:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203afd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3618:1874676443924480:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1787831093.415718:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787831093.415725:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787831093.415728:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787831093.415731:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:1.0:1787831093.418531:0:17852:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000020:01000000:3.0:1787831093.418804:0:17834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1787831093.418836:0:17834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787831093.418861:0:17834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d23344b6c00/0x95459fb9d1d29b94 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d29b9b expref: -99 pid: 17834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831093.418874:0:17834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8d23344b6c00/0x95459fb9d1d29b94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d29b9b expref: -99 pid: 17834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787831093.418924:0:17834:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787831093.418926:0:17834:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787831093.418928:0:17834:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787831093.418933:0:17834:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787831093.418934:0:17834:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787831093.418936:0:17834:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787831093.418937:0:17834:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787831093.418939:0:17834:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787831093.418940:0:17834:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787831093.418944:0:17834:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:3.0:1787831093.418947:0:17834:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787831093.418948:0:17834:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787831093.418949:0:17834:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787831093.418949:0:17834:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787831093.418950:0:17834:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787831093.418951:0:17834:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787831093.418952:0:17834:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787831093.418953:0:17834:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787831093.418954:0:17834:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787831093.418980:0:17834:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1787831093.419000:0:17834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203afd2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:17834:1874676443924608:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787831093.419069:0:17834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831093.419109:0:17834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2202713e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787831093.419372:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443924608 00000100:00100000:3.0:1787831093.419380:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443924608 00000100:00100000:3.0:1787831093.419421:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787831093.419430:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233c005450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be45932f-3bcb-4e49-b61c-a2395180b0ee+18:17834:x1874676443924608:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787831093.419458:0:17098:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1787831093.419473:0:17098:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1787831093.420218:0:17145:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2202713600 going to sleep for 0 seconds 00000001:00100000:0.0:1787831093.422788:0:17084:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:3.0:1787831093.424239:0:17098:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787831093.424291:0:17098:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1787831093.425879:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233c005450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be45932f-3bcb-4e49-b61c-a2395180b0ee+18:17834:x1874676443924608:12345-0@lo:253:mount.lustre.0 Request processed in 6441us (6800us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831093.425894:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787831093.425999:0:17834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203afd2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:17834:1874676443924608:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787831093.426015:0:17834:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1787831093.426018:0:17834:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787831093.426020:0:17834:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787831093.426021:0:17834:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787831093.426023:0:17834:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787831093.426024:0:17834:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787831093.426025:0:17834:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787831093.426027:0:17834:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787831093.426028:0:17834:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787831093.426030:0:17834:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787831093.426043:0:17834:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:0.0:1787831093.432423:0:17120:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787831093.432434:0:17120:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787831093.432456:0:17120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d2303aa3800/0x95459fb9d1d29bb7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831093.432475:0:17120:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d22039c0200/0x95459fb9d1d29abb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d29ab4 expref: 17 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831093.432491:0:17120:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2303aa2a00/0x95459fb9d1d29b7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d29b78 expref: 17 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831093.432498:0:17120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d2303aa3800/0x95459fb9d1d29bb7 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831093.432541:0:17120:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2303aa2a00/0x95459fb9d1d29b7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x95459fb9d1d29b78 expref: 17 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831093.432558:0:17120:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d2303aa2a00/0x95459fb9d1d29b7f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x95459fb9d1d29b78 expref: 17 pid: 17096 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831093.432573:0:17120:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204627480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17120:1874676443924736:0@lo:104: 00000100:00100000:0.0:1787831093.433245:0:17120:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787831093.433314:0:17120:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d22039c0200/0x95459fb9d1d29abb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x95459fb9d1d29ab4 expref: 17 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831093.433324:0:17120:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d22039c0200/0x95459fb9d1d29abb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x95459fb9d1d29ab4 expref: 17 pid: 17097 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831093.433335:0:17120:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204626d00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17120:1874676443924864:0@lo:104: 00000100:00100000:0.0:1787831093.433363:0:17120:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831093.433384:0:17120:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d22027a7180 going to sleep for 11 seconds 00000100:00100000:0.0:1787831093.433435:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443924736 00000100:00100000:0.0:1787831093.433442:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443924736 00000100:00100000:0.0:1787831093.433475:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443924864 00000100:00100000:0.0:1787831093.433478:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443924864 00000100:00100000:0.0:1787831093.433491:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787831093.433498:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204624f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:be45932f-3bcb-4e49-b61c-a2395180b0ee+4:17120:x1874676443924736:12345-0@lo:104: 00010000:00010000:0.0:1787831093.433517:0:17087:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff8d2307c77a00/0x95459fb9d1d29b78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d29b7f expref: -99 pid: 17834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831093.433566:0:17087:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787831093.433571:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204624f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:be45932f-3bcb-4e49-b61c-a2395180b0ee+4:17120:x1874676443924736:12345-0@lo:104: Request processed in 74us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831093.433578:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787831093.433597:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787831093.433604:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204626580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:be45932f-3bcb-4e49-b61c-a2395180b0ee+3:17120:x1874676443924864:12345-0@lo:104: 00010000:00010000:0.0:1787831093.433611:0:17087:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff8d2307c77800/0x95459fb9d1d29ab4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d29abb expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831093.433712:0:17087:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787831093.433718:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204626580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:be45932f-3bcb-4e49-b61c-a2395180b0ee+3:17120:x1874676443924864:12345-0@lo:104: Request processed in 115us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831093.433724:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787831093.433760:0:17120:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204627480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17120:1874676443924736:0@lo:104: 00000100:00100000:0.0:1787831093.433770:0:17120:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204626d00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17120:1874676443924864:0@lo:104: 00010000:00010000:0.0:1787831093.433790:0:17120:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d2303aa3800/0x95459fb9d1d29bb7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831093.433806:0:17092:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787831093.433812:0:17092:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8d2307c77a00/0x95459fb9d1d29b78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d29b7f expref: -99 pid: 17834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831093.433819:0:17092:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2307c77a00 already unused, calling callback (ffffffffc14f9c20) 10000000:00010000:0.0:1787831093.433823:0:17092:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8d2307c77a00/0x95459fb9d1d29b78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x95459fb9d1d29b7f expref: -99 pid: 17834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831093.433839:0:17092:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8d2307c77a00/0x95459fb9d1d29b78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x95459fb9d1d29b7f expref: -99 pid: 17834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787831093.433846:0:17092:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8d2307c77a00/0x95459fb9d1d29b78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x95459fb9d1d29b7f expref: -99 pid: 17834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787831093.433852:0:17092:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787831093.433880:0:17092:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8d2307c77a00/0x95459fb9d1d29b78 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d29b7f expref: -99 pid: 17834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831093.433887:0:17092:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787831093.433904:0:17092:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8d2307c77a00/0x95459fb9d1d29b78 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d29b7f expref: -99 pid: 17834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831093.433912:0:17092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8d2307c77a00/0x95459fb9d1d29b78 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d29b7f expref: -99 pid: 17834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831093.433923:0:17092:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787831093.433926:0:17092:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8d2307c77800/0x95459fb9d1d29ab4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d29abb expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831093.433932:0:17092:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2307c77800 already unused, calling callback (ffffffffc14f9c20) 10000000:00010000:0.0:1787831093.433936:0:17092:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8d2307c77800/0x95459fb9d1d29ab4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x95459fb9d1d29abb expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831093.433949:0:17092:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8d2307c77800/0x95459fb9d1d29ab4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x95459fb9d1d29abb expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787831093.433955:0:17092:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8d2307c77800/0x95459fb9d1d29ab4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x95459fb9d1d29abb expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787831093.433967:0:17092:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787831093.433984:0:17092:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8d2307c77800/0x95459fb9d1d29ab4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d29abb expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831093.433991:0:17092:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787831093.434006:0:17092:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8d2307c77800/0x95459fb9d1d29ab4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d29abb expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831093.434013:0:17092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8d2307c77800/0x95459fb9d1d29ab4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d29abb expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831093.434026:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787831093.434028:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787831093.434030:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787831093.434049:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204626d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:be45932f-3bcb-4e49-b61c-a2395180b0ee:3622:1874676443924992:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787831093.434078:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831093.434110:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204627480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:be45932f-3bcb-4e49-b61c-a2395180b0ee:3619:1874676443925120:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787831093.434131:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831093.434155:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443924992 00000100:00100000:0.0:1787831093.434158:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443924992 00010000:00010000:0.0:1787831093.434176:0:17089:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2303aa2a00/0x95459fb9d1d29b7f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d29b78 expref: 18 pid: 17096 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831093.434194:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443925120 00000100:00100000:0.0:1787831093.434197:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443925120 00010000:00010000:0.0:1787831093.434220:0:17089:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d22039c0200/0x95459fb9d1d29abb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d29ab4 expref: 19 pid: 17097 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831093.434232:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787831093.434248:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22046243c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:be45932f-3bcb-4e49-b61c-a2395180b0ee+19:3622:x1874676443924992:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787831093.434259:0:17089:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787831093.434264:0:17089:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2303aa2a00/0x95459fb9d1d29b7f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d29b78 expref: 19 pid: 17096 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831093.434274:0:17089:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2303aa2a00/0x95459fb9d1d29b7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x95459fb9d1d29b78 expref: 19 pid: 17096 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831093.434288:0:17089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2303aa2a00/0x95459fb9d1d29b7f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x95459fb9d1d29b78 expref: 19 pid: 17096 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831093.434299:0:17089:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787831093.434329:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22046243c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:be45932f-3bcb-4e49-b61c-a2395180b0ee+18:3622:x1874676443924992:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831093.434335:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787831093.434349:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787831093.434356:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204627c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:be45932f-3bcb-4e49-b61c-a2395180b0ee+17:3619:x1874676443925120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787831093.434363:0:17089:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787831093.434368:0:17089:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d22039c0200/0x95459fb9d1d29abb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d29ab4 expref: 17 pid: 17097 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831093.434376:0:17089:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d22039c0200/0x95459fb9d1d29abb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x95459fb9d1d29ab4 expref: 17 pid: 17097 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831093.434385:0:17089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d22039c0200/0x95459fb9d1d29abb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x95459fb9d1d29ab4 expref: 17 pid: 17097 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831093.434395:0:17089:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d2303aa3800/0x95459fb9d1d29bb7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831093.434413:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2303aa3800/0x95459fb9d1d29bb7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787831093.434426:0:17089:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006287325s 00010000:00010000:0.0:1787831093.434431:0:17089:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d2303aa3800/0x95459fb9d1d29bb7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831093.434437:0:17089:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d2303aa3800/0x95459fb9d1d29bb7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831093.434443:0:17089:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d2303aa3800/0x95459fb9d1d29bb7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831093.434450:0:17089:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d2303aa3800/0x95459fb9d1d29bb7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831093.434455:0:17089:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2303aa3800 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:0.0:1787831093.434459:0:17089:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d2303aa3800/0x95459fb9d1d29bb7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831093.434467:0:17089:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d2303aa3800/0x95459fb9d1d29bb7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831093.434480:0:17089:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d2303aa3800/0x95459fb9d1d29bb7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831093.434489:0:17089:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787831093.434516:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204627c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:be45932f-3bcb-4e49-b61c-a2395180b0ee+16:3619:x1874676443925120:12345-0@lo:103:ldlm_bl.0 Request processed in 161us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831093.434522:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787831093.434558:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204626d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:be45932f-3bcb-4e49-b61c-a2395180b0ee:3622:1874676443924992:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787831093.434575:0:17120:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d2303aa3800/0x95459fb9d1d29bb7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831093.434582:0:17120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d2303aa3800/0x95459fb9d1d29bb7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831093.434588:0:17120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2303aa3800/0x95459fb9d1d29bb7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831093.434611:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204627480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:be45932f-3bcb-4e49-b61c-a2395180b0ee:3619:1874676443925120:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787831093.434734:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1787831093.443878:0:17834:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:2.0:1787831093.443975:0:17858:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:2.0:1787831093.443980:0:17858:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:2.0:1787831093.444753:0:17859:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1787831093.445379:0:17834:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:00080000:2.0:1787831093.445522:0:17859:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787831093.447188:0:17860:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203afc3c0 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17860:1874676443925248:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1787831093.447266:0:17860:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831093.447331:0:17860:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d220375e900 going to sleep for 11 seconds 00000040:01000000:0.0:1787831093.448120:0:17834:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:0.0:1787831093.448154:0:17834:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1787831093.450391:0:17834:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1787831093.450411:0:17834:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:0.0:1787831093.450503:0:17834:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787831093.452730:0:17834:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:1.0:1787831093.453353:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443925248 00000100:00100000:1.0:1787831093.453364:0:17110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443925248 00000100:00100000:1.0:1787831093.453423:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787831093.453433:0:17110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203afde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17860:x1874676443925248:12345-0@lo:1000:lod0001_rec0000.0 00000040:00080000:0.0:1787831093.453456:0:17834:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1787831093.453500:0:17834:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000100:00100000:1.0:1787831093.453558:0:17110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203afde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17860:x1874676443925248:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 126us (6291us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831093.453566:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000040:00080000:0.0:1787831093.453692:0:17834:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787831093.453768:0:17860:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203afc3c0 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17860:1874676443925248:0@lo:1000:lod0001_rec0000.0 00000040:01000000:1.0:1787831093.453810:0:17860:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1787831093.453861:0:17860:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a23840 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17860:1874676443925376:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1787831093.453908:0:17860:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831093.453931:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443925376 00000100:00100000:1.0:1787831093.453935:0:17110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443925376 00000100:00100000:1.0:1787831093.453955:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787831093.453962:0:17110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a230c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17860:x1874676443925376:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1787831093.454083:0:17110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a230c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17860:x1874676443925376:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 121us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831093.454091:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787831093.454115:0:17860:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d232f73f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787831093.454132:0:17860:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a23840 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17860:1874676443925376:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1787831093.454189:0:17860:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a23840 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17860:1874676443925504:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1787831093.454248:0:17860:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831093.454272:0:17860:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d233bcbc0c0 going to sleep for 11 seconds 00080000:10000000:0.0:1787831093.454387:0:17834:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000040:00080000:2.0:1787831093.454949:0:17859:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1787831093.455011:0:17859:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000100:00100000:3.0:1787831093.455156:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443925504 00000100:00100000:3.0:1787831093.455167:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443925504 00000100:00100000:3.0:1787831093.455196:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787831093.455217:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a20780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17860:x1874676443925504:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1787831093.455284:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a20780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17860:x1874676443925504:12345-0@lo:900:lod0001_rec0000.0 Request processed in 69us (1036us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831093.455290:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787831093.455503:0:17860:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8d2203a23840 x1874676443925504/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787831109 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787831093.455515:0:17860:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a23840 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17860:1874676443925504:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1787831093.455569:0:17860:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a23840 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17860:1874676443925632:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1787831093.455600:0:17860:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831093.455793:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443925632 00000100:00100000:1.0:1787831093.455798:0:17110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443925632 00000100:00100000:1.0:1787831093.455869:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787831093.455877:0:17110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a212c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17860:x1874676443925632:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1787831093.455931:0:17110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a212c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17860:x1874676443925632:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 55us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831093.455938:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787831093.456010:0:17860:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d233bcbcb40 going to sleep for 11 seconds 00000100:00100000:1.0:1787831093.456023:0:17860:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a23840 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17860:1874676443925632:0@lo:1000:lod0001_rec0000.0 00000040:00080000:1.0:1787831093.456068:0:17860:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787831093.458403:0:17860:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1787831093.458485:0:17860:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1787831093.458490:0:17860:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00000004:3.0:1787831093.466072:0:17834:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1787831093.468327:0:17834:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1787831093.468376:0:17834:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffae38c1c83988 00100000:10000000:3.0:1787831093.468386:0:17834:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:1.0:1787831093.468745:0:17834:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787831093.468784:0:17834:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.131@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787831093.468801:0:17834:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1787831093.468827:0:17834:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:0.0:1787831093.472469:0:17834:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787831093.472796:0:17834:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787831094.185116:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787831094.438749:0:17145:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2202713600 going to sleep for 0 seconds 00000100:00100000:1.0:1787831094.439059:0:3618:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787831083/real 1787831083] req@ffff8d2204707480 x1874676443917696/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787831093 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787831094.439128:0:3618:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d2204707480 x1874676443917696/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787831093 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787831094.439140:0:3618:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787831083/real 1787831083] req@ffff8d2204704b40 x1874676443917568/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787831093 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787831094.439153:0:3618:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d2204704b40 x1874676443917568/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787831093 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787831094.439173:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8d2303f2a800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787831094.439206:0:3618:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787831094.439211:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1874676443917696:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1787831094.439217:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8d233be52000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787831094.439223:0:3618:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787831094.439227:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1874676443917568:0@lo:8:llog_process_th.0 00000040:00080000:2.0:1787831094.439480:0:17855:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787831094.441159:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787831094.443524:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204627480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:be45932f-3bcb-4e49-b61c-a2395180b0ee:3619:1874676443925760:0@lo:400:kworker.0 00000100:00100000:1.0:1787831094.443613:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831094.444143:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443925760 00000100:00100000:2.0:1787831094.444153:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443925760 00000100:00100000:2.0:1787831094.444232:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787831094.444242:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233c006050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be45932f-3bcb-4e49-b61c-a2395180b0ee+16:3619:x1874676443925760:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787831094.445086:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1787831094.445094:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1787831094.445097:0:8:0:(import.c:65:import_set_state_nolock()) ffff8d2201e0b000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787831094.445107:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8d2201e0b000 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:0.0:1787831094.445139:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2204626d00 x1874676443925888/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787831094.445174:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787831094.445177:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1787831094.445335:0:8:0:(import.c:65:import_set_state_nolock()) ffff8d233be52000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787831094.445341:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 374 00000100:00080000:0.0:1787831094.445346:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787831094.445350:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d233be52000 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:0.0:1787831094.445365:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2204625a40 x1874676443926016/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787831094.445374:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787831094.445377:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787831094.445379:0:8:0:(import.c:65:import_set_state_nolock()) ffff8d2303f2a800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787831094.445383:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 374 00000100:00080000:0.0:1787831094.445385:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787831094.445388:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d2303f2a800 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:0.0:1787831094.445398:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2204624000 x1874676443926144/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787831094.445436:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787831094.445440:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787831094.445443:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787831094.445445:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787831094.445491:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204627840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3621:1874676443926272:0@lo:400:kworker.0 00000100:00100000:3.0:1787831094.445610:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204626d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1874676443925888:0@lo:38:kworker.0 00000100:00100000:2.0:1787831094.445755:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233c006050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be45932f-3bcb-4e49-b61c-a2395180b0ee+16:3619:x1874676443925760:12345-0@lo:400:kworker.0 Request processed in 1512us (2138us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831094.445765:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787831094.445819:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787831094.445829:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22046261c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3620:1874676443926528:0@lo:400:kworker.0 00000100:00100000:2.0:1787831094.445859:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831094.445929:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204625e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676443926400:0@lo:400:kworker.0 00000100:00100000:2.0:1787831094.445987:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831094.446025:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443926400 00000100:00100000:2.0:1787831094.446031:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443926400 00000100:00100000:2.0:1787831094.446064:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787831094.446071:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204704b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676443926400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787831094.446115:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204704b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676443926400:12345-0@lo:400:kworker.0 Request processed in 45us (128us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831094.446122:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787831094.446156:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204625e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676443926400:0@lo:400:kworker.0 00000100:00100000:2.0:1787831094.446200:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443926528 00000100:00100000:2.0:1787831094.446204:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443926528 00000100:00100000:2.0:1787831094.446245:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787831094.446251:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204705680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1874676443926528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787831094.446285:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204705680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1874676443926528:12345-0@lo:400:kworker.0 Request processed in 35us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831094.446292:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787831094.446317:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d22046261c0 x1874676443926528/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787831110 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787831094.446328:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22046261c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3620:1874676443926528:0@lo:400:kworker.0 00000100:00100000:0.0:1787831094.446666:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831094.446709:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443926272 00000100:00100000:2.0:1787831094.446715:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443926272 00000100:00100000:2.0:1787831094.446752:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787831094.446759:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22046270c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1874676443926272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787831094.446798:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22046270c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1874676443926272:12345-0@lo:400:kworker.0 Request processed in 39us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831094.446804:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787831094.447654:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d2204627840 x1874676443926272/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787831110 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787831094.447671:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204627840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3621:1874676443926272:0@lo:400:kworker.0 00000100:00100000:1.0:1787831094.448979:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204627480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:be45932f-3bcb-4e49-b61c-a2395180b0ee:3619:1874676443925760:0@lo:400:kworker.0 00000100:00100000:3.0:1787831094.450751:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831094.450859:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204625a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1874676443926016:0@lo:8:kworker.0 00000400:00000100:3.0:1787831094.450900:0:3618:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874676443926016 offset 0 length 520: 4 00000100:00100000:3.0:1787831094.450923:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204624000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1874676443926144:0@lo:8:kworker.0 00000400:00000100:3.0:1787831094.450939:0:3618:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874676443926144 offset 0 length 520: 4 00000100:00100000:2.0:1787831094.454713:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443925888 00000100:00100000:2.0:1787831094.454727:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443925888 00000100:00100000:2.0:1787831094.454776:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787831094.454784:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203afcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3618:x1874676443925888:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1787831094.454818:0:17109:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 385 last 0 00000020:00000080:2.0:1787831094.454852:0:17109:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x95459fb9d1d29bbe 00000004:00100000:2.0:1787831094.454869:0:17109:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1787831094.454874:0:17109:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:2.0:1787831094.462495:0:17109:0:(import.c:65:import_set_state_nolock()) ffff8d2303f2d800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787831094.462599:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203afcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3618:x1874676443925888:12345-0@lo:38:kworker.0 Request processed in 7813us (11851us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831094.462663:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:3.0:1787831094.462692:0:3618:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1787831094.462702:0:3618:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1787831094.462709:0:3618:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1787831094.462711:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8d2201e0b000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1787831094.462726:0:3618:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000073170c1c): req@ffff8d2204625680 x1874676443920128/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787831094.462755:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204626d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1874676443925888:0@lo:38:kworker.0 00000100:00100000:2.0:1787831094.462914:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204627840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1874676443926656:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787831094.462962:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831094.463007:0:17145:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831094.463029:0:17145:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2202713600 going to sleep for 11 seconds 00000100:00100000:2.0:1787831094.463030:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443926656 00000100:00100000:2.0:1787831094.463038:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443926656 00000100:00100000:2.0:1787831094.463065:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443920128 00000100:00100000:2.0:1787831094.463068:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443920128 00000100:00100000:2.0:1787831094.463082:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787831094.463090:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204707480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:3620:x1874676443926656:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787831094.463117:0:17109:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787831094.463163:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204707480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:3620:x1874676443926656:12345-0@lo:41:osp-pre-1-0.0 Request processed in 73us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831094.463169:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787831094.463183:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787831094.463189:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a23840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17145:x1874676443920128:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1787831094.463266:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a23840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17145:x1874676443920128:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 77us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831094.463273:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787831094.463302:0:17145:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204625680 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17145:1874676443920128:0@lo:1000:lod0000_rec0001.0 00000040:01000000:1.0:1787831094.463341:0:17145:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1787831094.463375:0:17145:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a22940 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17145:1874676443926784:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787831094.463406:0:17145:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831094.463447:0:17145:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d233bcbc0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787831094.463551:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443926784 00000100:00100000:2.0:1787831094.463555:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443926784 00000100:00100000:3.0:1787831094.463658:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204627840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1874676443926656:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787831094.464536:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787831094.464552:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a21680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17145:x1874676443926784:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1787831094.464725:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a21680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17145:x1874676443926784:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 179us (1317us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831094.464732:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787831094.464815:0:17145:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a22940 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17145:1874676443926784:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787831094.464909:0:17145:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a22940 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17145:1874676443926912:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787831094.464939:0:17145:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831094.465259:0:17145:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d233bcbc0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787831094.465314:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443926912 00000100:00100000:0.0:1787831094.465320:0:17110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443926912 00000100:00100000:0.0:1787831094.465349:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787831094.465357:0:17110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a21a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17145:x1874676443926912:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1787831094.465423:0:17110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a21a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17145:x1874676443926912:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 66us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831094.465430:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787831094.465498:0:17145:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a22940 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17145:1874676443926912:0@lo:1000:lod0000_rec0001.0 00000040:00080000:1.0:1787831094.465546:0:17145:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787831094.468954:0:17145:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1787831094.469045:0:17145:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 11, retries 0 00000004:00080000:1.0:1787831094.469050:0:17145:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 10000000:01000000:0.0:1787831095.206697:0:17102:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787831095.206705:0:17102:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d233f43f000 from 8 10000000:01000000:0.0:1787831095.206710:0:17102:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787831095.206758:0:17102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d2303aa2600/0x95459fb9d1d29bc5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831095.206771:0:17102:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8d2303aa2600/0x95459fb9d1d29bc5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831095.206782:0:17102:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8d2303aa2600/0x95459fb9d1d29bc5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831095.206813:0:17102:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204624b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be45932f-3bcb-4e49-b61c-a2395180b0ee:17102:1874676443927040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787831095.206892:0:17102:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831095.206949:0:17102:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2307d75600 going to sleep for 11 seconds 00010000:00010000:0.0:1787831095.207113:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787831095.207227:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443927040 00000100:00100000:3.0:1787831095.207234:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443927040 00000100:00100000:3.0:1787831095.207326:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787831095.207336:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233c005c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be45932f-3bcb-4e49-b61c-a2395180b0ee+16:17102:x1874676443927040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787831095.207348:0:17098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787831095.207362:0:17098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2307c76400/0x95459fb9d1d29bcc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d29bc5 expref: -99 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831095.207387:0:17098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2307c76400/0x95459fb9d1d29bcc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d29bc5 expref: 17 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831095.207399:0:17098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2307c76400/0x95459fb9d1d29bcc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d29bc5 expref: 17 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831095.207409:0:17098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2307c76400, rc 0) 00000100:00100000:3.0:1787831095.207458:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233c005c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be45932f-3bcb-4e49-b61c-a2395180b0ee+17:17102:x1874676443927040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831095.207466:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787831095.207548:0:17102:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204624b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be45932f-3bcb-4e49-b61c-a2395180b0ee:17102:1874676443927040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787831095.207563:0:17102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8d2303aa2600/0x95459fb9d1d29bc5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d29bcc expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831095.207578:0:17102:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8d2303aa2600/0x95459fb9d1d29bc5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d29bcc expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831095.207649:0:17102:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204624b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be45932f-3bcb-4e49-b61c-a2395180b0ee:17102:1874676443927168:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787831095.207682:0:17102:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831095.207828:0:17102:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2307d75600 going to sleep for 11 seconds 00000100:00100000:2.0:1787831095.207870:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443927168 00000100:00100000:2.0:1787831095.207880:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443927168 00000100:00100000:2.0:1787831095.207905:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787831095.207911:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233c004850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be45932f-3bcb-4e49-b61c-a2395180b0ee+17:17102:x1874676443927168:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787831095.207926:0:17097:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787831095.207942:0:17097:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787831095.207945:0:17097:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1787831095.208120:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233c004850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be45932f-3bcb-4e49-b61c-a2395180b0ee+17:17102:x1874676443927168:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 208us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831095.208127:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787831095.208283:0:17102:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204624b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be45932f-3bcb-4e49-b61c-a2395180b0ee:17102:1874676443927168:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787831095.208325:0:17102:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787831095.208333:0:17102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d2303aa2600/0x95459fb9d1d29bc5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d29bcc expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831095.208343:0:17102:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8d2303aa2600/0x95459fb9d1d29bc5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d29bcc expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787831095.208353:0:17102:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787831095.208355:0:17102:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d23115b5000 from 8 10000000:01000000:0.0:1787831095.208358:0:17102:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787831095.208378:0:17102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d2303aa2200/0x95459fb9d1d29bd3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831095.208386:0:17102:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8d2303aa2200/0x95459fb9d1d29bd3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831095.208393:0:17102:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8d2303aa2200/0x95459fb9d1d29bd3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831095.208406:0:17102:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204624b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be45932f-3bcb-4e49-b61c-a2395180b0ee:17102:1874676443927296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787831095.208438:0:17102:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831095.208497:0:17102:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2307d75600 going to sleep for 11 seconds 00000100:00100000:2.0:1787831095.208530:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443927296 00000100:00100000:2.0:1787831095.208534:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443927296 00000100:00100000:2.0:1787831095.208598:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787831095.208605:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233c004450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be45932f-3bcb-4e49-b61c-a2395180b0ee+17:17102:x1874676443927296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787831095.208613:0:17097:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787831095.208647:0:17097:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d22039c0600/0x95459fb9d1d29bda lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d29bd3 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831095.208665:0:17097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22039c0600/0x95459fb9d1d29bda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d29bd3 expref: 18 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831095.208675:0:17097:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d22039c0600/0x95459fb9d1d29bda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d29bd3 expref: 18 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831095.208683:0:17097:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22039c0600, rc 0) 00000100:00100000:2.0:1787831095.208709:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233c004450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be45932f-3bcb-4e49-b61c-a2395180b0ee+18:17102:x1874676443927296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831095.208715:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787831095.208774:0:17102:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204624b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be45932f-3bcb-4e49-b61c-a2395180b0ee:17102:1874676443927296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787831095.208785:0:17102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8d2303aa2200/0x95459fb9d1d29bd3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d29bda expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831095.208794:0:17102:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8d2303aa2200/0x95459fb9d1d29bd3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d29bda expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831095.208831:0:17102:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204624b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be45932f-3bcb-4e49-b61c-a2395180b0ee:17102:1874676443927424:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787831095.208856:0:17102:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831095.208934:0:17102:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2307d75600 going to sleep for 11 seconds 00000100:00100000:3.0:1787831095.208964:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443927424 00000100:00100000:3.0:1787831095.208968:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443927424 00000100:00100000:3.0:1787831095.208990:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787831095.208996:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233c007c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be45932f-3bcb-4e49-b61c-a2395180b0ee+18:17102:x1874676443927424:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1787831095.209006:0:17096:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787831095.209017:0:17096:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787831095.209020:0:17096:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1787831095.209257:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233c007c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be45932f-3bcb-4e49-b61c-a2395180b0ee+18:17102:x1874676443927424:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 260us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831095.209264:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787831095.209359:0:17102:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204624b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be45932f-3bcb-4e49-b61c-a2395180b0ee:17102:1874676443927424:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787831095.209395:0:17102:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787831095.209400:0:17102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d2303aa2200/0x95459fb9d1d29bd3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d29bda expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831095.209409:0:17102:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8d2303aa2200/0x95459fb9d1d29bd3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d29bda expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787831095.465480:0:17139:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1787831095.465681:0:17855:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787831096.231756:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787831096.896096:0:18103:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg331-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787831097.257959:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787831097.664524:0:18155:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787831097.664754:0:18155:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787831098.281023:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787831098.527818:0:18205:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787831098.528042:0:18205:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1787831098.598931:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787831098.598961:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204624b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676443927552:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787831098.599287:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831098.599389:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443927552 00000100:00100000:0.0:1787831098.599409:0:17110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443927552 00000100:00100000:0.0:1787831098.599470:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787831098.599480:0:17110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204626940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676443927552:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787831098.599514:0:17110:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1787831098.599581:0:17110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204626940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676443927552:12345-0@lo:41:osp-pre-0-1.0 Request processed in 103us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831098.599588:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787831098.599670:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204624b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676443927552:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787831099.303801:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787831099.485983:0:18253:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffefd06d9c0 20000000:00000080:3.0:1787831099.486000:0:18253:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d2305801400 uarg=0000000000000000 20000000:01000000:3.0:1787831099.486042:0:18253:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1787831099.486050:0:18253:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1787831099.486055:0:18253:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1787831099.486523:0:18254:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:3.0:1787831099.486853:0:18253:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1787831099.493138:0:18253:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787831099.493178:0:18253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d2307c77800/0x95459fb9d1d29be1 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831099.493197:0:18253:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2307c76e00/0x95459fb9d1d29a8a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d29a83 expref: 17 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831099.493205:0:18253:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2303aa2400/0x95459fb9d1d29b8d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d29b86 expref: 17 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831099.493212:0:18253:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d2307c77800/0x95459fb9d1d29be1 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831099.493254:0:18253:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2303aa2400/0x95459fb9d1d29b8d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x95459fb9d1d29b86 expref: 17 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831099.493269:0:18253:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d2303aa2400/0x95459fb9d1d29b8d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x95459fb9d1d29b86 expref: 17 pid: 17098 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787831099.493283:0:18253:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203aff0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18253:1874676443927680:0@lo:104: 00000100:00100000:3.0:1787831099.493349:0:18253:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787831099.493457:0:18253:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2307c76e00/0x95459fb9d1d29a8a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x95459fb9d1d29a83 expref: 17 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831099.493467:0:18253:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d2307c76e00/0x95459fb9d1d29a8a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x95459fb9d1d29a83 expref: 17 pid: 17096 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787831099.493487:0:18253:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203afed00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18253:1874676443927808:0@lo:104: 00000100:00100000:3.0:1787831099.493511:0:18253:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831099.493595:0:18253:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d22034db300 going to sleep for 11 seconds 00000100:00100000:0.0:1787831099.500363:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443927680 00000100:00100000:0.0:1787831099.500381:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443927680 00000100:00100000:0.0:1787831099.500441:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443927808 00000100:00100000:0.0:1787831099.500444:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443927808 00000100:00100000:0.0:1787831099.500461:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787831099.500470:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203afd680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:be45932f-3bcb-4e49-b61c-a2395180b0ee+4:18253:x1874676443927680:12345-0@lo:104: 00010000:00010000:0.0:1787831099.500488:0:17087:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff8d23344b6e00/0x95459fb9d1d29b86 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d29b8d expref: -99 pid: 17834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831099.500613:0:17087:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787831099.500620:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203afd680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:be45932f-3bcb-4e49-b61c-a2395180b0ee+4:18253:x1874676443927680:12345-0@lo:104: Request processed in 151us (7270us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831099.500644:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787831099.500662:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787831099.500668:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203afcb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:be45932f-3bcb-4e49-b61c-a2395180b0ee+3:18253:x1874676443927808:12345-0@lo:104: 00010000:00010000:0.0:1787831099.500677:0:17087:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff8d2303aa3e00/0x95459fb9d1d29a83 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d29a8a expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831099.500712:0:17087:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787831099.500730:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203afcb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:be45932f-3bcb-4e49-b61c-a2395180b0ee+3:18253:x1874676443927808:12345-0@lo:104: Request processed in 62us (7218us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831099.500736:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1787831099.500759:0:17092:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787831099.500765:0:17092:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8d23344b6e00/0x95459fb9d1d29b86 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d29b8d expref: -99 pid: 17834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831099.500774:0:17092:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d23344b6e00 already unused, calling callback (ffffffffc14f9c20) 10000000:00010000:0.0:1787831099.500778:0:17092:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8d23344b6e00/0x95459fb9d1d29b86 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x95459fb9d1d29b8d expref: -99 pid: 17834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831099.500787:0:17092:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8d23344b6e00/0x95459fb9d1d29b86 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x95459fb9d1d29b8d expref: -99 pid: 17834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787831099.500794:0:17092:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8d23344b6e00/0x95459fb9d1d29b86 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x95459fb9d1d29b8d expref: -99 pid: 17834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787831099.500801:0:17092:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787831099.500835:0:17092:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8d23344b6e00/0x95459fb9d1d29b86 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d29b8d expref: -99 pid: 17834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831099.500842:0:17092:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787831099.500862:0:17092:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8d23344b6e00/0x95459fb9d1d29b86 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d29b8d expref: -99 pid: 17834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831099.500870:0:17092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8d23344b6e00/0x95459fb9d1d29b86 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d29b8d expref: -99 pid: 17834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831099.500883:0:17092:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787831099.500886:0:17092:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8d2303aa3e00/0x95459fb9d1d29a83 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d29a8a expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831099.500903:0:17092:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2303aa3e00 already unused, calling callback (ffffffffc14f9c20) 10000000:00010000:0.0:1787831099.500906:0:17092:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8d2303aa3e00/0x95459fb9d1d29a83 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x95459fb9d1d29a8a expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831099.500913:0:17092:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8d2303aa3e00/0x95459fb9d1d29a83 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x95459fb9d1d29a8a expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787831099.500918:0:17092:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8d2303aa3e00/0x95459fb9d1d29a83 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x95459fb9d1d29a8a expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787831099.500923:0:17092:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787831099.500937:0:17092:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8d2303aa3e00/0x95459fb9d1d29a83 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d29a8a expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831099.500943:0:17092:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787831099.500959:0:17092:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8d2303aa3e00/0x95459fb9d1d29a83 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d29a8a expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831099.500966:0:17092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8d2303aa3e00/0x95459fb9d1d29a83 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d29a8a expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831099.500979:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787831099.500980:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787831099.500982:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787831099.500988:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787831099.501007:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204627840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:be45932f-3bcb-4e49-b61c-a2395180b0ee:3622:1874676443927936:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787831099.501045:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831099.501137:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204625680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:be45932f-3bcb-4e49-b61c-a2395180b0ee:3619:1874676443928064:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787831099.501183:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831099.501215:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443927936 00000100:00100000:0.0:1787831099.501220:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443927936 00010000:00010000:0.0:1787831099.501239:0:17089:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2303aa2400/0x95459fb9d1d29b8d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d29b86 expref: 18 pid: 17098 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831099.501259:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443928064 00000100:00100000:0.0:1787831099.501261:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443928064 00010000:00010000:0.0:1787831099.501273:0:17089:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2307c76e00/0x95459fb9d1d29a8a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d29a83 expref: 19 pid: 17096 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831099.501285:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787831099.501291:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204626d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:be45932f-3bcb-4e49-b61c-a2395180b0ee+19:3622:x1874676443927936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787831099.501301:0:17089:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787831099.501306:0:17089:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2303aa2400/0x95459fb9d1d29b8d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d29b86 expref: 19 pid: 17098 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831099.501315:0:17089:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2303aa2400/0x95459fb9d1d29b8d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x95459fb9d1d29b86 expref: 19 pid: 17098 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831099.501331:0:17089:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787831099.501358:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204626d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:be45932f-3bcb-4e49-b61c-a2395180b0ee+19:3622:x1874676443927936:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831099.501365:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787831099.501379:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787831099.501385:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204627480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:be45932f-3bcb-4e49-b61c-a2395180b0ee+18:3619:x1874676443928064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787831099.501392:0:17089:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787831099.501396:0:17089:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2307c76e00/0x95459fb9d1d29a8a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d29a83 expref: 18 pid: 17096 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831099.501415:0:17089:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2307c76e00/0x95459fb9d1d29a8a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x95459fb9d1d29a83 expref: 18 pid: 17096 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831099.501428:0:17089:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d2307c77800/0x95459fb9d1d29be1 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831099.501436:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2307c77800/0x95459fb9d1d29be1 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831099.501450:0:17089:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d2307c77800/0x95459fb9d1d29be1 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831099.501458:0:17089:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d2307c77800/0x95459fb9d1d29be1 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831099.501465:0:17089:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d2307c77800/0x95459fb9d1d29be1 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831099.501472:0:17089:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d2307c77800/0x95459fb9d1d29be1 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831099.501476:0:17089:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2307c77800 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:0.0:1787831099.501480:0:17089:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d2307c77800/0x95459fb9d1d29be1 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831099.501486:0:17089:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d2307c77800/0x95459fb9d1d29be1 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831099.501494:0:17089:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d2307c77800/0x95459fb9d1d29be1 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831099.501514:0:17089:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787831099.501541:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204627480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:be45932f-3bcb-4e49-b61c-a2395180b0ee+18:3619:x1874676443928064:12345-0@lo:103:ldlm_bl.0 Request processed in 157us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831099.501548:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787831099.501589:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204627840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:be45932f-3bcb-4e49-b61c-a2395180b0ee:3622:1874676443927936:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787831099.501614:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204625680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:be45932f-3bcb-4e49-b61c-a2395180b0ee:3619:1874676443928064:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787831099.502068:0:18253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2303aa2400/0x95459fb9d1d29b8d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x95459fb9d1d29b86 expref: 17 pid: 17098 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831099.502084:0:18253:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203aff0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18253:1874676443927680:0@lo:104: 00010000:00010000:1.0:1787831099.502096:0:18253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2307c76e00/0x95459fb9d1d29a8a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x95459fb9d1d29a83 expref: 16 pid: 17096 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831099.502103:0:18253:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203afed00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18253:1874676443927808:0@lo:104: 00010000:00010000:1.0:1787831099.502120:0:18253:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d2307c77800/0x95459fb9d1d29be1 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831099.502128:0:18253:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d2307c77800/0x95459fb9d1d29be1 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831099.502146:0:18253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d2307c77800/0x95459fb9d1d29be1 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831099.502152:0:18253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2307c77800/0x95459fb9d1d29be1 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831099.622925:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787831099.622945:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204624b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443928192:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787831099.623010:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831099.623046:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443928192 00000100:00100000:0.0:1787831099.623052:0:17110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443928192 00000100:00080000:2.0:1787831099.623172:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787831099.623178:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787831099.623181:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787831099.623184:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787831099.623213:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787831099.623215:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787831099.623218:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787831099.623221:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787831099.623273:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787831099.623282:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3620:1874676443928576:0@lo:400:kworker.0 00000100:00100000:3.0:1787831099.623314:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831099.623375:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443928576 00000100:00100000:2.0:1787831099.623379:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443928576 00000100:00100000:2.0:1787831099.623418:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787831099.623429:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203afe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1874676443928576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787831099.623478:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203afe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1874676443928576:12345-0@lo:400:kworker.0 Request processed in 51us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831099.623486:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1787831099.623568:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d2204704780 x1874676443928576/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787831115 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787831099.623581:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3620:1874676443928576:0@lo:400:kworker.0 00000100:00100000:0.0:1787831099.623762:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787831099.623772:0:17110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204625680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3619:x1874676443928192:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787831099.623800:0:17110:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787831099.623838:0:17110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204625680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3619:x1874676443928192:12345-0@lo:41:osp-pre-1-0.0 Request processed in 68us (828us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831099.623845:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787831099.623868:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3621:1874676443928320:0@lo:400:kworker.0 00000100:00100000:0.0:1787831099.623891:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831099.623918:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787831099.623924:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22047052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443928448:0@lo:400:kworker.0 00000100:00100000:0.0:1787831099.623944:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831099.623984:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204624b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443928192:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787831099.624043:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443928448 00000100:00100000:3.0:1787831099.624047:0:17110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443928448 00000100:00100000:3.0:1787831099.624080:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787831099.624097:0:17110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22046261c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443928448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787831099.624135:0:17110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22046261c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443928448:12345-0@lo:400:kworker.0 Request processed in 50us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831099.624142:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787831099.624266:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443928320 00000100:00100000:2.0:1787831099.624272:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443928320 00000100:00100000:2.0:1787831099.624342:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787831099.624349:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204627840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1874676443928320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787831099.624382:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204627840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1874676443928320:12345-0@lo:400:kworker.0 Request processed in 33us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831099.624388:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787831099.624562:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22047052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443928448:0@lo:400:kworker.0 00010000:00080000:0.0:1787831099.624593:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d2204705a40 x1874676443928320/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787831115 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787831099.624950:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3621:1874676443928320:0@lo:400:kworker.0 00000001:00100000:1.0:1787831100.137914:0:17835:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1787831100.326881:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787831101.032503:0:17102:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787831101.032515:0:17102:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d233f43f000 from 13 10000000:01000000:0.0:1787831101.032522:0:17102:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787831101.032900:0:17102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d2303aa2a00/0x95459fb9d1d29be8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831101.032916:0:17102:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8d2303aa2a00/0x95459fb9d1d29be8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831101.032931:0:17102:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8d2303aa2a00/0x95459fb9d1d29be8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831101.032966:0:17102:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204624b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be45932f-3bcb-4e49-b61c-a2395180b0ee:17102:1874676443928704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787831101.033066:0:17102:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831101.033199:0:17102:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2201e97900 going to sleep for 11 seconds 00000100:00100000:3.0:1787831101.034318:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443928704 00000100:00100000:3.0:1787831101.034335:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443928704 00000100:00100000:3.0:1787831101.034423:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787831101.034435:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233c007850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be45932f-3bcb-4e49-b61c-a2395180b0ee+16:17102:x1874676443928704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787831101.034456:0:17096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787831101.034478:0:17096:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2307c77a00/0x95459fb9d1d29bef lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d29be8 expref: -99 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831101.034515:0:17096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2307c77a00/0x95459fb9d1d29bef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d29be8 expref: 17 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831101.034701:0:17096:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2307c77a00/0x95459fb9d1d29bef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d29be8 expref: 17 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831101.034712:0:17096:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2307c77a00, rc 0) 00000100:00100000:3.0:1787831101.034816:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233c007850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be45932f-3bcb-4e49-b61c-a2395180b0ee+17:17102:x1874676443928704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 383us (1749us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831101.034824:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787831101.035005:0:17102:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204624b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be45932f-3bcb-4e49-b61c-a2395180b0ee:17102:1874676443928704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787831101.035036:0:17102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8d2303aa2a00/0x95459fb9d1d29be8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d29bef expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831101.035049:0:17102:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8d2303aa2a00/0x95459fb9d1d29be8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d29bef expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831101.035161:0:17102:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a20f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be45932f-3bcb-4e49-b61c-a2395180b0ee:17102:1874676443928832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787831101.035227:0:17102:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831101.035280:0:17102:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d22034db540 going to sleep for 11 seconds 00000100:00100000:2.0:1787831101.035362:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443928832 00000100:00100000:2.0:1787831101.035368:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443928832 00000100:00100000:2.0:1787831101.035444:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787831101.035452:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233c006450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be45932f-3bcb-4e49-b61c-a2395180b0ee+17:17102:x1874676443928832:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787831101.035585:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233c006450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be45932f-3bcb-4e49-b61c-a2395180b0ee+17:17102:x1874676443928832:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 133us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831101.035593:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787831101.036082:0:17102:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a20f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be45932f-3bcb-4e49-b61c-a2395180b0ee:17102:1874676443928832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787831101.036121:0:17102:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a20f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be45932f-3bcb-4e49-b61c-a2395180b0ee:17102:1874676443928960:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787831101.036178:0:17102:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831101.036270:0:17102:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d22034db540 going to sleep for 11 seconds 00000100:00100000:0.0:1787831101.036368:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443928960 00000100:00100000:0.0:1787831101.036373:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443928960 00000100:00100000:0.0:1787831101.036409:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787831101.036417:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233c007050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be45932f-3bcb-4e49-b61c-a2395180b0ee+17:17102:x1874676443928960:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787831101.036564:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233c007050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be45932f-3bcb-4e49-b61c-a2395180b0ee+17:17102:x1874676443928960:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 147us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831101.036572:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787831101.036852:0:17102:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a20f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be45932f-3bcb-4e49-b61c-a2395180b0ee:17102:1874676443928960:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787831101.038776:0:18322:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1787831101.042937:0:17102:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1787831101.042984:0:17102:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787831101.042997:0:17102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d2303aa2a00/0x95459fb9d1d29be8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d29bef expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831101.043025:0:17102:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8d2303aa2a00/0x95459fb9d1d29be8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d29bef expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787831101.043036:0:17102:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787831101.043038:0:17102:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d23115b5000 from 13 10000000:01000000:1.0:1787831101.043041:0:17102:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787831101.043079:0:17102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d23344b7a00/0x95459fb9d1d29bf6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831101.043086:0:17102:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8d23344b7a00/0x95459fb9d1d29bf6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831101.043098:0:17102:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8d23344b7a00/0x95459fb9d1d29bf6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831101.043123:0:17102:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a20f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be45932f-3bcb-4e49-b61c-a2395180b0ee:17102:1874676443929088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787831101.043200:0:17102:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831101.043244:0:17102:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d22034db540 going to sleep for 11 seconds 00000100:00100000:3.0:1787831101.043405:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443929088 00000100:00100000:3.0:1787831101.043412:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443929088 00000100:00100000:3.0:1787831101.043501:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787831101.043511:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233c006850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be45932f-3bcb-4e49-b61c-a2395180b0ee+17:17102:x1874676443929088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787831101.043524:0:17096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787831101.043538:0:17096:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2307c77400/0x95459fb9d1d29bfd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d29bf6 expref: -99 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831101.043565:0:17096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2307c77400/0x95459fb9d1d29bfd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d29bf6 expref: 18 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831101.043579:0:17096:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2307c77400/0x95459fb9d1d29bfd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d29bf6 expref: 18 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831101.043588:0:17096:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2307c77400, rc 0) 00000100:00100000:3.0:1787831101.043658:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233c006850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be45932f-3bcb-4e49-b61c-a2395180b0ee+18:17102:x1874676443929088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 150us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831101.043665:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787831101.043770:0:17102:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a20f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be45932f-3bcb-4e49-b61c-a2395180b0ee:17102:1874676443929088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787831101.043784:0:17102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8d23344b7a00/0x95459fb9d1d29bf6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d29bfd expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831101.043793:0:17102:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8d23344b7a00/0x95459fb9d1d29bf6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d29bfd expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831101.043854:0:17102:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a20f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be45932f-3bcb-4e49-b61c-a2395180b0ee:17102:1874676443929216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787831101.043886:0:17102:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831101.044137:0:17102:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d22034db540 going to sleep for 11 seconds 00000100:00100000:2.0:1787831101.044208:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443929216 00000100:00100000:2.0:1787831101.044213:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443929216 00000100:00100000:2.0:1787831101.044241:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787831101.044247:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233c004050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be45932f-3bcb-4e49-b61c-a2395180b0ee+18:17102:x1874676443929216:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787831101.044367:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233c004050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be45932f-3bcb-4e49-b61c-a2395180b0ee+18:17102:x1874676443929216:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 119us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831101.044374:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787831101.044441:0:17102:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a20f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be45932f-3bcb-4e49-b61c-a2395180b0ee:17102:1874676443929216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787831101.044473:0:17102:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a20f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be45932f-3bcb-4e49-b61c-a2395180b0ee:17102:1874676443929344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787831101.044513:0:17102:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831101.044534:0:17102:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d22034db540 going to sleep for 11 seconds 00000100:00100000:2.0:1787831101.044677:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443929344 00000100:00100000:2.0:1787831101.044682:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443929344 00000100:00100000:2.0:1787831101.044711:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787831101.044717:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233c005050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be45932f-3bcb-4e49-b61c-a2395180b0ee+18:17102:x1874676443929344:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787831101.044814:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233c005050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be45932f-3bcb-4e49-b61c-a2395180b0ee+18:17102:x1874676443929344:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 95us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831101.044820:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787831101.045690:0:17102:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a20f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be45932f-3bcb-4e49-b61c-a2395180b0ee:17102:1874676443929344:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787831101.047612:0:18323:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1787831101.048076:0:17102:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1787831101.048105:0:17102:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787831101.048117:0:17102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d23344b7a00/0x95459fb9d1d29bf6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d29bfd expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831101.048129:0:17102:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8d23344b7a00/0x95459fb9d1d29bf6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d29bfd expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831101.351206:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787831102.374785:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787831103.399489:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787831103.590719:0:3618:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787831093/real 1787831093] req@ffff8d2203afc780 x1874676443922688/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787831103 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787831103.590752:0:3618:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d2203afc780 x1874676443922688/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787831103 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787831103.590764:0:3618:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787831093/real 1787831093] req@ffff8d2203aff840 x1874676443922560/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787831103 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787831103.590776:0:3618:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d2203aff840 x1874676443922560/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787831103 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787831103.590796:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8d2303234000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787831103.590820:0:3618:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787831103.590824:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203afc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1874676443922688:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1787831103.590830:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8d232b962800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787831103.590835:0:3618:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787831103.590838:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203aff840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1874676443922560:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1787831103.590903:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787831103.590917:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a23c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:be45932f-3bcb-4e49-b61c-a2395180b0ee:3619:1874676443929472:0@lo:400:kworker.0 00000100:00100000:1.0:1787831103.590984:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787831103.591022:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787831103.591027:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787831103.591030:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787831103.591033:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787831103.591044:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204625e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443929600:0@lo:400:kworker.0 00000100:00100000:0.0:1787831103.591078:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831103.591138:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443929600 00000100:00100000:1.0:1787831103.591145:0:17110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443929600 00000100:00100000:0.0:1787831103.591161:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204624b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3622:1874676443929728:0@lo:400:kworker.0 00000100:00100000:1.0:1787831103.591194:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787831103.591201:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831103.591210:0:17110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204624780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1874676443929600:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787831103.591265:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787831103.591269:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1787831103.591271:0:37:0:(import.c:65:import_set_state_nolock()) ffff8d232b962800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787831103.591276:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 384 00000100:00080000:0.0:1787831103.591281:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00100000:1.0:1787831103.591287:0:17110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204624780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1874676443929600:12345-0@lo:400:kworker.0 Request processed in 80us (207us total) trans 0 rc 0/0 00000100:00080000:0.0:1787831103.591289:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8d232b962800 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:1.0:1787831103.591300:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787831103.591316:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2314ed5e00 x1874676443929984/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787831103.591334:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787831103.591337:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787831103.591339:0:37:0:(import.c:65:import_set_state_nolock()) ffff8d2303234000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787831103.591343:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 384 00000100:00080000:0.0:1787831103.591346:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00100000:1.0:1787831103.591348:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204625e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443929600:0@lo:400:kworker.0 00000100:00080000:0.0:1787831103.591352:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8d2303234000 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:0.0:1787831103.591367:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2314ed5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1874676443929984:0@lo:8:kworker.0 00000100:00100000:1.0:1787831103.591379:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2314ed5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443929856:0@lo:400:kworker.0 00000400:00000100:0.0:1787831103.591396:0:3618:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874676443929984 offset 0 length 520: 4 00000100:00100000:1.0:1787831103.591415:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831103.591438:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443929856 00000100:00100000:1.0:1787831103.591442:0:17110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443929856 00000100:00100000:1.0:1787831103.591460:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787831103.591465:0:17110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a21e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443929856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787831103.591497:0:17110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a21e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443929856:12345-0@lo:400:kworker.0 Request processed in 31us (82us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831103.591503:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787831103.591526:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2314ed5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443929856:0@lo:400:kworker.0 00000100:00100000:0.0:1787831103.591807:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2314ed7c00 x1874676443930112/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787831103.591939:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2314ed43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3620:1874676443930240:0@lo:400:kworker.0 00000100:00100000:3.0:1787831103.591985:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831103.592021:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2314ed7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1874676443930112:0@lo:8:kworker.0 00000100:00100000:3.0:1787831103.592035:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443929472 00000100:00100000:3.0:1787831103.592041:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443929472 00000400:00000100:1.0:1787831103.592072:0:3618:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874676443930112 offset 0 length 520: 4 00000100:00100000:3.0:1787831103.592076:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787831103.592089:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233c005850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be45932f-3bcb-4e49-b61c-a2395180b0ee+18:3619:x1874676443929472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787831103.593700:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443929728 00000100:00100000:2.0:1787831103.593710:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443929728 00000100:00100000:3.0:1787831103.594110:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233c005850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be45932f-3bcb-4e49-b61c-a2395180b0ee+18:3619:x1874676443929472:12345-0@lo:400:kworker.0 Request processed in 2022us (3123us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831103.594122:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787831103.594273:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a23c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:be45932f-3bcb-4e49-b61c-a2395180b0ee:3619:1874676443929472:0@lo:400:kworker.0 00000100:00100000:2.0:1787831103.594830:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443930240 00000100:00100000:2.0:1787831103.594837:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443930240 00000100:00100000:0.0:1787831103.594838:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787831103.594864:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2314ed6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1874676443929728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787831103.594866:0:17105:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1787831103.594876:0:17105:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1787831103.594946:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2314ed6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1874676443929728:12345-0@lo:400:kworker.0 Request processed in 87us (3748us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831103.594954:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787831103.594973:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787831103.594979:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203afed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1874676443930240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787831103.595030:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203afed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1874676443930240:12345-0@lo:400:kworker.0 Request processed in 52us (3044us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831103.595036:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1787831103.595085:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d2204624b40 x1874676443929728/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787831119 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787831103.595097:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204624b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3622:1874676443929728:0@lo:400:kworker.0 00010000:00080000:2.0:1787831103.595476:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d2314ed43c0 x1874676443930240/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787831119 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787831103.595489:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2314ed43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3620:1874676443930240:0@lo:400:kworker.0 00000100:00100000:1.0:1787831103.720836:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2314ed4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443930368:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787831103.721000:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831103.721387:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443930368 00000100:00100000:0.0:1787831103.721396:0:17110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443930368 00000100:00100000:0.0:1787831103.721518:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787831103.721606:0:17110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a22580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443930368:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787831103.721664:0:17110:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1787831103.721979:0:17110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a22580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443930368:12345-0@lo:41:osp-pre-0-1.0 Request processed in 377us (978us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831103.721989:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787831103.722024:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2314ed4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443930368:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787831104.424017:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787831104.743871:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787831104.743896:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2314ed4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443930496:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787831104.744165:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831104.744310:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443930496 00000100:00100000:1.0:1787831104.744319:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443930496 00000100:00100000:1.0:1787831104.744374:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787831104.744384:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203aff0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1874676443930496:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787831104.744422:0:17109:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787831104.744483:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203aff0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1874676443930496:12345-0@lo:41:osp-pre-1-0.0 Request processed in 100us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831104.744490:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787831104.744598:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2314ed4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443930496:0@lo:41:osp-pre-1-0.0 00000020:01000004:1.0:1787831104.894760:0:18603:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787831104.894764:0:18603:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:1.0:1787831104.894765:0:18603:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1787831104.895327:0:18603:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8d2202768800 00000020:01000004:1.0:1787831104.895356:0:18603:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1787831104.895370:0:18603:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1787831104.895386:0:18603:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8d233454b370) 00000020:00000080:1.0:1787831104.895403:0:18603:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1787831104.962794:0:18603:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1787831104.965088:0:18603:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1787831104.965615:0:18603:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1787831104.965908:0:18603:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1787831104.966133:0:18603:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1787831104.966393:0:18603:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1787831104.966694:0:18603:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:01000000:2.0:1787831104.968968:0:18603:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1787831104.969186:0:18603:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1787831104.969200:0:18603:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787831104.969287:0:18603:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x95459fb9d1d29c0b 00000020:01000004:2.0:1787831104.969294:0:18603:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1787831104.969317:0:18603:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.131@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787831104.969320:0:18603:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.131@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787831104.969326:0:18603:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1787831104.969330:0:18603:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1787831104.969353:0:18603:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8d2306c699b8) 00000020:00000080:2.0:1787831104.969365:0:18603:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:2.0:1787831104.977939:0:18603:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787831104.978158:0:18603:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1787831104.978165:0:18603:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1787831104.980913:0:18603:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1787831104.980927:0:18603:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1787831104.982021:0:18603:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1787831104.982032:0:18603:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1787831104.983452:0:18603:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787831104.983677:0:18603:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1787831104.983683:0:18603:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1787831104.984583:0:18603:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1787831104.984592:0:18603:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1787831105.037377:0:18603:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787831105.037601:0:18603:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1787831105.037608:0:18603:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1787831105.044135:0:18603:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1787831105.044150:0:18603:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1787831105.050551:0:18603:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1787831105.050569:0:18603:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1787831105.065257:0:18603:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787831105.065462:0:18603:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1787831105.065469:0:18603:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1787831105.067006:0:18603:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1787831105.067027:0:18603:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1787831105.135105:0:18603:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787831105.135316:0:18603:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1787831105.135333:0:18603:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1787831105.139113:0:18603:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1787831105.139140:0:18603:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1787831105.142207:0:18603:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1787831105.142242:0:18603:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:2.0:1787831105.142249:0:18603:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.131@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1787831105.152617:0:18603:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.131@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787831105.152737:0:18603:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.131@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1787831105.152741:0:18603:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787831105.152743:0:18603:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787831105.152744:0:18603:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787831105.152746:0:18603:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787831105.152747:0:18603:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787831105.152748:0:18603:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787831105.152750:0:18603:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787831105.152751:0:18603:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787831105.152752:0:18603:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787831105.152756:0:18603:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1787831105.152758:0:18603:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787831105.152759:0:18603:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787831105.152760:0:18603:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787831105.152761:0:18603:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787831105.152762:0:18603:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787831105.152763:0:18603:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787831105.152764:0:18603:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787831105.152765:0:18603:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787831105.152766:0:18603:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787831105.152792:0:18603:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787831105.152809:0:18603:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204706580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:18603:1874676443930624:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787831105.152891:0:18603:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831105.152979:0:18603:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d232f7e7540 going to sleep for 11 seconds 00000100:00100000:0.0:1787831105.153279:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443930624 00000100:00100000:0.0:1787831105.153285:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443930624 00000100:00100000:0.0:1787831105.153391:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787831105.153400:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233c0e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be45932f-3bcb-4e49-b61c-a2395180b0ee+18:18603:x1874676443930624:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787831105.153439:0:17098:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1787831105.153443:0:17098:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1787831105.153446:0:17098:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1787831105.153857:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233c0e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be45932f-3bcb-4e49-b61c-a2395180b0ee+18:18603:x1874676443930624:12345-0@lo:253:mount.lustre.0 Request processed in 456us (964us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831105.153873:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787831105.153944:0:18603:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204706580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:18603:1874676443930624:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787831105.153955:0:18603:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787831105.153964:0:18603:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787831105.153965:0:18603:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787831105.153966:0:18603:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787831105.153967:0:18603:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787831105.153968:0:18603:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787831105.153969:0:18603:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787831105.153970:0:18603:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787831105.153972:0:18603:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787831105.153973:0:18603:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787831105.153990:0:18603:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d2202768800 from lustre-OST0000 10000000:01000000:2.0:1787831105.154043:0:18603:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1787831105.154047:0:18603:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787831105.154055:0:18603:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8d2201e1cd28 local copy 00010000:00010000:2.0:1787831105.154066:0:18603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d23344b7200/0x95459fb9d1d299c6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d299cd expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831105.154161:0:18603:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204706580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:18603:1874676443930752:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787831105.154195:0:18603:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831105.154225:0:18603:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d232f7e7480 going to sleep for 11 seconds 00000100:00100000:3.0:1787831105.154336:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443930752 00000100:00100000:3.0:1787831105.154341:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443930752 00000100:00100000:3.0:1787831105.154371:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787831105.154378:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233c0ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be45932f-3bcb-4e49-b61c-a2395180b0ee+18:18603:x1874676443930752:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787831105.154887:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233c0ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be45932f-3bcb-4e49-b61c-a2395180b0ee+18:18603:x1874676443930752:12345-0@lo:501:mount.lustre.0 Request processed in 508us (689us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787831105.154895:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787831105.154948:0:18603:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204706580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:18603:1874676443930752:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1787831105.154967:0:18603:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.131@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787831105.154989:0:18603:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.131@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787831105.154997:0:18603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d23344b7200/0x95459fb9d1d299c6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d299cd expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831105.155006:0:18603:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8d23344b7200/0x95459fb9d1d299c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d299cd expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787831105.155102:0:18603:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d2202768800 10000000:01000000:2.0:1787831105.155108:0:18603:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787831105.155114:0:18603:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787831105.155140:0:18603:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787831105.155145:0:18603:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1787831105.155148:0:18603:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1787831105.155171:0:18603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d22039c1600/0x95459fb9d1d29c19 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831105.155180:0:18603:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8d22039c1600/0x95459fb9d1d29c19 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831105.155189:0:18603:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8d22039c1600/0x95459fb9d1d29c19 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831105.155204:0:18603:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204706580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:18603:1874676443930880:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787831105.155231:0:18603:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831105.155312:0:18603:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d232f7e7480 going to sleep for 11 seconds 00000100:00100000:0.0:1787831105.155779:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443930880 00000100:00100000:0.0:1787831105.155786:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443930880 00000100:00100000:0.0:1787831105.155827:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787831105.155836:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233be91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be45932f-3bcb-4e49-b61c-a2395180b0ee+18:18603:x1874676443930880:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787831105.155847:0:17098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787831105.155861:0:17098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2303aa2400/0x95459fb9d1d29c20 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d29c19 expref: -99 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831105.155993:0:17098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2303aa2400/0x95459fb9d1d29c20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d29c19 expref: 19 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831105.156004:0:17098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2303aa2400/0x95459fb9d1d29c20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d29c19 expref: 19 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831105.156013:0:17098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2303aa2400, rc 0) 00000100:00100000:1.0:1787831105.156062:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233be91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be45932f-3bcb-4e49-b61c-a2395180b0ee+19:18603:x1874676443930880:12345-0@lo:101:mount.lustre.0 Request processed in 229us (830us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831105.156069:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787831105.156125:0:18603:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204706580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:18603:1874676443930880:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787831105.156140:0:18603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8d22039c1600/0x95459fb9d1d29c19 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d29c20 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831105.156148:0:18603:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8d22039c1600/0x95459fb9d1d29c19 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d29c20 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787831105.157483:0:18603:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1787831105.158345:0:18603:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787831105.160964:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1787831105.161015:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1787831105.161030:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1787831105.161389:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1787831105.161407:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1787831105.161422:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1787831105.161459:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1787831105.161465:0:18603:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1787831105.161853:0:18603:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204706580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:18603:1874676443931008:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787831105.161929:0:18603:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831105.161980:0:18603:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d232f7e7600 going to sleep for 11 seconds 00000100:00100000:3.0:1787831105.162071:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443931008 00000100:00100000:3.0:1787831105.162079:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443931008 00000100:00100000:3.0:1787831105.162181:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787831105.162191:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233be90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be45932f-3bcb-4e49-b61c-a2395180b0ee+19:18603:x1874676443931008:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787831105.162374:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233be90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be45932f-3bcb-4e49-b61c-a2395180b0ee+19:18603:x1874676443931008:12345-0@lo:501:mount.lustre.0 Request processed in 185us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831105.162388:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787831105.162459:0:18603:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204706580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:18603:1874676443931008:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787831105.162493:0:18603:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204706580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:18603:1874676443931136:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787831105.162536:0:18603:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831105.163971:0:18603:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d232f7e7600 going to sleep for 11 seconds 00000100:00100000:0.0:1787831105.164092:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443931136 00000100:00100000:0.0:1787831105.164100:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443931136 00000100:00100000:0.0:1787831105.164314:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787831105.164323:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2308753c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be45932f-3bcb-4e49-b61c-a2395180b0ee+19:18603:x1874676443931136:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787831105.165516:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2308753c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be45932f-3bcb-4e49-b61c-a2395180b0ee+19:18603:x1874676443931136:12345-0@lo:503:mount.lustre.0 Request processed in 1188us (2973us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831105.165539:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787831105.165700:0:18603:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204706580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:18603:1874676443931136:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787831105.166211:0:18603:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787831105.166312:0:18603:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204706580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:18603:1874676443931264:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787831105.167255:0:18603:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831105.167400:0:18603:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d232f7e7480 going to sleep for 11 seconds 00000100:00100000:3.0:1787831105.168511:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443931264 00000100:00100000:3.0:1787831105.168522:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443931264 00000100:00100000:1.0:1787831105.168717:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787831105.168832:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2308752c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be45932f-3bcb-4e49-b61c-a2395180b0ee+19:18603:x1874676443931264:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787831105.169716:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2308752c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be45932f-3bcb-4e49-b61c-a2395180b0ee+19:18603:x1874676443931264:12345-0@lo:502:mount.lustre.0 Request processed in 988us (2461us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831105.169842:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787831105.169910:0:18603:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204706580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:18603:1874676443931264:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787831105.170147:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1787831105.170182:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1787831105.170197:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1787831105.170211:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1787831105.170224:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1787831105.170237:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1787831105.170250:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1787831105.170264:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1787831105.170278:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:2.0:1787831105.170291:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:2.0:1787831105.170305:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:2.0:1787831105.170318:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:2.0:1787831105.170439:0:18603:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204706580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:18603:1874676443931392:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787831105.170492:0:18603:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831105.170532:0:18603:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d232f7e7480 going to sleep for 11 seconds 00000100:00100000:0.0:1787831105.170595:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443931392 00000100:00100000:0.0:1787831105.170600:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443931392 00000100:00100000:0.0:1787831105.170667:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787831105.170676:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2308753450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be45932f-3bcb-4e49-b61c-a2395180b0ee+19:18603:x1874676443931392:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787831105.170773:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2308753450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be45932f-3bcb-4e49-b61c-a2395180b0ee+19:18603:x1874676443931392:12345-0@lo:502:mount.lustre.0 Request processed in 97us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831105.170780:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787831105.172333:0:18603:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204706580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:18603:1874676443931392:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787831105.172712:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:2.0:1787831105.172727:0:18603:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:2.0:1787831105.173822:0:18620:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787831105.173831:0:18620:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:2.0:1787831105.173837:0:18620:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787831105.173839:0:18620:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1787831105.173845:0:18620:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787831105.173859:0:18620:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8d2306c68000) 00000020:00000080:2.0:1787831105.173969:0:18620:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:2.0:1787831105.173979:0:18620:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787831105.174068:0:18620:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d2202768800 from lustre-OST0000, refs=2 00080000:01000000:2.0:1787831105.174077:0:18620:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787831105.174085:0:18620:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x95459fb9d1d29c2e 00010000:00010000:3.0:1787831105.184009:0:18620:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:3.0:1787831105.184809:0:18620:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:3.0:1787831105.191215:0:18620:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:1.0:1787831105.193350:0:18620:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1787831105.193361:0:18620:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787831105.193372:0:18620:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787831105.193374:0:18620:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1787831105.193378:0:18620:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787831105.193381:0:18620:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:1.0:1787831105.193382:0:18620:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787831105.193384:0:18620:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787831105.193385:0:18620:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787831105.193388:0:18620:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787831105.193389:0:18620:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787831105.193391:0:18620:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787831105.193394:0:18620:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787831105.193395:0:18620:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787831105.193398:0:18620:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787831105.193400:0:18620:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787831105.193402:0:18620:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787831105.193404:0:18620:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787831105.193405:0:18620:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787831105.193407:0:18620:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787831105.193409:0:18620:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787831105.193410:0:18620:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787831105.193413:0:18620:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1787831105.193456:0:18620:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787831105.193465:0:18620:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787831105.193467:0:18620:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787831105.193470:0:18620:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:2.0:1787831105.193650:0:18603:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1787831105.193684:0:18603:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1787831105.193702:0:18603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d22039c1600/0x95459fb9d1d29c19 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d29c20 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831105.193714:0:18603:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8d22039c1600/0x95459fb9d1d29c19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d29c20 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787831105.193722:0:18603:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d2202768800 from 1 10000000:01000000:2.0:1787831105.193724:0:18603:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787831105.193768:0:18603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d22039c0000/0x95459fb9d1d29c35 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831105.193787:0:18603:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8d22039c0000/0x95459fb9d1d29c35 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831105.193798:0:18603:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8d22039c0000/0x95459fb9d1d29c35 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831105.193833:0:18603:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204706580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:18603:1874676443931520:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787831105.193905:0:18603:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831105.193945:0:18603:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d232f7e7cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787831105.196604:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443931520 00000100:00100000:0.0:1787831105.196619:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443931520 00000100:00100000:0.0:1787831105.196727:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787831105.196745:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2308751850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be45932f-3bcb-4e49-b61c-a2395180b0ee+19:18603:x1874676443931520:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787831105.196763:0:17098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787831105.196780:0:17098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2303aa3c00/0x95459fb9d1d29c3c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d29c35 expref: -99 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831105.196808:0:17098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2303aa3c00/0x95459fb9d1d29c3c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d29c35 expref: 20 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831105.196820:0:17098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2303aa3c00/0x95459fb9d1d29c3c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d29c35 expref: 20 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831105.196829:0:17098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2303aa3c00, rc 0) 00000100:00100000:0.0:1787831105.196900:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2308751850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be45932f-3bcb-4e49-b61c-a2395180b0ee+20:18603:x1874676443931520:12345-0@lo:101:mount.lustre.0 Request processed in 159us (2995us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831105.196907:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787831105.197019:0:18603:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204706580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:18603:1874676443931520:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787831105.197038:0:18603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8d22039c0000/0x95459fb9d1d29c35 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d29c3c expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831105.197048:0:18603:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8d22039c0000/0x95459fb9d1d29c35 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d29c3c expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787831105.198858:0:18603:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1787831105.199150:0:18603:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787831105.199328:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1787831105.199355:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1787831105.199374:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1787831105.199380:0:18603:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1787831105.199446:0:18603:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204706580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:18603:1874676443931648:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787831105.199515:0:18603:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831105.199577:0:18603:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d232f7e7600 going to sleep for 11 seconds 00000100:00100000:1.0:1787831105.202619:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443931648 00000100:00100000:1.0:1787831105.202646:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443931648 00000100:00100000:1.0:1787831105.202697:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787831105.202706:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2308753850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be45932f-3bcb-4e49-b61c-a2395180b0ee+20:18603:x1874676443931648:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787831105.202879:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2308753850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be45932f-3bcb-4e49-b61c-a2395180b0ee+20:18603:x1874676443931648:12345-0@lo:501:mount.lustre.0 Request processed in 173us (3362us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831105.202886:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787831105.202927:0:18603:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204706580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:18603:1874676443931648:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787831105.202989:0:18603:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2314ed52c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:18603:1874676443931776:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787831105.203054:0:18603:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831105.203092:0:18603:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2303882540 going to sleep for 11 seconds 00000100:00100000:3.0:1787831105.203130:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443931776 00000100:00100000:3.0:1787831105.203135:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443931776 00000100:00100000:3.0:1787831105.203164:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787831105.203171:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2308752850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be45932f-3bcb-4e49-b61c-a2395180b0ee+20:18603:x1874676443931776:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787831105.203266:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2308752850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be45932f-3bcb-4e49-b61c-a2395180b0ee+20:18603:x1874676443931776:12345-0@lo:503:mount.lustre.0 Request processed in 95us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831105.203274:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787831105.203408:0:18603:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2314ed52c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:18603:1874676443931776:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787831105.204147:0:18603:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787831105.204235:0:18603:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a22940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:18603:1874676443931904:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787831105.204287:0:18603:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831105.204317:0:18603:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2307d75600 going to sleep for 11 seconds 00000100:00100000:0.0:1787831105.204872:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443931904 00000100:00100000:0.0:1787831105.204879:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443931904 00000100:00100000:0.0:1787831105.204923:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787831105.204931:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2308751c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be45932f-3bcb-4e49-b61c-a2395180b0ee+20:18603:x1874676443931904:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787831105.205066:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2308751c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be45932f-3bcb-4e49-b61c-a2395180b0ee+20:18603:x1874676443931904:12345-0@lo:502:mount.lustre.0 Request processed in 135us (778us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831105.205073:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787831105.205258:0:18603:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a22940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:18603:1874676443931904:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787831105.205853:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1787831105.205885:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1787831105.205899:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1787831105.205911:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1787831105.205922:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1787831105.205932:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1787831105.205945:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1787831105.205959:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:1.0:1787831105.205972:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1787831105.205984:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:1.0:1787831105.205997:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:1.0:1787831105.206027:0:18603:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a22940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:18603:1874676443932032:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787831105.206073:0:18603:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831105.206222:0:18603:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2303882540 going to sleep for 11 seconds 00000100:00100000:0.0:1787831105.206257:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443932032 00000100:00100000:0.0:1787831105.206268:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443932032 00000100:00100000:0.0:1787831105.206332:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787831105.206339:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2308750c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be45932f-3bcb-4e49-b61c-a2395180b0ee+20:18603:x1874676443932032:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787831105.206466:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2308750c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be45932f-3bcb-4e49-b61c-a2395180b0ee+20:18603:x1874676443932032:12345-0@lo:502:mount.lustre.0 Request processed in 127us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831105.206473:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787831105.206556:0:18603:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a22940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:18603:1874676443932032:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787831105.211349:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:0.0:1787831105.211713:0:18603:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1787831105.213832:0:18624:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787831105.213846:0:18624:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787831105.213849:0:18624:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787831105.213856:0:18624:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d2202768800 00000020:00000080:3.0:1787831105.213860:0:18624:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787831105.213868:0:18624:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787831105.213871:0:18624:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787831105.213872:0:18624:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787831105.213875:0:18624:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787831105.213878:0:18624:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787831105.213879:0:18624:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787831105.213883:0:18624:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d2202768800 00000020:00000080:3.0:1787831105.213886:0:18624:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787831105.214001:0:18624:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787831105.214005:0:18624:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787831105.214007:0:18624:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787831105.214009:0:18624:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787831105.214012:0:18624:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787831105.214014:0:18624:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787831105.214018:0:18624:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d2202768800 00000020:00000080:3.0:1787831105.214020:0:18624:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787831105.217941:0:18624:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787831105.217958:0:18624:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787831105.217960:0:18624:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787831105.217964:0:18624:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787831105.217969:0:18624:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787831105.217970:0:18624:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1787831105.217975:0:18624:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d2202768800 00000020:00000080:3.0:1787831105.217977:0:18624:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787831105.218042:0:18624:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787831105.218046:0:18624:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787831105.218047:0:18624:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1787831105.218051:0:18624:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:0.0:1787831105.223354:0:18603:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1787831105.223537:0:18603:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787831105.223802:0:18603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d22039c0000/0x95459fb9d1d29c35 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d29c3c expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831105.223813:0:18603:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8d22039c0000/0x95459fb9d1d29c35 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d29c3c expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787831105.223878:0:18603:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787831105.223881:0:18603:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d2202768800 10000000:01000000:0.0:1787831105.223885:0:18603:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d2202768800 10000000:01000000:0.0:1787831105.223889:0:18603:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787831105.223895:0:18603:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d2202768800 from 1 10000000:01000000:0.0:1787831105.223898:0:18603:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787831105.223935:0:18603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d2303aa3600/0x95459fb9d1d29c43 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831105.223945:0:18603:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8d2303aa3600/0x95459fb9d1d29c43 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831105.223956:0:18603:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8d2303aa3600/0x95459fb9d1d29c43 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831105.223993:0:18603:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2314ed70c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:18603:1874676443932160:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787831105.224070:0:18603:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831105.224133:0:18603:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d220257c480 going to sleep for 11 seconds 00000100:00100000:2.0:1787831105.226448:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443932160 00000100:00100000:2.0:1787831105.226461:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443932160 00000100:00100000:2.0:1787831105.226526:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787831105.226537:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2308750450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be45932f-3bcb-4e49-b61c-a2395180b0ee+20:18603:x1874676443932160:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787831105.226856:0:17096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787831105.226875:0:17096:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d22039c0200/0x95459fb9d1d29c4a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d29c43 expref: -99 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831105.226906:0:17096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22039c0200/0x95459fb9d1d29c4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d29c43 expref: 21 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831105.226917:0:17096:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d22039c0200/0x95459fb9d1d29c4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d29c43 expref: 21 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831105.226928:0:17096:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22039c0200, rc 0) 00000100:00100000:0.0:1787831105.227314:0:18603:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2314ed70c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:18603:1874676443932160:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787831105.227334:0:18603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8d2303aa3600/0x95459fb9d1d29c43 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d29c4a expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831105.227344:0:18603:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8d2303aa3600/0x95459fb9d1d29c43 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d29c4a expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831105.228092:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2308750450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be45932f-3bcb-4e49-b61c-a2395180b0ee+21:18603:x1874676443932160:12345-0@lo:101:mount.lustre.0 Request processed in 1555us (4019us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831105.228102:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000040:00080000:1.0:1787831105.230923:0:18603:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:1.0:1787831105.231266:0:18603:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787831105.231464:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1787831105.231494:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1787831105.231511:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1787831105.231526:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1787831105.231541:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1787831105.231917:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1787831105.231946:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1787831105.231960:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1787831105.231984:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1787831105.231996:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1787831105.232026:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1787831105.232042:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1787831105.232054:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1787831105.232066:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1787831105.232080:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1787831105.232093:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1787831105.232106:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1787831105.232130:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1787831105.232146:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1787831105.232160:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1787831105.232174:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1787831105.232187:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1787831105.232200:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1787831105.232213:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1787831105.232226:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:1.0:1787831105.232240:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:1.0:1787831105.232268:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:1.0:1787831105.232282:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:1.0:1787831105.232296:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:1.0:1787831105.232310:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:1.0:1787831105.232324:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:1.0:1787831105.232337:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:1.0:1787831105.232349:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:1.0:1787831105.232362:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:1.0:1787831105.232375:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:1.0:1787831105.232387:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:1.0:1787831105.232400:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:1.0:1787831105.232423:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:1.0:1787831105.232428:0:18603:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:1.0:1787831105.232527:0:18603:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a203c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:18603:1874676443932288:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787831105.232864:0:18603:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831105.232905:0:18603:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2307d75600 going to sleep for 11 seconds 00000100:00100000:0.0:1787831105.234285:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443932288 00000100:00100000:0.0:1787831105.234297:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443932288 00000100:00100000:0.0:1787831105.234364:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787831105.234374:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2308751450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be45932f-3bcb-4e49-b61c-a2395180b0ee+21:18603:x1874676443932288:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787831105.234548:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2308751450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be45932f-3bcb-4e49-b61c-a2395180b0ee+21:18603:x1874676443932288:12345-0@lo:501:mount.lustre.0 Request processed in 175us (1684us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831105.234556:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787831105.234852:0:18603:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a203c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:18603:1874676443932288:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787831105.234900:0:18603:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a203c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:18603:1874676443932416:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787831105.234947:0:18603:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831105.234985:0:18603:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2307d75600 going to sleep for 11 seconds 00000100:00100000:3.0:1787831105.235041:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443932416 00000100:00100000:3.0:1787831105.235046:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443932416 00000100:00100000:3.0:1787831105.235082:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787831105.235090:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2308752450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be45932f-3bcb-4e49-b61c-a2395180b0ee+22:18603:x1874676443932416:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787831105.235180:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2308752450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be45932f-3bcb-4e49-b61c-a2395180b0ee+22:18603:x1874676443932416:12345-0@lo:503:mount.lustre.0 Request processed in 89us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831105.235187:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787831105.235271:0:18603:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a203c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:18603:1874676443932416:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787831105.235846:0:18603:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787831105.235917:0:18603:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a203c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:18603:1874676443932544:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787831105.235959:0:18603:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831105.235992:0:18603:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d233be68780 going to sleep for 11 seconds 00000100:00100000:3.0:1787831105.236039:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443932544 00000100:00100000:3.0:1787831105.236043:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443932544 00000100:00100000:3.0:1787831105.236075:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787831105.236084:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220377e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be45932f-3bcb-4e49-b61c-a2395180b0ee+22:18603:x1874676443932544:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787831105.236185:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220377e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be45932f-3bcb-4e49-b61c-a2395180b0ee+21:18603:x1874676443932544:12345-0@lo:502:mount.lustre.0 Request processed in 102us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831105.236192:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787831105.236263:0:18603:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a203c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:18603:1874676443932544:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787831105.236424:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1787831105.236449:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1787831105.236481:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1787831105.236497:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1787831105.236513:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1787831105.236527:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1787831105.236540:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1787831105.236731:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1787831105.236750:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1787831105.236763:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1787831105.236775:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1787831105.236790:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1787831105.236801:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1787831105.236812:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1787831105.236825:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1787831105.236850:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1787831105.236865:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1787831105.236878:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1787831105.236904:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1787831105.236920:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1787831105.236933:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1787831105.236946:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1787831105.236958:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1787831105.236972:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1787831105.236985:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:1.0:1787831105.236998:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:1.0:1787831105.237012:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:1.0:1787831105.237023:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:1.0:1787831105.237034:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:1.0:1787831105.237048:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:1.0:1787831105.237061:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:1.0:1787831105.237074:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:1.0:1787831105.237088:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:1.0:1787831105.237101:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:1.0:1787831105.237142:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:1.0:1787831105.237159:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:1.0:1787831105.237172:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:1.0:1787831105.237185:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:1.0:1787831105.237197:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:1.0:1787831105.237210:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:1.0:1787831105.237223:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:1.0:1787831105.237236:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:1.0:1787831105.237247:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:1.0:1787831105.237260:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:1.0:1787831105.237274:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:1.0:1787831105.237287:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:1.0:1787831105.237300:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:1.0:1787831105.237313:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:1.0:1787831105.237361:0:18603:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a203c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:18603:1874676443932672:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787831105.237411:0:18603:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831105.239202:0:18603:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d233be68780 going to sleep for 11 seconds 00000100:00100000:3.0:1787831105.240598:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443932672 00000100:00100000:3.0:1787831105.240611:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443932672 00000100:00100000:3.0:1787831105.240686:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787831105.240698:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220377cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be45932f-3bcb-4e49-b61c-a2395180b0ee+21:18603:x1874676443932672:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787831105.240849:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220377cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be45932f-3bcb-4e49-b61c-a2395180b0ee+21:18603:x1874676443932672:12345-0@lo:502:mount.lustre.0 Request processed in 153us (3436us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831105.240857:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787831105.241863:0:18603:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a203c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:18603:1874676443932672:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787831105.242108:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:1.0:1787831105.242165:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:1.0:1787831105.242200:0:18603:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a203c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:18603:1874676443932800:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787831105.242256:0:18603:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831105.242291:0:18603:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d233be68780 going to sleep for 11 seconds 00000100:00100000:0.0:1787831105.243889:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443932800 00000100:00100000:0.0:1787831105.243900:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443932800 00000100:00100000:0.0:1787831105.243963:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787831105.243975:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220377d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be45932f-3bcb-4e49-b61c-a2395180b0ee+21:18603:x1874676443932800:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787831105.244149:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220377d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be45932f-3bcb-4e49-b61c-a2395180b0ee+21:18603:x1874676443932800:12345-0@lo:502:mount.lustre.0 Request processed in 176us (1892us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831105.244157:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787831105.246195:0:18603:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a203c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:18603:1874676443932800:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787831105.246462:0:18603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:0.0:1787831105.246478:0:18603:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1787831105.250216:0:18630:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1787831105.250235:0:18630:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8d23088a19b8) 00000020:00000080:0.0:1787831105.250259:0:18630:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:0.0:1787831105.250570:0:18630:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d2202768800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787831105.250576:0:18630:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d2202768800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787831105.250578:0:18630:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d2202768800 3 00010000:00080000:0.0:1787831105.250608:0:18630:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d23073ef800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.131@tcp at head 00010000:00010000:1.0:1787831105.252385:0:18630:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:1.0:1787831105.252572:0:18630:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1787831105.252620:0:18630:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787831105.252663:0:18630:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x95459fb9d1d29c58 00000100:00080000:1.0:1787831105.252674:0:18630:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787831105.252679:0:18630:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8d23073ef800 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:1.0:1787831105.252716:0:18630:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2203a20000 x1874676443932928/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787831105.252740:0:18630:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787831105.252945:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:0.0:1787831105.252949:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3618:1874676443932928:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1787831105.252951:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787831105.252956:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787831105.252960:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787831105.252987:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787831105.252990:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787831105.252992:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787831105.252995:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787831105.253028:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831105.253031:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203afe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443933056:0@lo:400:kworker.0 00000100:00100000:3.0:1787831105.253073:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831105.253098:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443932928 00000100:00100000:3.0:1787831105.253099:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787831105.253106:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443932928 00000100:00100000:3.0:1787831105.253109:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203afc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874676443933184:0@lo:400:kworker.0 00000100:00100000:3.0:1787831105.253145:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831105.253153:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787831105.253192:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203afd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443933312:0@lo:400:kworker.0 00000100:00100000:3.0:1787831105.253217:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831105.253233:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787831105.253237:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203afda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3621:1874676443933440:0@lo:400:kworker.0 00000100:00100000:3.0:1787831105.253257:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831105.253307:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2314ed70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3618:x1874676443932928:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787831105.253334:0:17104:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 396 last 0 00000020:00000080:0.0:1787831105.253368:0:17104:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x95459fb9d1d29c5f 00000004:00100000:0.0:1787831105.253384:0:17104:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787831105.253422:0:17104:0:(import.c:65:import_set_state_nolock()) ffff8d23073ed800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787831105.253471:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2314ed70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1874676443932928:12345-0@lo:38:llog_process_th.0 Request processed in 307us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831105.253479:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787831105.253495:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443933184 00000100:00100000:0.0:1787831105.253498:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443933184 00000100:00100000:0.0:1787831105.253516:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443933440 00000100:00100000:0.0:1787831105.253519:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443933440 00000100:00100000:0.0:1787831105.253531:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787831105.253537:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203afc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874676443933184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787831105.253741:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203afc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874676443933184:12345-0@lo:400:kworker.0 Request processed in 203us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831105.253749:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787831105.253763:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787831105.253769:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220442cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1874676443933440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787831105.253802:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220442cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1874676443933440:12345-0@lo:400:kworker.0 Request processed in 34us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831105.253807:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787831105.253831:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443933056 00000100:00100000:0.0:1787831105.253834:0:17110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443933056 00000100:00100000:0.0:1787831105.253848:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443933312 00000100:00100000:0.0:1787831105.253850:0:17110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443933312 00000100:00100000:0.0:1787831105.253862:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787831105.253868:0:17110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203aff840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676443933056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787831105.253899:0:17110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203aff840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676443933056:12345-0@lo:400:kworker.0 Request processed in 32us (827us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831105.253905:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787831105.253916:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787831105.253922:0:17110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203affc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443933312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787831105.253947:0:17110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203affc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443933312:12345-0@lo:400:kworker.0 Request processed in 26us (729us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831105.253954:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:3.0:1787831105.253998:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d2203afc3c0 x1874676443933184/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787831121 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1787831105.254007:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d2203afda40 x1874676443933440/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787831121 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787831105.254015:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203afc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874676443933184:0@lo:400:kworker.0 00000100:00100000:0.0:1787831105.254022:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203afda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3621:1874676443933440:0@lo:400:kworker.0 00000100:00100000:3.0:1787831105.254031:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203afe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443933056:0@lo:400:kworker.0 00000100:00100000:0.0:1787831105.254052:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203afd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443933312:0@lo:400:kworker.0 00010000:00080000:0.0:1787831105.254090:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d2203a20000 x1874676443932928/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787831115 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787831105.254098:0:3618:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787831105.254105:0:3618:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1787831105.254111:0:3618:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787831105.254134:0:3618:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787831105.254137:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8d23073ef800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787831105.254144:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3618:1874676443932928:0@lo:38:llog_process_th.0 00000020:01000004:3.0:1787831105.254756:0:18630:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1787831105.254773:0:18630:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff8d23344a19b8) 00000020:00000080:3.0:1787831105.254791:0:18630:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:3.0:1787831105.254878:0:18630:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d2202768800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1787831105.254883:0:18630:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d2202768800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1787831105.254885:0:18630:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d2202768800 3 00010000:00080000:3.0:1787831105.254911:0:18630:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d22034d4800@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.131@tcp at head 00010000:00010000:3.0:1787831105.262032:0:18630:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:3.0:1787831105.262236:0:18630:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:3.0:1787831105.262281:0:18630:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787831105.262296:0:18630:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x95459fb9d1d29c6d 00000100:00080000:3.0:1787831105.262307:0:18630:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787831105.262313:0:18630:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8d22034d4800 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:3.0:1787831105.262351:0:18630:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d220442ed00 x1874676443933568/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787831105.262378:0:18630:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1787831105.262409:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787831105.262421:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787831105.262424:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787831105.262427:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787831105.262431:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220442ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3618:1874676443933568:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1787831105.262432:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787831105.262442:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787831105.262446:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787831105.262449:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787831105.262512:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831105.262596:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443933568 00000100:00100000:0.0:1787831105.262603:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443933568 00000100:00100000:0.0:1787831105.262655:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787831105.262662:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2314ed7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3618:x1874676443933568:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787831105.262699:0:17104:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 396 last 0 00000020:00000080:0.0:1787831105.262736:0:17104:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x95459fb9d1d29c74 00000004:00100000:0.0:1787831105.266225:0:17104:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787831105.266327:0:17104:0:(import.c:65:import_set_state_nolock()) ffff8d220470d800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787831105.266647:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2314ed7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1874676443933568:12345-0@lo:38:llog_process_th.0 Request processed in 3895us (4047us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831105.266660:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1787831105.266818:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d220442ed00 x1874676443933568/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787831115 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787831105.266843:0:3618:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787831105.266852:0:3618:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1787831105.266860:0:3618:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787831105.266865:0:3618:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1787831105.266868:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8d22034d4800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787831105.266874:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220442ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3618:1874676443933568:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1787831105.267480:0:18630:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:0.0:1787831105.267871:0:18603:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1787831105.267900:0:18603:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787831105.267922:0:18603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d2303aa3600/0x95459fb9d1d29c43 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d29c4a expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831105.267933:0:18603:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8d2303aa3600/0x95459fb9d1d29c43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d29c4a expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787831105.267985:0:18603:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787831105.267987:0:18603:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787831105.267988:0:18603:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787831105.267990:0:18603:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787831105.267991:0:18603:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787831105.267992:0:18603:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787831105.267993:0:18603:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787831105.267995:0:18603:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787831105.267997:0:18603:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787831105.268000:0:18603:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1787831105.268002:0:18603:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787831105.268004:0:18603:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787831105.268005:0:18603:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787831105.268006:0:18603:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787831105.268007:0:18603:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787831105.268008:0:18603:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787831105.268009:0:18603:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787831105.268014:0:18603:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787831105.268014:0:18603:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787831105.268038:0:18603:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1787831105.268053:0:18603:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2314ed61c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:18603:1874676443933696:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787831105.268500:0:18603:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831105.268539:0:18603:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d220257c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787831105.268669:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443933696 00000100:00100000:1.0:1787831105.268676:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443933696 00000100:00100000:1.0:1787831105.268719:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787831105.268728:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220377dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be45932f-3bcb-4e49-b61c-a2395180b0ee+21:18603:x1874676443933696:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787831105.268757:0:17096:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1787831105.268772:0:17096:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1787831105.277339:0:17096:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787831105.277364:0:17096:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1787831105.277725:0:17120:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787831105.277731:0:17120:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787831105.277752:0:17120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d22039c1200/0x95459fb9d1d29c7b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831105.277772:0:17120:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2307c76400/0x95459fb9d1d29bcc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d29bc5 expref: 21 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831105.277780:0:17120:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d22039c0600/0x95459fb9d1d29bda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d29bd3 expref: 21 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831105.277788:0:17120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d22039c1200/0x95459fb9d1d29c7b lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831105.277826:0:17120:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d22039c0600/0x95459fb9d1d29bda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x95459fb9d1d29bd3 expref: 21 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831105.277847:0:17120:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d22039c0600/0x95459fb9d1d29bda lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x95459fb9d1d29bd3 expref: 21 pid: 17097 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831105.277860:0:17120:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204707840 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17120:1874676443933824:0@lo:104: 00000100:00100000:2.0:1787831105.277921:0:17120:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787831105.277973:0:17120:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2307c76400/0x95459fb9d1d29bcc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x95459fb9d1d29bc5 expref: 21 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831105.277982:0:17120:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d2307c76400/0x95459fb9d1d29bcc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x95459fb9d1d29bc5 expref: 21 pid: 17098 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831105.277990:0:17120:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204706580 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17120:1874676443933952:0@lo:104: 00000100:00100000:2.0:1787831105.278017:0:17120:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831105.278038:0:17120:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d232f7e7300 going to sleep for 11 seconds 00000100:00100000:1.0:1787831105.278142:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220377dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be45932f-3bcb-4e49-b61c-a2395180b0ee+21:18603:x1874676443933696:12345-0@lo:253:mount.lustre.0 Request processed in 9413us (9640us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831105.278154:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787831105.278659:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443933824 00000100:00100000:0.0:1787831105.278666:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443933824 00000100:00100000:0.0:1787831105.278706:0:17087:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787831105.278716:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443933952 00000100:00100000:0.0:1787831105.278718:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443933952 00000100:00100000:0.0:1787831105.278732:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787831105.278739:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204706d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:be45932f-3bcb-4e49-b61c-a2395180b0ee+4:17120:x1874676443933824:12345-0@lo:104: 00010000:00010000:0.0:1787831105.278751:0:17087:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff8d2303aa2200/0x95459fb9d1d29bd3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d29bda expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831105.278805:0:17087:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787831105.278810:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204706d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:be45932f-3bcb-4e49-b61c-a2395180b0ee+4:17120:x1874676443933824:12345-0@lo:104: Request processed in 72us (889us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831105.278816:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787831105.278828:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787831105.278834:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204755450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:be45932f-3bcb-4e49-b61c-a2395180b0ee+3:17120:x1874676443933952:12345-0@lo:104: 00010000:00010000:0.0:1787831105.278840:0:17087:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff8d2303aa2600/0x95459fb9d1d29bc5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d29bcc expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831105.278867:0:17093:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787831105.278871:0:17087:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:2.0:1787831105.278876:0:17093:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8d2303aa2200/0x95459fb9d1d29bd3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d29bda expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831105.278878:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204755450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:be45932f-3bcb-4e49-b61c-a2395180b0ee+3:17120:x1874676443933952:12345-0@lo:104: Request processed in 44us (859us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831105.278892:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1787831105.278893:0:17093:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2303aa2200 already unused, calling callback (ffffffffc14f9c20) 10000000:00010000:2.0:1787831105.278899:0:17093:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8d2303aa2200/0x95459fb9d1d29bd3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x95459fb9d1d29bda expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831105.278910:0:17093:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8d2303aa2200/0x95459fb9d1d29bd3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x95459fb9d1d29bda expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787831105.278918:0:17093:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8d2303aa2200/0x95459fb9d1d29bd3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x95459fb9d1d29bda expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787831105.278923:0:17093:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787831105.278934:0:17092:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787831105.278967:0:17093:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8d2303aa2200/0x95459fb9d1d29bd3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d29bda expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831105.278975:0:17093:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787831105.278997:0:17093:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8d2303aa2200/0x95459fb9d1d29bd3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d29bda expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831105.279004:0:17093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8d2303aa2200/0x95459fb9d1d29bd3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d29bda expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831105.279017:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787831105.279020:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787831105.279022:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787831105.279046:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:be45932f-3bcb-4e49-b61c-a2395180b0ee:3619:1874676443934080:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787831105.279046:0:18603:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2314ed61c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:18603:1874676443933696:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787831105.279064:0:18603:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1787831105.279069:0:18603:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787831105.279071:0:18603:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787831105.279073:0:18603:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787831105.279074:0:18603:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787831105.279076:0:18603:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787831105.279078:0:18603:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787831105.279079:0:18603:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787831105.279081:0:18603:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787831105.279083:0:18603:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1787831105.279089:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:02000000:0.0:1787831105.279096:0:18603:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1787831105.279163:0:17120:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204707840 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17120:1874676443933824:0@lo:104: 00000100:00100000:2.0:1787831105.279174:0:17120:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204706580 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17120:1874676443933952:0@lo:104: 00010000:00010000:2.0:1787831105.279195:0:17120:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d22039c1200/0x95459fb9d1d29c7b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831105.279739:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443934080 00000100:00100000:2.0:1787831105.279746:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443934080 00010000:00010000:2.0:1787831105.279770:0:17089:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d22039c0600/0x95459fb9d1d29bda lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d29bd3 expref: 21 pid: 17097 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831105.279797:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787831105.279804:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204705a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:be45932f-3bcb-4e49-b61c-a2395180b0ee+21:3619:x1874676443934080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787831105.279816:0:17089:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787831105.279822:0:17089:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d22039c0600/0x95459fb9d1d29bda lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d29bd3 expref: 21 pid: 17097 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831105.279839:0:17089:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d22039c0600/0x95459fb9d1d29bda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x95459fb9d1d29bd3 expref: 21 pid: 17097 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831105.279855:0:17089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d22039c0600/0x95459fb9d1d29bda lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x95459fb9d1d29bd3 expref: 21 pid: 17097 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831105.279869:0:17089:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787831105.279913:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204705a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:be45932f-3bcb-4e49-b61c-a2395180b0ee+20:3619:x1874676443934080:12345-0@lo:103:ldlm_bl.0 Request processed in 109us (825us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831105.279920:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787831105.280082:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:be45932f-3bcb-4e49-b61c-a2395180b0ee:3619:1874676443934080:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787831105.280152:0:18633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787831105.280161:0:17092:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8d2303aa2600/0x95459fb9d1d29bc5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d29bcc expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831105.280168:0:17092:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2303aa2600 already unused, calling callback (ffffffffc14f9c20) 10000000:00010000:2.0:1787831105.280172:0:17092:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8d2303aa2600/0x95459fb9d1d29bc5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x95459fb9d1d29bcc expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831105.280181:0:17092:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8d2303aa2600/0x95459fb9d1d29bc5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x95459fb9d1d29bcc expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787831105.280188:0:17092:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8d2303aa2600/0x95459fb9d1d29bc5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x95459fb9d1d29bcc expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787831105.280195:0:17092:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787831105.280220:0:17092:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8d2303aa2600/0x95459fb9d1d29bc5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d29bcc expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831105.280237:0:17092:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787831105.280250:0:17092:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8d2303aa2600/0x95459fb9d1d29bc5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d29bcc expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831105.280257:0:17092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8d2303aa2600/0x95459fb9d1d29bc5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d29bcc expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831105.280273:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787831105.280275:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787831105.280279:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787831105.280299:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:be45932f-3bcb-4e49-b61c-a2395180b0ee:3620:1874676443934208:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787831105.280335:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787831105.280382:0:18633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787831105.280385:0:18633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787831105.281888:0:17088:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/1 left), rc = 0 00000100:00100000:1.0:1787831105.282823:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443934208 00000100:00100000:1.0:1787831105.282834:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443934208 00010000:00010000:1.0:1787831105.282888:0:17091:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2307c76400/0x95459fb9d1d29bcc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d29bc5 expref: 20 pid: 17098 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831105.282927:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787831105.282938:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233c0e9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:be45932f-3bcb-4e49-b61c-a2395180b0ee+20:3620:x1874676443934208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787831105.282953:0:17091:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787831105.282959:0:17091:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2307c76400/0x95459fb9d1d29bcc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d29bc5 expref: 20 pid: 17098 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831105.282975:0:17091:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2307c76400/0x95459fb9d1d29bcc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x95459fb9d1d29bc5 expref: 20 pid: 17098 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831105.282995:0:17091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2307c76400/0x95459fb9d1d29bcc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x95459fb9d1d29bc5 expref: 20 pid: 17098 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831105.283010:0:17091:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d22039c1200/0x95459fb9d1d29c7b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831105.283019:0:17091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22039c1200/0x95459fb9d1d29c7b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787831105.283038:0:17091:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006287325s 00010000:00010000:1.0:1787831105.283043:0:17091:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d22039c1200/0x95459fb9d1d29c7b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831105.283050:0:17091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d22039c1200/0x95459fb9d1d29c7b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831105.283065:0:17091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d22039c1200/0x95459fb9d1d29c7b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831105.283071:0:17091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d22039c1200/0x95459fb9d1d29c7b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831105.283077:0:17091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22039c1200 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:1.0:1787831105.283081:0:17091:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d22039c1200/0x95459fb9d1d29c7b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831105.283091:0:17091:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d22039c1200/0x95459fb9d1d29c7b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831105.283129:0:17091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d22039c1200/0x95459fb9d1d29c7b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831105.283142:0:17091:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787831105.283241:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233c0e9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:be45932f-3bcb-4e49-b61c-a2395180b0ee+19:3620:x1874676443934208:12345-0@lo:103:ldlm_bl.0 Request processed in 304us (2903us total) trans 0 rc 0/0 00010000:00010000:2.0:1787831105.283245:0:17120:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d22039c1200/0x95459fb9d1d29c7b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831105.283253:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1787831105.283262:0:17120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d22039c1200/0x95459fb9d1d29c7b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831105.283272:0:17120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d22039c1200/0x95459fb9d1d29c7b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787831105.283277:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:be45932f-3bcb-4e49-b61c-a2395180b0ee:3620:1874676443934208:0@lo:103:ldlm_bl.0 00000001:00000004:2.0:1787831105.285828:0:18603:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1787831105.290793:0:18603:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1787831105.290803:0:18603:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1787831105.290843:0:18603:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787831105.290895:0:18603:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.131@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787831105.290916:0:18603:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1787831105.290954:0:18603:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:2.0:1787831105.291701:0:18603:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787831105.291902:0:18603:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787831105.448298:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787831105.704368:0:17855:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1787831105.704941:0:17139:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:3.0:1787831106.054912:0:18683:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787831106.055153:0:18683:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787831106.470740:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787831107.175852:0:17102:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787831107.175860:0:17102:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d233f43f000 from 9 10000000:01000000:2.0:1787831107.175865:0:17102:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787831107.175913:0:17102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d22039c0800/0x95459fb9d1d29c82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831107.175926:0:17102:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8d22039c0800/0x95459fb9d1d29c82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831107.175938:0:17102:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8d22039c0800/0x95459fb9d1d29c82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831107.175963:0:17102:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22047052c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be45932f-3bcb-4e49-b61c-a2395180b0ee:17102:1874676443934336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787831107.176036:0:17102:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831107.176078:0:17102:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2334484840 going to sleep for 11 seconds 00000100:00100000:0.0:1787831107.176263:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443934336 00000100:00100000:0.0:1787831107.176271:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443934336 00000100:00100000:0.0:1787831107.176323:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787831107.176333:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220377c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be45932f-3bcb-4e49-b61c-a2395180b0ee+19:17102:x1874676443934336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787831107.176352:0:17097:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787831107.176370:0:17097:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2303aa3800/0x95459fb9d1d29c89 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d29c82 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831107.176395:0:17097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2303aa3800/0x95459fb9d1d29c89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d29c82 expref: 20 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831107.176405:0:17097:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2303aa3800/0x95459fb9d1d29c89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d29c82 expref: 20 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831107.176413:0:17097:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2303aa3800, rc 0) 00000100:00100000:0.0:1787831107.176466:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220377c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be45932f-3bcb-4e49-b61c-a2395180b0ee+20:17102:x1874676443934336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831107.176489:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787831107.176569:0:17102:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22047052c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be45932f-3bcb-4e49-b61c-a2395180b0ee:17102:1874676443934336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787831107.176586:0:17102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8d22039c0800/0x95459fb9d1d29c82 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d29c89 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831107.176594:0:17102:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8d22039c0800/0x95459fb9d1d29c82 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d29c89 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831107.176673:0:17102:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22047052c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be45932f-3bcb-4e49-b61c-a2395180b0ee:17102:1874676443934464:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787831107.176707:0:17102:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831107.176737:0:17102:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2334484840 going to sleep for 11 seconds 00000100:00100000:0.0:1787831107.176861:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443934464 00000100:00100000:0.0:1787831107.176865:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443934464 00000100:00100000:0.0:1787831107.176898:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787831107.176905:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220377d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be45932f-3bcb-4e49-b61c-a2395180b0ee+20:17102:x1874676443934464:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787831107.176918:0:17096:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787831107.176935:0:17096:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787831107.176939:0:17096:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:0.0:1787831107.177013:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220377d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be45932f-3bcb-4e49-b61c-a2395180b0ee+20:17102:x1874676443934464:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 108us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831107.177020:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787831107.177085:0:17102:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22047052c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be45932f-3bcb-4e49-b61c-a2395180b0ee:17102:1874676443934464:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787831107.177157:0:17102:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787831107.177165:0:17102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d22039c0800/0x95459fb9d1d29c82 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d29c89 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831107.177175:0:17102:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8d22039c0800/0x95459fb9d1d29c82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d29c89 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787831107.177184:0:17102:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787831107.177186:0:17102:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d23115b5000 from 9 10000000:01000000:2.0:1787831107.177189:0:17102:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787831107.177207:0:17102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d22039c1800/0x95459fb9d1d29c90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831107.177215:0:17102:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8d22039c1800/0x95459fb9d1d29c90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831107.177222:0:17102:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8d22039c1800/0x95459fb9d1d29c90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831107.177235:0:17102:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22047052c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be45932f-3bcb-4e49-b61c-a2395180b0ee:17102:1874676443934592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787831107.177275:0:17102:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831107.177296:0:17102:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2338238480 going to sleep for 11 seconds 00000100:00100000:0.0:1787831107.177375:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443934592 00000100:00100000:0.0:1787831107.177380:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443934592 00000100:00100000:0.0:1787831107.177407:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787831107.177414:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220377e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be45932f-3bcb-4e49-b61c-a2395180b0ee+20:17102:x1874676443934592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787831107.177421:0:17096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787831107.177430:0:17096:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2303aa3e00/0x95459fb9d1d29c97 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d29c90 expref: -99 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831107.177445:0:17096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2303aa3e00/0x95459fb9d1d29c97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d29c90 expref: 21 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831107.177453:0:17096:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2303aa3e00/0x95459fb9d1d29c97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d29c90 expref: 21 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831107.177459:0:17096:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2303aa3e00, rc 0) 00000100:00100000:0.0:1787831107.177489:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220377e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be45932f-3bcb-4e49-b61c-a2395180b0ee+21:17102:x1874676443934592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 76us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831107.177503:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787831107.177600:0:17102:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22047052c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be45932f-3bcb-4e49-b61c-a2395180b0ee:17102:1874676443934592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787831107.177611:0:17102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8d22039c1800/0x95459fb9d1d29c90 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d29c97 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831107.177619:0:17102:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8d22039c1800/0x95459fb9d1d29c90 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d29c97 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831107.177700:0:17102:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22047052c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be45932f-3bcb-4e49-b61c-a2395180b0ee:17102:1874676443934720:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787831107.177727:0:17102:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831107.177755:0:17102:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2338238480 going to sleep for 11 seconds 00000100:00100000:1.0:1787831107.178037:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443934720 00000100:00100000:1.0:1787831107.178042:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443934720 00000100:00100000:1.0:1787831107.178079:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787831107.178087:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220377f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be45932f-3bcb-4e49-b61c-a2395180b0ee+21:17102:x1874676443934720:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787831107.178111:0:17098:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787831107.178125:0:17098:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787831107.178128:0:17098:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:1.0:1787831107.178207:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220377f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be45932f-3bcb-4e49-b61c-a2395180b0ee+21:17102:x1874676443934720:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 120us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831107.178221:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787831107.178418:0:17102:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22047052c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be45932f-3bcb-4e49-b61c-a2395180b0ee:17102:1874676443934720:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787831107.178476:0:17102:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787831107.178483:0:17102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d22039c1800/0x95459fb9d1d29c90 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d29c97 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831107.178491:0:17102:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8d22039c1800/0x95459fb9d1d29c90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d29c97 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831107.495010:0:18633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787831108.519426:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787831108.838875:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787831108.838908:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2314ed4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676443934848:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787831108.839005:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831108.839134:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443934848 00000100:00100000:0.0:1787831108.839145:0:17110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443934848 00000100:00100000:0.0:1787831108.839213:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787831108.839224:0:17110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22047052c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676443934848:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787831108.839269:0:17110:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1787831108.839333:0:17110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22047052c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676443934848:12345-0@lo:41:osp-pre-0-1.0 Request processed in 111us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831108.839339:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787831108.839433:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2314ed4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676443934848:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787831109.355038:0:3618:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787831094/real 1787831094] req@ffff8d2204625a40 x1874676443926016/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787831109 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787831109.355067:0:3618:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d2204625a40 x1874676443926016/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787831109 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787831109.358934:0:3618:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787831094/real 1787831094] req@ffff8d2204624000 x1874676443926144/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787831109 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787831109.358963:0:3618:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d2204624000 x1874676443926144/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787831109 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787831109.358989:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8d233be52000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787831109.359007:0:3618:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787831109.359011:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204625a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1874676443926016:0@lo:8:kworker.0 00000100:00100000:0.0:1787831109.359097:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00080000:1.0:1787831109.359133:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787831109.359137:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1787831109.359139:0:37:0:(import.c:65:import_set_state_nolock()) ffff8d233be52000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787831109.359144:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 385 00000100:00080000:1.0:1787831109.359149:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787831109.359155:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d233be52000 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:1.0:1787831109.359174:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2203a23c00 x1874676443935232/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787831109.359183:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787831109.359186:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787831109.359347:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443935488:0@lo:400:kworker.0 00000100:00100000:0.0:1787831109.359413:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831109.359443:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a203c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:be45932f-3bcb-4e49-b61c-a2395180b0ee:3621:1874676443934976:0@lo:400:kworker.0 00000100:00100000:0.0:1787831109.359470:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831109.359515:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443935488 00000100:00100000:0.0:1787831109.359522:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443935488 00000100:00100000:0.0:1787831109.359561:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787831109.359570:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2314ed6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443935488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787831109.359651:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2314ed6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443935488:12345-0@lo:400:kworker.0 Request processed in 54us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831109.359669:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787831109.359693:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443934976 00000100:00100000:0.0:1787831109.359697:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443934976 00000100:00100000:0.0:1787831109.359722:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787831109.359729:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233f45a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be45932f-3bcb-4e49-b61c-a2395180b0ee+21:3621:x1874676443934976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787831109.359760:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233f45a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be45932f-3bcb-4e49-b61c-a2395180b0ee+21:3621:x1874676443934976:12345-0@lo:400:kworker.0 Request processed in 32us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831109.359766:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787831109.359815:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443935488:0@lo:400:kworker.0 00000100:00100000:0.0:1787831109.359824:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a203c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:be45932f-3bcb-4e49-b61c-a2395180b0ee:3621:1874676443934976:0@lo:400:kworker.0 00000100:00080000:1.0:1787831109.360106:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787831109.360111:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787831109.360114:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787831109.360118:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787831109.360167:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a22d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3622:1874676443935616:0@lo:400:kworker.0 00000100:00100000:1.0:1787831109.360201:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831109.360246:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a22940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443935104:0@lo:400:kworker.0 00000100:00100000:1.0:1787831109.360272:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831109.360287:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a203c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3619:1874676443935744:0@lo:400:kworker.0 00000100:00100000:1.0:1787831109.360311:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831109.360329:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787831109.360335:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a20f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874676443935360:0@lo:400:kworker.0 00000100:00100000:1.0:1787831109.360356:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831109.360373:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3619:1874676443935872:0@lo:400:kworker.0 00000100:00100000:1.0:1787831109.360396:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831109.360425:0:18518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443935616 00000100:00100000:1.0:1787831109.360429:0:18518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443935616 00000100:00100000:1.0:1787831109.360451:0:18518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443935744 00000100:00100000:1.0:1787831109.360454:0:18518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443935744 00000100:00100000:1.0:1787831109.360473:0:18518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443935360 00000100:00100000:1.0:1787831109.360476:0:18518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443935360 00000100:00100000:1.0:1787831109.360485:0:18518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443935872 00000100:00100000:1.0:1787831109.360487:0:18518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443935872 00000100:00100000:1.0:1787831109.360501:0:18518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787831109.360508:0:18518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22046252c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1874676443935616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787831109.360545:0:18518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22046252c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1874676443935616:12345-0@lo:400:kworker.0 Request processed in 38us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831109.360552:0:18518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787831109.360564:0:18518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787831109.360570:0:18518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204627c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874676443935744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787831109.360614:0:18518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204627c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874676443935744:12345-0@lo:400:kworker.0 Request processed in 43us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831109.360621:0:18518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787831109.360657:0:18518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787831109.360662:0:18518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204626d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874676443935360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787831109.360688:0:18518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204626d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874676443935360:12345-0@lo:400:kworker.0 Request processed in 26us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831109.360693:0:18518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787831109.360703:0:18518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787831109.360709:0:18518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204627480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874676443935872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787831109.360734:0:18518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204627480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874676443935872:12345-0@lo:400:kworker.0 Request processed in 25us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831109.360740:0:18518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1787831109.360771:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2203a22d00 x1874676443935616/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787831125 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787831109.360782:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a22d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3622:1874676443935616:0@lo:400:kworker.0 00010000:00080000:1.0:1787831109.360804:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2203a20f00 x1874676443935360/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787831125 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787831109.360812:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a20f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874676443935360:0@lo:400:kworker.0 00010000:00080000:1.0:1787831109.360820:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2203a20000 x1874676443935872/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787831125 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787831109.360828:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3619:1874676443935872:0@lo:400:kworker.0 00010000:00080000:1.0:1787831109.360836:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2203a203c0 x1874676443935744/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787831125 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787831109.360849:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a203c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3619:1874676443935744:0@lo:400:kworker.0 00000100:00080000:1.0:1787831109.360869:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8d2303f2a800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787831109.360880:0:3618:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787831109.360884:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204624000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1874676443926144:0@lo:8:kworker.0 00000100:00080000:1.0:1787831109.360904:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787831109.360907:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787831109.360909:0:37:0:(import.c:65:import_set_state_nolock()) ffff8d2303f2a800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787831109.360913:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 385 00000100:00080000:1.0:1787831109.360916:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787831109.360921:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d2303f2a800 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:1.0:1787831109.360940:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2204624000 x1874676443936000/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787831109.360951:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787831109.360954:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787831109.360956:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787831109.360959:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787831109.360971:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a23c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1874676443935232:0@lo:8:kworker.0 00000100:00100000:1.0:1787831109.361003:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831109.361037:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204624000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1874676443936000:0@lo:8:kworker.0 00000100:00100000:1.0:1787831109.361058:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831109.361114:0:18608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443935232 00000100:00100000:1.0:1787831109.361117:0:18608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443935232 00000100:00100000:1.0:1787831109.361138:0:18608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443936000 00000100:00100000:1.0:1787831109.361140:0:18608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443936000 00000100:00100000:1.0:1787831109.361148:0:18608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787831109.361152:0:18608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204625a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3618:x1874676443935232:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1787831109.361188:0:18608:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 400 last 0 00000020:00000080:1.0:1787831109.361213:0:18608:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x95459fb9d1d29c9e 00002000:00100000:1.0:1787831109.361226:0:18608:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8d2201d9b800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211393d ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1787831109.361230:0:18608:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1787831109.361233:0:18608:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1787831109.361386:0:18608:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787831109.361405:0:18608:0:(import.c:65:import_set_state_nolock()) ffff8d2201d9f800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787831109.361439:0:18608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204625a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3618:x1874676443935232:12345-0@lo:8:kworker.0 Request processed in 285us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831109.361445:0:18608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787831109.361457:0:18608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787831109.361461:0:18608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204624f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3618:x1874676443936000:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1787831109.361472:0:18608:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:3.0:1787831109.362787:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787831109.362794:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787831109.362899:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443935104 00000100:00100000:0.0:1787831109.362907:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443935104 00000100:00100000:0.0:1787831109.362946:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787831109.362953:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22046243c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676443935104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787831109.363024:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22046243c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676443935104:12345-0@lo:400:kworker.0 Request processed in 72us (2751us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831109.363031:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787831109.363076:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a22940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443935104:0@lo:400:kworker.0 00010000:00080000:0.0:1787831109.365775:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2203a23c00 x1874676443935232/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787831129 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787831109.365789:0:3618:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787831109.365800:0:3618:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1787831109.365809:0:3618:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787831109.365816:0:3618:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1787831109.365837:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8d233be52000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787831109.365867:0:3618:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787831109.365874:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a23c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1874676443935232:0@lo:8:kworker.0 00000004:00080000:3.0:1787831109.365992:0:17129:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x5:0x0] 00000100:00100000:3.0:1787831109.366015:0:17129:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220442cb40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17129:1874676443936256:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1787831109.366073:0:17129:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831109.366112:0:17129:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d22038d8c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787831109.366161:0:18609:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1787831109.366169:0:18609:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1787831109.366193:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220442e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443936128:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787831109.366220:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1787831109.368688:0:17128:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787831109.368790:0:17128:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 400369165323ns, next at 0ns, rc = 0 00080000:00080000:0.0:1787831109.368800:0:17128:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:0.0:1787831109.369784:0:18609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443936256 00000100:00100000:0.0:1787831109.369795:0:18609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443936256 00000100:00080000:0.0:1787831109.369854:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787831109.369972:0:18914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787831109.369982:0:18914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220442fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17129:x1874676443936256:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1787831109.371852:0:18914:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:0.0:1787831109.371862:0:18914:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:0.0:1787831109.371868:0:18914:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:6 to 0x280000401:33) 00000100:00100000:1.0:1787831109.373761:0:18611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443936128 00000100:00100000:1.0:1787831109.373775:0:18611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443936128 00000100:00100000:1.0:1787831109.373843:0:18611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787831109.373854:0:18611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2314ed4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3621:x1874676443936128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787831109.373884:0:18611:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1787831109.373978:0:18611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2314ed4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3621:x1874676443936128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (7755us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831109.373986:0:18611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787831109.374040:0:18608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204624f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3618:x1874676443936000:12345-0@lo:8:kworker.0 Request processed in 12576us (12979us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787831109.374063:0:18608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1787831109.377255:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8d2303f2a800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787831109.377266:0:3618:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787831109.377270:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204624000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1874676443936000:0@lo:8:kworker.0 00010000:00080000:3.0:1787831109.377522:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d220442e1c0 x1874676443936128/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787831125 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787831109.377546:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220442e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443936128:0@lo:13:osp-pre-0-0.0 00000004:00080000:2.0:1787831109.386873:0:17084:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:0.0:1787831109.387246:0:18914:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787831109.387256:0:18914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d24d21c/0x95459fb9d1d29ca5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.387274:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=400s v=(0 0) 00010000:00010000:0.0:1787831109.387279:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787831109.387285:0:18914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001d24d21c/0x95459fb9d1d29ca5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.387303:0:18914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001d24d21c/0x95459fb9d1d29ca5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.387313:0:18914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d24d21c/0x95459fb9d1d29ca5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.387327:0:18914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001d24d21c/0x95459fb9d1d29ca5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.387352:0:18914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787831109.387391:0:17092:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787831109.387400:0:17092:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001d24d21c/0x95459fb9d1d29ca5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831109.387412:0:17092:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2303aa2600 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:2.0:1787831109.387417:0:17092:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001d24d21c/0x95459fb9d1d29ca5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831109.387442:0:17092:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001d24d21c/0x95459fb9d1d29ca5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831109.387462:0:17092:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001d24d21c/0x95459fb9d1d29ca5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831109.387470:0:17092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001d24d21c/0x95459fb9d1d29ca5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831109.387492:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787831109.387494:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787831109.387496:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787831109.387694:0:18914:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787831109.387702:0:18914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009360e7aa/0x95459fb9d1d29cac lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.387721:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=400s v=(0 0) 00010000:00010000:0.0:1787831109.387724:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787831109.387729:0:18914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009360e7aa/0x95459fb9d1d29cac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.387739:0:18914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009360e7aa/0x95459fb9d1d29cac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.387748:0:18914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009360e7aa/0x95459fb9d1d29cac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.387756:0:18914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009360e7aa/0x95459fb9d1d29cac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.387775:0:18914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787831109.387792:0:18633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787831109.387798:0:18633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009360e7aa/0x95459fb9d1d29cac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831109.387807:0:18633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2303aa2200 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:2.0:1787831109.387811:0:18633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009360e7aa/0x95459fb9d1d29cac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831109.387820:0:18633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009360e7aa/0x95459fb9d1d29cac lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831109.387834:0:18633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009360e7aa/0x95459fb9d1d29cac lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831109.387855:0:18633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009360e7aa/0x95459fb9d1d29cac lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831109.387871:0:18633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787831109.387872:0:18633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787831109.387874:0:18633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787831109.388247:0:18914:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787831109.388253:0:18914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056a6f52d/0x95459fb9d1d29cb3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.388264:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=400s v=(0 0) 00010000:00010000:0.0:1787831109.388266:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787831109.388269:0:18914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056a6f52d/0x95459fb9d1d29cb3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.388277:0:18914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056a6f52d/0x95459fb9d1d29cb3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.388282:0:18914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056a6f52d/0x95459fb9d1d29cb3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.388286:0:18914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000056a6f52d/0x95459fb9d1d29cb3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.388305:0:18914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787831109.388328:0:17093:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787831109.388334:0:17093:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000056a6f52d/0x95459fb9d1d29cb3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831109.388342:0:17093:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233bf11a00 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:2.0:1787831109.388346:0:17093:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000056a6f52d/0x95459fb9d1d29cb3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831109.388355:0:17093:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000056a6f52d/0x95459fb9d1d29cb3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831109.388367:0:17093:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000056a6f52d/0x95459fb9d1d29cb3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831109.388375:0:17093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056a6f52d/0x95459fb9d1d29cb3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831109.388391:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787831109.388393:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787831109.388394:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787831109.388603:0:18914:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787831109.388610:0:18914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ca36c01a/0x95459fb9d1d29cba lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.388617:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=400s v=(0 0) 00010000:00010000:0.0:1787831109.388620:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787831109.388649:0:18914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ca36c01a/0x95459fb9d1d29cba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.388658:0:18914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ca36c01a/0x95459fb9d1d29cba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.388677:0:18914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ca36c01a/0x95459fb9d1d29cba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.388684:0:18914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ca36c01a/0x95459fb9d1d29cba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.388702:0:18914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787831109.388720:0:17092:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787831109.388726:0:17092:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ca36c01a/0x95459fb9d1d29cba lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831109.388734:0:17092:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233bf10e00 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:2.0:1787831109.388738:0:17092:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca36c01a/0x95459fb9d1d29cba lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831109.388746:0:17092:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca36c01a/0x95459fb9d1d29cba lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831109.388757:0:17092:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ca36c01a/0x95459fb9d1d29cba lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831109.388765:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787831109.388767:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787831109.388769:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787831109.388774:0:18914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ca36c01a/0x95459fb9d1d29cba lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787831109.389728:0:18914:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787831109.389738:0:18914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2f88c89/0x95459fb9d1d29cc1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.389750:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=400s v=(0 0) 00010000:00010000:0.0:1787831109.389754:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787831109.389759:0:18914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2f88c89/0x95459fb9d1d29cc1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.389771:0:18914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2f88c89/0x95459fb9d1d29cc1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.389779:0:18914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2f88c89/0x95459fb9d1d29cc1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.389809:0:18914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2f88c89/0x95459fb9d1d29cc1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.389830:0:18914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787831109.389851:0:18633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787831109.389858:0:18633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2f88c89/0x95459fb9d1d29cc1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831109.389867:0:18633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233bf11200 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:2.0:1787831109.389871:0:18633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2f88c89/0x95459fb9d1d29cc1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831109.389881:0:18633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2f88c89/0x95459fb9d1d29cc1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831109.389909:0:18633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2f88c89/0x95459fb9d1d29cc1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831109.389917:0:18633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2f88c89/0x95459fb9d1d29cc1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831109.389936:0:18633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787831109.389938:0:18633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787831109.389940:0:18633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787831109.390406:0:18914:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787831109.390413:0:18914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ebc62a4b/0x95459fb9d1d29cc8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.390424:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=400s v=(0 0) 00010000:00010000:0.0:1787831109.390428:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787831109.390433:0:18914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ebc62a4b/0x95459fb9d1d29cc8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.390444:0:18914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ebc62a4b/0x95459fb9d1d29cc8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.390453:0:18914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ebc62a4b/0x95459fb9d1d29cc8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.390461:0:18914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ebc62a4b/0x95459fb9d1d29cc8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.390483:0:18914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787831109.390666:0:17093:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787831109.390673:0:17093:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ebc62a4b/0x95459fb9d1d29cc8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831109.390681:0:17093:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233bf10200 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:2.0:1787831109.390686:0:17093:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ebc62a4b/0x95459fb9d1d29cc8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831109.390693:0:17093:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ebc62a4b/0x95459fb9d1d29cc8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831109.390707:0:17093:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ebc62a4b/0x95459fb9d1d29cc8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831109.390715:0:17093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ebc62a4b/0x95459fb9d1d29cc8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831109.390744:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787831109.390745:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787831109.390747:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787831109.390990:0:18914:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787831109.390997:0:18914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8fc040b/0x95459fb9d1d29ccf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.391012:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=400s v=(0 0) 00010000:00010000:0.0:1787831109.391016:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787831109.391020:0:18914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8fc040b/0x95459fb9d1d29ccf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.391030:0:18914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d8fc040b/0x95459fb9d1d29ccf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.391038:0:18914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8fc040b/0x95459fb9d1d29ccf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.391046:0:18914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d8fc040b/0x95459fb9d1d29ccf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.391067:0:18914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787831109.391115:0:17092:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787831109.391121:0:17092:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d8fc040b/0x95459fb9d1d29ccf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831109.391130:0:17092:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233bf10c00 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:2.0:1787831109.391133:0:17092:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8fc040b/0x95459fb9d1d29ccf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831109.391142:0:17092:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8fc040b/0x95459fb9d1d29ccf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831109.391153:0:17092:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d8fc040b/0x95459fb9d1d29ccf lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831109.391162:0:17092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d8fc040b/0x95459fb9d1d29ccf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831109.391176:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787831109.391178:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787831109.391180:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787831109.392363:0:18914:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787831109.392375:0:18914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d08b8527/0x95459fb9d1d29cd6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.392387:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=400s v=(0 0) 00010000:00010000:0.0:1787831109.392391:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787831109.392403:0:18914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d08b8527/0x95459fb9d1d29cd6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.392414:0:18914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d08b8527/0x95459fb9d1d29cd6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.392436:0:18914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d08b8527/0x95459fb9d1d29cd6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.392444:0:18914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d08b8527/0x95459fb9d1d29cd6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.392468:0:18914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787831109.392502:0:18633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787831109.392516:0:18633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d08b8527/0x95459fb9d1d29cd6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831109.392525:0:18633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233bf10000 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:3.0:1787831109.392529:0:18633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d08b8527/0x95459fb9d1d29cd6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831109.392537:0:18633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d08b8527/0x95459fb9d1d29cd6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831109.392557:0:18633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d08b8527/0x95459fb9d1d29cd6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831109.392565:0:18633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d08b8527/0x95459fb9d1d29cd6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831109.392584:0:18633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787831109.392586:0:18633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787831109.392587:0:18633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787831109.393268:0:18914:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787831109.393276:0:18914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d2c49235/0x95459fb9d1d29cdd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.393288:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=400s v=(0 0) 00010000:00010000:0.0:1787831109.393291:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787831109.393296:0:18914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d2c49235/0x95459fb9d1d29cdd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.393306:0:18914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d2c49235/0x95459fb9d1d29cdd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.393316:0:18914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d2c49235/0x95459fb9d1d29cdd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.393324:0:18914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d2c49235/0x95459fb9d1d29cdd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.393362:0:18914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787831109.393667:0:17093:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787831109.393675:0:17093:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d2c49235/0x95459fb9d1d29cdd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831109.393683:0:17093:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233bf11e00 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:3.0:1787831109.393687:0:17093:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d2c49235/0x95459fb9d1d29cdd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787831109.393698:0:18914:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787831109.393711:0:17093:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d2c49235/0x95459fb9d1d29cdd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831109.393726:0:17093:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d2c49235/0x95459fb9d1d29cdd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831109.393733:0:17093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d2c49235/0x95459fb9d1d29cdd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831109.393749:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787831109.393751:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787831109.393752:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787831109.394262:0:18914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e6fafee/0x95459fb9d1d29ce4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.394275:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=400s v=(0 0) 00010000:00010000:0.0:1787831109.394278:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787831109.394284:0:18914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e6fafee/0x95459fb9d1d29ce4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.394295:0:18914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009e6fafee/0x95459fb9d1d29ce4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.394304:0:18914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e6fafee/0x95459fb9d1d29ce4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.394310:0:18914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009e6fafee/0x95459fb9d1d29ce4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.394335:0:18914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787831109.394366:0:17092:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787831109.394373:0:17092:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009e6fafee/0x95459fb9d1d29ce4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831109.394380:0:17092:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233bf10a00 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:3.0:1787831109.394384:0:17092:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009e6fafee/0x95459fb9d1d29ce4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831109.394391:0:17092:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009e6fafee/0x95459fb9d1d29ce4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831109.394405:0:17092:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009e6fafee/0x95459fb9d1d29ce4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831109.394424:0:17092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e6fafee/0x95459fb9d1d29ce4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831109.394442:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787831109.394443:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787831109.394445:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787831109.394795:0:18914:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787831109.394802:0:18914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000188990d4/0x95459fb9d1d29ceb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.394813:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=400s v=(0 0) 00010000:00010000:0.0:1787831109.394822:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787831109.394827:0:18914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000188990d4/0x95459fb9d1d29ceb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.394838:0:18914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000188990d4/0x95459fb9d1d29ceb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.394847:0:18914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000188990d4/0x95459fb9d1d29ceb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.394865:0:18914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000188990d4/0x95459fb9d1d29ceb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.394884:0:18914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787831109.395116:0:18633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787831109.395122:0:18633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000188990d4/0x95459fb9d1d29ceb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831109.395130:0:18633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233bf11600 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:3.0:1787831109.395133:0:18633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000188990d4/0x95459fb9d1d29ceb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831109.395141:0:18633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000188990d4/0x95459fb9d1d29ceb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831109.395154:0:18633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000188990d4/0x95459fb9d1d29ceb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831109.395160:0:18633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000188990d4/0x95459fb9d1d29ceb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831109.395174:0:18633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787831109.395176:0:18633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787831109.395177:0:18633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787831109.395512:0:18914:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787831109.395519:0:18914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032c42f53/0x95459fb9d1d29cf2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.395529:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=400s v=(0 0) 00010000:00010000:0.0:1787831109.395532:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787831109.395537:0:18914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032c42f53/0x95459fb9d1d29cf2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.395547:0:18914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000032c42f53/0x95459fb9d1d29cf2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.395556:0:18914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032c42f53/0x95459fb9d1d29cf2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.395572:0:18914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000032c42f53/0x95459fb9d1d29cf2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.395593:0:18914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787831109.395673:0:17093:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787831109.395679:0:17093:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000032c42f53/0x95459fb9d1d29cf2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831109.395687:0:17093:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233bf11800 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:3.0:1787831109.395690:0:17093:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000032c42f53/0x95459fb9d1d29cf2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831109.395699:0:17093:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000032c42f53/0x95459fb9d1d29cf2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831109.395711:0:17093:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000032c42f53/0x95459fb9d1d29cf2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831109.395718:0:17093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032c42f53/0x95459fb9d1d29cf2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831109.395733:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787831109.395734:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787831109.395736:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787831109.396017:0:18914:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787831109.396023:0:18914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000509b85e5/0x95459fb9d1d29cf9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.396032:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=400s v=(0 0) 00010000:00010000:0.0:1787831109.396035:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787831109.396039:0:18914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000509b85e5/0x95459fb9d1d29cf9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.396048:0:18914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000509b85e5/0x95459fb9d1d29cf9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.396056:0:18914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000509b85e5/0x95459fb9d1d29cf9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.396062:0:18914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000509b85e5/0x95459fb9d1d29cf9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.396102:0:18914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787831109.396121:0:17092:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787831109.396128:0:17092:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000509b85e5/0x95459fb9d1d29cf9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831109.396137:0:17092:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233bf10800 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:3.0:1787831109.396140:0:17092:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000509b85e5/0x95459fb9d1d29cf9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831109.396162:0:17092:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000509b85e5/0x95459fb9d1d29cf9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831109.396174:0:17092:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000509b85e5/0x95459fb9d1d29cf9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831109.396182:0:17092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000509b85e5/0x95459fb9d1d29cf9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831109.396198:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787831109.396199:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787831109.396201:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787831109.396350:0:18914:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787831109.396356:0:18914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6e95077/0x95459fb9d1d29d00 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.396371:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=400s v=(0 0) 00010000:00010000:0.0:1787831109.396375:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787831109.396380:0:18914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6e95077/0x95459fb9d1d29d00 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.396390:0:18914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e6e95077/0x95459fb9d1d29d00 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.396398:0:18914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6e95077/0x95459fb9d1d29d00 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.396406:0:18914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e6e95077/0x95459fb9d1d29d00 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.396426:0:18914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787831109.396669:0:18633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787831109.396676:0:18633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e6e95077/0x95459fb9d1d29d00 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831109.396684:0:18633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233bf11000 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:3.0:1787831109.396688:0:18633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6e95077/0x95459fb9d1d29d00 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831109.396696:0:18633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6e95077/0x95459fb9d1d29d00 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787831109.396699:0:18914:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787831109.396712:0:18633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e6e95077/0x95459fb9d1d29d00 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831109.396732:0:18633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6e95077/0x95459fb9d1d29d00 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831109.396746:0:18633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787831109.396748:0:18633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787831109.396749:0:18633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787831109.396921:0:18914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000697613f/0x95459fb9d1d29d07 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.396930:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=400s v=(0 0) 00010000:00010000:0.0:1787831109.396933:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787831109.396938:0:18914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000697613f/0x95459fb9d1d29d07 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.396947:0:18914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000697613f/0x95459fb9d1d29d07 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.396969:0:18914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000697613f/0x95459fb9d1d29d07 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.396977:0:18914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000697613f/0x95459fb9d1d29d07 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.396999:0:18914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787831109.397115:0:17093:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787831109.397121:0:17093:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000697613f/0x95459fb9d1d29d07 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831109.397128:0:17093:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233bf10400 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:3.0:1787831109.397132:0:17093:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000697613f/0x95459fb9d1d29d07 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831109.397140:0:17093:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000697613f/0x95459fb9d1d29d07 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831109.397151:0:17093:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000697613f/0x95459fb9d1d29d07 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831109.397158:0:17093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000697613f/0x95459fb9d1d29d07 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831109.397172:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787831109.397173:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787831109.397174:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787831109.397284:0:18914:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787831109.397291:0:18914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003859dea3/0x95459fb9d1d29d0e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.397301:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=400s v=(0 0) 00010000:00010000:0.0:1787831109.397304:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787831109.397309:0:18914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003859dea3/0x95459fb9d1d29d0e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.397319:0:18914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003859dea3/0x95459fb9d1d29d0e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.397329:0:18914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003859dea3/0x95459fb9d1d29d0e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.397338:0:18914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003859dea3/0x95459fb9d1d29d0e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.397372:0:18914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787831109.397549:0:17092:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787831109.397555:0:17092:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003859dea3/0x95459fb9d1d29d0e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831109.397562:0:17092:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233bf11400 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:3.0:1787831109.397566:0:17092:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003859dea3/0x95459fb9d1d29d0e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831109.397574:0:17092:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003859dea3/0x95459fb9d1d29d0e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831109.397585:0:17092:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003859dea3/0x95459fb9d1d29d0e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831109.397592:0:17092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003859dea3/0x95459fb9d1d29d0e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831109.397650:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787831109.397653:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787831109.397654:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787831109.397671:0:18914:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787831109.397677:0:18914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ca36c01a/0x95459fb9d1d29d15 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.397686:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=400s v=(0 0) 00010000:00010000:0.0:1787831109.397689:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787831109.397694:0:18914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ca36c01a/0x95459fb9d1d29d15 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.397703:0:18914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ca36c01a/0x95459fb9d1d29d15 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.397723:0:18914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ca36c01a/0x95459fb9d1d29d15 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.397731:0:18914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ca36c01a/0x95459fb9d1d29d15 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.397751:0:18914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787831109.398125:0:18914:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787831109.398131:0:18914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4a63826/0x95459fb9d1d29d1c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.398140:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=400s v=(0 0) 00010000:00010000:0.0:1787831109.398150:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787831109.398154:0:18914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4a63826/0x95459fb9d1d29d1c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.398164:0:18914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e4a63826/0x95459fb9d1d29d1c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.398172:0:18914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4a63826/0x95459fb9d1d29d1c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.398179:0:18914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e4a63826/0x95459fb9d1d29d1c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.398193:0:18914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1787831109.399023:0:18914:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787831109.399033:0:18914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d29575cf/0x95459fb9d1d29d23 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831109.399044:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=400s v=(0 0) 00010000:00010000:1.0:1787831109.399048:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787831109.399053:0:18914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d29575cf/0x95459fb9d1d29d23 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831109.399064:0:18914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d29575cf/0x95459fb9d1d29d23 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831109.399073:0:18914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d29575cf/0x95459fb9d1d29d23 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831109.399081:0:18914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d29575cf/0x95459fb9d1d29d23 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831109.399103:0:18914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1787831109.399280:0:17093:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787831109.399287:0:17093:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ca36c01a/0x95459fb9d1d29d15 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831109.399294:0:17093:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233bf10e00 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:3.0:1787831109.399298:0:17093:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca36c01a/0x95459fb9d1d29d15 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831109.399319:0:17093:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca36c01a/0x95459fb9d1d29d15 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831109.399336:0:17093:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ca36c01a/0x95459fb9d1d29d15 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831109.399344:0:17093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ca36c01a/0x95459fb9d1d29d15 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831109.399363:0:17093:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787831109.399367:0:17093:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e4a63826/0x95459fb9d1d29d1c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831109.399373:0:17093:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233bf11c00 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:3.0:1787831109.399376:0:17093:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4a63826/0x95459fb9d1d29d1c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831109.399384:0:17093:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4a63826/0x95459fb9d1d29d1c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831109.399395:0:17093:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e4a63826/0x95459fb9d1d29d1c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831109.399402:0:17093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e4a63826/0x95459fb9d1d29d1c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831109.399429:0:17093:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787831109.399432:0:17093:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d29575cf/0x95459fb9d1d29d23 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831109.399439:0:17093:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d23344b7600 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:3.0:1787831109.399442:0:17093:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d29575cf/0x95459fb9d1d29d23 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831109.399450:0:17093:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d29575cf/0x95459fb9d1d29d23 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831109.399461:0:17093:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d29575cf/0x95459fb9d1d29d23 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831109.399468:0:17093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d29575cf/0x95459fb9d1d29d23 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831109.399481:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787831109.399483:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787831109.399485:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787831109.399492:0:18633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787831109.399497:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787831109.400302:0:18914:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787831109.400313:0:18914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bab5f199/0x95459fb9d1d29d2a lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831109.400337:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=400s v=(0 0) 00010000:00010000:1.0:1787831109.400341:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787831109.400347:0:18914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bab5f199/0x95459fb9d1d29d2a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831109.400359:0:18914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bab5f199/0x95459fb9d1d29d2a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831109.400368:0:18914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bab5f199/0x95459fb9d1d29d2a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831109.400375:0:18914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bab5f199/0x95459fb9d1d29d2a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831109.403145:0:18914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787831109.403450:0:17093:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787831109.403460:0:17093:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bab5f199/0x95459fb9d1d29d2a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831109.403485:0:17093:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d23344b7e00 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:3.0:1787831109.403490:0:17093:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bab5f199/0x95459fb9d1d29d2a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831109.403501:0:17093:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bab5f199/0x95459fb9d1d29d2a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831109.403522:0:17093:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bab5f199/0x95459fb9d1d29d2a lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831109.403530:0:17093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bab5f199/0x95459fb9d1d29d2a lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831109.403550:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787831109.403552:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787831109.403554:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787831109.403714:0:18914:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787831109.403721:0:18914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc618567/0x95459fb9d1d29d31 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831109.403733:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=400s v=(0 0) 00010000:00010000:1.0:1787831109.403737:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787831109.403744:0:18914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bc618567/0x95459fb9d1d29d31 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831109.403755:0:18914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bc618567/0x95459fb9d1d29d31 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831109.403775:0:18914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc618567/0x95459fb9d1d29d31 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831109.403782:0:18914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bc618567/0x95459fb9d1d29d31 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831109.403799:0:18914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787831109.403967:0:18633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787831109.403974:0:18633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bc618567/0x95459fb9d1d29d31 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.403984:0:18633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d23344b6e00 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:0.0:1787831109.403995:0:18633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc618567/0x95459fb9d1d29d31 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.404008:0:18633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc618567/0x95459fb9d1d29d31 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.404022:0:18633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bc618567/0x95459fb9d1d29d31 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.404043:0:18633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bc618567/0x95459fb9d1d29d31 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.404059:0:18633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787831109.404061:0:18633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787831109.404063:0:18633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787831109.404128:0:18914:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787831109.404134:0:18914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000903060dd/0x95459fb9d1d29d38 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831109.404143:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=400s v=(0 0) 00010000:00010000:1.0:1787831109.404146:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787831109.404150:0:18914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000903060dd/0x95459fb9d1d29d38 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831109.404159:0:18914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000903060dd/0x95459fb9d1d29d38 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831109.404166:0:18914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000903060dd/0x95459fb9d1d29d38 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831109.404171:0:18914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000903060dd/0x95459fb9d1d29d38 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831109.404201:0:18914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787831109.404309:0:17092:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787831109.404315:0:17092:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000903060dd/0x95459fb9d1d29d38 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831109.404324:0:17092:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d23344b6a00 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:3.0:1787831109.404327:0:17092:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000903060dd/0x95459fb9d1d29d38 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831109.404334:0:17092:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000903060dd/0x95459fb9d1d29d38 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831109.404352:0:17092:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000903060dd/0x95459fb9d1d29d38 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831109.404358:0:17092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000903060dd/0x95459fb9d1d29d38 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831109.404371:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787831109.404373:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787831109.404374:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787831109.404619:0:18914:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787831109.404746:0:18914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000920a8703/0x95459fb9d1d29d3f lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831109.404756:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=400s v=(0 0) 00010000:00010000:1.0:1787831109.404760:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787831109.404764:0:18914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000920a8703/0x95459fb9d1d29d3f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831109.404774:0:18914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000920a8703/0x95459fb9d1d29d3f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831109.404783:0:18914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000920a8703/0x95459fb9d1d29d3f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831109.404790:0:18914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000920a8703/0x95459fb9d1d29d3f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831109.404840:0:18914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787831109.405140:0:18914:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787831109.405146:0:18914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000039b296cc/0x95459fb9d1d29d46 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831109.405155:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=400s v=(0 0) 00010000:00010000:1.0:1787831109.405163:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787831109.405168:0:18914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000039b296cc/0x95459fb9d1d29d46 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831109.405177:0:18914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000039b296cc/0x95459fb9d1d29d46 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831109.405186:0:18914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000039b296cc/0x95459fb9d1d29d46 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831109.405192:0:18914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000039b296cc/0x95459fb9d1d29d46 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831109.408140:0:17093:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787831109.408154:0:17093:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000920a8703/0x95459fb9d1d29d3f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831109.408169:0:17093:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d23344b6600 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:3.0:1787831109.408174:0:17093:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000920a8703/0x95459fb9d1d29d3f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831109.408186:0:17093:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000920a8703/0x95459fb9d1d29d3f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831109.408208:0:17093:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000920a8703/0x95459fb9d1d29d3f lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831109.408217:0:17093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000920a8703/0x95459fb9d1d29d3f lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831109.408259:0:17093:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787831109.408263:0:17093:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000039b296cc/0x95459fb9d1d29d46 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831109.408270:0:17093:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d23344b6200 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:3.0:1787831109.408273:0:17093:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000039b296cc/0x95459fb9d1d29d46 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831109.408281:0:17093:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000039b296cc/0x95459fb9d1d29d46 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831109.408290:0:17093:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000039b296cc/0x95459fb9d1d29d46 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831109.408297:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787831109.408299:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787831109.408301:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787831109.408454:0:18633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787831109.408463:0:18914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787831109.408472:0:18914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000039b296cc/0x95459fb9d1d29d46 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787831109.409389:0:18914:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787831109.409398:0:18914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a8e188d/0x95459fb9d1d29d4d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.409410:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=400s v=(0 0) 00010000:00010000:0.0:1787831109.409415:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787831109.409420:0:18914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a8e188d/0x95459fb9d1d29d4d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.409433:0:18914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005a8e188d/0x95459fb9d1d29d4d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.409442:0:18914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a8e188d/0x95459fb9d1d29d4d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.409450:0:18914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005a8e188d/0x95459fb9d1d29d4d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.409471:0:18914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787831109.409823:0:18914:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787831109.409829:0:18914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4a63826/0x95459fb9d1d29d54 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.409838:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=400s v=(0 0) 00010000:00010000:0.0:1787831109.409841:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787831109.409845:0:18914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4a63826/0x95459fb9d1d29d54 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.409854:0:18914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e4a63826/0x95459fb9d1d29d54 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.409862:0:18914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4a63826/0x95459fb9d1d29d54 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.409868:0:18914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e4a63826/0x95459fb9d1d29d54 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.409888:0:18914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1787831109.410185:0:18914:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787831109.410191:0:18914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ca36c01a/0x95459fb9d1d29d5b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.410200:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=400s v=(0 0) 00010000:00010000:0.0:1787831109.410204:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787831109.410208:0:18914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ca36c01a/0x95459fb9d1d29d5b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.410228:0:18914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ca36c01a/0x95459fb9d1d29d5b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.410236:0:18914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ca36c01a/0x95459fb9d1d29d5b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.410243:0:18914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ca36c01a/0x95459fb9d1d29d5b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.410258:0:18914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1787831109.410272:0:18633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787831109.410277:0:18633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005a8e188d/0x95459fb9d1d29d4d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.410284:0:18633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233bf10600 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:0.0:1787831109.410288:0:18633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005a8e188d/0x95459fb9d1d29d4d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.410296:0:18633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005a8e188d/0x95459fb9d1d29d4d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.410310:0:18633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005a8e188d/0x95459fb9d1d29d4d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.410316:0:18633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005a8e188d/0x95459fb9d1d29d4d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.410339:0:18633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787831109.410342:0:18633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e4a63826/0x95459fb9d1d29d54 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.410348:0:18633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233bf11c00 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:0.0:1787831109.410350:0:18633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4a63826/0x95459fb9d1d29d54 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.410358:0:18633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4a63826/0x95459fb9d1d29d54 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.410366:0:18633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e4a63826/0x95459fb9d1d29d54 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.410373:0:18633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e4a63826/0x95459fb9d1d29d54 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.410382:0:18633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787831109.410385:0:18633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ca36c01a/0x95459fb9d1d29d5b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.410390:0:18633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233bf10e00 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:0.0:1787831109.410393:0:18633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca36c01a/0x95459fb9d1d29d5b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.410411:0:18633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca36c01a/0x95459fb9d1d29d5b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.410421:0:18633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ca36c01a/0x95459fb9d1d29d5b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.410428:0:18633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ca36c01a/0x95459fb9d1d29d5b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.410439:0:18633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787831109.410441:0:18633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787831109.410443:0:18633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787831109.410757:0:18914:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787831109.410762:0:18914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003859dea3/0x95459fb9d1d29d62 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.410770:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=400s v=(0 0) 00010000:00010000:0.0:1787831109.410773:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787831109.410777:0:18914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003859dea3/0x95459fb9d1d29d62 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.410786:0:18914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003859dea3/0x95459fb9d1d29d62 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.410793:0:18914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003859dea3/0x95459fb9d1d29d62 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.410810:0:18914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003859dea3/0x95459fb9d1d29d62 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.410822:0:18914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787831109.410829:0:18633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787831109.410832:0:18633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003859dea3/0x95459fb9d1d29d62 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.410838:0:18633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233bf11400 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:0.0:1787831109.410841:0:18633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003859dea3/0x95459fb9d1d29d62 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.410849:0:18633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003859dea3/0x95459fb9d1d29d62 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.410859:0:18633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003859dea3/0x95459fb9d1d29d62 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.410866:0:18633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003859dea3/0x95459fb9d1d29d62 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831109.410876:0:18633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787831109.410878:0:18633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787831109.410879:0:18633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1787831109.410911:0:18914:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:5 00000100:00100000:0.0:1787831109.411007:0:18914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220442fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17129:x1874676443936256:12345-0@lo:5:osp-pre-0-0.0 Request processed in 41023us (44930us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831109.411022:0:18914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787831109.411149:0:17129:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220442cb40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17129:1874676443936256:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1787831109.411166:0:17129:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x5:0x0] 00000100:00100000:3.0:1787831109.411213:0:17129:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220442cb40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17129:1874676443936384:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1787831109.411251:0:17129:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831109.411286:0:17129:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d22038d8c00 going to sleep for 11 seconds 00010000:00010000:3.0:1787831109.411299:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787831109.411366:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787831109.411409:0:18609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443936384 00000100:00100000:0.0:1787831109.411415:0:18609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443936384 00000100:00100000:0.0:1787831109.411462:0:18609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787831109.411470:0:18609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220442e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17129:x1874676443936384:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1787831109.411506:0:18609:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00000001:00080000:1.0:1787831109.419722:0:18604:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:1.0:1787831109.419770:0:18604:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1787831109.420470:0:18609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220442e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:17129:x1874676443936384:12345-0@lo:5:osp-pre-0-0.0 Request processed in 8995us (9214us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1787831109.420483:0:18609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787831109.420707:0:17129:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1787831109.420724:0:17129:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220442cb40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17129:1874676443936384:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1787831109.420740:0:17129:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00010000:00010000:0.0:1787831109.542827:0:18633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787831109.863814:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220442cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676443936512:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787831109.863956:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831109.864053:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443936512 00000100:00100000:3.0:1787831109.864060:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443936512 00000100:00100000:3.0:1787831109.864122:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787831109.864131:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204624000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1874676443936512:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787831109.864165:0:17109:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787831109.864229:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204624000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1874676443936512:12345-0@lo:41:osp-pre-1-0.0 Request processed in 99us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831109.864237:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787831109.864376:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220442cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676443936512:0@lo:41:osp-pre-1-0.0 00000001:02000400:3.0:1787831110.174219:0:18974:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg331-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787831110.567619:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787831110.855789:0:19026:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787831110.856050:0:19026:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:3.0:1787831111.514329:0:19076:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787831111.514649:0:19076:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787831111.593697:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787831112.617898:0:18633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787831113.639035:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787831113.959029:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22047070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443936640:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787831113.959119:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831113.960265:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443936640 00000100:00100000:1.0:1787831113.960276:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443936640 00000100:00100000:1.0:1787831113.960328:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787831113.960334:0:17110:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:1.0:1787831113.960340:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204704780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443936640:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787831113.960346:0:17110:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000004:00000024:1.0:1787831113.960387:0:17109:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1787831113.960458:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204704780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443936640:12345-0@lo:41:osp-pre-0-1.0 Request processed in 122us (1339us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831113.960466:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787831113.961419:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22047070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443936640:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787831114.471164:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1874676443936768:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787831114.471239:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831114.471303:0:18611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443936768 00000100:00100000:2.0:1787831114.471310:0:18611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443936768 00000100:00100000:2.0:1787831114.471362:0:18611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787831114.471370:0:18611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204706580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1874676443936768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787831114.471398:0:18611:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787831114.471441:0:18611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204706580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1874676443936768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831114.471448:0:18611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1787831114.471468:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787831114.471501:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1874676443936768:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787831114.476348:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787831114.476354:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787831114.476357:0:37:0:(import.c:65:import_set_state_nolock()) ffff8d2303f2a800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787831114.476365:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 400 00000100:00080000:3.0:1787831114.476370:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1787831114.476377:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d2303f2a800 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:3.0:1787831114.476397:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d220442d680 x1874676443937152/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787831114.476433:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787831114.476448:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787831114.476451:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787831114.476454:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787831114.476507:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220442d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1874676443937152:0@lo:8:kworker.0 00000100:00100000:3.0:1787831114.476566:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831114.476613:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220442da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874676443937280:0@lo:400:kworker.0 00000100:00100000:3.0:1787831114.476654:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831114.476665:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220442d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676443937024:0@lo:400:kworker.0 00000100:00100000:3.0:1787831114.476672:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220442de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3619:1874676443937792:0@lo:400:kworker.0 00000100:00100000:3.0:1787831114.476692:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831114.476694:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831114.476709:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787831114.476715:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220442c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443937408:0@lo:400:kworker.0 00000100:00100000:1.0:1787831114.476720:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220442f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3622:1874676443937664:0@lo:400:kworker.0 00000100:00100000:3.0:1787831114.476733:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831114.476736:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831114.476749:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787831114.476756:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220442f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:be45932f-3bcb-4e49-b61c-a2395180b0ee:3622:1874676443936896:0@lo:400:kworker.0 00000100:00100000:3.0:1787831114.476763:0:18518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443937280 00000100:00100000:3.0:1787831114.476769:0:18518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443937280 00000100:00100000:1.0:1787831114.476781:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831114.476798:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220442e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3622:1874676443937536:0@lo:400:kworker.0 00000100:00100000:3.0:1787831114.476807:0:18518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443937792 00000100:00100000:3.0:1787831114.476809:0:18518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443937792 00000100:00100000:1.0:1787831114.476818:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831114.476845:0:18518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443937664 00000100:00100000:3.0:1787831114.476848:0:18518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443937664 00000100:00100000:1.0:1787831114.476849:0:18608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443937152 00000100:00100000:1.0:1787831114.476852:0:18608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443937152 00000100:00100000:3.0:1787831114.476859:0:18518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443937536 00000100:00100000:3.0:1787831114.476860:0:18518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443937536 00000100:00100000:3.0:1787831114.476874:0:18518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787831114.476876:0:18608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787831114.476881:0:18518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220442e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874676443937280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787831114.476881:0:18608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220442c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3618:x1874676443937152:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1787831114.476900:0:18608:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787831114.476926:0:18518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220442e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874676443937280:12345-0@lo:400:kworker.0 Request processed in 45us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831114.476932:0:18518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787831114.476949:0:18518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787831114.476963:0:18518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220442c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874676443937792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787831114.476992:0:18518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220442c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874676443937792:12345-0@lo:400:kworker.0 Request processed in 30us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831114.476998:0:18518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787831114.477009:0:18518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787831114.477014:0:18518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204626580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1874676443937664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787831114.477043:0:18518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204626580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1874676443937664:12345-0@lo:400:kworker.0 Request processed in 29us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831114.477048:0:18518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787831114.477071:0:18518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787831114.477077:0:18518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a23c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1874676443937536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787831114.477103:0:18518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a23c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1874676443937536:12345-0@lo:400:kworker.0 Request processed in 27us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831114.477108:0:18518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787831114.477129:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443937024 00000100:00100000:3.0:1787831114.477133:0:17110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443937024 00000100:00100000:3.0:1787831114.477152:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443937408 00000100:00100000:3.0:1787831114.477154:0:17110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443937408 00000100:00100000:3.0:1787831114.477166:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787831114.477172:0:17110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204624b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1874676443937024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787831114.477202:0:17110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204624b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1874676443937024:12345-0@lo:400:kworker.0 Request processed in 30us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831114.477207:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787831114.477219:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787831114.477225:0:17110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220442f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443937408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787831114.477249:0:17110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220442f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443937408:12345-0@lo:400:kworker.0 Request processed in 25us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831114.477264:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:3.0:1787831114.477287:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787831114.477291:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787831114.477319:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220442c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443937408:0@lo:400:kworker.0 00010000:00080000:3.0:1787831114.477333:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d220442da40 x1874676443937280/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787831130 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787831114.477343:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220442da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874676443937280:0@lo:400:kworker.0 00010000:00080000:3.0:1787831114.477353:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d220442de00 x1874676443937792/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787831130 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787831114.477361:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220442de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3619:1874676443937792:0@lo:400:kworker.0 00010000:00080000:3.0:1787831114.477393:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d220442e940 x1874676443937536/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787831130 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787831114.477402:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220442e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3622:1874676443937536:0@lo:400:kworker.0 00000100:00100000:3.0:1787831114.477411:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220442d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676443937024:0@lo:400:kworker.0 00010000:00080000:3.0:1787831114.477423:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d220442f0c0 x1874676443937664/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787831130 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787831114.477432:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220442f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3622:1874676443937664:0@lo:400:kworker.0 00000100:00100000:3.0:1787831114.477478:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443936896 00000100:00100000:3.0:1787831114.477482:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443936896 00000100:00100000:3.0:1787831114.477507:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787831114.477514:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233f459450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be45932f-3bcb-4e49-b61c-a2395180b0ee+21:3622:x1874676443936896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787831114.477562:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233f459450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be45932f-3bcb-4e49-b61c-a2395180b0ee+21:3622:x1874676443936896:12345-0@lo:400:kworker.0 Request processed in 48us (779us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831114.477574:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787831114.477613:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220442f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:be45932f-3bcb-4e49-b61c-a2395180b0ee:3622:1874676443936896:0@lo:400:kworker.0 00000100:00100000:1.0:1787831114.496797:0:18608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220442c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3618:x1874676443937152:12345-0@lo:8:kworker.0 Request processed in 19907us (20222us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787831114.496811:0:18608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1787831114.497022:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8d2303f2a800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787831114.497029:0:3618:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787831114.497034:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220442d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1874676443937152:0@lo:8:kworker.0 00010000:00010000:1.0:1787831114.670127:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787831114.983251:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787831114.983275:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220442f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443937920:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787831114.983406:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831114.983894:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443937920 00000100:00100000:3.0:1787831114.983903:0:17110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443937920 00000100:00100000:3.0:1787831114.983954:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787831114.983963:0:17110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a22940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676443937920:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787831114.983996:0:17110:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787831114.984070:0:17110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a22940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676443937920:12345-0@lo:41:osp-pre-1-0.0 Request processed in 107us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831114.984078:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787831114.984117:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220442f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443937920:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787831115.688107:0:18633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787831115.944614:0:17855:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1787831115.946942:0:17139:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000004:0.0:1787831116.469142:0:19421:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787831116.469146:0:19421:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:0.0:1787831116.469147:0:19421:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1787831116.469258:0:19421:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8d2204708800 00000020:01000004:0.0:1787831116.469272:0:19421:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1787831116.469287:0:19421:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1787831116.469300:0:19421:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8d23088a4d28) 00000020:00000080:0.0:1787831116.469316:0:19421:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1787831116.548986:0:19421:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1787831116.553428:0:19421:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1787831116.554476:0:19421:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1787831116.555679:0:19421:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1787831116.555909:0:19421:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1787831116.556116:0:19421:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1787831116.556298:0:19421:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:01000000:2.0:1787831116.557860:0:19421:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1787831116.558088:0:19421:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1787831116.558104:0:19421:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787831116.558119:0:19421:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x95459fb9d1d29d70 00000020:01000004:2.0:1787831116.558126:0:19421:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:2.0:1787831116.558146:0:19421:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.131@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787831116.558149:0:19421:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.131@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787831116.558155:0:19421:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1787831116.558184:0:19421:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:2.0:1787831116.558189:0:19421:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.131@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1787831116.568218:0:19421:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.131@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787831116.568253:0:19421:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.131@tcp, index=0001, flags=0x20002 00000020:01000004:0.0:1787831116.568258:0:19421:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787831116.568259:0:19421:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787831116.568260:0:19421:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787831116.568261:0:19421:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787831116.568265:0:19421:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787831116.568266:0:19421:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787831116.568267:0:19421:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787831116.568268:0:19421:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787831116.568269:0:19421:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787831116.568272:0:19421:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:0.0:1787831116.568274:0:19421:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787831116.568275:0:19421:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787831116.568275:0:19421:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787831116.568276:0:19421:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787831116.568276:0:19421:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787831116.568277:0:19421:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787831116.568278:0:19421:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787831116.568278:0:19421:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787831116.568279:0:19421:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787831116.568304:0:19421:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1787831116.568322:0:19421:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2314ed43c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:19421:1874676443938048:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787831116.568386:0:19421:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831116.568503:0:19421:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2201e97180 going to sleep for 11 seconds 00000100:00100000:2.0:1787831116.568507:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443938048 00000100:00100000:2.0:1787831116.568513:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443938048 00000100:00100000:2.0:1787831116.568560:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787831116.568567:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233f45ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be45932f-3bcb-4e49-b61c-a2395180b0ee+21:19421:x1874676443938048:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787831116.568594:0:17096:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1787831116.568596:0:17096:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1787831116.568601:0:17096:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1787831116.568965:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233f45ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be45932f-3bcb-4e49-b61c-a2395180b0ee+21:19421:x1874676443938048:12345-0@lo:253:mount.lustre.0 Request processed in 396us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831116.568973:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787831116.568996:0:19421:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2314ed43c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:19421:1874676443938048:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787831116.569005:0:19421:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1787831116.569007:0:19421:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787831116.569008:0:19421:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787831116.569010:0:19421:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787831116.569011:0:19421:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787831116.569012:0:19421:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787831116.569013:0:19421:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787831116.569014:0:19421:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787831116.569015:0:19421:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787831116.569017:0:19421:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787831116.569034:0:19421:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d2204708800 from lustre-OST0001 10000000:01000000:0.0:1787831116.569137:0:19421:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1787831116.569141:0:19421:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1787831116.569149:0:19421:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8d2201e1cd28 local copy 00010000:00010000:0.0:1787831116.569158:0:19421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d23344b7200/0x95459fb9d1d299c6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d299cd expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831116.569249:0:19421:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2314ed43c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:19421:1874676443938176:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787831116.569278:0:19421:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831116.569318:0:19421:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2201e97780 going to sleep for 11 seconds 00000100:00100000:1.0:1787831116.569358:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443938176 00000100:00100000:1.0:1787831116.569363:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443938176 00000100:00100000:1.0:1787831116.569402:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787831116.569409:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233f459050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be45932f-3bcb-4e49-b61c-a2395180b0ee+21:19421:x1874676443938176:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787831116.569494:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233f459050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be45932f-3bcb-4e49-b61c-a2395180b0ee+21:19421:x1874676443938176:12345-0@lo:501:mount.lustre.0 Request processed in 77us (207us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787831116.569501:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787831116.569501:0:19421:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2314ed43c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:19421:1874676443938176:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1787831116.569513:0:19421:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.131@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1787831116.569529:0:19421:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.131@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1787831116.569535:0:19421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d23344b7200/0x95459fb9d1d299c6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d299cd expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831116.569543:0:19421:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8d23344b7200/0x95459fb9d1d299c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d299cd expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787831116.569566:0:19421:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d2204708800 10000000:01000000:0.0:1787831116.569571:0:19421:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787831116.569576:0:19421:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1787831116.569579:0:19421:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787831116.569583:0:19421:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1787831116.569586:0:19421:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1787831116.569606:0:19421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233bf10000/0x95459fb9d1d29d77 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831116.569614:0:19421:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8d233bf10000/0x95459fb9d1d29d77 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831116.569656:0:19421:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8d233bf10000/0x95459fb9d1d29d77 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831116.569680:0:19421:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2314ed43c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:19421:1874676443938304:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787831116.569705:0:19421:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831116.569728:0:19421:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2201e97780 going to sleep for 11 seconds 00000100:00100000:2.0:1787831116.569773:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443938304 00000100:00100000:2.0:1787831116.569777:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443938304 00000100:00100000:2.0:1787831116.569802:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787831116.569807:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233f458050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be45932f-3bcb-4e49-b61c-a2395180b0ee+21:19421:x1874676443938304:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787831116.569815:0:17096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787831116.570076:0:17096:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d22039c0c00/0x95459fb9d1d29d7e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d29d77 expref: -99 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831116.570100:0:17096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22039c0c00/0x95459fb9d1d29d7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d29d77 expref: 22 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831116.570121:0:17096:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d22039c0c00/0x95459fb9d1d29d7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d29d77 expref: 22 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831116.570130:0:17096:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22039c0c00, rc 0) 00000100:00100000:2.0:1787831116.570170:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233f458050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be45932f-3bcb-4e49-b61c-a2395180b0ee+22:19421:x1874676443938304:12345-0@lo:101:mount.lustre.0 Request processed in 362us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831116.570177:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787831116.570363:0:19421:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2314ed43c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:19421:1874676443938304:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787831116.570377:0:19421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8d233bf10000/0x95459fb9d1d29d77 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d29d7e expref: -99 pid: 19421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831116.570386:0:19421:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8d233bf10000/0x95459fb9d1d29d77 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d29d7e expref: -99 pid: 19421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787831116.571337:0:19421:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1787831116.571978:0:19421:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787831116.573752:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1787831116.573802:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1787831116.573817:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1787831116.573831:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1787831116.573846:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1787831116.573860:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1787831116.573882:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1787831116.573887:0:19421:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1787831116.573979:0:19421:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2314ed43c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:19421:1874676443938432:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787831116.574058:0:19421:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831116.574154:0:19421:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2201e97d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787831116.574199:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443938432 00000100:00100000:1.0:1787831116.574206:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443938432 00000100:00100000:1.0:1787831116.574262:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787831116.574272:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233f45b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be45932f-3bcb-4e49-b61c-a2395180b0ee+22:19421:x1874676443938432:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787831116.574444:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233f45b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be45932f-3bcb-4e49-b61c-a2395180b0ee+22:19421:x1874676443938432:12345-0@lo:501:mount.lustre.0 Request processed in 173us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831116.574452:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787831116.574695:0:19421:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2314ed43c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:19421:1874676443938432:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787831116.574727:0:19421:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2314ed43c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:19421:1874676443938560:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787831116.574772:0:19421:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831116.574863:0:19421:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2201e97d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787831116.574894:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443938560 00000100:00100000:2.0:1787831116.574899:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443938560 00000100:00100000:2.0:1787831116.574967:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787831116.574975:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233f45b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be45932f-3bcb-4e49-b61c-a2395180b0ee+22:19421:x1874676443938560:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787831116.575581:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233f45b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be45932f-3bcb-4e49-b61c-a2395180b0ee+22:19421:x1874676443938560:12345-0@lo:503:mount.lustre.0 Request processed in 604us (805us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831116.575589:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787831116.575685:0:19421:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2314ed43c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:19421:1874676443938560:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787831116.576106:0:19421:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787831116.576194:0:19421:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2314ed43c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:19421:1874676443938688:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787831116.576239:0:19421:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831116.576595:0:19421:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2201e97780 going to sleep for 11 seconds 00000100:00100000:1.0:1787831116.576645:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443938688 00000100:00100000:1.0:1787831116.576651:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443938688 00000100:00100000:2.0:1787831116.576714:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787831116.576724:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233f459c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be45932f-3bcb-4e49-b61c-a2395180b0ee+22:19421:x1874676443938688:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787831116.577124:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233f459c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be45932f-3bcb-4e49-b61c-a2395180b0ee+22:19421:x1874676443938688:12345-0@lo:502:mount.lustre.0 Request processed in 401us (883us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831116.577131:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787831116.577202:0:19421:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2314ed43c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:19421:1874676443938688:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787831116.577386:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1787831116.577413:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1787831116.577433:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1787831116.577447:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1787831116.577460:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1787831116.577473:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1787831116.577498:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1787831116.577514:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1787831116.577528:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:0.0:1787831116.577554:0:19421:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2314ed43c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:19421:1874676443938816:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787831116.577601:0:19421:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831116.577621:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443938816 00000100:00100000:0.0:1787831116.577621:0:19421:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2201e97780 going to sleep for 11 seconds 00000100:00100000:1.0:1787831116.577642:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443938816 00000100:00100000:1.0:1787831116.577665:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787831116.577671:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233f458c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be45932f-3bcb-4e49-b61c-a2395180b0ee+22:19421:x1874676443938816:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787831116.577774:0:19421:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2314ed43c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:19421:1874676443938816:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787831116.577809:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:0.0:1787831116.577817:0:19421:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000100:00100000:1.0:1787831116.578148:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233f458c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be45932f-3bcb-4e49-b61c-a2395180b0ee+22:19421:x1874676443938816:12345-0@lo:502:mount.lustre.0 Request processed in 82us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831116.578156:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000020:01000000:1.0:1787831116.578397:0:19426:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787831116.578403:0:19426:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:1.0:1787831116.578407:0:19426:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787831116.578413:0:19426:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1787831116.578417:0:19426:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787831116.578429:0:19426:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8d2334548000) 00000020:00000080:1.0:1787831116.578446:0:19426:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:1.0:1787831116.578450:0:19426:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787831116.578612:0:19426:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d2204708800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1787831116.578621:0:19426:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787831116.578656:0:19426:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x95459fb9d1d29d8c 00010000:00010000:1.0:1787831116.581654:0:19426:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:1.0:1787831116.582196:0:19426:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:1.0:1787831116.583323:0:19426:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:1.0:1787831116.584506:0:19426:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1787831116.584517:0:19426:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787831116.584523:0:19426:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787831116.584526:0:19426:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1787831116.584529:0:19426:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787831116.584533:0:19426:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787831116.584534:0:19426:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787831116.584537:0:19426:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787831116.584539:0:19426:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787831116.584541:0:19426:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787831116.584543:0:19426:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787831116.584545:0:19426:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787831116.584547:0:19426:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787831116.584548:0:19426:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787831116.584550:0:19426:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787831116.584553:0:19426:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1787831116.584577:0:19426:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787831116.584580:0:19426:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787831116.584582:0:19426:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787831116.584584:0:19426:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:0.0:1787831116.585149:0:19421:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1787831116.585179:0:19421:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1787831116.585205:0:19421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233bf10000/0x95459fb9d1d29d77 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d29d7e expref: -99 pid: 19421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831116.585218:0:19421:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8d233bf10000/0x95459fb9d1d29d77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d29d7e expref: -99 pid: 19421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787831116.585233:0:19421:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d2204708800 from 1 10000000:01000000:0.0:1787831116.585236:0:19421:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787831116.585268:0:19421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233bf11e00/0x95459fb9d1d29d93 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831116.585275:0:19421:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8d233bf11e00/0x95459fb9d1d29d93 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831116.585286:0:19421:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8d233bf11e00/0x95459fb9d1d29d93 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831116.585310:0:19421:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2314ed43c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:19421:1874676443938944:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787831116.585378:0:19421:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831116.585413:0:19421:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2201e97780 going to sleep for 11 seconds 00000100:00100000:2.0:1787831116.586855:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443938944 00000100:00100000:2.0:1787831116.586866:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443938944 00000100:00100000:2.0:1787831116.586918:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787831116.586927:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233f458850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be45932f-3bcb-4e49-b61c-a2395180b0ee+22:19421:x1874676443938944:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787831116.586943:0:17096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787831116.586959:0:17096:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d22039c0a00/0x95459fb9d1d29d9a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d29d93 expref: -99 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831116.586992:0:17096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22039c0a00/0x95459fb9d1d29d9a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d29d93 expref: 23 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831116.587002:0:17096:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d22039c0a00/0x95459fb9d1d29d9a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d29d93 expref: 23 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831116.587011:0:17096:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22039c0a00, rc 0) 00000100:00100000:2.0:1787831116.587085:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233f458850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be45932f-3bcb-4e49-b61c-a2395180b0ee+23:19421:x1874676443938944:12345-0@lo:101:mount.lustre.0 Request processed in 159us (1707us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831116.587091:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787831116.587149:0:19421:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2314ed43c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:19421:1874676443938944:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787831116.587166:0:19421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8d233bf11e00/0x95459fb9d1d29d93 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d29d9a expref: -99 pid: 19421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831116.587175:0:19421:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8d233bf11e00/0x95459fb9d1d29d93 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d29d9a expref: -99 pid: 19421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787831116.588065:0:19421:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1787831116.588319:0:19421:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787831116.588915:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1787831116.588942:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1787831116.588974:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1787831116.588981:0:19421:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1787831116.589058:0:19421:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204704000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:19421:1874676443939072:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787831116.589117:0:19421:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831116.589205:0:19421:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2305811f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787831116.589305:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443939072 00000100:00100000:3.0:1787831116.589312:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443939072 00000100:00100000:3.0:1787831116.589384:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787831116.589394:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233f45b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be45932f-3bcb-4e49-b61c-a2395180b0ee+23:19421:x1874676443939072:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787831116.589542:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233f45b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be45932f-3bcb-4e49-b61c-a2395180b0ee+23:19421:x1874676443939072:12345-0@lo:501:mount.lustre.0 Request processed in 149us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831116.589550:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787831116.589700:0:19421:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204704000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:19421:1874676443939072:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787831116.589733:0:19421:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a203c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:19421:1874676443939200:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787831116.589779:0:19421:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831116.589807:0:19421:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d23184ce0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787831116.589849:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443939200 00000100:00100000:2.0:1787831116.589859:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443939200 00000100:00100000:2.0:1787831116.589890:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787831116.589896:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203527850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be45932f-3bcb-4e49-b61c-a2395180b0ee+23:19421:x1874676443939200:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787831116.589963:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203527850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be45932f-3bcb-4e49-b61c-a2395180b0ee+23:19421:x1874676443939200:12345-0@lo:503:mount.lustre.0 Request processed in 67us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831116.589970:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787831116.590049:0:19421:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a203c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:19421:1874676443939200:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787831116.590373:0:19421:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787831116.590431:0:19421:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a203c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:19421:1874676443939328:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787831116.590472:0:19421:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831116.590585:0:19421:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2303250840 going to sleep for 11 seconds 00000100:00100000:3.0:1787831116.590655:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443939328 00000100:00100000:3.0:1787831116.590659:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443939328 00000100:00100000:3.0:1787831116.590685:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787831116.590692:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203524050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be45932f-3bcb-4e49-b61c-a2395180b0ee+23:19421:x1874676443939328:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787831116.590767:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203524050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be45932f-3bcb-4e49-b61c-a2395180b0ee+23:19421:x1874676443939328:12345-0@lo:502:mount.lustre.0 Request processed in 75us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831116.590774:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787831116.590859:0:19421:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a203c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:19421:1874676443939328:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787831116.591020:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1787831116.591057:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1787831116.591077:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1787831116.591090:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1787831116.591102:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1787831116.591116:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1787831116.591129:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1787831116.591141:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:1.0:1787831116.591155:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1787831116.591168:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:1.0:1787831116.591179:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:1.0:1787831116.591206:0:19421:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a203c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:19421:1874676443939456:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787831116.591246:0:19421:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831116.591280:0:19421:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d23184ce0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787831116.591325:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443939456 00000100:00100000:2.0:1787831116.591330:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443939456 00000100:00100000:2.0:1787831116.591387:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787831116.591394:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203524c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be45932f-3bcb-4e49-b61c-a2395180b0ee+23:19421:x1874676443939456:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787831116.591478:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203524c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be45932f-3bcb-4e49-b61c-a2395180b0ee+23:19421:x1874676443939456:12345-0@lo:502:mount.lustre.0 Request processed in 84us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831116.591606:0:19421:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a203c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:19421:1874676443939456:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787831116.591642:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000040:00080000:0.0:1787831116.591678:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:0.0:1787831116.591687:0:19421:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1787831116.592455:0:19430:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787831116.592536:0:19430:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787831116.592539:0:19430:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787831116.592547:0:19430:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d2204708800 00000020:00000080:3.0:1787831116.592550:0:19430:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787831116.592558:0:19430:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787831116.592561:0:19430:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787831116.592562:0:19430:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787831116.592565:0:19430:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787831116.592567:0:19430:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787831116.592569:0:19430:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787831116.592572:0:19430:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d2204708800 00000020:00000080:3.0:1787831116.592575:0:19430:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787831116.592778:0:19430:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787831116.592783:0:19430:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787831116.592784:0:19430:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787831116.592788:0:19430:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787831116.592790:0:19430:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787831116.592791:0:19430:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787831116.592795:0:19430:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d2204708800 00000020:00000080:3.0:1787831116.592797:0:19430:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787831116.592817:0:19430:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787831116.592831:0:19430:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787831116.592833:0:19430:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787831116.592836:0:19430:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787831116.592838:0:19430:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787831116.592839:0:19430:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1787831116.592843:0:19430:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d2204708800 00000020:00000080:3.0:1787831116.592845:0:19430:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787831116.592869:0:19430:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787831116.592872:0:19430:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787831116.592874:0:19430:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1787831116.592876:0:19430:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:0.0:1787831116.593033:0:19421:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1787831116.593143:0:19421:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787831116.593166:0:19421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233bf11e00/0x95459fb9d1d29d93 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d29d9a expref: -99 pid: 19421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831116.593177:0:19421:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8d233bf11e00/0x95459fb9d1d29d93 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d29d9a expref: -99 pid: 19421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787831116.593227:0:19421:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787831116.593230:0:19421:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d2204708800 10000000:01000000:0.0:1787831116.593233:0:19421:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d2204708800 10000000:01000000:0.0:1787831116.593242:0:19421:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787831116.593248:0:19421:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d2204708800 from 1 10000000:01000000:0.0:1787831116.593250:0:19421:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787831116.593281:0:19421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233bf10a00/0x95459fb9d1d29da1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831116.593301:0:19421:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8d233bf10a00/0x95459fb9d1d29da1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831116.593311:0:19421:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8d233bf10a00/0x95459fb9d1d29da1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831116.593332:0:19421:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2314ed5a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:19421:1874676443939584:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787831116.593611:0:19421:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831116.593787:0:19421:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2201e976c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787831116.593825:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443939584 00000100:00100000:3.0:1787831116.593832:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443939584 00000100:00100000:3.0:1787831116.593906:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787831116.593914:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203527c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be45932f-3bcb-4e49-b61c-a2395180b0ee+23:19421:x1874676443939584:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787831116.593927:0:17098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787831116.593939:0:17098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2307c77000/0x95459fb9d1d29da8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d29da1 expref: -99 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831116.593962:0:17098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2307c77000/0x95459fb9d1d29da8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d29da1 expref: 24 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831116.593972:0:17098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2307c77000/0x95459fb9d1d29da8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d29da1 expref: 24 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831116.593980:0:17098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2307c77000, rc 0) 00000100:00100000:3.0:1787831116.594019:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203527c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be45932f-3bcb-4e49-b61c-a2395180b0ee+24:19421:x1874676443939584:12345-0@lo:101:mount.lustre.0 Request processed in 106us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831116.594026:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787831116.594151:0:19421:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2314ed5a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:19421:1874676443939584:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787831116.594165:0:19421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8d233bf10a00/0x95459fb9d1d29da1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d29da8 expref: -99 pid: 19421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831116.594174:0:19421:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8d233bf10a00/0x95459fb9d1d29da1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d29da8 expref: -99 pid: 19421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787831116.596098:0:19421:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:0.0:1787831116.596353:0:19421:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787831116.596574:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1787831116.596597:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1787831116.596611:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1787831116.596650:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1787831116.596668:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1787831116.596681:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1787831116.596713:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1787831116.596725:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1787831116.596739:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1787831116.596753:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1787831116.596763:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1787831116.596775:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1787831116.596785:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1787831116.596795:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1787831116.596805:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1787831116.596816:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1787831116.596825:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1787831116.596838:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1787831116.596848:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1787831116.596862:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1787831116.596873:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1787831116.596884:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1787831116.596909:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1787831116.596923:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1787831116.596937:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:0.0:1787831116.596948:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:0.0:1787831116.596960:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:0.0:1787831116.596971:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:0.0:1787831116.596984:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:0.0:1787831116.596996:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:0.0:1787831116.597010:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:0.0:1787831116.597023:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:0.0:1787831116.597035:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:0.0:1787831116.597062:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:0.0:1787831116.597075:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:0.0:1787831116.597087:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:0.0:1787831116.597099:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:0.0:1787831116.597111:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:0.0:1787831116.597139:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:0.0:1787831116.597162:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:0.0:1787831116.597176:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:0.0:1787831116.597188:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:0.0:1787831116.597201:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:0.0:1787831116.597212:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:0.0:1787831116.597225:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:0.0:1787831116.597238:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:0.0:1787831116.597259:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:0.0:1787831116.597264:0:19421:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:0.0:1787831116.597344:0:19421:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2314ed5a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:19421:1874676443939712:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787831116.597409:0:19421:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831116.597451:0:19421:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2201e97d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787831116.597592:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443939712 00000100:00100000:2.0:1787831116.597599:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443939712 00000100:00100000:2.0:1787831116.597658:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787831116.597668:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203527450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be45932f-3bcb-4e49-b61c-a2395180b0ee+24:19421:x1874676443939712:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787831116.597783:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203527450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be45932f-3bcb-4e49-b61c-a2395180b0ee+24:19421:x1874676443939712:12345-0@lo:501:mount.lustre.0 Request processed in 116us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831116.597791:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787831116.600405:0:19421:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2314ed5a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:19421:1874676443939712:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787831116.600465:0:19421:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204705a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:19421:1874676443939840:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787831116.601673:0:19421:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831116.601708:0:19421:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d23058119c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787831116.601783:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443939840 00000100:00100000:3.0:1787831116.601791:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443939840 00000100:00100000:3.0:1787831116.602586:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787831116.602597:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203526c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be45932f-3bcb-4e49-b61c-a2395180b0ee+24:19421:x1874676443939840:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787831116.602753:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203526c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be45932f-3bcb-4e49-b61c-a2395180b0ee+24:19421:x1874676443939840:12345-0@lo:503:mount.lustre.0 Request processed in 157us (1083us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831116.602761:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787831116.603283:0:19421:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204705a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:19421:1874676443939840:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787831116.603727:0:19421:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787831116.603803:0:19421:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204705a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:19421:1874676443939968:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787831116.603853:0:19421:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831116.603888:0:19421:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2302f5e180 going to sleep for 11 seconds 00000100:00100000:0.0:1787831116.603957:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443939968 00000100:00100000:0.0:1787831116.603963:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443939968 00000100:00100000:0.0:1787831116.604000:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787831116.604008:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203524450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be45932f-3bcb-4e49-b61c-a2395180b0ee+24:19421:x1874676443939968:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787831116.604114:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203524450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be45932f-3bcb-4e49-b61c-a2395180b0ee+24:19421:x1874676443939968:12345-0@lo:502:mount.lustre.0 Request processed in 106us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831116.604121:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787831116.605190:0:19421:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204705a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:19421:1874676443939968:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787831116.605380:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1787831116.605407:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1787831116.605421:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1787831116.605433:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1787831116.605446:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1787831116.605459:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1787831116.605472:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1787831116.606649:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1787831116.606688:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1787831116.606702:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1787831116.606716:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1787831116.606730:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1787831116.606745:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1787831116.606762:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1787831116.606778:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1787831116.606809:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1787831116.606825:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1787831116.606840:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1787831116.606854:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1787831116.606868:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1787831116.606883:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1787831116.606896:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1787831116.606910:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1787831116.606924:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1787831116.606938:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:2.0:1787831116.606963:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:2.0:1787831116.606978:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:2.0:1787831116.606992:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:2.0:1787831116.607005:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:2.0:1787831116.607019:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:2.0:1787831116.607032:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:2.0:1787831116.607070:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:2.0:1787831116.607087:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:2.0:1787831116.607098:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:2.0:1787831116.607112:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:2.0:1787831116.607126:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:2.0:1787831116.607141:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:2.0:1787831116.607153:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:2.0:1787831116.607163:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:2.0:1787831116.607175:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:2.0:1787831116.607185:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:2.0:1787831116.607198:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:2.0:1787831116.607209:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:2.0:1787831116.607221:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:2.0:1787831116.607233:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:2.0:1787831116.607243:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:2.0:1787831116.607255:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:2.0:1787831116.607283:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:2.0:1787831116.607336:0:19421:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204705a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:19421:1874676443940096:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787831116.607409:0:19421:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831116.607460:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443940096 00000100:00100000:2.0:1787831116.607466:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443940096 00000100:00100000:2.0:1787831116.608805:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787831116.608817:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203525450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be45932f-3bcb-4e49-b61c-a2395180b0ee+24:19421:x1874676443940096:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787831116.608951:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203525450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be45932f-3bcb-4e49-b61c-a2395180b0ee+24:19421:x1874676443940096:12345-0@lo:502:mount.lustre.0 Request processed in 137us (1542us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831116.608968:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787831116.610689:0:19421:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2302f5e180 going to sleep for 11 seconds 00000100:00100000:3.0:1787831116.610728:0:19421:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204705a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:19421:1874676443940096:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787831116.611011:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:3.0:1787831116.611050:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:3.0:1787831116.611086:0:19421:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220442e940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:19421:1874676443940224:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787831116.611149:0:19421:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831116.611183:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443940224 00000100:00100000:3.0:1787831116.611188:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443940224 00000100:00100000:3.0:1787831116.611227:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787831116.611234:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203526450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be45932f-3bcb-4e49-b61c-a2395180b0ee+24:19421:x1874676443940224:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787831116.611332:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203526450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be45932f-3bcb-4e49-b61c-a2395180b0ee+24:19421:x1874676443940224:12345-0@lo:502:mount.lustre.0 Request processed in 98us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831116.611340:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787831116.611382:0:19421:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2302f5e180 going to sleep for 11 seconds 00000100:00100000:3.0:1787831116.611396:0:19421:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220442e940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:19421:1874676443940224:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787831116.611430:0:19421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:3.0:1787831116.611439:0:19421:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1787831116.614780:0:19435:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1787831116.614810:0:19435:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8d2202a719b8) 00000020:00000080:3.0:1787831116.614835:0:19435:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:3.0:1787831116.614918:0:19435:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d2204708800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787831116.614922:0:19435:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d2204708800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787831116.614925:0:19435:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d2204708800 3 00010000:00080000:3.0:1787831116.614954:0:19435:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d2202a7e000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.131@tcp at head 00010000:00010000:3.0:1787831116.617428:0:19435:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:3.0:1787831116.617739:0:19435:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1787831116.617790:0:19435:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787831116.617803:0:19435:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x95459fb9d1d29db6 00000100:00080000:3.0:1787831116.617814:0:19435:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787831116.617821:0:19435:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8d2202a7e000 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:3.0:1787831116.617854:0:19435:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d220442e940 x1874676443940352/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787831116.617885:0:19435:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787831116.618005:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787831116.618010:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787831116.618013:0:8:0:(import.c:65:import_set_state_nolock()) ffff8d2303f2a800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1787831116.618017:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220442e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3618:1874676443940352:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1787831116.618020:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 405 00000100:00080000:0.0:1787831116.618025:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1787831116.618030:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d2303f2a800 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:0.0:1787831116.618057:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2314ed4000 x1874676443940736/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787831116.618094:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787831116.618103:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787831116.618106:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787831116.618108:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787831116.618114:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831116.618165:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2314ed4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1874676443940736:0@lo:8:kworker.0 00000100:00100000:2.0:1787831116.618199:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831116.618266:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2314ed5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443940480:0@lo:400:kworker.0 00000100:00100000:2.0:1787831116.618499:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831116.618582:0:18609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443940736 00000100:00100000:0.0:1787831116.618589:0:18609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443940736 00000100:00100000:2.0:1787831116.618603:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2314ed5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3621:1874676443941120:0@lo:400:kworker.0 00000100:00100000:2.0:1787831116.618661:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831116.618687:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787831116.618694:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2314ed43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443940608:0@lo:400:kworker.0 00000100:00100000:2.0:1787831116.618719:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831116.618746:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2314ed61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3621:1874676443941248:0@lo:400:kworker.0 00000100:00100000:2.0:1787831116.618773:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831116.618808:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2314ed4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874676443940864:0@lo:400:kworker.0 00000100:00100000:2.0:1787831116.618836:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831116.618856:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220390cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3619:1874676443941376:0@lo:400:kworker.0 00000100:00100000:2.0:1787831116.618881:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831116.618899:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787831116.618907:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2314ed52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443940992:0@lo:400:kworker.0 00000100:00100000:0.0:1787831116.618933:0:18609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787831116.618934:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831116.618947:0:18609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204705a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3618:x1874676443940736:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1787831116.618972:0:18518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443940352 00000100:00100000:2.0:1787831116.618977:0:18518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443940352 00000100:00100000:2.0:1787831116.618994:0:18518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443941120 00000100:00100000:2.0:1787831116.619004:0:18518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443941120 00000100:00100000:0.0:1787831116.619014:0:18609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204705a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3618:x1874676443940736:12345-0@lo:8:kworker.0 Request processed in 68us (816us total) trans 0 rc -11/-11 00000100:00100000:0.0:1787831116.619023:0:18609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787831116.619051:0:18609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443940608 00000100:00100000:2.0:1787831116.619053:0:18518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443941248 00000100:00100000:0.0:1787831116.619055:0:18609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443940608 00000100:00100000:2.0:1787831116.619058:0:18518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443941248 00000100:00100000:0.0:1787831116.619092:0:18609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787831116.619099:0:18609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22047070c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1874676443940608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787831116.619142:0:18609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22047070c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1874676443940608:12345-0@lo:400:kworker.0 Request processed in 43us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831116.619148:0:18609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787831116.619216:0:18518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443940864 00000100:00100000:2.0:1787831116.619220:0:18518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443940864 00000100:00100000:2.0:1787831116.619234:0:18518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443941376 00000100:00100000:2.0:1787831116.619236:0:18518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443941376 00000100:00100000:2.0:1787831116.619254:0:18518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787831116.619262:0:18518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204707c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1874676443941120:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1787831116.619412:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787831116.619418:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787831116.619420:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787831116.619433:0:18518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204707c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1874676443941120:12345-0@lo:400:kworker.0 Request processed in 170us (769us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831116.619441:0:18518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787831116.619462:0:18518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787831116.619470:0:18518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204625e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1874676443941248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787831116.619646:0:18518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204625e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1874676443941248:12345-0@lo:400:kworker.0 Request processed in 157us (852us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831116.619654:0:18518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787831116.619671:0:18518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787831116.619678:0:18518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22038fbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874676443940864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787831116.619752:0:18518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22038fbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874676443940864:12345-0@lo:400:kworker.0 Request processed in 75us (916us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831116.619760:0:18518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787831116.619768:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787831116.619778:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22038f9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874676443941376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787831116.619784:0:18518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787831116.619791:0:18518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204706d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3618:x1874676443940352:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787831116.619812:0:18518:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 407 last 0 00000100:00100000:3.0:1787831116.619814:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22038f9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874676443941376:12345-0@lo:400:kworker.0 Request processed in 37us (931us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831116.619823:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787831116.619851:0:19224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443940480 00000100:00100000:3.0:1787831116.619855:0:19224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443940480 00000020:00000080:2.0:1787831116.619864:0:18518:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x95459fb9d1d29dbd 00000004:00100000:2.0:1787831116.619883:0:18518:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:3.0:1787831116.619886:0:19224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443940992 00000100:00100000:3.0:1787831116.619891:0:19224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443940992 00000100:00100000:1.0:1787831116.619896:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787831116.619906:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204704000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1874676443940480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787831116.619910:0:19224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787831116.619916:0:19224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22038f83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443940992:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787831116.619928:0:18518:0:(import.c:65:import_set_state_nolock()) ffff8d2203b25800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787831116.619946:0:19224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22038f83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443940992:12345-0@lo:400:kworker.0 Request processed in 30us (1013us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831116.619946:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204704000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1874676443940480:12345-0@lo:400:kworker.0 Request processed in 42us (1448us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831116.619954:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787831116.619975:0:18518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204706d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1874676443940352:12345-0@lo:38:llog_process_th.0 Request processed in 183us (1862us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831116.619984:0:18518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787831116.620029:0:3618:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787831116.620112:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8d2303f2a800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787831116.620118:0:3618:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1787831116.620122:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2314ed4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1874676443940736:0@lo:8:kworker.0 00010000:00080000:2.0:1787831116.620142:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d220442e940 x1874676443940352/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787831126 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787831116.620151:0:3618:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787831116.620157:0:3618:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1787831116.620165:0:3618:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787831116.620169:0:3618:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787831116.620172:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8d2202a7e000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787831116.620177:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220442e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3618:1874676443940352:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787831116.620217:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2314ed43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443940608:0@lo:400:kworker.0 00010000:00080000:2.0:1787831116.620229:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2314ed61c0 x1874676443941248/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787831132 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787831116.620238:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2314ed61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3621:1874676443941248:0@lo:400:kworker.0 00000100:00100000:2.0:1787831116.620249:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2314ed5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443940480:0@lo:400:kworker.0 00010000:00080000:2.0:1787831116.620259:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2314ed5680 x1874676443941120/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787831132 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787831116.620374:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2314ed5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3621:1874676443941120:0@lo:400:kworker.0 00000100:00100000:2.0:1787831116.620502:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2314ed52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443940992:0@lo:400:kworker.0 00010000:00080000:2.0:1787831116.620655:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2314ed4b40 x1874676443940864/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787831132 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787831116.620668:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2314ed4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874676443940864:0@lo:400:kworker.0 00010000:00080000:2.0:1787831116.620685:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d220390cf00 x1874676443941376/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787831132 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787831116.620694:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220390cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3619:1874676443941376:0@lo:400:kworker.0 00000100:00100000:3.0:1787831116.620817:0:19224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000020:01000004:2.0:1787831116.621140:0:19435:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1787831116.621154:0:19435:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff8d2306c6b370) 00000020:00000080:2.0:1787831116.621174:0:19435:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:2.0:1787831116.621251:0:19435:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d2204708800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787831116.621256:0:19435:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d2204708800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787831116.621258:0:19435:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d2204708800 3 00010000:00080000:2.0:1787831116.621288:0:19435:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d2203b25000@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.131@tcp at head 00010000:00010000:2.0:1787831116.622909:0:19435:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:2.0:1787831116.623117:0:19435:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:2.0:1787831116.623163:0:19435:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787831116.623177:0:19435:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x95459fb9d1d29dcb 00000100:00080000:2.0:1787831116.623189:0:19435:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787831116.623195:0:19435:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8d2203b25000 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:2.0:1787831116.623235:0:19435:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d22038f9e00 x1874676443941504/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787831116.623278:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22038f9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3618:1874676443941504:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787831116.623363:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831116.623429:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443941504 00000100:00100000:2.0:1787831116.623437:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443941504 00000100:00100000:2.0:1787831116.623470:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787831116.623477:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22038fa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3618:x1874676443941504:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787831116.623506:0:17104:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 407 last 0 00000020:00000080:2.0:1787831116.623540:0:17104:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x95459fb9d1d29dd2 00000004:00100000:2.0:1787831116.623556:0:17104:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787831116.623587:0:17104:0:(import.c:65:import_set_state_nolock()) ffff8d2203b22800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787831116.623654:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22038fa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1874676443941504:12345-0@lo:38:llog_process_th.0 Request processed in 176us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831116.623661:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1787831116.623700:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22038f9e00 x1874676443941504/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787831126 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787831116.623709:0:3618:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787831116.623716:0:3618:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1787831116.623723:0:3618:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787831116.623727:0:3618:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1787831116.623729:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8d2203b25000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787831116.623734:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22038f9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3618:1874676443941504:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1787831116.623751:0:19435:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1787831116.623775:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787831116.623780:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787831116.623784:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787831116.623794:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:2.0:1787831116.624035:0:19435:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:2.0:1787831116.628973:0:19421:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1787831116.629010:0:19421:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787831116.629034:0:19421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233bf10a00/0x95459fb9d1d29da1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d29da8 expref: -99 pid: 19421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831116.629125:0:19421:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8d233bf10a00/0x95459fb9d1d29da1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d29da8 expref: -99 pid: 19421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787831116.629179:0:19421:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787831116.629181:0:19421:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787831116.629182:0:19421:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787831116.629184:0:19421:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787831116.629185:0:19421:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787831116.629187:0:19421:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787831116.629188:0:19421:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787831116.629190:0:19421:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787831116.629192:0:19421:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787831116.629195:0:19421:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1787831116.629197:0:19421:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787831116.629199:0:19421:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787831116.629200:0:19421:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787831116.629201:0:19421:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787831116.629202:0:19421:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787831116.629203:0:19421:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787831116.629204:0:19421:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787831116.629205:0:19421:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787831116.629206:0:19421:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787831116.629873:0:19421:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1787831116.629894:0:19421:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22038f9e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:19421:1874676443941632:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787831116.629965:0:19421:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831116.630005:0:19421:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2201e97d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787831116.630140:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443941632 00000100:00100000:2.0:1787831116.630147:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443941632 00000100:00100000:2.0:1787831116.630196:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787831116.630206:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203525c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be45932f-3bcb-4e49-b61c-a2395180b0ee+24:19421:x1874676443941632:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787831116.630231:0:17096:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1787831116.630251:0:17096:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1787831116.633054:0:17096:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787831116.633073:0:17096:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1787831116.633214:0:17120:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787831116.633219:0:17120:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787831116.633243:0:17120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d233bf11600/0x95459fb9d1d29dd9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831116.633260:0:17120:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2303aa3800/0x95459fb9d1d29c89 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d29c82 expref: 24 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831116.633277:0:17120:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2303aa3e00/0x95459fb9d1d29c97 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d29c90 expref: 24 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831116.633285:0:17120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d233bf11600/0x95459fb9d1d29dd9 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831116.633321:0:17120:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2303aa3e00/0x95459fb9d1d29c97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x95459fb9d1d29c90 expref: 24 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831116.633335:0:17120:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d2303aa3e00/0x95459fb9d1d29c97 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x95459fb9d1d29c90 expref: 24 pid: 17096 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831116.633349:0:17120:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220390c780 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17120:1874676443941760:0@lo:104: 00000100:00100000:0.0:1787831116.633410:0:17120:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787831116.633461:0:17120:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2303aa3800/0x95459fb9d1d29c89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x95459fb9d1d29c82 expref: 24 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831116.633470:0:17120:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d2303aa3800/0x95459fb9d1d29c89 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x95459fb9d1d29c82 expref: 24 pid: 17097 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831116.633478:0:17120:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220390cb40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17120:1874676443941888:0@lo:104: 00000100:00100000:3.0:1787831116.633559:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443941760 00000100:00100000:3.0:1787831116.633566:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443941760 00000100:00100000:3.0:1787831116.633607:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787831116.633615:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220390e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:be45932f-3bcb-4e49-b61c-a2395180b0ee+3:17120:x1874676443941760:12345-0@lo:104: 00010000:00010000:3.0:1787831116.633643:0:17088:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff8d22039c1800/0x95459fb9d1d29c90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d29c97 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831116.633688:0:17088:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787831116.633694:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220390e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:be45932f-3bcb-4e49-b61c-a2395180b0ee+3:17120:x1874676443941760:12345-0@lo:104: Request processed in 81us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831116.633707:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:3.0:1787831116.633730:0:17092:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787831116.633735:0:17092:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8d22039c1800/0x95459fb9d1d29c90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d29c97 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831116.633742:0:17092:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22039c1800 already unused, calling callback (ffffffffc14f9c20) 10000000:00010000:3.0:1787831116.633746:0:17092:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8d22039c1800/0x95459fb9d1d29c90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x95459fb9d1d29c97 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831116.633754:0:17092:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8d22039c1800/0x95459fb9d1d29c90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x95459fb9d1d29c97 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787831116.633765:0:17092:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8d22039c1800/0x95459fb9d1d29c90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x95459fb9d1d29c97 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787831116.633771:0:17092:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787831116.633798:0:17092:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8d22039c1800/0x95459fb9d1d29c90 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d29c97 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831116.633804:0:17092:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787831116.633824:0:17092:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8d22039c1800/0x95459fb9d1d29c90 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d29c97 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831116.633831:0:17092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8d22039c1800/0x95459fb9d1d29c90 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d29c97 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831116.633843:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787831116.633845:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787831116.633847:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787831116.633924:0:17120:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831116.633949:0:17120:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2201e97780 going to sleep for 11 seconds 00000100:00100000:0.0:1787831116.633971:0:17120:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220390c780 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17120:1874676443941760:0@lo:104: 00000100:00100000:3.0:1787831116.634009:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443941888 00000100:00100000:3.0:1787831116.634018:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443941888 00000100:00100000:3.0:1787831116.634052:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787831116.634058:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220390e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:be45932f-3bcb-4e49-b61c-a2395180b0ee+3:17120:x1874676443941888:12345-0@lo:104: 00010000:00010000:3.0:1787831116.634066:0:17088:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff8d22039c0800/0x95459fb9d1d29c82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d29c89 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831116.634105:0:17088:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787831116.634110:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220390e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:be45932f-3bcb-4e49-b61c-a2395180b0ee+3:17120:x1874676443941888:12345-0@lo:104: Request processed in 53us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831116.634116:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787831116.634141:0:17120:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220390cb40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17120:1874676443941888:0@lo:104: 00010000:00010000:3.0:1787831116.634158:0:17120:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d233bf11600/0x95459fb9d1d29dd9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831116.634274:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220442de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:be45932f-3bcb-4e49-b61c-a2395180b0ee:3620:1874676443942016:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787831116.634302:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831116.634462:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203525c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be45932f-3bcb-4e49-b61c-a2395180b0ee+24:19421:x1874676443941632:12345-0@lo:253:mount.lustre.0 Request processed in 4258us (4497us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831116.634471:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787831116.634519:0:19421:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22038f9e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be45932f-3bcb-4e49-b61c-a2395180b0ee:19421:1874676443941632:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787831116.634534:0:19421:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1787831116.634537:0:19421:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787831116.634539:0:19421:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787831116.634540:0:19421:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787831116.634542:0:19421:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787831116.634544:0:19421:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787831116.634545:0:19421:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787831116.634546:0:19421:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787831116.634548:0:19421:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787831116.634549:0:19421:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787831116.634560:0:19421:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:1.0:1787831116.638346:0:17093:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787831116.638359:0:17093:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8d22039c0800/0x95459fb9d1d29c82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d29c89 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831116.638370:0:17093:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22039c0800 already unused, calling callback (ffffffffc14f9c20) 10000000:00010000:1.0:1787831116.638374:0:17093:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8d22039c0800/0x95459fb9d1d29c82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x95459fb9d1d29c89 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831116.638384:0:17093:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8d22039c0800/0x95459fb9d1d29c82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x95459fb9d1d29c89 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787831116.638391:0:17093:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8d22039c0800/0x95459fb9d1d29c82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x95459fb9d1d29c89 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787831116.638396:0:17093:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787831116.638449:0:17093:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8d22039c0800/0x95459fb9d1d29c82 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d29c89 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831116.638456:0:17093:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787831116.638478:0:17093:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8d22039c0800/0x95459fb9d1d29c82 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d29c89 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831116.638497:0:17093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8d22039c0800/0x95459fb9d1d29c82 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d29c89 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831116.638513:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787831116.638515:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787831116.638517:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787831116.638532:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:be45932f-3bcb-4e49-b61c-a2395180b0ee:3621:1874676443942144:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787831116.638590:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831116.641821:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443942016 00000100:00100000:3.0:1787831116.641831:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443942016 00010000:00010000:3.0:1787831116.641867:0:17089:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2303aa3e00/0x95459fb9d1d29c97 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d29c90 expref: 24 pid: 17096 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787831116.641906:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443942144 00000100:00100000:3.0:1787831116.641910:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443942144 00010000:00010000:3.0:1787831116.641921:0:17089:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2303aa3800/0x95459fb9d1d29c89 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d29c82 expref: 25 pid: 17097 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787831116.641936:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787831116.641943:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22038fa940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:be45932f-3bcb-4e49-b61c-a2395180b0ee+25:3620:x1874676443942016:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787831116.641956:0:17089:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787831116.641961:0:17089:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2303aa3e00/0x95459fb9d1d29c97 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d29c90 expref: 25 pid: 17096 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831116.641983:0:17089:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2303aa3e00/0x95459fb9d1d29c97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x95459fb9d1d29c90 expref: 25 pid: 17096 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831116.642000:0:17089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2303aa3e00/0x95459fb9d1d29c97 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x95459fb9d1d29c90 expref: 25 pid: 17096 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831116.642013:0:17089:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787831116.642084:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22038fa940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:be45932f-3bcb-4e49-b61c-a2395180b0ee+24:3620:x1874676443942016:12345-0@lo:103:ldlm_bl.0 Request processed in 141us (7780us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831116.642091:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787831116.642107:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787831116.642114:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a20f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:be45932f-3bcb-4e49-b61c-a2395180b0ee+23:3621:x1874676443942144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787831116.642121:0:17089:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787831116.642126:0:17089:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2303aa3800/0x95459fb9d1d29c89 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d29c82 expref: 23 pid: 17097 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831116.642134:0:17089:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2303aa3800/0x95459fb9d1d29c89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x95459fb9d1d29c82 expref: 23 pid: 17097 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831116.642143:0:17089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2303aa3800/0x95459fb9d1d29c89 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x95459fb9d1d29c82 expref: 23 pid: 17097 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831116.642152:0:17089:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d233bf11600/0x95459fb9d1d29dd9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831116.642160:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d233bf11600/0x95459fb9d1d29dd9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787831116.642175:0:17089:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008956900s 00010000:00010000:3.0:1787831116.642187:0:17089:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d233bf11600/0x95459fb9d1d29dd9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831116.642195:0:17089:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d233bf11600/0x95459fb9d1d29dd9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831116.642202:0:17089:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d233bf11600/0x95459fb9d1d29dd9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831116.642209:0:17089:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d233bf11600/0x95459fb9d1d29dd9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831116.642216:0:17089:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233bf11600 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:3.0:1787831116.642220:0:17089:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d233bf11600/0x95459fb9d1d29dd9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831116.642228:0:17089:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d233bf11600/0x95459fb9d1d29dd9 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831116.642245:0:17089:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d233bf11600/0x95459fb9d1d29dd9 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831116.642255:0:17089:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787831116.642282:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a20f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:be45932f-3bcb-4e49-b61c-a2395180b0ee+22:3621:x1874676443942144:12345-0@lo:103:ldlm_bl.0 Request processed in 169us (3691us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831116.642288:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787831116.642606:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220442de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:be45932f-3bcb-4e49-b61c-a2395180b0ee:3620:1874676443942016:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787831116.642788:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:be45932f-3bcb-4e49-b61c-a2395180b0ee:3621:1874676443942144:0@lo:103:ldlm_bl.0 00000001:00000004:0.0:1787831116.643480:0:19421:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1787831116.645450:0:19421:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1787831116.645458:0:19421:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1787831116.645546:0:19421:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787831116.645583:0:19421:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.131@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787831116.645601:0:19421:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:0.0:1787831116.645616:0:19421:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:0.0:1787831116.646402:0:19421:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787831116.647761:0:19421:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787831116.650709:0:17120:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d233bf11600/0x95459fb9d1d29dd9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831116.650726:0:17120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d233bf11600/0x95459fb9d1d29dd9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831116.650734:0:17120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d233bf11600/0x95459fb9d1d29dd9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831116.713361:0:18633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787831117.457253:0:19488:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787831117.457511:0:19488:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787831117.734788:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787831117.798752:0:17102:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787831117.798760:0:17102:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d233f43f000 from 10 10000000:01000000:1.0:1787831117.798765:0:17102:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787831117.798814:0:17102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d23344b7e00/0x95459fb9d1d29de0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831117.798825:0:17102:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8d23344b7e00/0x95459fb9d1d29de0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831117.798837:0:17102:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8d23344b7e00/0x95459fb9d1d29de0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831117.798861:0:17102:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a20000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be45932f-3bcb-4e49-b61c-a2395180b0ee:17102:1874676443942272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787831117.798931:0:17102:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831117.798983:0:17102:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d23100b7300 going to sleep for 11 seconds 00000100:00100000:3.0:1787831117.799316:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443942272 00000100:00100000:3.0:1787831117.799324:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443942272 00000100:00100000:3.0:1787831117.799375:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787831117.799383:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203526050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be45932f-3bcb-4e49-b61c-a2395180b0ee+22:17102:x1874676443942272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787831117.799396:0:17098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787831117.799424:0:17098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2307c77200/0x95459fb9d1d29de7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d29de0 expref: -99 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831117.799458:0:17098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2307c77200/0x95459fb9d1d29de7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d29de0 expref: 23 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831117.799470:0:17098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2307c77200/0x95459fb9d1d29de7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d29de0 expref: 23 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831117.799480:0:17098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2307c77200, rc 0) 00000100:00100000:3.0:1787831117.799533:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203526050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be45932f-3bcb-4e49-b61c-a2395180b0ee+23:17102:x1874676443942272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 150us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831117.799541:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787831117.799821:0:17102:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a20000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be45932f-3bcb-4e49-b61c-a2395180b0ee:17102:1874676443942272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787831117.799839:0:17102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8d23344b7e00/0x95459fb9d1d29de0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d29de7 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831117.799849:0:17102:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8d23344b7e00/0x95459fb9d1d29de0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d29de7 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831117.799900:0:17102:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a20000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be45932f-3bcb-4e49-b61c-a2395180b0ee:17102:1874676443942400:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787831117.799934:0:17102:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831117.799967:0:17102:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d23100b7300 going to sleep for 11 seconds 00000100:00100000:0.0:1787831117.800037:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443942400 00000100:00100000:0.0:1787831117.800043:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443942400 00000100:00100000:0.0:1787831117.800080:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787831117.800088:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203527050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be45932f-3bcb-4e49-b61c-a2395180b0ee+23:17102:x1874676443942400:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787831117.800104:0:17096:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787831117.800121:0:17096:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787831117.800124:0:17096:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:0.0:1787831117.800341:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203527050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be45932f-3bcb-4e49-b61c-a2395180b0ee+23:17102:x1874676443942400:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 253us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831117.800348:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787831117.802260:0:17102:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a20000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be45932f-3bcb-4e49-b61c-a2395180b0ee:17102:1874676443942400:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787831117.807952:0:17102:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787831117.807972:0:17102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d23344b7e00/0x95459fb9d1d29de0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d29de7 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831117.807984:0:17102:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8d23344b7e00/0x95459fb9d1d29de0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d29de7 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787831117.807996:0:17102:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787831117.807998:0:17102:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d23115b5000 from 10 10000000:01000000:1.0:1787831117.808001:0:17102:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787831117.808043:0:17102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d23344b6e00/0x95459fb9d1d29dee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831117.808052:0:17102:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8d23344b6e00/0x95459fb9d1d29dee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831117.808063:0:17102:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8d23344b6e00/0x95459fb9d1d29dee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831117.808086:0:17102:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a20000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be45932f-3bcb-4e49-b61c-a2395180b0ee:17102:1874676443942528:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787831117.808147:0:17102:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831117.808183:0:17102:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d22027a7f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787831117.810478:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443942528 00000100:00100000:3.0:1787831117.810493:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443942528 00000100:00100000:3.0:1787831117.810715:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787831117.810727:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203524850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be45932f-3bcb-4e49-b61c-a2395180b0ee+23:17102:x1874676443942528:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787831117.810743:0:17098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787831117.810760:0:17098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2307c76800/0x95459fb9d1d29df5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d29dee expref: -99 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831117.810788:0:17098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2307c76800/0x95459fb9d1d29df5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d29dee expref: 24 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831117.810800:0:17098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2307c76800/0x95459fb9d1d29df5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d29dee expref: 24 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831117.810810:0:17098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2307c76800, rc 0) 00000100:00100000:3.0:1787831117.810880:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203524850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be45932f-3bcb-4e49-b61c-a2395180b0ee+24:17102:x1874676443942528:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 157us (2732us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831117.810901:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787831117.811041:0:17102:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a20000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be45932f-3bcb-4e49-b61c-a2395180b0ee:17102:1874676443942528:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787831117.811059:0:17102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8d23344b6e00/0x95459fb9d1d29dee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d29df5 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831117.811070:0:17102:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8d23344b6e00/0x95459fb9d1d29dee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d29df5 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831117.811146:0:17102:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a20000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be45932f-3bcb-4e49-b61c-a2395180b0ee:17102:1874676443942656:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787831117.811211:0:17102:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831117.811250:0:17102:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d22027a7f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787831117.811501:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443942656 00000100:00100000:3.0:1787831117.811507:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443942656 00000100:00100000:3.0:1787831117.811704:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787831117.811713:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2309e26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be45932f-3bcb-4e49-b61c-a2395180b0ee+24:17102:x1874676443942656:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1787831117.811729:0:17096:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787831117.811747:0:17096:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787831117.811750:0:17096:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:3.0:1787831117.811837:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2309e26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be45932f-3bcb-4e49-b61c-a2395180b0ee+24:17102:x1874676443942656:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 125us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831117.811846:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787831117.811895:0:17102:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a20000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be45932f-3bcb-4e49-b61c-a2395180b0ee:17102:1874676443942656:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787831117.811960:0:17102:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787831117.811969:0:17102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d23344b6e00/0x95459fb9d1d29dee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d29df5 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831117.811980:0:17102:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8d23344b6e00/0x95459fb9d1d29dee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d29df5 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831118.694819:0:3618:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787831103/real 1787831103] req@ffff8d2314ed7c00 x1874676443930112/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787831118 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787831118.694852:0:3618:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d2314ed7c00 x1874676443930112/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787831118 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787831118.694863:0:3618:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787831103/real 1787831103] req@ffff8d2314ed5e00 x1874676443929984/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787831118 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787831118.694879:0:3618:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d2314ed5e00 x1874676443929984/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787831118 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787831118.694897:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8d2303234000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787831118.694926:0:3618:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787831118.694930:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2314ed7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1874676443930112:0@lo:8:kworker.0 00000100:00080000:2.0:1787831118.694952:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8d232b962800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787831118.694959:0:3618:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787831118.694961:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2314ed5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1874676443929984:0@lo:8:kworker.0 00000100:00080000:1.0:1787831118.695148:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787831118.695152:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787831118.695155:0:37:0:(import.c:65:import_set_state_nolock()) ffff8d2303f2a800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787831118.695163:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d2303f2a800 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:1.0:1787831118.695180:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2204403840 x1874676443943168/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787831118.695201:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787831118.695203:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1787831118.695205:0:37:0:(import.c:65:import_set_state_nolock()) ffff8d232b962800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787831118.695208:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 394 00000100:00080000:1.0:1787831118.695212:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787831118.695215:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8d232b962800 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:1.0:1787831118.695224:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2204402580 x1874676443943552/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787831118.695231:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787831118.695233:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787831118.695234:0:37:0:(import.c:65:import_set_state_nolock()) ffff8d2303234000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787831118.695237:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 394 00000100:00080000:1.0:1787831118.695239:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787831118.695241:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8d2303234000 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:1.0:1787831118.695252:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2204400f00 x1874676443943680/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787831118.695273:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a22d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:be45932f-3bcb-4e49-b61c-a2395180b0ee:3622:1874676443942784:0@lo:400:kworker.0 00000100:00100000:3.0:1787831118.695343:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831118.695389:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22044012c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676443943424:0@lo:400:kworker.0 00000100:00100000:3.0:1787831118.695418:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831118.695441:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204400000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3622:1874676443944192:0@lo:400:kworker.0 00000100:00100000:3.0:1787831118.695470:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831118.695491:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787831118.695496:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204401680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3622:1874676443943296:0@lo:400:kworker.0 00000100:00100000:3.0:1787831118.695518:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831118.695533:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22044030c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3622:1874676443944064:0@lo:400:kworker.0 00000100:00100000:3.0:1787831118.695552:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831118.695590:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443944192 00000100:00100000:3.0:1787831118.695597:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443944192 00000100:00100000:2.0:1787831118.695649:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a203c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1874676443943040:0@lo:400:kworker.0 00000100:00100000:3.0:1787831118.695684:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443943296 00000100:00100000:2.0:1787831118.695686:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831118.695695:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443943296 00000100:00100000:2.0:1787831118.695711:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22044021c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3620:1874676443943936:0@lo:400:kworker.0 00000100:00100000:2.0:1787831118.695814:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831118.695830:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1787831118.695836:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1874676443942912:0@lo:400:kworker.0 00000100:00100000:2.0:1787831118.695864:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831118.695867:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443944064 00000100:00100000:3.0:1787831118.695872:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443944064 00000100:00100000:2.0:1787831118.695886:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204401e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3620:1874676443943808:0@lo:400:kworker.0 00000100:00100000:3.0:1787831118.695892:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443943936 00000100:00100000:3.0:1787831118.695896:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443943936 00000100:00100000:2.0:1787831118.695911:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831118.695917:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443943808 00000100:00100000:3.0:1787831118.695922:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443943808 00000100:00100000:2.0:1787831118.695926:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22044003c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3620:1874676443944320:0@lo:400:kworker.0 00000100:00100000:3.0:1787831118.695941:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787831118.695948:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831118.695953:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220442c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1874676443944192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787831118.695971:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443943424 00000100:00100000:2.0:1787831118.695976:0:17110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443943424 00000100:00100000:2.0:1787831118.696004:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443942912 00000100:00100000:2.0:1787831118.696007:0:17110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443942912 00000100:00100000:2.0:1787831118.696021:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787831118.696038:0:17110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220442da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676443943424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787831118.696267:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443942784 00000100:00100000:1.0:1787831118.696272:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443942784 00000100:00100000:1.0:1787831118.696340:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787831118.696348:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233c007450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be45932f-3bcb-4e49-b61c-a2395180b0ee+24:3622:x1874676443942784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787831118.696834:0:17110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220442da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676443943424:12345-0@lo:400:kworker.0 Request processed in 795us (1414us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831118.696843:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787831118.696863:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787831118.696872:0:17110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22038fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1874676443942912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787831118.696876:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220442c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1874676443944192:12345-0@lo:400:kworker.0 Request processed in 924us (1402us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831118.696888:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787831118.696906:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443944320 00000100:00100000:3.0:1787831118.696911:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443944320 00000100:00100000:2.0:1787831118.696929:0:17110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22038fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1874676443942912:12345-0@lo:400:kworker.0 Request processed in 57us (1064us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831118.696936:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787831118.696940:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787831118.696946:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220442de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1874676443943296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787831118.696966:0:18518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787831118.696975:0:18518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220442e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1874676443944064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787831118.696988:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220442de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1874676443943296:12345-0@lo:400:kworker.0 Request processed in 43us (1468us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831118.697011:0:18518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220442e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1874676443944064:12345-0@lo:400:kworker.0 Request processed in 38us (1457us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831118.697017:0:18518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787831118.697043:0:18518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787831118.697050:0:18518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22038f8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1874676443943936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787831118.697092:0:18518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22038f8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1874676443943936:12345-0@lo:400:kworker.0 Request processed in 43us (1278us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831118.697099:0:18518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787831118.697112:0:18518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787831118.697121:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787831118.697122:0:18518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22038f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1874676443943808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787831118.697145:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787831118.697155:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22038fa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1874676443944320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787831118.697159:0:18518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22038f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1874676443943808:12345-0@lo:400:kworker.0 Request processed in 37us (1245us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831118.697167:0:18518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787831118.697198:0:18609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443943040 00000100:00100000:2.0:1787831118.697202:0:18609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443943040 00000100:00100000:2.0:1787831118.697234:0:18609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787831118.697242:0:18609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22038f9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1874676443943040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787831118.697264:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22038fa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1874676443944320:12345-0@lo:400:kworker.0 Request processed in 110us (1314us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831118.697272:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787831118.697288:0:18609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22038f9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1874676443943040:12345-0@lo:400:kworker.0 Request processed in 46us (1601us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831118.697296:0:18609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1787831118.697297:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787831118.697302:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787831118.697307:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787831118.697338:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204403840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1874676443943168:0@lo:8:kworker.0 00000100:00100000:2.0:1787831118.697375:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1787831118.697384:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2204401680 x1874676443943296/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787831134 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787831118.697401:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204402580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1874676443943552:0@lo:8:kworker.0 00000100:00100000:3.0:1787831118.697415:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204401680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3622:1874676443943296:0@lo:400:kworker.0 00010000:00080000:3.0:1787831118.697436:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d22044030c0 x1874676443944064/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787831134 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787831118.697436:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831118.697448:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22044030c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3622:1874676443944064:0@lo:400:kworker.0 00010000:00080000:3.0:1787831118.697463:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2204400000 x1874676443944192/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787831134 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787831118.697469:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204400f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1874676443943680:0@lo:8:kworker.0 00000100:00100000:3.0:1787831118.697475:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204400000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3622:1874676443944192:0@lo:400:kworker.0 00000100:00100000:3.0:1787831118.697489:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22044012c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676443943424:0@lo:400:kworker.0 00000100:00100000:2.0:1787831118.697499:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831118.697544:0:18609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443943168 00000100:00100000:2.0:1787831118.697548:0:18609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443943168 00000100:00100000:3.0:1787831118.697558:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1874676443942912:0@lo:400:kworker.0 00000100:00100000:2.0:1787831118.697568:0:18609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443943552 00000100:00100000:2.0:1787831118.697572:0:18609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443943552 00010000:00080000:3.0:1787831118.697576:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2204401e00 x1874676443943808/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787831134 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787831118.697582:0:18609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443943680 00000100:00100000:2.0:1787831118.697586:0:18609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443943680 00000100:00100000:3.0:1787831118.697588:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204401e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3620:1874676443943808:0@lo:400:kworker.0 00000100:00100000:2.0:1787831118.697601:0:18609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1787831118.697609:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d22044003c0 x1874676443944320/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787831134 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787831118.697610:0:18609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22038fad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3618:x1874676443943168:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1787831118.697651:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22044003c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3620:1874676443944320:0@lo:400:kworker.0 00000100:00100000:3.0:1787831118.697667:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a203c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1874676443943040:0@lo:400:kworker.0 00010000:00080000:2.0:1787831118.697667:0:18609:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 409 last 0 00010000:00080000:3.0:1787831118.697684:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d22044021c0 x1874676443943936/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787831134 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787831118.697692:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22044021c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3620:1874676443943936:0@lo:400:kworker.0 00000020:00000080:2.0:1787831118.697699:0:18609:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x95459fb9d1d29dfc 00002000:00100000:2.0:1787831118.697714:0:18609:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8d2203b20000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211393d ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1787831118.697719:0:18609:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1787831118.697722:0:18609:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787831118.697894:0:18609:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00100000:0.0:1787831118.697902:0:18608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787831118.697911:0:18608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22038f8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3618:x1874676443943552:12345-0@lo:8:kworker.0 00000100:00080000:2.0:1787831118.697916:0:18609:0:(import.c:65:import_set_state_nolock()) ffff8d2203b23800 : changing import state from RECOVER to FULL 00010000:00080000:0.0:1787831118.697931:0:18608:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 409 last 0 00000020:00000080:0.0:1787831118.697954:0:18608:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x95459fb9d1d29e03 00002000:00100000:0.0:1787831118.697963:0:18608:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff8d22025c3800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211393d ocd_grant: 0 ocd_index: 0 ocd_group 1 00000100:00100000:2.0:1787831118.697964:0:18609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22038fad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3618:x1874676443943168:12345-0@lo:8:kworker.0 Request processed in 355us (587us total) trans 0 rc 0/0 00002000:00080000:0.0:1787831118.697971:0:18608:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:0.0:1787831118.697975:0:18608:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:2.0:1787831118.697978:0:18609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787831118.697993:0:18609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787831118.697998:0:18609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22038fb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3618:x1874676443943680:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1787831118.698015:0:18609:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 409 last 0 00002000:00080000:0.0:1787831118.698039:0:18608:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000020:00000080:2.0:1787831118.698055:0:18609:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x95459fb9d1d29e0a 00000100:00080000:0.0:1787831118.698057:0:18608:0:(import.c:65:import_set_state_nolock()) ffff8d22025c1000 : changing import state from RECOVER to FULL 00002000:00100000:2.0:1787831118.698065:0:18609:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff8d2203b27800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211393d ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:2.0:1787831118.698070:0:18609:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:2.0:1787831118.698072:0:18609:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787831118.698099:0:18609:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00100000:0.0:1787831118.698104:0:18608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22038f8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3618:x1874676443943552:12345-0@lo:8:kworker.0 Request processed in 190us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831118.698113:0:18608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:2.0:1787831118.698118:0:18609:0:(import.c:65:import_set_state_nolock()) ffff8d2203b24000 : changing import state from RECOVER to FULL 00010000:00080000:3.0:1787831118.698128:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2204403840 x1874676443943168/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787831143 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787831118.698147:0:3618:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1787831118.698155:0:3618:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00100000:2.0:1787831118.698159:0:18609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22038fb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3618:x1874676443943680:12345-0@lo:8:kworker.0 Request processed in 158us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831118.698168:0:18609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1787831118.698234:0:3618:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1787831118.698237:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8d2303f2a800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787831118.698266:0:3618:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787831118.698271:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204403840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1874676443943168:0@lo:8:kworker.0 00000100:00100000:3.0:1787831118.698289:0:3618:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787831118.698294:0:3618:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1787831118.698299:0:3618:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787831118.698302:0:3618:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1787831118.698303:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8d232b962800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787831118.698312:0:3618:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787831118.698315:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204402580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1874676443943552:0@lo:8:kworker.0 00010000:00080000:3.0:1787831118.698330:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2204400f00 x1874676443943680/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787831138 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787831118.698337:0:3618:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787831118.698340:0:3618:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1787831118.698345:0:3618:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787831118.698348:0:3618:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1787831118.698350:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8d2303234000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787831118.698361:0:3618:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787831118.698364:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204400f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1874676443943680:0@lo:8:kworker.0 00000004:00080000:3.0:1787831118.698396:0:17845:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787831118.698454:0:17845:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 409698829076ns, next at 0ns, rc = 0 00080000:00080000:3.0:1787831118.698461:0:17845:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:2.0:1787831118.698884:0:17130:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1787831118.698930:0:17130:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 409699305336ns, next at 0ns, rc = 0 00080000:00080000:2.0:1787831118.698936:0:17130:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:2.0:1787831118.698966:0:17843:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1787831118.699000:0:17843:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 409699375509ns, next at 0ns, rc = 0 00080000:00080000:2.0:1787831118.699005:0:17843:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:2.0:1787831118.699059:0:17846:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1787831118.699080:0:17846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22038f8f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17846:1874676443944576:0@lo:7:osp-pre-1-1.0 00000100:00100000:2.0:1787831118.699121:0:17846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831118.699142:0:17846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d22034db780 going to sleep for 11 seconds 00000100:00100000:2.0:1787831118.699154:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787831118.699164:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22038f92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443944448:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787831118.699189:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831118.699215:0:18611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443944448 00000100:00100000:2.0:1787831118.699221:0:18611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443944448 00000004:00080000:0.0:1787831118.699258:0:17131:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x6:0x0] 00000100:00100000:2.0:1787831118.699266:0:18611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787831118.699275:0:18611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2314ed5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3619:x1874676443944448:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787831118.699277:0:17131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220390d2c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17131:1874676443944832:0@lo:5:osp-pre-1-0.0 00002000:00000024:2.0:1787831118.699299:0:18611:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787831118.699313:0:17131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831118.699332:0:17131:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d232b9ab900 going to sleep for 11 seconds 00000004:00080000:0.0:1787831118.699358:0:17844:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:2.0:1787831118.699359:0:18611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2314ed5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3619:x1874676443944448:12345-0@lo:13:osp-pre-1-1.0 Request processed in 85us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831118.699369:0:18611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787831118.699377:0:17844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220390da40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17844:1874676443945088:0@lo:7:osp-pre-0-1.0 00000100:00100000:2.0:1787831118.699395:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220390f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443944704:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787831118.699416:0:17844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831118.699431:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831118.699437:0:17844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d232b9ab480 going to sleep for 11 seconds 00000100:00100000:0.0:1787831118.699455:0:18610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443944576 00000100:00100000:2.0:1787831118.699459:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787831118.699460:0:18610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443944576 00000100:00100000:2.0:1787831118.699467:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220390c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443944960:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787831118.699490:0:18610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443944832 00000100:00100000:2.0:1787831118.699495:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831118.699496:0:18610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443944832 00000100:00100000:0.0:1787831118.699515:0:18610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443945088 00000100:00100000:0.0:1787831118.699518:0:18610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443945088 00000100:00100000:0.0:1787831118.699533:0:18610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787831118.699540:0:18610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22038f9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17846:x1874676443944576:12345-0@lo:7:osp-pre-1-1.0 00000100:00080000:3.0:1787831118.699944:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787831118.699950:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787831118.699964:0:18914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787831118.699974:0:18914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220390ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17131:x1874676443944832:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1787831118.700094:0:18612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443944704 00000100:00100000:2.0:1787831118.700099:0:18612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443944704 00000100:00100000:2.0:1787831118.700115:0:18612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443944960 00000100:00100000:2.0:1787831118.700118:0:18612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443944960 00000100:00100000:2.0:1787831118.700130:0:18612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787831118.700137:0:18612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2314ed7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3621:x1874676443944704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787831118.700147:0:18612:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00010000:00080000:3.0:1787831118.701675:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d22038f92c0 x1874676443944448/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787831134 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787831118.701702:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22038f92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443944448:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787831118.702018:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233c007450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be45932f-3bcb-4e49-b61c-a2395180b0ee+24:3622:x1874676443942784:12345-0@lo:400:kworker.0 Request processed in 5668us (6673us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831118.702038:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787831118.702169:0:18612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2314ed7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3621:x1874676443944704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2031us (2738us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831118.702177:0:18612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787831118.702198:0:18612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787831118.702208:0:18612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2314ed4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3621:x1874676443944960:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787831118.702233:0:18612:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787831118.702268:0:18612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2314ed4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3621:x1874676443944960:12345-0@lo:13:osp-pre-0-1.0 Request processed in 65us (2776us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831118.702275:0:18612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787831118.702693:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a22d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:be45932f-3bcb-4e49-b61c-a2395180b0ee:3622:1874676443942784:0@lo:400:kworker.0 00000100:00100000:0.0:1787831118.702862:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220390c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443944960:0@lo:13:osp-pre-0-1.0 00010000:00080000:0.0:1787831118.702878:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d220390f480 x1874676443944704/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787831134 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787831118.702893:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220390f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443944704:0@lo:13:osp-pre-1-0.0 00000004:00080000:0.0:1787831118.707820:0:17084:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:1.0:1787831118.707931:0:17835:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00002000:00080000:0.0:1787831118.711163:0:18610:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:0.0:1787831118.711172:0:18610:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1787831118.711276:0:18610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22038f9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17846:x1874676443944576:12345-0@lo:7:osp-pre-1-1.0 Request processed in 11731us (12149us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831118.711288:0:18610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000004:00080000:1.0:1787831118.711296:0:17835:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:0.0:1787831118.711322:0:18610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787831118.711336:0:18610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220390f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17844:x1874676443945088:12345-0@lo:7:osp-pre-0-1.0 00010000:00080000:2.0:1787831118.711581:0:17846:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d22038f8f00 x1874676443944576/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787831134 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787831118.711596:0:17846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22038f8f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17846:1874676443944576:0@lo:7:osp-pre-1-1.0 00000004:00080000:2.0:1787831118.711614:0:17846:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:2.0:1787831118.711674:0:17846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2314ed52c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17846:1874676443945216:0@lo:5:osp-pre-1-1.0 00000100:00100000:2.0:1787831118.711709:0:17846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831118.711734:0:17846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d22034db780 going to sleep for 11 seconds 00000100:00100000:0.0:1787831118.711890:0:18608:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:0.0:1787831118.711898:0:18608:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:0.0:1787831118.713970:0:18608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443945216 00000100:00100000:0.0:1787831118.713980:0:18608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443945216 00002000:00080000:3.0:1787831118.714315:0:18914:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:3.0:1787831118.714325:0:18914:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:3.0:1787831118.714331:0:18914:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:7 to 0x2c0000401:33) 00000100:00100000:1.0:1787831118.714338:0:19566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787831118.714351:0:19566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2314ed5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:17846:x1874676443945216:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1787831118.714379:0:19566:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:1.0:1787831118.714511:0:19566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2314ed5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:17846:x1874676443945216:12345-0@lo:5:osp-pre-1-1.0 Request processed in 162us (2800us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831118.714519:0:19566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1787831118.714775:0:17846:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2314ed52c0 x1874676443945216/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787831134 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787831118.714791:0:17846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2314ed52c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17846:1874676443945216:0@lo:5:osp-pre-1-1.0 00000004:00080000:2.0:1787831118.714805:0:17846:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:2.0:1787831118.714847:0:17846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2314ed52c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17846:1874676443945344:0@lo:5:osp-pre-1-1.0 00000100:00100000:2.0:1787831118.714886:0:17846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831118.714910:0:17846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d22034db780 going to sleep for 11 seconds 00000100:00100000:2.0:1787831118.714925:0:18608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443945344 00000100:00100000:2.0:1787831118.714929:0:18608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443945344 00000100:00100000:2.0:1787831118.714957:0:18608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787831118.714966:0:18608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2314ed5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17846:x1874676443945344:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:2.0:1787831118.714991:0:18608:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00002000:00080000:1.0:1787831118.728087:0:18610:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:1.0:1787831118.728096:0:18610:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:1.0:1787831118.728195:0:18610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220390f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17844:x1874676443945088:12345-0@lo:7:osp-pre-0-1.0 Request processed in 16861us (28776us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831118.728207:0:18610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787831118.728500:0:17844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220390da40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17844:1874676443945088:0@lo:7:osp-pre-0-1.0 00000004:00080000:0.0:1787831118.728522:0:17844:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:0.0:1787831118.728560:0:17844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220390da40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17844:1874676443945472:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1787831118.728599:0:17844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831118.728699:0:17844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d232b9ab480 going to sleep for 11 seconds 00002000:00010000:3.0:1787831118.729609:0:18914:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787831118.729618:0:18914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ffb6e523/0x95459fb9d1d29e11 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831118.730218:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=409s v=(0 0) 00010000:00010000:3.0:1787831118.730222:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787831118.730229:0:18914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ffb6e523/0x95459fb9d1d29e11 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831118.730249:0:18914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ffb6e523/0x95459fb9d1d29e11 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831118.730259:0:18914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ffb6e523/0x95459fb9d1d29e11 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831118.730279:0:18914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ffb6e523/0x95459fb9d1d29e11 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831118.730298:0:18914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787831118.731319:0:19566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443945472 00000100:00100000:1.0:1787831118.731707:0:19566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443945472 00010000:00010000:1.0:1787831118.731820:0:17093:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787831118.731829:0:17093:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ffb6e523/0x95459fb9d1d29e11 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831118.731841:0:17093:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2307c76000 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:1.0:1787831118.731857:0:17093:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ffb6e523/0x95459fb9d1d29e11 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831118.731868:0:17093:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ffb6e523/0x95459fb9d1d29e11 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831118.731887:0:19566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00010000:00010000:1.0:1787831118.731891:0:17093:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ffb6e523/0x95459fb9d1d29e11 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831118.731899:0:19566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220390f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:17844:x1874676443945472:12345-0@lo:5:osp-pre-0-1.0 00010000:00010000:1.0:1787831118.731903:0:17093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ffb6e523/0x95459fb9d1d29e11 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831118.731928:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787831118.731930:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787831118.731932:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1787831118.731948:0:19566:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:2.0:1787831118.732117:0:19566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220390f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:17844:x1874676443945472:12345-0@lo:5:osp-pre-0-1.0 Request processed in 222us (3517us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831118.732125:0:19566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787831118.732266:0:17844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220390da40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17844:1874676443945472:0@lo:5:osp-pre-0-1.0 00000004:00080000:1.0:1787831118.732278:0:17844:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:1.0:1787831118.732321:0:17844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204401a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17844:1874676443945600:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1787831118.732357:0:17844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831118.732459:0:17844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d233be68540 going to sleep for 11 seconds 00002000:00010000:2.0:1787831118.732493:0:18914:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787831118.732500:0:18914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5e07209/0x95459fb9d1d29e18 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831118.732518:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=409s v=(0 0) 00010000:00010000:2.0:1787831118.732522:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787831118.732528:0:18914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c5e07209/0x95459fb9d1d29e18 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831118.732542:0:18914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c5e07209/0x95459fb9d1d29e18 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831118.732552:0:18914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5e07209/0x95459fb9d1d29e18 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831118.732560:0:18914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c5e07209/0x95459fb9d1d29e18 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831118.732581:0:18914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787831118.732620:0:18633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787831118.732642:0:18633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c5e07209/0x95459fb9d1d29e18 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831118.732650:0:18633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22039c1000 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:1.0:1787831118.732653:0:18633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5e07209/0x95459fb9d1d29e18 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831118.732667:0:18633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5e07209/0x95459fb9d1d29e18 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831118.732680:0:18633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c5e07209/0x95459fb9d1d29e18 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831118.732686:0:18633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c5e07209/0x95459fb9d1d29e18 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831118.732699:0:18633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787831118.732701:0:18633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787831118.732702:0:18633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787831118.732815:0:18610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443945600 00000100:00100000:3.0:1787831118.732820:0:18610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443945600 00000100:00100000:3.0:1787831118.732854:0:18610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787831118.732862:0:18610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204403480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17844:x1874676443945600:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:3.0:1787831118.732891:0:18610:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00002000:00010000:3.0:1787831118.733904:0:18914:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787831118.733915:0:18914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027d68771/0x95459fb9d1d29e1f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831118.733928:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=409s v=(0 0) 00010000:00010000:3.0:1787831118.733932:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787831118.733937:0:18914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000027d68771/0x95459fb9d1d29e1f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831118.733949:0:18914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000027d68771/0x95459fb9d1d29e1f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831118.733959:0:18914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027d68771/0x95459fb9d1d29e1f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831118.733965:0:18914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000027d68771/0x95459fb9d1d29e1f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831118.733997:0:18914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787831118.734127:0:17092:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787831118.734138:0:17092:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000027d68771/0x95459fb9d1d29e1f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831118.734147:0:17092:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2307c76200 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:0.0:1787831118.734152:0:17092:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000027d68771/0x95459fb9d1d29e1f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831118.734161:0:17092:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000027d68771/0x95459fb9d1d29e1f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831118.734180:0:17092:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000027d68771/0x95459fb9d1d29e1f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831118.734188:0:17092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000027d68771/0x95459fb9d1d29e1f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831118.734205:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787831118.734208:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787831118.734210:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787831118.737307:0:18914:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787831118.737318:0:18914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000044ec40b6/0x95459fb9d1d29e26 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831118.737336:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=409s v=(0 0) 00010000:00010000:3.0:1787831118.737340:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787831118.737346:0:18914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000044ec40b6/0x95459fb9d1d29e26 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831118.737423:0:18914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000044ec40b6/0x95459fb9d1d29e26 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831118.737435:0:18914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000044ec40b6/0x95459fb9d1d29e26 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831118.737443:0:18914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000044ec40b6/0x95459fb9d1d29e26 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831118.737468:0:18914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787831118.737521:0:17093:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787831118.737530:0:17093:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000044ec40b6/0x95459fb9d1d29e26 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831118.737540:0:17093:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2307c76c00 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:2.0:1787831118.737545:0:17093:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000044ec40b6/0x95459fb9d1d29e26 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831118.737555:0:17093:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000044ec40b6/0x95459fb9d1d29e26 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831118.737587:0:17093:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000044ec40b6/0x95459fb9d1d29e26 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831118.737595:0:17093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000044ec40b6/0x95459fb9d1d29e26 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831118.737616:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787831118.737618:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787831118.737620:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787831118.744016:0:18914:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787831118.744039:0:18914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000903060dd/0x95459fb9d1d29e2d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831118.744056:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=409s v=(0 0) 00010000:00010000:1.0:1787831118.744061:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787831118.744067:0:18914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000903060dd/0x95459fb9d1d29e2d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831118.744081:0:18914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000903060dd/0x95459fb9d1d29e2d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831118.744092:0:18914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000903060dd/0x95459fb9d1d29e2d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831118.744107:0:18914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000903060dd/0x95459fb9d1d29e2d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831118.744133:0:18914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787831118.744714:0:18633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787831118.744722:0:18633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000903060dd/0x95459fb9d1d29e2d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831118.744744:0:18633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d23344b6a00 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:0.0:1787831118.744749:0:18633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000903060dd/0x95459fb9d1d29e2d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831118.744759:0:18633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000903060dd/0x95459fb9d1d29e2d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831118.744777:0:18633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000903060dd/0x95459fb9d1d29e2d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831118.744785:0:18633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000903060dd/0x95459fb9d1d29e2d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831118.744802:0:18633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787831118.744804:0:18633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787831118.744806:0:18633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787831118.744943:0:18914:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787831118.744951:0:18914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000920a8703/0x95459fb9d1d29e34 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831118.744961:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=409s v=(0 0) 00010000:00010000:1.0:1787831118.744964:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787831118.744970:0:18914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000920a8703/0x95459fb9d1d29e34 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831118.744981:0:18914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000920a8703/0x95459fb9d1d29e34 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831118.744989:0:18914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000920a8703/0x95459fb9d1d29e34 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831118.744999:0:18914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000920a8703/0x95459fb9d1d29e34 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831118.745035:0:18914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787831118.745055:0:17092:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787831118.745062:0:17092:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000920a8703/0x95459fb9d1d29e34 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831118.745070:0:17092:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d23344b6600 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:0.0:1787831118.745074:0:17092:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000920a8703/0x95459fb9d1d29e34 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831118.745082:0:17092:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000920a8703/0x95459fb9d1d29e34 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831118.745101:0:17092:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000920a8703/0x95459fb9d1d29e34 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831118.745108:0:17092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000920a8703/0x95459fb9d1d29e34 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831118.745121:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787831118.745123:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787831118.745125:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787831118.746295:0:18914:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787831118.746307:0:18914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039b296cc/0x95459fb9d1d29e3b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831118.746326:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=409s v=(0 0) 00010000:00010000:1.0:1787831118.746331:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787831118.746337:0:18914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000039b296cc/0x95459fb9d1d29e3b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831118.746349:0:18914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000039b296cc/0x95459fb9d1d29e3b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831118.746358:0:18914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039b296cc/0x95459fb9d1d29e3b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831118.746366:0:18914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000039b296cc/0x95459fb9d1d29e3b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831118.746463:0:18914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787831118.750598:0:17093:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787831118.750610:0:17093:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000039b296cc/0x95459fb9d1d29e3b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831118.750638:0:17093:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d23344b6200 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:3.0:1787831118.750651:0:17093:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000039b296cc/0x95459fb9d1d29e3b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831118.750664:0:17093:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000039b296cc/0x95459fb9d1d29e3b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831118.750684:0:17093:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000039b296cc/0x95459fb9d1d29e3b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831118.750693:0:17093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000039b296cc/0x95459fb9d1d29e3b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831118.750714:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787831118.750716:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787831118.750718:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787831118.751946:0:18914:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787831118.751960:0:18914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5e07209/0x95459fb9d1d29e42 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831118.751976:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=409s v=(0 0) 00010000:00010000:2.0:1787831118.751980:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787831118.751987:0:18914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c5e07209/0x95459fb9d1d29e42 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831118.752002:0:18914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c5e07209/0x95459fb9d1d29e42 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831118.752012:0:18914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5e07209/0x95459fb9d1d29e42 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831118.752020:0:18914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c5e07209/0x95459fb9d1d29e42 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831118.752070:0:18914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787831118.752099:0:18633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787831118.752108:0:18633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c5e07209/0x95459fb9d1d29e42 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831118.752119:0:18633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22039c1000 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:3.0:1787831118.752123:0:18633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5e07209/0x95459fb9d1d29e42 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831118.752132:0:18633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5e07209/0x95459fb9d1d29e42 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831118.752149:0:18633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c5e07209/0x95459fb9d1d29e42 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831118.752164:0:18633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c5e07209/0x95459fb9d1d29e42 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831118.752183:0:18633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787831118.752185:0:18633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787831118.752187:0:18633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787831118.753062:0:19422:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:2.0:1787831118.753076:0:19422:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1787831118.753080:0:19422:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:3.0:1787831118.753153:0:18914:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787831118.753161:0:18914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f7c0c50/0x95459fb9d1d29e49 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831118.753172:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=409s v=(0 0) 00010000:00010000:3.0:1787831118.753176:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787831118.753182:0:18914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f7c0c50/0x95459fb9d1d29e49 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831118.753194:0:18914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008f7c0c50/0x95459fb9d1d29e49 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831118.753203:0:18914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f7c0c50/0x95459fb9d1d29e49 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831118.753211:0:18914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008f7c0c50/0x95459fb9d1d29e49 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831118.753229:0:18914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787831118.753232:0:18608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2314ed5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:17846:x1874676443945344:12345-0@lo:5:osp-pre-1-1.0 Request processed in 38264us (38341us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1787831118.753242:0:18608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787831118.753296:0:17846:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1787831118.753305:0:17846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2314ed52c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17846:1874676443945344:0@lo:5:osp-pre-1-1.0 00000004:00080000:2.0:1787831118.753321:0:17846:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:2.0:1787831118.753369:0:17846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2314ed52c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17846:1874676443945728:0@lo:900:osp-pre-1-1.0 00000100:00100000:2.0:1787831118.753402:0:17846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831118.753433:0:17846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d22034db780 going to sleep for 11 seconds 00010000:00010000:0.0:1787831118.753477:0:17092:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787831118.753483:0:17092:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008f7c0c50/0x95459fb9d1d29e49 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831118.753490:0:17092:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2307c76a00 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:0.0:1787831118.753494:0:17092:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008f7c0c50/0x95459fb9d1d29e49 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831118.753502:0:17092:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008f7c0c50/0x95459fb9d1d29e49 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831118.753517:0:17092:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008f7c0c50/0x95459fb9d1d29e49 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831118.753523:0:17092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008f7c0c50/0x95459fb9d1d29e49 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787831118.753532:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443945728 00000100:00100000:3.0:1787831118.753546:0:17116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443945728 00010000:00010000:0.0:1787831118.753549:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787831118.753552:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787831118.753554:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787831118.753592:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787831118.753602:0:17116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2314ed61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17846:x1874676443945728:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:3.0:1787831118.753676:0:17116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2314ed61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17846:x1874676443945728:12345-0@lo:900:osp-pre-1-1.0 Request processed in 76us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831118.753682:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787831118.753711:0:17846:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2314ed52c0 x1874676443945728/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787831134 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787831118.753722:0:17846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2314ed52c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17846:1874676443945728:0@lo:900:osp-pre-1-1.0 00002000:00010000:3.0:1787831118.754642:0:18914:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787831118.754652:0:18914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000030a0b447/0x95459fb9d1d29e50 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831118.754666:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=409s v=(0 0) 00010000:00010000:3.0:1787831118.754670:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787831118.754676:0:18914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000030a0b447/0x95459fb9d1d29e50 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831118.754689:0:18914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000030a0b447/0x95459fb9d1d29e50 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831118.754699:0:18914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000030a0b447/0x95459fb9d1d29e50 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831118.754706:0:18914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000030a0b447/0x95459fb9d1d29e50 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831118.754733:0:18914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787831118.754742:0:17093:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787831118.754747:0:17093:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000030a0b447/0x95459fb9d1d29e50 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831118.754755:0:17093:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2307c76600 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:3.0:1787831118.754759:0:17093:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000030a0b447/0x95459fb9d1d29e50 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831118.754768:0:17093:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000030a0b447/0x95459fb9d1d29e50 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831118.754782:0:17093:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000030a0b447/0x95459fb9d1d29e50 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831118.754790:0:17093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000030a0b447/0x95459fb9d1d29e50 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831118.754805:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787831118.754807:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787831118.754808:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787831118.756455:0:18914:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787831118.756466:0:18914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000044ec40b6/0x95459fb9d1d29e57 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831118.756831:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=409s v=(0 0) 00010000:00010000:3.0:1787831118.756844:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787831118.756852:0:18914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000044ec40b6/0x95459fb9d1d29e57 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831118.756867:0:18914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000044ec40b6/0x95459fb9d1d29e57 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831118.756878:0:18914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000044ec40b6/0x95459fb9d1d29e57 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831118.756886:0:18914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000044ec40b6/0x95459fb9d1d29e57 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831118.757320:0:18914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787831118.757905:0:18914:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787831118.757915:0:18914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027d68771/0x95459fb9d1d29e5e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831118.757927:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=409s v=(0 0) 00010000:00010000:3.0:1787831118.757931:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787831118.757936:0:18914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000027d68771/0x95459fb9d1d29e5e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831118.757947:0:18914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000027d68771/0x95459fb9d1d29e5e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831118.757956:0:18914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027d68771/0x95459fb9d1d29e5e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831118.757970:0:18914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000027d68771/0x95459fb9d1d29e5e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831118.758249:0:18633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787831118.758257:0:18633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000044ec40b6/0x95459fb9d1d29e57 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831118.758266:0:18633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2307c76c00 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:2.0:1787831118.758270:0:18633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000044ec40b6/0x95459fb9d1d29e57 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831118.758280:0:18633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000044ec40b6/0x95459fb9d1d29e57 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831118.758311:0:18633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000044ec40b6/0x95459fb9d1d29e57 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831118.758319:0:18633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000044ec40b6/0x95459fb9d1d29e57 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831118.758336:0:18633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787831118.758340:0:18633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000027d68771/0x95459fb9d1d29e5e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831118.758346:0:18633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2307c76200 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:2.0:1787831118.758350:0:18633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000027d68771/0x95459fb9d1d29e5e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831118.758357:0:18633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000027d68771/0x95459fb9d1d29e5e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831118.758365:0:18633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000027d68771/0x95459fb9d1d29e5e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831118.758372:0:18633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787831118.758374:0:18633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787831118.758375:0:18633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787831118.758463:0:18914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787831118.758468:0:18914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000027d68771/0x95459fb9d1d29e5e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787831118.759395:0:18914:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787831118.759403:0:18914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ffb6e523/0x95459fb9d1d29e65 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831118.759415:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=409s v=(0 0) 00010000:00010000:3.0:1787831118.759418:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787831118.759424:0:18914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ffb6e523/0x95459fb9d1d29e65 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831118.759435:0:18914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ffb6e523/0x95459fb9d1d29e65 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831118.759445:0:18914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ffb6e523/0x95459fb9d1d29e65 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831118.759452:0:18914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ffb6e523/0x95459fb9d1d29e65 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831118.759720:0:17092:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787831118.759727:0:17092:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ffb6e523/0x95459fb9d1d29e65 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831118.759746:0:17092:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2307c76000 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:2.0:1787831118.759749:0:17092:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ffb6e523/0x95459fb9d1d29e65 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831118.759758:0:17092:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ffb6e523/0x95459fb9d1d29e65 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831118.759772:0:17092:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ffb6e523/0x95459fb9d1d29e65 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831118.759781:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787831118.759782:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787831118.759784:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787831118.759953:0:18914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787831118.759959:0:18914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ffb6e523/0x95459fb9d1d29e65 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831118.761393:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787831118.761438:0:18633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787831118.763154:0:18914:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787831118.763167:0:18914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6e95077/0x95459fb9d1d29e6c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831118.763185:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=409s v=(0 0) 00010000:00010000:0.0:1787831118.763190:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787831118.763197:0:18914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e6e95077/0x95459fb9d1d29e6c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831118.763212:0:18914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e6e95077/0x95459fb9d1d29e6c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831118.763222:0:18914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6e95077/0x95459fb9d1d29e6c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831118.763229:0:18914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e6e95077/0x95459fb9d1d29e6c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831118.763262:0:18914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787831118.763433:0:17092:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787831118.763441:0:17092:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e6e95077/0x95459fb9d1d29e6c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831118.763449:0:17092:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233bf11000 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:2.0:1787831118.763454:0:17092:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6e95077/0x95459fb9d1d29e6c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831118.763462:0:17092:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6e95077/0x95459fb9d1d29e6c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831118.763490:0:17092:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e6e95077/0x95459fb9d1d29e6c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831118.763498:0:17092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e6e95077/0x95459fb9d1d29e6c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831118.763530:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787831118.763532:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787831118.763534:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787831118.763692:0:18914:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787831118.763699:0:18914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000509b85e5/0x95459fb9d1d29e73 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831118.763775:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=409s v=(0 0) 00010000:00010000:0.0:1787831118.763779:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787831118.763784:0:18914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000509b85e5/0x95459fb9d1d29e73 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831118.763793:0:18914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000509b85e5/0x95459fb9d1d29e73 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831118.763802:0:18914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000509b85e5/0x95459fb9d1d29e73 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831118.763809:0:18914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000509b85e5/0x95459fb9d1d29e73 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831118.763827:0:18914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787831118.763963:0:17093:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787831118.763969:0:17093:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000509b85e5/0x95459fb9d1d29e73 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831118.763977:0:17093:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233bf10800 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:0.0:1787831118.763981:0:17093:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000509b85e5/0x95459fb9d1d29e73 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831118.763989:0:17093:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000509b85e5/0x95459fb9d1d29e73 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831118.764012:0:17093:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000509b85e5/0x95459fb9d1d29e73 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831118.764020:0:17093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000509b85e5/0x95459fb9d1d29e73 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831118.764045:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787831118.764047:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787831118.764049:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787831118.764565:0:18914:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787831118.764573:0:18914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000188990d4/0x95459fb9d1d29e7a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831118.764582:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=409s v=(0 0) 00010000:00010000:0.0:1787831118.764586:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787831118.764591:0:18914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000188990d4/0x95459fb9d1d29e7a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831118.764601:0:18914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000188990d4/0x95459fb9d1d29e7a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831118.764609:0:18914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000188990d4/0x95459fb9d1d29e7a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831118.764616:0:18914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000188990d4/0x95459fb9d1d29e7a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831118.764759:0:18914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787831118.764789:0:18633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787831118.764796:0:18633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000188990d4/0x95459fb9d1d29e7a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831118.764806:0:18633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233bf11600 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:1.0:1787831118.764811:0:18633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000188990d4/0x95459fb9d1d29e7a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831118.764821:0:18633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000188990d4/0x95459fb9d1d29e7a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831118.764850:0:18633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000188990d4/0x95459fb9d1d29e7a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831118.764858:0:18633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000188990d4/0x95459fb9d1d29e7a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831118.764874:0:18633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787831118.764877:0:18633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787831118.764879:0:18633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787831118.765358:0:18914:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787831118.765365:0:18914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032c42f53/0x95459fb9d1d29e81 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831118.765375:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=409s v=(0 0) 00010000:00010000:0.0:1787831118.765378:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787831118.765383:0:18914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032c42f53/0x95459fb9d1d29e81 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831118.765393:0:18914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032c42f53/0x95459fb9d1d29e81 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831118.765401:0:18914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032c42f53/0x95459fb9d1d29e81 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831118.765409:0:18914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032c42f53/0x95459fb9d1d29e81 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831118.765433:0:18914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787831118.765547:0:17092:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787831118.765553:0:17092:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032c42f53/0x95459fb9d1d29e81 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831118.765561:0:17092:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233bf11800 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:1.0:1787831118.765565:0:17092:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032c42f53/0x95459fb9d1d29e81 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831118.765572:0:17092:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032c42f53/0x95459fb9d1d29e81 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831118.765586:0:17092:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032c42f53/0x95459fb9d1d29e81 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831118.765593:0:17092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032c42f53/0x95459fb9d1d29e81 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831118.765640:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787831118.765642:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787831118.765645:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787831118.766168:0:18914:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787831118.766175:0:18914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8fc040b/0x95459fb9d1d29e88 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831118.766185:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=409s v=(0 0) 00010000:00010000:0.0:1787831118.766194:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787831118.766200:0:18914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d8fc040b/0x95459fb9d1d29e88 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831118.766212:0:18914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d8fc040b/0x95459fb9d1d29e88 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831118.766220:0:18914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8fc040b/0x95459fb9d1d29e88 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831118.766228:0:18914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d8fc040b/0x95459fb9d1d29e88 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831118.766256:0:18914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787831118.766467:0:17093:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787831118.766478:0:17093:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d8fc040b/0x95459fb9d1d29e88 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831118.766486:0:17093:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233bf10c00 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:1.0:1787831118.766490:0:17093:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8fc040b/0x95459fb9d1d29e88 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831118.766498:0:17093:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8fc040b/0x95459fb9d1d29e88 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831118.766513:0:17093:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d8fc040b/0x95459fb9d1d29e88 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831118.766651:0:17093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d8fc040b/0x95459fb9d1d29e88 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831118.766674:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787831118.766677:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787831118.766679:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787831118.768900:0:18914:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787831118.768913:0:18914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ffb6e523/0x95459fb9d1d29e8f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831118.768929:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=409s v=(0 0) 00010000:00010000:3.0:1787831118.768934:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787831118.768941:0:18914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ffb6e523/0x95459fb9d1d29e8f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831118.768956:0:18914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ffb6e523/0x95459fb9d1d29e8f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831118.768966:0:18914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ffb6e523/0x95459fb9d1d29e8f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831118.768975:0:18914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ffb6e523/0x95459fb9d1d29e8f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831118.769000:0:18914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787831118.769472:0:18633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787831118.769481:0:18633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ffb6e523/0x95459fb9d1d29e8f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831118.769490:0:18633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2307c76000 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:0.0:1787831118.769495:0:18633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ffb6e523/0x95459fb9d1d29e8f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831118.769504:0:18633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ffb6e523/0x95459fb9d1d29e8f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831118.769522:0:18633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ffb6e523/0x95459fb9d1d29e8f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831118.769542:0:18633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ffb6e523/0x95459fb9d1d29e8f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831118.769560:0:18633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787831118.769562:0:18633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787831118.769563:0:18633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787831118.769683:0:18914:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787831118.769691:0:18914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027d68771/0x95459fb9d1d29e96 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831118.769707:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=409s v=(0 0) 00010000:00010000:3.0:1787831118.769711:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787831118.769716:0:18914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000027d68771/0x95459fb9d1d29e96 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831118.769727:0:18914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000027d68771/0x95459fb9d1d29e96 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831118.769735:0:18914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027d68771/0x95459fb9d1d29e96 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831118.769742:0:18914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000027d68771/0x95459fb9d1d29e96 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831118.769760:0:18914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787831118.769895:0:17092:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787831118.769901:0:17092:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000027d68771/0x95459fb9d1d29e96 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831118.769910:0:17092:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2307c76200 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:0.0:1787831118.769914:0:17092:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000027d68771/0x95459fb9d1d29e96 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831118.769922:0:17092:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000027d68771/0x95459fb9d1d29e96 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831118.769934:0:17092:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000027d68771/0x95459fb9d1d29e96 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831118.769942:0:17092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000027d68771/0x95459fb9d1d29e96 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831118.769958:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787831118.769960:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787831118.769962:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787831118.770203:0:18914:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787831118.770209:0:18914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000030a0b447/0x95459fb9d1d29e9d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831118.770217:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=409s v=(0 0) 00010000:00010000:3.0:1787831118.770221:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787831118.770225:0:18914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000030a0b447/0x95459fb9d1d29e9d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831118.770234:0:18914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000030a0b447/0x95459fb9d1d29e9d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831118.770255:0:18914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000030a0b447/0x95459fb9d1d29e9d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831118.770263:0:18914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000030a0b447/0x95459fb9d1d29e9d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831118.770286:0:18914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787831118.770399:0:17093:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787831118.770405:0:17093:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000030a0b447/0x95459fb9d1d29e9d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831118.770412:0:17093:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2307c76600 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:0.0:1787831118.770415:0:17093:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000030a0b447/0x95459fb9d1d29e9d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831118.770423:0:17093:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000030a0b447/0x95459fb9d1d29e9d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831118.770434:0:17093:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000030a0b447/0x95459fb9d1d29e9d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831118.770440:0:17093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000030a0b447/0x95459fb9d1d29e9d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831118.770454:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787831118.770455:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787831118.770457:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787831118.770530:0:18914:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787831118.770536:0:18914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f3975c6/0x95459fb9d1d29ea4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831118.770546:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=409s v=(0 0) 00010000:00010000:3.0:1787831118.770549:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787831118.770554:0:18914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007f3975c6/0x95459fb9d1d29ea4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831118.770562:0:18914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007f3975c6/0x95459fb9d1d29ea4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831118.770569:0:18914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f3975c6/0x95459fb9d1d29ea4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831118.770577:0:18914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007f3975c6/0x95459fb9d1d29ea4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831118.770650:0:18914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787831118.770824:0:18633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787831118.770829:0:18633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007f3975c6/0x95459fb9d1d29ea4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831118.770836:0:18633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2307c76400 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:0.0:1787831118.770840:0:18633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007f3975c6/0x95459fb9d1d29ea4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831118.770859:0:18633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007f3975c6/0x95459fb9d1d29ea4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831118.770871:0:18633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007f3975c6/0x95459fb9d1d29ea4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831118.770878:0:18633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007f3975c6/0x95459fb9d1d29ea4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831118.770892:0:18633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787831118.770894:0:18633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787831118.770896:0:18633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787831118.770975:0:18914:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787831118.770980:0:18914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000023de687f/0x95459fb9d1d29eab lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831118.770989:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=409s v=(0 0) 00010000:00010000:3.0:1787831118.770992:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787831118.770997:0:18914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000023de687f/0x95459fb9d1d29eab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831118.771006:0:18914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000023de687f/0x95459fb9d1d29eab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831118.771015:0:18914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000023de687f/0x95459fb9d1d29eab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831118.771045:0:18914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000023de687f/0x95459fb9d1d29eab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831118.771060:0:18914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787831118.771436:0:17092:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787831118.771442:0:17092:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000023de687f/0x95459fb9d1d29eab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831118.771450:0:17092:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2307c77800 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:0.0:1787831118.771454:0:17092:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000023de687f/0x95459fb9d1d29eab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831118.771463:0:17092:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000023de687f/0x95459fb9d1d29eab lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831118.771476:0:17092:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000023de687f/0x95459fb9d1d29eab lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831118.771497:0:17092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000023de687f/0x95459fb9d1d29eab lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787831118.772157:0:18914:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787831118.772167:0:18914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5385f2b/0x95459fb9d1d29eb2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831118.772192:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=409s v=(0 0) 00010000:00010000:1.0:1787831118.772196:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787831118.772202:0:18914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d5385f2b/0x95459fb9d1d29eb2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831118.772214:0:18914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d5385f2b/0x95459fb9d1d29eb2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831118.772224:0:18914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5385f2b/0x95459fb9d1d29eb2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831118.772232:0:18914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d5385f2b/0x95459fb9d1d29eb2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831118.772249:0:18914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787831118.772585:0:18914:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787831118.772592:0:18914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039b296cc/0x95459fb9d1d29eb9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831118.772601:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=409s v=(0 0) 00010000:00010000:1.0:1787831118.772604:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787831118.772610:0:18914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000039b296cc/0x95459fb9d1d29eb9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831118.772620:0:18914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000039b296cc/0x95459fb9d1d29eb9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831118.772799:0:18914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039b296cc/0x95459fb9d1d29eb9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831118.772806:0:18914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000039b296cc/0x95459fb9d1d29eb9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831118.772855:0:18914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1787831118.773937:0:18914:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787831118.773947:0:18914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000920a8703/0x95459fb9d1d29ec0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831118.773960:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=409s v=(0 0) 00010000:00010000:1.0:1787831118.773964:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787831118.773971:0:18914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000920a8703/0x95459fb9d1d29ec0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831118.773982:0:18914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000920a8703/0x95459fb9d1d29ec0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831118.773991:0:18914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000920a8703/0x95459fb9d1d29ec0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831118.773998:0:17092:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787831118.774000:0:18914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000920a8703/0x95459fb9d1d29ec0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831118.774006:0:17092:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d5385f2b/0x95459fb9d1d29eb2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831118.774094:0:17092:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d23344b7800 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:0.0:1787831118.774099:0:17092:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5385f2b/0x95459fb9d1d29eb2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831118.774109:0:17092:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5385f2b/0x95459fb9d1d29eb2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831118.774126:0:17092:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d5385f2b/0x95459fb9d1d29eb2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831118.774132:0:17092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d5385f2b/0x95459fb9d1d29eb2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831118.774146:0:17092:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787831118.774150:0:17092:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000039b296cc/0x95459fb9d1d29eb9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831118.774155:0:17092:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d23344b6200 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:0.0:1787831118.774165:0:17092:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000039b296cc/0x95459fb9d1d29eb9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831118.774173:0:17092:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000039b296cc/0x95459fb9d1d29eb9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831118.774186:0:17092:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000039b296cc/0x95459fb9d1d29eb9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831118.774193:0:17092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000039b296cc/0x95459fb9d1d29eb9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831118.774206:0:18633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787831118.774208:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787831118.774211:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787831118.774213:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787831118.774214:0:18633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000920a8703/0x95459fb9d1d29ec0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831118.774223:0:18633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d23344b6600 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:2.0:1787831118.774227:0:18633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000920a8703/0x95459fb9d1d29ec0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831118.774236:0:18633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000920a8703/0x95459fb9d1d29ec0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831118.774250:0:18633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000920a8703/0x95459fb9d1d29ec0 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831118.774251:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787831118.774261:0:18633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787831118.774263:0:18633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787831118.774265:0:18633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787831118.774333:0:18914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787831118.774338:0:18914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000920a8703/0x95459fb9d1d29ec0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831118.774343:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787831118.775274:0:18914:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787831118.775280:0:18914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000509b85e5/0x95459fb9d1d29ec7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831118.775290:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=409s v=(0 0) 00010000:00010000:0.0:1787831118.775294:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787831118.775298:0:18914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000509b85e5/0x95459fb9d1d29ec7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831118.775307:0:18914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000509b85e5/0x95459fb9d1d29ec7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831118.775325:0:18914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000509b85e5/0x95459fb9d1d29ec7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831118.775331:0:18914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000509b85e5/0x95459fb9d1d29ec7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831118.775352:0:18914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1787831118.775388:0:18914:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:6 00000100:00100000:0.0:1787831118.775539:0:18914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220390ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:17131:x1874676443944832:12345-0@lo:5:osp-pre-1-0.0 Request processed in 75563us (76221us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831118.775549:0:18914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1787831118.775574:0:17093:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787831118.775582:0:17093:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000509b85e5/0x95459fb9d1d29ec7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831118.775591:0:17093:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233bf10800 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:3.0:1787831118.775604:0:17093:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000509b85e5/0x95459fb9d1d29ec7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831118.775608:0:17131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220390d2c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17131:1874676443944832:0@lo:5:osp-pre-1-0.0 00010000:00010000:3.0:1787831118.775616:0:17093:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000509b85e5/0x95459fb9d1d29ec7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831118.775658:0:17093:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000509b85e5/0x95459fb9d1d29ec7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831118.775666:0:17093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000509b85e5/0x95459fb9d1d29ec7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831118.775684:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787831118.775686:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787831118.775688:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1787831118.775731:0:17131:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x6:0x0] 00000100:00100000:0.0:1787831118.775776:0:17131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220390d2c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17131:1874676443945856:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1787831118.775809:0:17131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831118.775836:0:17131:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d232f6e2600 going to sleep for 11 seconds 00000100:00100000:0.0:1787831118.775852:0:18914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443945856 00000100:00100000:0.0:1787831118.775857:0:18914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443945856 00000100:00100000:0.0:1787831118.775895:0:18914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787831118.775902:0:18914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220390c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:17131:x1874676443945856:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1787831118.775936:0:18914:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00000001:00080000:2.0:1787831118.776514:0:18604:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:2.0:1787831118.776525:0:18604:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:1.0:1787831118.776784:0:18610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204403480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:17844:x1874676443945600:12345-0@lo:5:osp-pre-0-1.0 Request processed in 43921us (44424us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1787831118.776793:0:18610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787831118.777130:0:17844:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934594 gen 2 00000100:00100000:2.0:1787831118.777138:0:17844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204401a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17844:1874676443945600:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1787831118.777150:0:17844:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:2.0:1787831118.777191:0:17844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2314ed43c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17844:1874676443945984:0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1787831118.777223:0:17844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831118.777249:0:17844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d22034db900 going to sleep for 11 seconds 00000100:00100000:3.0:1787831118.778397:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443945984 00000100:00100000:3.0:1787831118.778405:0:17116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443945984 00000100:00100000:3.0:1787831118.778461:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787831118.778471:0:17116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2314ed4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17844:x1874676443945984:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1787831118.778665:0:17116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2314ed4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17844:x1874676443945984:12345-0@lo:900:osp-pre-0-1.0 Request processed in 196us (1440us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831118.778673:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787831118.778714:0:17844:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2314ed43c0 x1874676443945984/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787831134 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787831118.778728:0:17844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2314ed43c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17844:1874676443945984:0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1787831118.784088:0:18914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220390c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17131:x1874676443945856:12345-0@lo:5:osp-pre-1-0.0 Request processed in 8180us (8272us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1787831118.784103:0:18914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787831118.789069:0:17131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220390d2c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17131:1874676443945856:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1787831118.789091:0:17131:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00000100:00100000:3.0:1787831119.078877:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2314ed43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443946112:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787831119.078969:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831119.079119:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443946112 00000100:00100000:0.0:1787831119.079126:0:17110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443946112 00000100:00100000:0.0:1787831119.079176:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787831119.079186:0:17110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220442d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443946112:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787831119.079219:0:17110:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1787831119.079276:0:17110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220442d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443946112:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831119.079293:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787831119.079439:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2314ed43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443946112:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787831119.590893:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787831119.590928:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2314ed52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443946240:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787831119.591072:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831119.591204:0:18611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443946240 00000100:00100000:2.0:1787831119.591214:0:18611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443946240 00000100:00100000:2.0:1787831119.591321:0:18611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787831119.591330:0:18611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220442f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676443946240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787831119.591355:0:18611:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787831119.591433:0:18611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220442f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676443946240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831119.591450:0:18611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787831119.591524:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2314ed52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443946240:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787831119.784522:0:18633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787831120.103220:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787831120.103245:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220442f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676443946368:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787831120.103334:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831120.103736:0:19224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443946368 00000100:00100000:3.0:1787831120.103744:0:19224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443946368 00000100:00100000:3.0:1787831120.103799:0:19224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787831120.103808:0:19224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2314ed43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1874676443946368:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787831120.103846:0:19224:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787831120.103919:0:19224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2314ed43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1874676443946368:12345-0@lo:41:osp-pre-1-0.0 Request processed in 111us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831120.103927:0:19224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787831120.103986:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220442f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676443946368:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787831120.810239:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787831121.545413:0:19778:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg331-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787831121.830845:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787831122.255442:0:19830:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787831122.255714:0:19830:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787831122.855244:0:18633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787831122.915604:0:19880:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787831122.915963:0:19880:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1787831123.102381:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831123.102869:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433401728 00000100:00100000:3.0:1787831123.102884:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433401728 00000100:00100000:3.0:1787831123.103130:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 111 00000100:00100000:3.0:1787831123.103140:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233c006c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2393:x1874676433401728:12345-192.168.203.31@tcp:250:mount.lustre.0 00010000:00080000:3.0:1787831123.103178:0:17096:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 1f931f0c-5730-4db2-abdb-70a9ab2deeff@192.168.203.31@tcp t0 exp 0000000000000000 cur 414 last 0 00000020:00000080:3.0:1787831123.103213:0:17096:0:(genops.c:1385:class_connect()) connect: client 1f931f0c-5730-4db2-abdb-70a9ab2deeff, cookie 0x95459fb9d1d29ece 00000100:00080000:3.0:1787831123.103386:0:17096:0:(import.c:65:import_set_state_nolock()) ffff8d2202a7c800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787831123.103530:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233c006c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f931f0c-5730-4db2-abdb-70a9ab2deeff+5:2393:x1874676433401728:12345-192.168.203.31@tcp:250:mount.lustre.0 Request processed in 389us (1166us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831123.103539:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 111 00000100:00100000:3.0:1787831123.111543:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831123.111612:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433401856 00000100:00100000:1.0:1787831123.111642:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433401856 00000100:00100000:1.0:1787831123.111731:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 112 00000100:00100000:1.0:1787831123.111744:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233c004c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f931f0c-5730-4db2-abdb-70a9ab2deeff+5:14862:x1874676433401856:12345-192.168.203.31@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787831123.111765:0:17097:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787831123.111788:0:17097:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d23344b6600/0x95459fb9d1d29ed5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xe558a92a9942411f expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831123.111823:0:17097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d23344b6600/0x95459fb9d1d29ed5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a9942411f expref: 6 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831123.111835:0:17097:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d23344b6600/0x95459fb9d1d29ed5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a9942411f expref: 6 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831123.111845:0:17097:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d23344b6600, rc 0) 00000100:00100000:1.0:1787831123.111925:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233c004c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f931f0c-5730-4db2-abdb-70a9ab2deeff+6:14862:x1874676433401856:12345-192.168.203.31@tcp:101:mount.lustre.0 Request processed in 185us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831123.111957:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 112 00000100:00100000:1.0:1787831123.115704:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831123.117128:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433401984 00000100:00100000:0.0:1787831123.117143:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433401984 00000100:00100000:0.0:1787831123.117214:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 113 00000100:00100000:0.0:1787831123.117225:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233c005450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f931f0c-5730-4db2-abdb-70a9ab2deeff+6:14862:x1874676433401984:12345-192.168.203.31@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787831123.117386:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233c005450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f931f0c-5730-4db2-abdb-70a9ab2deeff+6:14862:x1874676433401984:12345-192.168.203.31@tcp:501:mount.lustre.0 Request processed in 162us (1700us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787831123.117395:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 113 00000100:00100000:3.0:1787831123.119429:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831123.119508:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433402112 00000100:00100000:0.0:1787831123.119517:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433402112 00000100:00100000:0.0:1787831123.119571:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 114 00000100:00100000:0.0:1787831123.119580:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233c006050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f931f0c-5730-4db2-abdb-70a9ab2deeff+6:14862:x1874676433402112:12345-192.168.203.31@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787831123.119597:0:17097:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787831123.119616:0:17097:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d233bf11000/0x95459fb9d1d29edc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xe558a92a99424126 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831123.119788:0:17097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d233bf11000/0x95459fb9d1d29edc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424126 expref: 7 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831123.119802:0:17097:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d233bf11000/0x95459fb9d1d29edc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424126 expref: 7 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831123.119812:0:17097:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233bf11000, rc 0) 00000100:00100000:0.0:1787831123.119897:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233c006050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f931f0c-5730-4db2-abdb-70a9ab2deeff+7:14862:x1874676433402112:12345-192.168.203.31@tcp:101:mount.lustre.0 Request processed in 318us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831123.119905:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 114 00000100:00100000:3.0:1787831123.122356:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831123.122483:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433402240 00000100:00100000:2.0:1787831123.122494:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433402240 00000100:00100000:2.0:1787831123.122561:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 115 00000100:00100000:2.0:1787831123.122573:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233c005c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f931f0c-5730-4db2-abdb-70a9ab2deeff+7:14862:x1874676433402240:12345-192.168.203.31@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787831123.122830:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233c005c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f931f0c-5730-4db2-abdb-70a9ab2deeff+8:14862:x1874676433402240:12345-192.168.203.31@tcp:501:mount.lustre.0 Request processed in 258us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831123.122838:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 115 00000100:00100000:1.0:1787831123.125889:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831123.126707:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433402368 00000100:00100000:0.0:1787831123.126873:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433402368 00000100:00100000:0.0:1787831123.126953:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 116 00000100:00100000:0.0:1787831123.126965:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233c004850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f931f0c-5730-4db2-abdb-70a9ab2deeff+8:14862:x1874676433402368:12345-192.168.203.31@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787831123.127190:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233c004850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f931f0c-5730-4db2-abdb-70a9ab2deeff+8:14862:x1874676433402368:12345-192.168.203.31@tcp:503:mount.lustre.0 Request processed in 227us (1313us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831123.127199:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 116 00000100:00100000:3.0:1787831123.133588:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831123.133904:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433402496 00000100:00100000:2.0:1787831123.133916:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433402496 00000100:00100000:2.0:1787831123.133983:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 117 00000100:00100000:2.0:1787831123.134003:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233c004450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f931f0c-5730-4db2-abdb-70a9ab2deeff+8:14881:x1874676433402496:12345-192.168.203.31@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787831123.134204:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233c004450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f931f0c-5730-4db2-abdb-70a9ab2deeff+8:14881:x1874676433402496:12345-192.168.203.31@tcp:502:llog_process_th.0 Request processed in 211us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831123.134213:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 117 00000100:00100000:3.0:1787831123.152580:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831123.152713:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433402624 00000100:00100000:1.0:1787831123.152727:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433402624 00000100:00100000:1.0:1787831123.152817:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 118 00000100:00100000:1.0:1787831123.152828:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233c007c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f931f0c-5730-4db2-abdb-70a9ab2deeff+8:14881:x1874676433402624:12345-192.168.203.31@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787831123.153047:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233c007c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f931f0c-5730-4db2-abdb-70a9ab2deeff+8:14881:x1874676433402624:12345-192.168.203.31@tcp:502:llog_process_th.0 Request processed in 220us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831123.153056:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 118 00000100:00100000:1.0:1787831123.160552:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831123.160851:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433402752 00000100:00100000:2.0:1787831123.160864:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433402752 00000100:00100000:2.0:1787831123.160940:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 119 00000100:00100000:2.0:1787831123.160954:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233c007850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f931f0c-5730-4db2-abdb-70a9ab2deeff+8:14881:x1874676433402752:12345-192.168.203.31@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787831123.161163:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233c007850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f931f0c-5730-4db2-abdb-70a9ab2deeff+8:14881:x1874676433402752:12345-192.168.203.31@tcp:502:llog_process_th.0 Request processed in 212us (624us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831123.161171:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 119 00000100:00100000:3.0:1787831123.165707:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831123.167593:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433402880 00000100:00100000:1.0:1787831123.167611:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433402880 00000100:00100000:2.0:1787831123.168234:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 120 00000100:00100000:2.0:1787831123.168249:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233c006450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f931f0c-5730-4db2-abdb-70a9ab2deeff+8:14862:x1874676433402880:12345-192.168.203.31@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787831123.168271:0:17098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787831123.168296:0:17098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d22039c1400/0x95459fb9d1d29ee3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe558a92a99424157 expref: -99 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831123.168334:0:17098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22039c1400/0x95459fb9d1d29ee3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424157 expref: 9 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831123.168369:0:17098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d22039c1400/0x95459fb9d1d29ee3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424157 expref: 9 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831123.168381:0:17098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22039c1400, rc 0) 00000100:00100000:2.0:1787831123.168478:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233c006450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f931f0c-5730-4db2-abdb-70a9ab2deeff+9:14862:x1874676433402880:12345-192.168.203.31@tcp:101:mount.lustre.0 Request processed in 232us (2788us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831123.168485:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 120 00000100:00100000:3.0:1787831123.175014:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831123.175417:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433403008 00000100:00100000:0.0:1787831123.175431:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433403008 00000100:00100000:0.0:1787831123.175606:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 121 00000100:00100000:0.0:1787831123.175620:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233c007050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f931f0c-5730-4db2-abdb-70a9ab2deeff+9:14862:x1874676433403008:12345-192.168.203.31@tcp:256:mount.lustre.0 20000000:01000000:0.0:1787831123.175718:0:17097:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1787831123.175755:0:17097:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787831123.175759:0:17097:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1787831123.175762:0:17097:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1787831123.175765:0:17097:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1787831123.175773:0:17097:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:0.0:1787831123.178759:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233c007050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f931f0c-5730-4db2-abdb-70a9ab2deeff+9:14862:x1874676433403008:12345-192.168.203.31@tcp:256:mount.lustre.0 Request processed in 3124us (3756us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831123.178775:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 121 00000100:00100000:1.0:1787831123.184180:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831123.184405:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433403136 00000100:00100000:2.0:1787831123.184414:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433403136 00000100:00100000:2.0:1787831123.184470:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 122 00000100:00100000:2.0:1787831123.184479:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233c006850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f931f0c-5730-4db2-abdb-70a9ab2deeff+9:14862:x1874676433403136:12345-192.168.203.31@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787831123.184496:0:17098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787831123.184510:0:17098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d22039c0600/0x95459fb9d1d29eea lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe558a92a9942415e expref: -99 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831123.184537:0:17098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22039c0600/0x95459fb9d1d29eea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a9942415e expref: 10 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831123.184548:0:17098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d22039c0600/0x95459fb9d1d29eea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a9942415e expref: 10 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831123.184557:0:17098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22039c0600, rc 0) 00000100:00100000:2.0:1787831123.184612:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233c006850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f931f0c-5730-4db2-abdb-70a9ab2deeff+10:14862:x1874676433403136:12345-192.168.203.31@tcp:101:mount.lustre.0 Request processed in 134us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831123.184620:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 122 00000100:00100000:3.0:1787831123.189075:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831123.189256:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433403264 00000100:00100000:0.0:1787831123.189265:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433403264 00000100:00100000:0.0:1787831123.189330:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 123 00000100:00100000:0.0:1787831123.189340:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233c004050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f931f0c-5730-4db2-abdb-70a9ab2deeff+10:14862:x1874676433403264:12345-192.168.203.31@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787831123.189608:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233c004050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f931f0c-5730-4db2-abdb-70a9ab2deeff+10:14862:x1874676433403264:12345-192.168.203.31@tcp:501:mount.lustre.0 Request processed in 269us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831123.189617:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 123 00000100:00100000:1.0:1787831123.194536:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831123.195772:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433403392 00000100:00100000:3.0:1787831123.195784:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433403392 00000100:00100000:3.0:1787831123.195909:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 124 00000100:00100000:3.0:1787831123.195920:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233c005050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f931f0c-5730-4db2-abdb-70a9ab2deeff+10:14862:x1874676433403392:12345-192.168.203.31@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787831123.196178:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233c005050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f931f0c-5730-4db2-abdb-70a9ab2deeff+10:14862:x1874676433403392:12345-192.168.203.31@tcp:503:mount.lustre.0 Request processed in 258us (1651us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831123.196186:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 124 00000100:00100000:0.0:1787831123.199388:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831123.199696:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433403520 00000100:00100000:3.0:1787831123.199706:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433403520 00000100:00100000:3.0:1787831123.199765:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 125 00000100:00100000:3.0:1787831123.199774:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233c005850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f931f0c-5730-4db2-abdb-70a9ab2deeff+10:14886:x1874676433403520:12345-192.168.203.31@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787831123.199930:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233c005850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f931f0c-5730-4db2-abdb-70a9ab2deeff+10:14886:x1874676433403520:12345-192.168.203.31@tcp:502:llog_process_th.0 Request processed in 156us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831123.199938:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 125 00000100:00100000:0.0:1787831123.206112:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831123.206354:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433403648 00000100:00100000:3.0:1787831123.206381:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433403648 00000100:00100000:3.0:1787831123.207421:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 126 00000100:00100000:3.0:1787831123.207456:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233c0e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f931f0c-5730-4db2-abdb-70a9ab2deeff+10:14886:x1874676433403648:12345-192.168.203.31@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787831123.207836:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233c0e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f931f0c-5730-4db2-abdb-70a9ab2deeff+10:14886:x1874676433403648:12345-192.168.203.31@tcp:502:llog_process_th.0 Request processed in 398us (1734us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831123.207853:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 126 00000100:00100000:1.0:1787831123.226095:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831123.226205:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831123.226285:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433403776 00000100:00100000:3.0:1787831123.226297:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433403776 00000100:00100000:3.0:1787831123.226356:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433404032 00000100:00100000:3.0:1787831123.226367:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433404032 00000100:00100000:3.0:1787831123.226396:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 7 00000100:00100000:3.0:1787831123.226405:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204402940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2393:x1874676433403776:12345-192.168.203.31@tcp:38:mount.lustre.0 00010000:00080000:3.0:1787831123.226436:0:17104:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 2240faf2-2a81-4e92-bb4c-b58ed0f19f2a@192.168.203.31@tcp t0 exp 0000000000000000 cur 414 last 0 00000100:00100000:2.0:1787831123.226560:0:18518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 8 00000020:00000080:3.0:1787831123.226563:0:17104:0:(genops.c:1385:class_connect()) connect: client 2240faf2-2a81-4e92-bb4c-b58ed0f19f2a, cookie 0x95459fb9d1d29ef1 00000100:00100000:2.0:1787831123.226570:0:18518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204400b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2393:x1874676433404032:12345-192.168.203.31@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787831123.226591:0:18518:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 2240faf2-2a81-4e92-bb4c-b58ed0f19f2a@192.168.203.31@tcp t0 exp 0000000000000000 cur 414 last 0 00000004:00100000:3.0:1787831123.226594:0:17104:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return 37 00000020:00000080:2.0:1787831123.226666:0:18518:0:(genops.c:1385:class_connect()) connect: client 2240faf2-2a81-4e92-bb4c-b58ed0f19f2a, cookie 0x95459fb9d1d29ef8 00000004:00100000:2.0:1787831123.226684:0:18518:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return 37 00000100:00080000:3.0:1787831123.226919:0:17104:0:(import.c:65:import_set_state_nolock()) ffff8d2202a79800 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1787831123.226933:0:18518:0:(import.c:65:import_set_state_nolock()) ffff8d22034d3800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787831123.227008:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204402940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+6:2393:x1874676433403776:12345-192.168.203.31@tcp:38:mount.lustre.0 Request processed in 602us (923us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831123.227011:0:18518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204400b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+6:2393:x1874676433404032:12345-192.168.203.31@tcp:38:mount.lustre.0 Request processed in 440us (804us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831123.227024:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 7 00000100:00100000:2.0:1787831123.227032:0:18518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 8 00000100:00100000:3.0:1787831123.238020:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831123.238206:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831123.238249:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433404288 00000100:00100000:1.0:1787831123.238259:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433404288 00000100:00100000:1.0:1787831123.238337:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433404160 00000100:00100000:1.0:1787831123.238340:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433404160 00000100:00100000:1.0:1787831123.238363:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 9 00000100:00100000:1.0:1787831123.238374:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220442f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+6:14862:x1874676433404288:12345-192.168.203.31@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787831123.238409:0:17106:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00080000:2.0:1787831123.238490:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787831123.238494:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787831123.238509:0:18518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 10 00000100:00100000:2.0:1787831123.238528:0:18518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220442d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+6:0:x1874676433404160:12345-192.168.203.31@tcp:41:mount.lustre.0 00000100:00100000:3.0:1787831123.238542:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000004:00000024:2.0:1787831123.238550:0:18518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787831123.238599:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220442f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+6:14862:x1874676433404288:12345-192.168.203.31@tcp:41:mount.lustre.0 Request processed in 226us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831123.238656:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 9 00000100:00100000:0.0:1787831123.238661:0:17105:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:0.0:1787831123.238671:0:17105:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:1.0:1787831123.238676:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433403904 00000100:00100000:1.0:1787831123.238680:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433403904 00000100:00100000:1.0:1787831123.238697:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 11 00000100:00100000:1.0:1787831123.238704:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220442cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+6:0:x1874676433403904:12345-192.168.203.31@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787831123.238716:0:17106:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1787831123.239232:0:18518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220442d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+6:0:x1874676433404160:12345-192.168.203.31@tcp:41:mount.lustre.0 Request processed in 715us (1025us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831123.239242:0:18518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 10 00000100:00100000:1.0:1787831123.241697:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220442cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+6:0:x1874676433403904:12345-192.168.203.31@tcp:41:mount.lustre.0 Request processed in 2982us (3146us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831123.241710:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 11 00000100:00100000:0.0:1787831123.250094:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831123.250250:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433404416 00000100:00100000:2.0:1787831123.250260:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433404416 00000100:00100000:2.0:1787831123.250353:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 12 00000100:00100000:2.0:1787831123.250364:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220390de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+6:14862:x1874676433404416:12345-192.168.203.31@tcp:40:mount.lustre.0 00000100:00100000:2.0:1787831123.250508:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220390de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+6:14862:x1874676433404416:12345-192.168.203.31@tcp:40:mount.lustre.0 Request processed in 145us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831123.250532:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 12 00000100:00100000:0.0:1787831123.254684:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831123.254846:0:18608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433404544 00000100:00100000:2.0:1787831123.254855:0:18608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433404544 00000100:00100000:2.0:1787831123.254911:0:18608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 17 00000100:00100000:2.0:1787831123.254919:0:18608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220390e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2393:x1874676433404544:12345-192.168.203.31@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787831123.254961:0:18608:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 2240faf2-2a81-4e92-bb4c-b58ed0f19f2a@192.168.203.31@tcp t0 exp 0000000000000000 cur 414 last 0 00000020:00000080:2.0:1787831123.255012:0:18608:0:(genops.c:1385:class_connect()) connect: client 2240faf2-2a81-4e92-bb4c-b58ed0f19f2a, cookie 0x95459fb9d1d29eff 00002000:00100000:2.0:1787831123.255025:0:18608:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 2240faf2-2a81-4e92-bb4c-b58ed0f19f2a/ffff8d233f423000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211393d ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00000100:00100000:0.0:1787831123.255104:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831123.255214:0:19566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433404672 00000100:00100000:1.0:1787831123.255218:0:19566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433404672 00000100:00100000:1.0:1787831123.255251:0:19566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 18 00000100:00100000:1.0:1787831123.255258:0:19566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220390c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2393:x1874676433404672:12345-192.168.203.31@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787831123.255278:0:19566:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 2240faf2-2a81-4e92-bb4c-b58ed0f19f2a@192.168.203.31@tcp t0 exp 0000000000000000 cur 414 last 0 00000020:00000080:1.0:1787831123.255296:0:19566:0:(genops.c:1385:class_connect()) connect: client 2240faf2-2a81-4e92-bb4c-b58ed0f19f2a, cookie 0x95459fb9d1d29f06 00002000:00100000:1.0:1787831123.255302:0:19566:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 2240faf2-2a81-4e92-bb4c-b58ed0f19f2a/ffff8d2201d9c800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211393d ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787831123.255316:0:19566:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return 37 00002000:00100000:2.0:1787831123.255432:0:18608:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return 37 00002000:00080000:1.0:1787831123.255494:0:19566:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787831123.255525:0:19566:0:(import.c:65:import_set_state_nolock()) ffff8d2201d98800 : changing import state from RECOVER to FULL 00002000:00080000:2.0:1787831123.255657:0:18608:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787831123.255677:0:18608:0:(import.c:65:import_set_state_nolock()) ffff8d220470d000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787831123.255694:0:19566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220390c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+6:2393:x1874676433404672:12345-192.168.203.31@tcp:8:mount.lustre.0 Request processed in 433us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831123.255704:0:19566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 18 00000100:00100000:2.0:1787831123.255709:0:18608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220390e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+6:2393:x1874676433404544:12345-192.168.203.31@tcp:8:mount.lustre.0 Request processed in 788us (1033us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831123.255719:0:18608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 17 00000100:00100000:0.0:1787831123.256022:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831123.256237:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433404800 00000100:00100000:3.0:1787831123.256244:0:17116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433404800 00000100:00100000:3.0:1787831123.256290:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 3 00000100:00100000:3.0:1787831123.256298:0:17116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220390f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+6:14862:x1874676433404800:12345-192.168.203.31@tcp:900:mount.lustre.0 00000100:00100000:3.0:1787831123.256350:0:17116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220390f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+6:14862:x1874676433404800:12345-192.168.203.31@tcp:900:mount.lustre.0 Request processed in 53us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831123.256357:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 3 00000100:00100000:1.0:1787831123.265960:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831123.266078:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433404928 00000100:00100000:3.0:1787831123.266087:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433404928 00000100:00100000:3.0:1787831123.266230:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 0 00000100:00100000:3.0:1787831123.266242:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204403c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+6:14862:x1874676433404928:12345-192.168.203.31@tcp:33:mount.lustre.0 00000004:00080000:0.0:1787831123.267232:0:17107:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 894us 00000004:00200000:0.0:1787831123.278368:0:17107:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1787831123.278500:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204403c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+6:14862:x1874676433404928:12345-192.168.203.31@tcp:33:mount.lustre.0 Request processed in 12255us (12545us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831123.278514:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 0 00000100:00100000:0.0:1787831123.436978:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831123.437223:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433405056 00000100:00100000:3.0:1787831123.437239:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433405056 00000100:00100000:3.0:1787831123.437321:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 13 00000100:00100000:3.0:1787831123.437332:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220390da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+6:14909:x1874676433405056:12345-192.168.203.31@tcp:101:mkdir.0 00010000:00010000:3.0:1787831123.437358:0:17104:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787831123.437389:0:17104:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76e00/0x95459fb9d1d29f0d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a9942418f expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831123.437498:0:17104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77800/0x95459fb9d1d29f14 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831123.437516:0:17104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77800/0x95459fb9d1d29f14 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831123.437534:0:17104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77800/0x95459fb9d1d29f14 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787831123.437592:0:17104:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787831123.437595:0:17104:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787831123.437676:0:17104:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77800/0x95459fb9d1d29f14 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831123.437706:0:17104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76e00/0x95459fb9d1d29f0d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a9942418f expref: 8 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831123.437727:0:17104:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77800/0x95459fb9d1d29f14 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a9942418f expref: 7 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831123.437755:0:17104:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d233a6f9800) 00010000:00010000:3.0:1787831123.437759:0:17104:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787831123.437763:0:17104:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2307c77800, rc 0) 00000100:00100000:3.0:1787831123.437842:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220390da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+7:14909:x1874676433405056:12345-192.168.203.31@tcp:101:mkdir.0 Request processed in 511us (875us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831123.437849:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 13 00010000:00010000:3.0:1787831123.879466:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787831124.198843:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787831124.199066:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787831124.199072:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2314ed52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443946624:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787831124.199084:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204645e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676443946880:0@lo:400:kworker.0 00000100:00100000:3.0:1787831124.199153:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831124.199175:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204645680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:be45932f-3bcb-4e49-b61c-a2395180b0ee:3620:1874676443946752:0@lo:400:kworker.0 00000100:00100000:0.0:1787831124.199210:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831124.199272:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443946624 00000100:00100000:0.0:1787831124.199280:0:17110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443946624 00000100:00100000:0.0:1787831124.199331:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787831124.199341:0:17110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22038fb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443946624:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787831124.199376:0:17110:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1787831124.199423:0:17110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22038fb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443946624:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831124.199430:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787831124.199447:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831124.199483:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220390fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676443947008:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787831124.199512:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831124.199557:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443946880 00000100:00100000:3.0:1787831124.199562:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443946880 00000100:00100000:3.0:1787831124.199592:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787831124.199599:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22038f8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1874676443946880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787831124.199657:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22038f8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1874676443946880:12345-0@lo:400:kworker.0 Request processed in 57us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831124.199664:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787831124.199690:0:18612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443947008 00000100:00100000:3.0:1787831124.199693:0:18612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443947008 00000100:00100000:3.0:1787831124.199727:0:18612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787831124.199733:0:18612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22038f92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676443947008:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787831124.199746:0:18612:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787831124.199775:0:18612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22038f92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676443947008:12345-0@lo:13:osp-pre-0-1.0 Request processed in 43us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831124.199788:0:18612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787831124.199828:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2314ed52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443946624:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787831124.199859:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220390fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676443947008:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787831124.199872:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204645e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676443946880:0@lo:400:kworker.0 00000100:00080000:3.0:1787831124.199898:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787831124.199910:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443946752 00000100:00100000:3.0:1787831124.199913:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443946752 00000100:00100000:3.0:1787831124.199939:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1787831124.199946:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233c0ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be45932f-3bcb-4e49-b61c-a2395180b0ee+24:3620:x1874676443946752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787831124.199978:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233c0ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be45932f-3bcb-4e49-b61c-a2395180b0ee+24:3620:x1874676443946752:12345-0@lo:400:kworker.0 Request processed in 33us (768us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831124.199998:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1787831124.200064:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2314ed52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443947136:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787831124.200099:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831124.200124:0:18612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443947136 00000100:00100000:3.0:1787831124.200127:0:18612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443947136 00000100:00100000:3.0:1787831124.200151:0:18612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787831124.200157:0:18612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a22d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3619:x1874676443947136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787831124.200168:0:18612:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787831124.200200:0:18612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a22d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3619:x1874676443947136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 43us (100us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831124.200207:0:18612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:3.0:1787831124.200220:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787831124.200243:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2314ed52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443947136:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787831124.200287:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204645680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:be45932f-3bcb-4e49-b61c-a2395180b0ee:3620:1874676443946752:0@lo:400:kworker.0 00000100:00100000:1.0:1787831124.200776:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220442ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443946496:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787831124.200810:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831124.200882:0:18612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443946496 00000100:00100000:3.0:1787831124.200886:0:18612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443946496 00000100:00100000:3.0:1787831124.200926:0:18612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787831124.200932:0:18612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204400780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443946496:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787831124.200944:0:18612:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787831124.200976:0:18612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204400780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443946496:12345-0@lo:13:osp-pre-1-1.0 Request processed in 44us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831124.200983:0:18612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:1.0:1787831124.201051:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787831124.201078:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220442ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443946496:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787831124.201299:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204647c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1874676443947264:0@lo:400:kworker.0 00000100:00100000:3.0:1787831124.201329:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831124.201387:0:18914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443947264 00000100:00100000:1.0:1787831124.201391:0:18914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443947264 00000100:00100000:0.0:1787831124.201434:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204644f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3621:1874676443947392:0@lo:400:kworker.0 00000100:00100000:1.0:1787831124.201442:0:18914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787831124.201451:0:18914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a203c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3620:x1874676443947264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787831124.201477:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831124.201500:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787831124.201506:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204647480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3621:1874676443947520:0@lo:400:kworker.0 00000100:00100000:0.0:1787831124.201528:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831124.201556:0:19892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443947392 00000100:00100000:0.0:1787831124.201560:0:19892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443947392 00000100:00100000:0.0:1787831124.201592:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443947520 00000100:00100000:0.0:1787831124.201595:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443947520 00000100:00100000:0.0:1787831124.201613:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787831124.201619:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220390d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1874676443947392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787831124.201675:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220390d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1874676443947392:12345-0@lo:400:kworker.0 Request processed in 56us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831124.201681:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787831124.201695:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787831124.201701:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220390cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1874676443947520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787831124.201741:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220390cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1874676443947520:12345-0@lo:400:kworker.0 Request processed in 40us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831124.201748:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787831124.201778:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204647480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3621:1874676443947520:0@lo:400:kworker.0 00000100:00100000:0.0:1787831124.201790:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204644f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3621:1874676443947392:0@lo:400:kworker.0 00000100:00080000:0.0:1787831124.201818:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787831124.201844:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204646580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3619:1874676443947648:0@lo:400:kworker.0 00000100:00100000:0.0:1787831124.201868:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831124.201906:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443947648 00000100:00100000:0.0:1787831124.201910:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443947648 00000100:00100000:0.0:1787831124.201936:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787831124.201942:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220390c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874676443947648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787831124.201975:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220390c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874676443947648:12345-0@lo:400:kworker.0 Request processed in 33us (106us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831124.201981:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1787831124.202007:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787831124.202026:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204646580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3619:1874676443947648:0@lo:400:kworker.0 00000100:00100000:1.0:1787831124.203311:0:18914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a203c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3620:x1874676443947264:12345-0@lo:400:kworker.0 Request processed in 1857us (1977us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831124.203323:0:18914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787831124.203530:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204644b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3620:1874676443947776:0@lo:400:kworker.0 00000100:00100000:3.0:1787831124.203578:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831124.203732:0:19892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443947776 00000100:00100000:1.0:1787831124.203738:0:19892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443947776 00000100:00100000:3.0:1787831124.203762:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204647c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1874676443947264:0@lo:400:kworker.0 00000100:00100000:1.0:1787831124.203793:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787831124.203802:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1874676443947776:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787831124.203824:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787831124.203847:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1874676443947776:12345-0@lo:400:kworker.0 Request processed in 46us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831124.203854:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:3.0:1787831124.203879:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2204644b40 x1874676443947776/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787831140 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787831124.203890:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204644b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3620:1874676443947776:0@lo:400:kworker.0 00000100:00100000:0.0:1787831124.204226:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22046452c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3622:1874676443948032:0@lo:400:kworker.0 00000100:00100000:0.0:1787831124.204267:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831124.204293:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787831124.204301:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204646d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3622:1874676443947904:0@lo:400:kworker.0 00000100:00100000:3.0:1787831124.204304:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443948032 00000100:00100000:3.0:1787831124.204308:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443948032 00000100:00100000:0.0:1787831124.204330:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831124.204373:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443947904 00000100:00100000:1.0:1787831124.204378:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443947904 00000100:00100000:3.0:1787831124.204452:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787831124.204459:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220390cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1874676443948032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787831124.204511:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220390cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1874676443948032:12345-0@lo:400:kworker.0 Request processed in 52us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831124.204518:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:0.0:1787831124.204534:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d22046452c0 x1874676443948032/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787831140 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787831124.204559:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22046452c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3622:1874676443948032:0@lo:400:kworker.0 00000100:00080000:2.0:1787831124.204676:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787831124.204680:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787831124.204693:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787831124.204700:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220390fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1874676443947904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787831124.204739:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220390fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1874676443947904:12345-0@lo:400:kworker.0 Request processed in 39us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831124.204745:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787831124.204769:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204646d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3622:1874676443947904:0@lo:400:kworker.0 00000100:00100000:0.0:1787831124.712239:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204646d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443948160:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787831124.712322:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831124.713159:0:18612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443948160 00000100:00100000:3.0:1787831124.713169:0:18612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443948160 00000100:00100000:3.0:1787831124.713235:0:18612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787831124.713244:0:18612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204707840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676443948160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787831124.713265:0:18612:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787831124.713323:0:18612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204707840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676443948160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (999us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831124.713330:0:18612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787831124.713604:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204646d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443948160:0@lo:13:osp-pre-0-0.0 00000001:00100000:3.0:1787831124.715581:0:19422:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2240faf2-2a81-4e92-bb4c-b58ed0f19f2a 00000001:00080000:3.0:1787831124.715605:0:19422:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00010000:00010000:0.0:1787831124.903018:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787831125.140415:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831125.140654:0:19892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433405184 00000100:00100000:1.0:1787831125.140664:0:19892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433405184 00000100:00100000:1.0:1787831125.140762:0:19892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 14 00000100:00100000:1.0:1787831125.140773:0:19892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204706940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+7:14961:x1874676433405184:12345-192.168.203.31@tcp:41:lfs.0 00000004:00000024:1.0:1787831125.140814:0:19892:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1787831125.140924:0:19892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204706940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+7:14961:x1874676433405184:12345-192.168.203.31@tcp:41:lfs.0 Request processed in 152us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831125.140931:0:19892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 14 00000100:00080000:2.0:1787831125.141057:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787831125.143718:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831125.143803:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433405312 00000100:00100000:3.0:1787831125.143813:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433405312 00000100:00100000:3.0:1787831125.143964:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 15 00000100:00100000:3.0:1787831125.143975:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204402d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+6:14961:x1874676433405312:12345-192.168.203.31@tcp:41:lfs.0 00000004:00000024:3.0:1787831125.144031:0:17104:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787831125.144144:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204402d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+6:14961:x1874676433405312:12345-192.168.203.31@tcp:41:lfs.0 Request processed in 171us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831125.144152:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 15 00000100:00080000:2.0:1787831125.148122:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787831125.153113:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831125.153208:0:18612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433405440 00000100:00100000:3.0:1787831125.153218:0:18612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433405440 00000100:00100000:3.0:1787831125.153294:0:18612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 10 00000100:00100000:3.0:1787831125.153304:0:18612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203790b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+6:14961:x1874676433405440:12345-192.168.203.31@tcp:13:lfs.0 00002000:00000024:3.0:1787831125.153580:0:18612:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787831125.153711:0:18612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203790b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+6:14961:x1874676433405440:12345-192.168.203.31@tcp:13:lfs.0 Request processed in 407us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831125.153719:0:18612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 10 00000100:00080000:2.0:1787831125.154149:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787831125.155790:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831125.155884:0:18611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433405568 00000100:00100000:1.0:1787831125.155893:0:18611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433405568 00000100:00100000:1.0:1787831125.155965:0:18611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 11 00000100:00100000:1.0:1787831125.155975:0:18611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203791e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+5:14961:x1874676433405568:12345-192.168.203.31@tcp:13:lfs.0 00002000:00000024:1.0:1787831125.156017:0:18611:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787831125.156099:0:18611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203791e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+5:14961:x1874676433405568:12345-192.168.203.31@tcp:13:lfs.0 Request processed in 124us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831125.156107:0:18611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 11 00000100:00080000:2.0:1787831125.156186:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:2.0:1787831125.159380:0:17855:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1787831125.160108:0:17139:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787831125.222912:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2314ed52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1874676443948288:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787831125.223064:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831125.223118:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443948288 00000100:00100000:0.0:1787831125.223125:0:17110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443948288 00000100:00100000:0.0:1787831125.223169:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787831125.223176:0:17110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204401a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1874676443948288:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787831125.223197:0:17110:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787831125.223399:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2314ed52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1874676443948288:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787831125.223450:0:17110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204401a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1874676443948288:12345-0@lo:41:osp-pre-1-0.0 Request processed in 273us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831125.223456:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787831125.268733:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831125.269563:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433405696 00000100:00100000:2.0:1787831125.269573:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433405696 00000100:00100000:2.0:1787831125.269680:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 128 00000100:00100000:2.0:1787831125.269703:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233be91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f931f0c-5730-4db2-abdb-70a9ab2deeff+10:14994:x1874676433405696:12345-192.168.203.31@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787831125.269720:0:17096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787831125.269736:0:17096:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d22039c0e00/0x95459fb9d1d29f1b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xe558a92a99424196 expref: -99 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831125.269764:0:17096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22039c0e00/0x95459fb9d1d29f1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424196 expref: 11 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831125.269776:0:17096:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d22039c0e00/0x95459fb9d1d29f1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424196 expref: 11 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831125.269785:0:17096:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22039c0e00, rc 0) 00000100:00100000:2.0:1787831125.269844:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233be91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f931f0c-5730-4db2-abdb-70a9ab2deeff+11:14994:x1874676433405696:12345-192.168.203.31@tcp:101:mount.lustre.0 Request processed in 143us (1120us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831125.269852:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 128 00000100:00100000:0.0:1787831125.273104:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831125.274708:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433405824 00000100:00100000:3.0:1787831125.274721:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433405824 00000100:00100000:3.0:1787831125.274930:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 129 00000100:00100000:3.0:1787831125.274942:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233be90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f931f0c-5730-4db2-abdb-70a9ab2deeff+11:14994:x1874676433405824:12345-192.168.203.31@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787831125.275129:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233be90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f931f0c-5730-4db2-abdb-70a9ab2deeff+11:14994:x1874676433405824:12345-192.168.203.31@tcp:501:mount.lustre.0 Request processed in 189us (2033us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831125.275138:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 129 00000100:00100000:0.0:1787831125.280854:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831125.282289:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433405952 00000100:00100000:3.0:1787831125.282304:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433405952 00000100:00100000:3.0:1787831125.282759:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 130 00000100:00100000:3.0:1787831125.282772:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2308753c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f931f0c-5730-4db2-abdb-70a9ab2deeff+11:14994:x1874676433405952:12345-192.168.203.31@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787831125.282947:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2308753c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f931f0c-5730-4db2-abdb-70a9ab2deeff+11:14994:x1874676433405952:12345-192.168.203.31@tcp:503:mount.lustre.0 Request processed in 178us (2102us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831125.282955:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 130 00000100:00100000:1.0:1787831125.302129:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831125.305456:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433406080 00000100:00100000:3.0:1787831125.305468:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433406080 00000100:00100000:3.0:1787831125.305538:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 131 00000100:00100000:3.0:1787831125.305548:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2308752c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f931f0c-5730-4db2-abdb-70a9ab2deeff+11:15000:x1874676433406080:12345-192.168.203.31@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787831125.305759:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2308752c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f931f0c-5730-4db2-abdb-70a9ab2deeff+11:15000:x1874676433406080:12345-192.168.203.31@tcp:502:llog_process_th.0 Request processed in 211us (3639us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831125.305767:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 131 00000100:00100000:0.0:1787831125.334845:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831125.334964:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433406208 00000100:00100000:3.0:1787831125.335049:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433406208 00000100:00100000:3.0:1787831125.335137:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 132 00000100:00100000:3.0:1787831125.335149:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2308753450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f931f0c-5730-4db2-abdb-70a9ab2deeff+11:15000:x1874676433406208:12345-192.168.203.31@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787831125.335381:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2308753450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f931f0c-5730-4db2-abdb-70a9ab2deeff+11:15000:x1874676433406208:12345-192.168.203.31@tcp:502:llog_process_th.0 Request processed in 234us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831125.335391:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 132 00000100:00100000:0.0:1787831125.339351:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831125.339506:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433406336 00000100:00100000:3.0:1787831125.339519:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433406336 00000100:00100000:3.0:1787831125.339680:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 133 00000100:00100000:3.0:1787831125.339693:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2308751850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f931f0c-5730-4db2-abdb-70a9ab2deeff+11:15000:x1874676433406336:12345-192.168.203.31@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787831125.339880:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2308751850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f931f0c-5730-4db2-abdb-70a9ab2deeff+11:15000:x1874676433406336:12345-192.168.203.31@tcp:502:llog_process_th.0 Request processed in 189us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831125.339889:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 133 00000100:00100000:1.0:1787831125.345911:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831125.346078:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433406464 00000100:00100000:3.0:1787831125.346091:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433406464 00000100:00100000:3.0:1787831125.346218:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 134 00000100:00100000:3.0:1787831125.346230:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2308753850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f931f0c-5730-4db2-abdb-70a9ab2deeff+11:14994:x1874676433406464:12345-192.168.203.31@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787831125.346252:0:17098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787831125.346274:0:17098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2307c76e00/0x95459fb9d1d29f22 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe558a92a994241c7 expref: -99 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831125.346323:0:17098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2307c76e00/0x95459fb9d1d29f22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994241c7 expref: 12 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831125.346337:0:17098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2307c76e00/0x95459fb9d1d29f22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994241c7 expref: 12 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831125.346348:0:17098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2307c76e00, rc 0) 00000100:00100000:3.0:1787831125.346430:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2308753850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f931f0c-5730-4db2-abdb-70a9ab2deeff+12:14994:x1874676433406464:12345-192.168.203.31@tcp:101:mount.lustre.0 Request processed in 202us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831125.346456:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 134 00000100:00100000:0.0:1787831125.349311:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831125.349411:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433406592 00000100:00100000:3.0:1787831125.349423:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433406592 00000100:00100000:3.0:1787831125.349500:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 135 00000100:00100000:3.0:1787831125.349511:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2308752850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f931f0c-5730-4db2-abdb-70a9ab2deeff+12:14994:x1874676433406592:12345-192.168.203.31@tcp:256:mount.lustre.0 20000000:01000000:3.0:1787831125.349543:0:17097:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1787831125.349575:0:17097:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1787831125.349580:0:17097:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1787831125.349584:0:17097:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1787831125.349587:0:17097:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1787831125.349589:0:17097:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:3.0:1787831125.352884:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2308752850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f931f0c-5730-4db2-abdb-70a9ab2deeff+12:14994:x1874676433406592:12345-192.168.203.31@tcp:256:mount.lustre.0 Request processed in 3358us (3569us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831125.352904:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 135 00000100:00100000:1.0:1787831125.356844:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831125.357069:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433406720 00000100:00100000:3.0:1787831125.357082:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433406720 00000100:00100000:3.0:1787831125.357152:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 136 00000100:00100000:3.0:1787831125.357164:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2308751c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f931f0c-5730-4db2-abdb-70a9ab2deeff+12:14994:x1874676433406720:12345-192.168.203.31@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787831125.357192:0:17098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787831125.357217:0:17098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2307c76400/0x95459fb9d1d29f29 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xe558a92a994241ce expref: -99 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831125.357260:0:17098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2307c76400/0x95459fb9d1d29f29 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994241ce expref: 13 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831125.357274:0:17098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2307c76400/0x95459fb9d1d29f29 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994241ce expref: 13 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831125.357355:0:17098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2307c76400, rc 0) 00000100:00100000:3.0:1787831125.357446:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2308751c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f931f0c-5730-4db2-abdb-70a9ab2deeff+13:14994:x1874676433406720:12345-192.168.203.31@tcp:101:mount.lustre.0 Request processed in 275us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831125.357453:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 136 00000100:00100000:0.0:1787831125.363313:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831125.363484:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433406848 00000100:00100000:3.0:1787831125.363498:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433406848 00000100:00100000:2.0:1787831125.364062:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 137 00000100:00100000:2.0:1787831125.364079:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2308750c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f931f0c-5730-4db2-abdb-70a9ab2deeff+13:14994:x1874676433406848:12345-192.168.203.31@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787831125.364355:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2308750c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f931f0c-5730-4db2-abdb-70a9ab2deeff+13:14994:x1874676433406848:12345-192.168.203.31@tcp:501:mount.lustre.0 Request processed in 281us (1057us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831125.364365:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 137 00000100:00100000:0.0:1787831125.367851:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831125.367953:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433406976 00000100:00100000:2.0:1787831125.367966:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433406976 00000100:00100000:2.0:1787831125.368053:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 138 00000100:00100000:2.0:1787831125.368064:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2308750450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f931f0c-5730-4db2-abdb-70a9ab2deeff+13:14994:x1874676433406976:12345-192.168.203.31@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787831125.368530:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2308750450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f931f0c-5730-4db2-abdb-70a9ab2deeff+13:14994:x1874676433406976:12345-192.168.203.31@tcp:503:mount.lustre.0 Request processed in 464us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831125.368550:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 138 00000100:00100000:1.0:1787831125.371349:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831125.371531:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433407104 00000100:00100000:0.0:1787831125.371556:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433407104 00000100:00100000:0.0:1787831125.371857:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 139 00000100:00100000:0.0:1787831125.371870:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2308752450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f931f0c-5730-4db2-abdb-70a9ab2deeff+13:15005:x1874676433407104:12345-192.168.203.31@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787831125.372129:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2308752450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f931f0c-5730-4db2-abdb-70a9ab2deeff+13:15005:x1874676433407104:12345-192.168.203.31@tcp:502:llog_process_th.0 Request processed in 261us (793us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831125.372139:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 139 00000100:00100000:0.0:1787831125.375365:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831125.376362:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433407232 00000100:00100000:2.0:1787831125.376378:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433407232 00000100:00100000:2.0:1787831125.376551:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 140 00000100:00100000:2.0:1787831125.376566:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2308751450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f931f0c-5730-4db2-abdb-70a9ab2deeff+13:15005:x1874676433407232:12345-192.168.203.31@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787831125.376915:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2308751450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f931f0c-5730-4db2-abdb-70a9ab2deeff+13:15005:x1874676433407232:12345-192.168.203.31@tcp:502:llog_process_th.0 Request processed in 352us (1566us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831125.376924:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 140 00000100:00100000:1.0:1787831125.390267:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831125.390315:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831125.390548:0:18518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433407360 00000100:00100000:2.0:1787831125.390563:0:18518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433407360 00000100:00100000:2.0:1787831125.390617:0:18518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433407616 00000100:00100000:2.0:1787831125.390620:0:18518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433407616 00000100:00100000:2.0:1787831125.390684:0:18518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 16 00000100:00100000:2.0:1787831125.390695:0:18518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204400f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2393:x1874676433407360:12345-192.168.203.31@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787831125.390737:0:18518:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 8db48c6c-a61a-41ec-9c3b-96530aeb2537@192.168.203.31@tcp t0 exp 0000000000000000 cur 416 last 0 00000100:00100000:0.0:1787831125.390784:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 17 00000100:00100000:0.0:1787831125.390794:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204402580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2393:x1874676433407616:12345-192.168.203.31@tcp:38:mount.lustre.0 00000020:00000080:2.0:1787831125.390795:0:18518:0:(genops.c:1385:class_connect()) connect: client 8db48c6c-a61a-41ec-9c3b-96530aeb2537, cookie 0x95459fb9d1d29f30 00010000:00080000:0.0:1787831125.390819:0:17106:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 8db48c6c-a61a-41ec-9c3b-96530aeb2537@192.168.203.31@tcp t0 exp 0000000000000000 cur 416 last 0 00000004:00100000:2.0:1787831125.390834:0:18518:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return 37 00000020:00000080:0.0:1787831125.390853:0:17106:0:(genops.c:1385:class_connect()) connect: client 8db48c6c-a61a-41ec-9c3b-96530aeb2537, cookie 0x95459fb9d1d29f37 00000004:00100000:0.0:1787831125.390873:0:17106:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return 37 00000100:00080000:2.0:1787831125.390962:0:18518:0:(import.c:65:import_set_state_nolock()) ffff8d2201d0f000 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1787831125.390963:0:17106:0:(import.c:65:import_set_state_nolock()) ffff8d2335568000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787831125.391063:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204402580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8db48c6c-a61a-41ec-9c3b-96530aeb2537+6:2393:x1874676433407616:12345-192.168.203.31@tcp:38:mount.lustre.0 Request processed in 269us (746us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831125.391086:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 17 00000100:00100000:2.0:1787831125.391196:0:18518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204400f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8db48c6c-a61a-41ec-9c3b-96530aeb2537+6:2393:x1874676433407360:12345-192.168.203.31@tcp:38:mount.lustre.0 Request processed in 501us (943us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831125.391265:0:18518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 16 00000100:00100000:1.0:1787831125.415924:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831125.415984:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831125.416028:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831125.416072:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433407744 00000100:00100000:1.0:1787831125.416085:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433407744 00000100:00100000:1.0:1787831125.416158:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433407488 00000100:00100000:1.0:1787831125.416161:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433407488 00000100:00100000:1.0:1787831125.416186:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433407872 00000100:00100000:1.0:1787831125.416189:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433407872 00000100:00100000:1.0:1787831125.416206:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 18 00000100:00100000:1.0:1787831125.416218:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204403840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8db48c6c-a61a-41ec-9c3b-96530aeb2537+6:0:x1874676433407744:12345-192.168.203.31@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787831125.416262:0:17104:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787831125.416354:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204403840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8db48c6c-a61a-41ec-9c3b-96530aeb2537+6:0:x1874676433407744:12345-192.168.203.31@tcp:41:mount.lustre.0 Request processed in 138us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831125.416362:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 18 00000100:00100000:1.0:1787831125.416382:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 19 00000100:00100000:1.0:1787831125.416388:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22044021c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8db48c6c-a61a-41ec-9c3b-96530aeb2537+7:0:x1874676433407488:12345-192.168.203.31@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787831125.416435:0:17104:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1787831125.416468:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22044021c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8db48c6c-a61a-41ec-9c3b-96530aeb2537+7:0:x1874676433407488:12345-192.168.203.31@tcp:41:mount.lustre.0 Request processed in 80us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831125.416474:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 19 00000100:00100000:1.0:1787831125.416487:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 20 00000100:00100000:1.0:1787831125.416494:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22044003c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8db48c6c-a61a-41ec-9c3b-96530aeb2537+6:14994:x1874676433407872:12345-192.168.203.31@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787831125.416504:0:17104:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1787831125.416524:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22044003c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8db48c6c-a61a-41ec-9c3b-96530aeb2537+6:14994:x1874676433407872:12345-192.168.203.31@tcp:41:mount.lustre.0 Request processed in 31us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831125.416543:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 20 00000100:00080000:2.0:1787831125.417143:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787831125.417152:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787831125.427299:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831125.429712:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433408000 00000100:00100000:1.0:1787831125.429731:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433408000 00000100:00100000:1.0:1787831125.429876:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 21 00000100:00100000:1.0:1787831125.429890:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203792580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8db48c6c-a61a-41ec-9c3b-96530aeb2537+6:14994:x1874676433408000:12345-192.168.203.31@tcp:40:mount.lustre.0 00000100:00100000:1.0:1787831125.430045:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203792580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8db48c6c-a61a-41ec-9c3b-96530aeb2537+6:14994:x1874676433408000:12345-192.168.203.31@tcp:40:mount.lustre.0 Request processed in 157us (2761us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831125.430054:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 21 00000100:00100000:3.0:1787831125.432368:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831125.432440:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831125.432477:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433408384 00000100:00100000:3.0:1787831125.432489:0:17116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433408384 00000100:00100000:3.0:1787831125.432551:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 4 00000100:00100000:3.0:1787831125.432562:0:17116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203aff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:8db48c6c-a61a-41ec-9c3b-96530aeb2537+6:14994:x1874676433408384:12345-192.168.203.31@tcp:900:mount.lustre.0 00000100:00100000:3.0:1787831125.432684:0:17116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203aff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:8db48c6c-a61a-41ec-9c3b-96530aeb2537+6:14994:x1874676433408384:12345-192.168.203.31@tcp:900:mount.lustre.0 Request processed in 125us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831125.432694:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 4 00000100:00100000:2.0:1787831125.432821:0:19566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433408128 00000100:00100000:2.0:1787831125.432828:0:19566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433408128 00000100:00100000:2.0:1787831125.432865:0:19566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 19 00000100:00100000:2.0:1787831125.432898:0:19566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2314ed52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2393:x1874676433408128:12345-192.168.203.31@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787831125.432934:0:19566:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 8db48c6c-a61a-41ec-9c3b-96530aeb2537@192.168.203.31@tcp t0 exp 0000000000000000 cur 416 last 0 00000020:00000080:2.0:1787831125.432973:0:19566:0:(genops.c:1385:class_connect()) connect: client 8db48c6c-a61a-41ec-9c3b-96530aeb2537, cookie 0x95459fb9d1d29f3e 00002000:00100000:2.0:1787831125.433090:0:19566:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 8db48c6c-a61a-41ec-9c3b-96530aeb2537/ffff8d2201d08800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211393d ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787831125.433105:0:19566:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return 37 00002000:00080000:2.0:1787831125.433220:0:19566:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787831125.433261:0:19566:0:(import.c:65:import_set_state_nolock()) ffff8d2201d09000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787831125.433450:0:19566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2314ed52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8db48c6c-a61a-41ec-9c3b-96530aeb2537+6:2393:x1874676433408128:12345-192.168.203.31@tcp:8:mount.lustre.0 Request processed in 551us (1093us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831125.435489:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831125.435681:0:19566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 19 00000100:00100000:0.0:1787831125.435874:0:18610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433408256 00000100:00100000:0.0:1787831125.435887:0:18610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433408256 00000100:00100000:0.0:1787831125.435938:0:18610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 20 00000100:00100000:0.0:1787831125.435947:0:18610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204401e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2393:x1874676433408256:12345-192.168.203.31@tcp:8:mount.lustre.0 00010000:00080000:0.0:1787831125.436013:0:18610:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 8db48c6c-a61a-41ec-9c3b-96530aeb2537@192.168.203.31@tcp t0 exp 0000000000000000 cur 416 last 0 00000020:00000080:0.0:1787831125.436049:0:18610:0:(genops.c:1385:class_connect()) connect: client 8db48c6c-a61a-41ec-9c3b-96530aeb2537, cookie 0x95459fb9d1d29f45 00002000:00100000:0.0:1787831125.436064:0:18610:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 8db48c6c-a61a-41ec-9c3b-96530aeb2537/ffff8d233556c800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211393d ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787831125.436097:0:18610:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return 37 00002000:00080000:0.0:1787831125.436196:0:18610:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787831125.436240:0:18610:0:(import.c:65:import_set_state_nolock()) ffff8d233556f000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787831125.436316:0:18610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204401e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8db48c6c-a61a-41ec-9c3b-96530aeb2537+6:2393:x1874676433408256:12345-192.168.203.31@tcp:8:mount.lustre.0 Request processed in 368us (837us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831125.436325:0:18610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 20 00000100:00100000:0.0:1787831125.438296:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831125.438583:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433408512 00000100:00100000:1.0:1787831125.438595:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433408512 00000100:00100000:1.0:1787831125.438775:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 1 00000100:00100000:1.0:1787831125.438787:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22037921c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8db48c6c-a61a-41ec-9c3b-96530aeb2537+6:14994:x1874676433408512:12345-192.168.203.31@tcp:33:mount.lustre.0 00000004:00200000:1.0:1787831125.438899:0:17108:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1787831125.439019:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22037921c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8db48c6c-a61a-41ec-9c3b-96530aeb2537+6:14994:x1874676433408512:12345-192.168.203.31@tcp:33:mount.lustre.0 Request processed in 234us (735us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831125.439028:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 1 00000100:00100000:2.0:1787831125.571264:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831125.571451:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433408640 00000100:00100000:3.0:1787831125.571464:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433408640 00000100:00100000:3.0:1787831125.571543:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 22 00000100:00100000:3.0:1787831125.571556:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22046461c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8db48c6c-a61a-41ec-9c3b-96530aeb2537+6:15028:x1874676433408640:12345-192.168.203.31@tcp:101:mkdir.0 00010000:00010000:3.0:1787831125.571583:0:17106:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787831125.571611:0:17106:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d29f4c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a994241ff expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831125.571774:0:17106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76200/0x95459fb9d1d29f53 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831125.571814:0:17106:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76200/0x95459fb9d1d29f53 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831125.571832:0:17106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76200/0x95459fb9d1d29f53 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787831125.571897:0:17106:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787831125.571901:0:17106:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787831125.571926:0:17106:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76200/0x95459fb9d1d29f53 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831125.571959:0:17106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76600/0x95459fb9d1d29f4c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994241ff expref: 8 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831125.571994:0:17106:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76200/0x95459fb9d1d29f53 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994241ff expref: 7 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831125.572004:0:17106:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d233a6f9800) 00010000:00010000:3.0:1787831125.572008:0:17106:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787831125.572012:0:17106:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2307c76200, rc 0) 00000100:00100000:3.0:1787831125.572090:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22046461c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8db48c6c-a61a-41ec-9c3b-96530aeb2537+7:15028:x1874676433408640:12345-192.168.203.31@tcp:101:mkdir.0 Request processed in 536us (839us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831125.572098:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 22 00010000:00010000:0.0:1787831125.928907:0:18633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787831126.951135:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787831127.750158:0:19979:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1787831127.975006:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787831128.814212:0:17835:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 8db48c6c-a61a-41ec-9c3b-96530aeb2537 00000001:00100000:1.0:1787831128.814234:0:17835:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 2240faf2-2a81-4e92-bb4c-b58ed0f19f2a 00000001:00100000:1.0:1787831128.815119:0:17084:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 8db48c6c-a61a-41ec-9c3b-96530aeb2537 00000001:00100000:1.0:1787831128.815131:0:17084:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 2240faf2-2a81-4e92-bb4c-b58ed0f19f2a 00000001:00100000:1.0:1787831128.815251:0:18604:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 8db48c6c-a61a-41ec-9c3b-96530aeb2537 00000001:00100000:1.0:1787831128.815258:0:18604:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2240faf2-2a81-4e92-bb4c-b58ed0f19f2a 00010000:00010000:0.0:1787831128.999801:0:18633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787831129.319224:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787831129.319277:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22044030c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676443948416:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787831129.319577:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204644780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443948672:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787831129.319704:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831129.319773:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203793c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443949184:0@lo:400:kworker.0 00000100:00100000:2.0:1787831129.319802:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831129.319822:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203790780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443949696:0@lo:400:kworker.0 00000100:00100000:2.0:1787831129.319842:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831129.319859:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1787831129.319865:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204646940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443948800:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787831129.319892:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831129.319911:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203790000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874676443949312:0@lo:400:kworker.0 00000100:00100000:2.0:1787831129.319937:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831129.319965:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203793480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874676443949824:0@lo:400:kworker.0 00000100:00100000:2.0:1787831129.319987:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831129.320032:0:19566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443949184 00000100:00100000:2.0:1787831129.320040:0:19566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443949184 00000100:00100000:2.0:1787831129.320104:0:19566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443949696 00000100:00100000:2.0:1787831129.320108:0:19566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443949696 00000100:00100000:2.0:1787831129.320137:0:19566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787831129.320146:0:19566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204647840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676443949184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787831129.320206:0:19566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204647840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676443949184:12345-0@lo:400:kworker.0 Request processed in 60us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831129.320215:0:19566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787831129.320236:0:19566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787831129.320242:0:19566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204644000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443949696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787831129.320859:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831129.320905:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22037912c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:be45932f-3bcb-4e49-b61c-a2395180b0ee:3622:1874676443948544:0@lo:400:kworker.0 00000100:00100000:1.0:1787831129.320947:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831129.320986:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22037930c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676443949056:0@lo:400:kworker.0 00000100:00100000:1.0:1787831129.321013:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831129.321279:0:19566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204644000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443949696:12345-0@lo:400:kworker.0 Request processed in 1036us (1434us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831129.321297:0:19566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787831129.321317:0:19566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443949056 00000100:00100000:2.0:1787831129.321323:0:19566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443949056 00000100:00100000:0.0:1787831129.321363:0:18612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443948672 00000100:00100000:0.0:1787831129.321369:0:18612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443948672 00000100:00100000:0.0:1787831129.321396:0:18612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443948416 00000100:00100000:0.0:1787831129.321398:0:18612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443948416 00000100:00100000:0.0:1787831129.321413:0:18612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787831129.321421:0:18612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22046443c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676443948672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787831129.321530:0:18612:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787831129.321579:0:18612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22046443c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676443948672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 159us (1877us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831129.321586:0:18612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787831129.321600:0:18612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787831129.321607:0:18612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204401680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676443948416:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787831129.321638:0:18612:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787831129.321663:0:18612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204401680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676443948416:12345-0@lo:13:osp-pre-1-1.0 Request processed in 58us (807us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831129.321684:0:18612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787831129.322073:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203792940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676443949568:0@lo:400:kworker.0 00000100:00100000:1.0:1787831129.322191:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831129.322211:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203793840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3622:1874676443950080:0@lo:400:kworker.0 00000100:00100000:1.0:1787831129.322243:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831129.322251:0:19566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443949568 00000100:00100000:2.0:1787831129.322257:0:19566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443949568 00000100:00100000:2.0:1787831129.322284:0:19566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787831129.322294:0:19566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22044012c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3622:x1874676443949056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787831129.322436:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22044030c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676443948416:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787831129.322471:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22037930c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676443949056:0@lo:400:kworker.0 00000100:00100000:1.0:1787831129.322483:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:1.0:1787831129.322491:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203790f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676443948928:0@lo:400:kworker.0 00000100:00100000:0.0:1787831129.322528:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443948544 00000100:00100000:0.0:1787831129.322545:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443948544 00000100:00100000:0.0:1787831129.322583:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1787831129.322593:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220377e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be45932f-3bcb-4e49-b61c-a2395180b0ee+24:3622:x1874676443948544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787831129.322671:0:19566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22044012c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3622:x1874676443949056:12345-0@lo:400:kworker.0 Request processed in 378us (1654us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831129.322679:0:19566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787831129.322684:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831129.322706:0:19566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787831129.322718:0:19566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220442ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676443949568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787831129.322719:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22037903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676443949440:0@lo:400:kworker.0 00000100:00100000:1.0:1787831129.322764:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831129.322769:0:19566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220442ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676443949568:12345-0@lo:400:kworker.0 Request processed in 55us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831129.322776:0:19566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787831129.322788:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203791680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3622:1874676443949952:0@lo:400:kworker.0 00000100:00100000:2.0:1787831129.322810:0:19224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443948800 00000100:00100000:1.0:1787831129.322815:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831129.322817:0:19224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443948800 00000100:00100000:1.0:1787831129.322840:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2309d0b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676443950464:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787831129.322841:0:19224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443948928 00000100:00100000:2.0:1787831129.322846:0:19224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443948928 00000100:00100000:2.0:1787831129.322865:0:19224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443949440 00000100:00100000:2.0:1787831129.322869:0:19224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443949440 00000100:00100000:1.0:1787831129.322874:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831129.322895:0:19224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787831129.322904:0:19224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22046470c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3619:x1874676443948800:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787831129.322911:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203792940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676443949568:0@lo:400:kworker.0 00000004:00000024:2.0:1787831129.322937:0:19224:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1787831129.323009:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203791a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3620:1874676443950336:0@lo:400:kworker.0 00000100:00100000:1.0:1787831129.323052:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831129.323075:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787831129.323082:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203792d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3620:1874676443950208:0@lo:400:kworker.0 00000100:00100000:1.0:1787831129.323111:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831129.323137:0:18611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443950464 00000100:00100000:1.0:1787831129.323141:0:18611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443950464 00000100:00100000:0.0:1787831129.323163:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220377e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be45932f-3bcb-4e49-b61c-a2395180b0ee+24:3622:x1874676443948544:12345-0@lo:400:kworker.0 Request processed in 571us (2213us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831129.323171:0:18611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787831129.323175:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1787831129.323184:0:18611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204555a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676443950464:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787831129.323203:0:18611:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1787831129.323240:0:18611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204555a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676443950464:12345-0@lo:13:osp-pre-0-1.0 Request processed in 60us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831129.323246:0:18611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787831129.323275:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443949312 00000100:00100000:1.0:1787831129.323279:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443949312 00000100:00100000:1.0:1787831129.323299:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443949824 00000100:00100000:1.0:1787831129.323302:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443949824 00000100:00100000:1.0:1787831129.323315:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443950080 00000100:00100000:1.0:1787831129.323318:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443950080 00000100:00100000:1.0:1787831129.323350:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443949952 00000100:00100000:1.0:1787831129.323354:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443949952 00000100:00100000:1.0:1787831129.323370:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443950336 00000100:00100000:1.0:1787831129.323373:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443950336 00000100:00100000:1.0:1787831129.323386:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443950208 00000100:00100000:1.0:1787831129.323388:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443950208 00000100:00100000:1.0:1787831129.323401:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787831129.323406:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204645a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874676443949312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787831129.323440:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204645a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874676443949312:12345-0@lo:400:kworker.0 Request processed in 34us (3502us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831129.323446:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787831129.323467:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787831129.323473:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204646d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874676443949824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787831129.323503:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204646d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874676443949824:12345-0@lo:400:kworker.0 Request processed in 31us (3516us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831129.323509:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787831129.323519:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787831129.323525:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204554f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1874676443950080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787831129.323556:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204554f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1874676443950080:12345-0@lo:400:kworker.0 Request processed in 32us (1313us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831129.323563:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787831129.323575:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787831129.323582:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204555e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1874676443949952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787831129.323612:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204555e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1874676443949952:12345-0@lo:400:kworker.0 Request processed in 31us (797us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831129.323619:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787831129.323662:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787831129.323676:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204554780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1874676443950336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787831129.323677:0:19224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22046470c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3619:x1874676443948800:12345-0@lo:41:osp-pre-0-1.0 Request processed in 768us (3778us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831129.323689:0:19224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787831129.323712:0:19224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787831129.323721:0:19224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22045561c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1874676443948928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787831129.323727:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204554780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1874676443950336:12345-0@lo:400:kworker.0 Request processed in 57us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831129.323735:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787831129.323751:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787831129.323763:0:19224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22045561c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1874676443948928:12345-0@lo:400:kworker.0 Request processed in 41us (1079us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831129.323763:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204556940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1874676443950208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787831129.323778:0:19224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787831129.323794:0:19224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787831129.323803:0:19224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204556d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676443949440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787831129.323809:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204556940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1874676443950208:12345-0@lo:400:kworker.0 Request processed in 50us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831129.323816:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787831129.323845:0:19224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204556d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676443949440:12345-0@lo:400:kworker.0 Request processed in 43us (1081us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831129.323852:0:19224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:2.0:1787831129.323891:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787831129.323896:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203790f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676443948928:0@lo:400:kworker.0 00000100:00080000:2.0:1787831129.323898:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787831129.323905:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787831129.323909:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787831129.323914:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22037903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676443949440:0@lo:400:kworker.0 00000100:00100000:1.0:1787831129.323928:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203791680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3622:1874676443949952:0@lo:400:kworker.0 00000100:00100000:1.0:1787831129.323964:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2309d0b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676443950464:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787831129.323977:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203792d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3620:1874676443950208:0@lo:400:kworker.0 00000100:00100000:1.0:1787831129.323982:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22037912c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:be45932f-3bcb-4e49-b61c-a2395180b0ee:3622:1874676443948544:0@lo:400:kworker.0 00010000:00080000:0.0:1787831129.324003:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2203791a40 x1874676443950336/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787831145 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1787831129.324004:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2203793840 x1874676443950080/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787831145 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787831129.324034:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203793840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3622:1874676443950080:0@lo:400:kworker.0 00000100:00100000:2.0:1787831129.324231:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204646940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443948800:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787831129.324251:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203790000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874676443949312:0@lo:400:kworker.0 00000100:00100000:2.0:1787831129.324280:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203793480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874676443949824:0@lo:400:kworker.0 00000100:00100000:2.0:1787831129.324296:0:3619:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:2.0:1787831129.324311:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203793c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443949184:0@lo:400:kworker.0 00000100:00100000:2.0:1787831129.324328:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203790780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443949696:0@lo:400:kworker.0 00000100:00100000:2.0:1787831129.324519:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204644780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443948672:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787831129.324612:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203791a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3620:1874676443950336:0@lo:400:kworker.0 00000100:00100000:1.0:1787831129.833253:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2309d08b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676443950592:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787831129.833349:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831129.833434:0:18611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443950592 00000100:00100000:1.0:1787831129.833443:0:18611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443950592 00000100:00100000:1.0:1787831129.833504:0:18611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787831129.833513:0:18611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204554b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1874676443950592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787831129.833538:0:18611:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1787831129.833584:0:18611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204554b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1874676443950592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831129.833592:0:18611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787831129.833671:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2309d08b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676443950592:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787831130.022837:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787831130.344705:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787831130.344742:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204557480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1874676443950720:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787831130.344848:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831130.344916:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443950720 00000100:00100000:1.0:1787831130.344960:0:17110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443950720 00000100:00100000:1.0:1787831130.345028:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787831130.345038:0:17110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204557840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1874676443950720:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787831130.345150:0:17110:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787831130.345220:0:17110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204557840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1874676443950720:12345-0@lo:41:osp-pre-1-0.0 Request processed in 183us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831130.345230:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787831130.345307:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204557480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1874676443950720:0@lo:41:osp-pre-1-0.0 00000020:00000080:3.0:1787831130.487127:0:20126:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdd0d00700 20000000:00000080:3.0:1787831130.487151:0:20126:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d233fa5d000 uarg=0000000000000000 20000000:01000000:3.0:1787831130.487207:0:20126:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787831130.487221:0:20126:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787831130.487225:0:20126:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1787831130.488115:0:20127:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:2.0:1787831130.488293:0:20126:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1787831130.499324:0:20126:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787831130.499361:0:20126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d22039c1000/0x95459fb9d1d29f5a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831130.499376:0:20126:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2307c77a00/0x95459fb9d1d29bef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d29be8 expref: 23 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831130.499382:0:20126:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2307c77400/0x95459fb9d1d29bfd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d29bf6 expref: 23 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831130.499464:0:20126:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2303aa3c00/0x95459fb9d1d29c3c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d29c35 expref: 23 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831130.499470:0:20126:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d22039c0a00/0x95459fb9d1d29d9a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d29d93 expref: 23 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831130.499477:0:20126:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d22039c0600/0x95459fb9d1d29eea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a9942415e expref: 12 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831130.499482:0:20126:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2307c76400/0x95459fb9d1d29f29 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994241ce expref: 12 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831130.499504:0:20126:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d22039c1000/0x95459fb9d1d29f5a lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831130.499554:0:20126:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2307c76400/0x95459fb9d1d29f29 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.31@tcp remote: 0xe558a92a994241ce expref: 12 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831130.499570:0:20126:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d2307c76400/0x95459fb9d1d29f29 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a994241ce expref: 12 pid: 17098 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831130.499586:0:20126:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204646940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20126:1874676443950848:192.168.203.31@tcp:104: 00010000:00010000:2.0:1787831130.499880:0:20126:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d22039c0600/0x95459fb9d1d29eea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.31@tcp remote: 0xe558a92a9942415e expref: 12 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831130.499890:0:20126:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d22039c0600/0x95459fb9d1d29eea lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a9942415e expref: 12 pid: 17098 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831130.499898:0:20126:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22046452c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20126:1874676443950976:192.168.203.31@tcp:104: 00010000:00010000:2.0:1787831130.499932:0:20126:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d22039c0a00/0x95459fb9d1d29d9a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x95459fb9d1d29d93 expref: 23 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831130.499951:0:20126:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d22039c0a00/0x95459fb9d1d29d9a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x95459fb9d1d29d93 expref: 23 pid: 17096 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831130.499961:0:20126:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204644b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20126:1874676443951104:0@lo:104: 00000100:00100000:2.0:1787831130.499998:0:20126:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787831130.500032:0:20126:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2303aa3c00/0x95459fb9d1d29c3c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x95459fb9d1d29c35 expref: 23 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831130.500051:0:20126:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d2303aa3c00/0x95459fb9d1d29c3c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x95459fb9d1d29c35 expref: 23 pid: 17098 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831130.500060:0:20126:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204646580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20126:1874676443951232:0@lo:104: 00000100:00100000:0.0:1787831130.500060:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443951104 00000100:00100000:0.0:1787831130.500066:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443951104 00000100:00100000:2.0:1787831130.500083:0:20126:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831130.500104:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443951232 00010000:00010000:2.0:1787831130.500106:0:20126:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2307c77400/0x95459fb9d1d29bfd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x95459fb9d1d29bf6 expref: 23 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831130.500107:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443951232 00010000:00010000:2.0:1787831130.500114:0:20126:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d2307c77400/0x95459fb9d1d29bfd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x95459fb9d1d29bf6 expref: 23 pid: 17096 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831130.500120:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787831130.500122:0:20126:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204647480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20126:1874676443951360:0@lo:104: 00000100:00100000:0.0:1787831130.500128:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204647c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:be45932f-3bcb-4e49-b61c-a2395180b0ee+4:20126:x1874676443951104:12345-0@lo:104: 00010000:00010000:0.0:1787831130.500141:0:17087:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff8d233bf11e00/0x95459fb9d1d29d93 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d29d9a expref: -99 pid: 19421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831130.500142:0:20126:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787831130.500156:0:20126:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2307c77a00/0x95459fb9d1d29bef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x95459fb9d1d29be8 expref: 23 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831130.500163:0:20126:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d2307c77a00/0x95459fb9d1d29bef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x95459fb9d1d29be8 expref: 23 pid: 17096 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831130.500171:0:20126:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204645e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20126:1874676443951488:0@lo:104: 00010000:00010000:0.0:1787831130.500183:0:17087:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787831130.500188:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204647c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:be45932f-3bcb-4e49-b61c-a2395180b0ee+4:20126:x1874676443951104:12345-0@lo:104: Request processed in 61us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831130.500189:0:20126:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831130.500195:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787831130.500197:0:20126:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d230879a000 going to sleep for 11 seconds 00000100:00100000:0.0:1787831130.500210:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443951360 00000100:00100000:0.0:1787831130.500213:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443951360 00000100:00100000:2.0:1787831130.500215:0:20126:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204644b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20126:1874676443951104:0@lo:104: 00000100:00100000:0.0:1787831130.500222:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443951488 00000100:00100000:0.0:1787831130.500224:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443951488 00000100:00100000:0.0:1787831130.500245:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00010000:00010000:2.0:1787831130.500249:0:17093:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1787831130.500250:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204644f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:be45932f-3bcb-4e49-b61c-a2395180b0ee+5:20126:x1874676443951232:12345-0@lo:104: 00010000:00010000:2.0:1787831130.500255:0:17093:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8d233bf11e00/0x95459fb9d1d29d93 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d29d9a expref: -99 pid: 19421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831130.500257:0:17087:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff8d22039c0000/0x95459fb9d1d29c35 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d29c3c expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831130.500263:0:17093:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233bf11e00 already unused, calling callback (ffffffffc14f9c20) 10000000:00010000:2.0:1787831130.500272:0:17093:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8d233bf11e00/0x95459fb9d1d29d93 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x95459fb9d1d29d9a expref: -99 pid: 19421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831130.500281:0:17093:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8d233bf11e00/0x95459fb9d1d29d93 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x95459fb9d1d29d9a expref: -99 pid: 19421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787831130.500289:0:17093:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8d233bf11e00/0x95459fb9d1d29d93 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x95459fb9d1d29d9a expref: -99 pid: 19421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787831130.500295:0:17093:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787831130.500296:0:17087:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787831130.500301:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204644f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:be45932f-3bcb-4e49-b61c-a2395180b0ee+5:20126:x1874676443951232:12345-0@lo:104: Request processed in 51us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831130.500308:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787831130.500321:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00010000:00010000:2.0:1787831130.500324:0:17093:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8d233bf11e00/0x95459fb9d1d29d93 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d29d9a expref: -99 pid: 19421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831130.500329:0:18633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1787831130.500329:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204645680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:be45932f-3bcb-4e49-b61c-a2395180b0ee+4:20126:x1874676443951360:12345-0@lo:104: 00010000:00010000:2.0:1787831130.500331:0:17093:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787831130.500342:0:18633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8d22039c0000/0x95459fb9d1d29c35 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d29c3c expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831130.500342:0:17087:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff8d23344b7a00/0x95459fb9d1d29bf6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d29bfd expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831130.500363:0:18633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22039c0000 already unused, calling callback (ffffffffc14f9c20) 10000000:00010000:1.0:1787831130.500368:0:18633:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8d22039c0000/0x95459fb9d1d29c35 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x95459fb9d1d29c3c expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831130.500378:0:18633:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8d22039c0000/0x95459fb9d1d29c35 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x95459fb9d1d29c3c expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787831130.500385:0:18633:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8d22039c0000/0x95459fb9d1d29c35 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x95459fb9d1d29c3c expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831130.500390:0:17087:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 10000000:01000000:1.0:1787831130.500391:0:18633:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:0.0:1787831130.500399:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204645680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:be45932f-3bcb-4e49-b61c-a2395180b0ee+4:20126:x1874676443951360:12345-0@lo:104: Request processed in 71us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831130.500406:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:1.0:1787831130.500415:0:18633:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8d22039c0000/0x95459fb9d1d29c35 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d29c3c expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831130.500424:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1787831130.500425:0:18633:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1787831130.500435:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220390d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:be45932f-3bcb-4e49-b61c-a2395180b0ee+3:20126:x1874676443951488:12345-0@lo:104: 00010000:00010000:0.0:1787831130.500443:0:17087:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff8d2303aa2a00/0x95459fb9d1d29be8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d29bef expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831130.500446:0:18633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8d22039c0000/0x95459fb9d1d29c35 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d29c3c expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831130.500471:0:18633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8d22039c0000/0x95459fb9d1d29c35 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d29c3c expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831130.500477:0:17087:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787831130.500484:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220390d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:be45932f-3bcb-4e49-b61c-a2395180b0ee+3:20126:x1874676443951488:12345-0@lo:104: Request processed in 51us (293us total) trans 0 rc 0/0 00010000:00010000:1.0:1787831130.500488:0:18633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:0.0:1787831130.500493:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1787831130.500506:0:18633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8d23344b7a00/0x95459fb9d1d29bf6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d29bfd expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831130.500515:0:18633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d23344b7a00 already unused, calling callback (ffffffffc14f9c20) 10000000:00010000:1.0:1787831130.500518:0:18633:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8d23344b7a00/0x95459fb9d1d29bf6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x95459fb9d1d29bfd expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831130.500525:0:18633:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8d23344b7a00/0x95459fb9d1d29bf6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x95459fb9d1d29bfd expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787831130.500532:0:18633:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8d23344b7a00/0x95459fb9d1d29bf6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x95459fb9d1d29bfd expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787831130.500538:0:18633:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787831130.500558:0:18633:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8d23344b7a00/0x95459fb9d1d29bf6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d29bfd expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831130.500564:0:18633:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787831130.500575:0:18633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8d23344b7a00/0x95459fb9d1d29bf6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d29bfd expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831130.500583:0:17093:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8d233bf11e00/0x95459fb9d1d29d93 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d29d9a expref: -99 pid: 19421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831130.500584:0:18633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8d23344b7a00/0x95459fb9d1d29bf6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d29bfd expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831130.500599:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22045b6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:be45932f-3bcb-4e49-b61c-a2395180b0ee:3620:1874676443951616:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787831130.500603:0:17093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8d233bf11e00/0x95459fb9d1d29d93 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d29d9a expref: -99 pid: 19421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831130.500607:0:18633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787831130.500618:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787831130.500621:0:18633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8d2303aa2a00/0x95459fb9d1d29be8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d29bef expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831130.500622:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787831130.500654:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787831130.500664:0:18633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2303aa2a00 already unused, calling callback (ffffffffc14f9c20) 10000000:00010000:1.0:1787831130.500669:0:18633:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8d2303aa2a00/0x95459fb9d1d29be8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x95459fb9d1d29bef expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831130.500675:0:18633:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8d2303aa2a00/0x95459fb9d1d29be8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x95459fb9d1d29bef expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831130.500676:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:1.0:1787831130.500685:0:18633:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8d2303aa2a00/0x95459fb9d1d29be8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x95459fb9d1d29bef expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787831130.500690:0:18633:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:0.0:1787831130.500715:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443951616 00000100:00100000:0.0:1787831130.500719:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443951616 00010000:00010000:1.0:1787831130.500722:0:18633:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8d2303aa2a00/0x95459fb9d1d29be8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d29bef expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831130.500729:0:18633:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787831130.500740:0:18633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8d2303aa2a00/0x95459fb9d1d29be8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d29bef expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831130.500743:0:17090:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d22039c0a00/0x95459fb9d1d29d9a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d29d93 expref: 24 pid: 17096 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831130.500755:0:18633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8d2303aa2a00/0x95459fb9d1d29be8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d29bef expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831130.500772:0:18633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787831130.500775:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00010000:00010000:1.0:1787831130.500776:0:18633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787831130.500781:0:18633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787831130.500785:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2309d08000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:be45932f-3bcb-4e49-b61c-a2395180b0ee+24:3620:x1874676443951616:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787831130.500795:0:17090:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1787831130.500797:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22045552c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:be45932f-3bcb-4e49-b61c-a2395180b0ee:3622:1874676443951872:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787831130.500802:0:17090:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d22039c0a00/0x95459fb9d1d29d9a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d29d93 expref: 24 pid: 17096 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831130.500813:0:17090:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d22039c0a00/0x95459fb9d1d29d9a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x95459fb9d1d29d93 expref: 24 pid: 17096 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831130.500826:0:17090:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d22039c0a00/0x95459fb9d1d29d9a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x95459fb9d1d29d93 expref: 24 pid: 17096 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831130.500835:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787831130.500839:0:17090:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787831130.500864:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787831130.500873:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2309d08000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:be45932f-3bcb-4e49-b61c-a2395180b0ee+23:3620:x1874676443951616:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831130.500874:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204557480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:be45932f-3bcb-4e49-b61c-a2395180b0ee:3622:1874676443951744:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787831130.500880:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787831130.500892:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443951872 00000100:00100000:0.0:1787831130.500897:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443951872 00010000:00010000:0.0:1787831130.500909:0:17090:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2307c77400/0x95459fb9d1d29bfd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d29bf6 expref: 23 pid: 17096 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831130.500918:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831130.500926:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443951744 00000100:00100000:0.0:1787831130.500930:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443951744 00010000:00010000:0.0:1787831130.500950:0:17090:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2303aa3c00/0x95459fb9d1d29c3c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d29c35 expref: 24 pid: 17098 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831130.500963:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22045570c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:be45932f-3bcb-4e49-b61c-a2395180b0ee:3619:1874676443952000:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787831130.500976:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787831130.500983:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204557c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:be45932f-3bcb-4e49-b61c-a2395180b0ee+24:3622:x1874676443951872:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787831130.500992:0:17090:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787831130.500997:0:17090:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2307c77400/0x95459fb9d1d29bfd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d29bf6 expref: 24 pid: 17096 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831130.501006:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787831130.501011:0:17090:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2307c77400/0x95459fb9d1d29bfd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x95459fb9d1d29bf6 expref: 24 pid: 17096 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831130.501022:0:17090:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787831130.501038:0:17091:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1787831130.501047:0:17091:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:0.0:1787831130.501054:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204557c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:be45932f-3bcb-4e49-b61c-a2395180b0ee+24:3622:x1874676443951872:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831130.501066:0:17089:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1787831130.501068:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787831130.501076:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443952000 00000100:00100000:1.0:1787831130.501081:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443952000 00000100:00100000:0.0:1787831130.501086:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787831130.501095:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204556580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:be45932f-3bcb-4e49-b61c-a2395180b0ee+24:3622:x1874676443951744:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787831130.501101:0:17089:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2307c77a00/0x95459fb9d1d29bef lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d29be8 expref: 24 pid: 17096 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831130.501103:0:17090:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787831130.501111:0:17090:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2303aa3c00/0x95459fb9d1d29c3c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d29c35 expref: 24 pid: 17098 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831130.501120:0:17090:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2303aa3c00/0x95459fb9d1d29c3c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x95459fb9d1d29c35 expref: 24 pid: 17098 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831130.501125:0:17089:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:0.0:1787831130.501130:0:17090:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787831130.501136:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787831130.501146:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22045543c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:be45932f-3bcb-4e49-b61c-a2395180b0ee+24:3619:x1874676443952000:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787831130.501156:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204556580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:be45932f-3bcb-4e49-b61c-a2395180b0ee+24:3622:x1874676443951744:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (238us total) trans 0 rc 0/0 00010000:00010000:1.0:1787831130.501157:0:17089:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787831130.501165:0:17089:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2307c77a00/0x95459fb9d1d29bef lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d29be8 expref: 24 pid: 17096 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831130.501166:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:1.0:1787831130.501179:0:17089:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2307c77a00/0x95459fb9d1d29bef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x95459fb9d1d29be8 expref: 23 pid: 17096 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831130.501191:0:17089:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787831130.501222:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22045543c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:be45932f-3bcb-4e49-b61c-a2395180b0ee+23:3619:x1874676443952000:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831130.501230:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787831130.501331:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22045570c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:be45932f-3bcb-4e49-b61c-a2395180b0ee:3619:1874676443952000:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787831130.501363:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22045b6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:be45932f-3bcb-4e49-b61c-a2395180b0ee:3620:1874676443951616:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787831130.501386:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204557480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:be45932f-3bcb-4e49-b61c-a2395180b0ee:3622:1874676443951744:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787831130.501404:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22045552c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:be45932f-3bcb-4e49-b61c-a2395180b0ee:3622:1874676443951872:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787831130.501493:0:20126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2303aa3c00/0x95459fb9d1d29c3c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x95459fb9d1d29c35 expref: 22 pid: 17098 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831130.501504:0:20126:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204646580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20126:1874676443951232:0@lo:104: 00010000:00010000:1.0:1787831130.501515:0:20126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2307c77400/0x95459fb9d1d29bfd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x95459fb9d1d29bf6 expref: 21 pid: 17096 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831130.501524:0:20126:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204647480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20126:1874676443951360:0@lo:104: 00010000:00010000:1.0:1787831130.501537:0:20126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2307c77a00/0x95459fb9d1d29bef lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x95459fb9d1d29be8 expref: 20 pid: 17096 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831130.501547:0:20126:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204645e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20126:1874676443951488:0@lo:104: 00010000:00010000:3.0:1787831130.502829:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787831130.503209:0:20126:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204646940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20126:1874676443950848:192.168.203.31@tcp:104: 00000100:00100000:1.0:1787831130.504643:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831130.504763:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433408768 00000100:00100000:0.0:1787831130.504774:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433408768 00010000:00010000:0.0:1787831130.504824:0:17090:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2307c76400/0x95459fb9d1d29f29 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a994241ce expref: 13 pid: 17098 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831130.504916:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 13 00000100:00100000:0.0:1787831130.504926:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233c0ea050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1f931f0c-5730-4db2-abdb-70a9ab2deeff+13:2397:x1874676433408768:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787831130.504952:0:17090:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787831130.504959:0:17090:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2307c76400/0x95459fb9d1d29f29 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a994241ce expref: 13 pid: 17098 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831130.504971:0:17090:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2307c76400/0x95459fb9d1d29f29 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a994241ce expref: 13 pid: 17098 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831130.504988:0:17090:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2307c76400/0x95459fb9d1d29f29 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a994241ce expref: 13 pid: 17098 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831130.505003:0:17090:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787831130.505067:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233c0ea050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1f931f0c-5730-4db2-abdb-70a9ab2deeff+12:2397:x1874676433408768:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 143us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831130.505075:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 13 00000100:00100000:1.0:1787831130.506898:0:20126:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22046452c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20126:1874676443950976:192.168.203.31@tcp:104: 00000100:00100000:2.0:1787831130.506902:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00010000:00010000:1.0:1787831130.506969:0:20126:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d22039c1000/0x95459fb9d1d29f5a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787831130.507836:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433408896 00000100:00100000:3.0:1787831130.507852:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433408896 00010000:00010000:3.0:1787831130.508043:0:17091:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d22039c0600/0x95459fb9d1d29eea lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a9942415e expref: 12 pid: 17098 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787831130.508090:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 14 00000100:00100000:3.0:1787831130.508102:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22045b7c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1f931f0c-5730-4db2-abdb-70a9ab2deeff+12:2396:x1874676433408896:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787831130.508123:0:17091:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787831130.508133:0:17091:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d22039c0600/0x95459fb9d1d29eea lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a9942415e expref: 12 pid: 17098 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831130.508151:0:17091:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d22039c0600/0x95459fb9d1d29eea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a9942415e expref: 12 pid: 17098 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831130.508175:0:17091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d22039c0600/0x95459fb9d1d29eea lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a9942415e expref: 12 pid: 17098 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831130.508199:0:17091:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d22039c1000/0x95459fb9d1d29f5a lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831130.508209:0:17091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22039c1000/0x95459fb9d1d29f5a lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831130.508231:0:17091:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d22039c1000/0x95459fb9d1d29f5a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831130.508238:0:17091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d22039c1000/0x95459fb9d1d29f5a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831130.508265:0:17091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d22039c1000/0x95459fb9d1d29f5a lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831130.508273:0:17091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d22039c1000/0x95459fb9d1d29f5a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831130.508280:0:17091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22039c1000 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:3.0:1787831130.508285:0:17091:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d22039c1000/0x95459fb9d1d29f5a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831130.508294:0:17091:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d22039c1000/0x95459fb9d1d29f5a lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831130.508418:0:17091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d22039c1000/0x95459fb9d1d29f5a lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831130.508419:0:20126:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d22039c1000/0x95459fb9d1d29f5a lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831130.508452:0:20126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d22039c1000/0x95459fb9d1d29f5a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831130.508453:0:17091:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787831130.508465:0:20126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d22039c1000/0x95459fb9d1d29f5a lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787831130.508955:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22045b7c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1f931f0c-5730-4db2-abdb-70a9ab2deeff+11:2396:x1874676433408896:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 775us (1976us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831130.508967:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 14 00000100:00100000:2.0:1787831130.711250:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831130.711299:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831130.711335:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831130.711365:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831130.711382:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831130.711398:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831130.711413:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831130.711461:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831130.711489:0:18518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433409024 00000100:00100000:2.0:1787831130.711498:0:18518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433409024 00000100:00100000:2.0:1787831130.711553:0:18518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433409536 00000100:00100000:2.0:1787831130.711556:0:18518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433409536 00000100:00100000:2.0:1787831130.711571:0:18518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433409152 00000100:00100000:2.0:1787831130.711573:0:18518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433409152 00000100:00100000:2.0:1787831130.711587:0:18518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433409664 00000100:00100000:2.0:1787831130.711589:0:18518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433409664 00000100:00100000:2.0:1787831130.711605:0:18518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 39 00000100:00100000:2.0:1787831130.711614:0:18518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22045b61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+6:2394:x1874676433409024:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1787831130.711712:0:18518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22045b61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+6:2394:x1874676433409024:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 98us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831130.711719:0:18518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 39 00000100:00100000:2.0:1787831130.711737:0:18518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 40 00000100:00100000:2.0:1787831130.711743:0:18518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22045b5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8db48c6c-a61a-41ec-9c3b-96530aeb2537+6:2394:x1874676433409536:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1787831130.711762:0:18518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22045b5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8db48c6c-a61a-41ec-9c3b-96530aeb2537+6:2394:x1874676433409536:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 21us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831130.711768:0:18518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 40 00000100:00100000:2.0:1787831130.711777:0:18518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 41 00000100:00100000:2.0:1787831130.711782:0:18518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22045b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+5:2394:x1874676433409152:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1787831130.711799:0:18518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22045b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+5:2394:x1874676433409152:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 17us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831130.711804:0:18518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 41 00000100:00100000:2.0:1787831130.711813:0:18518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 42 00000100:00100000:2.0:1787831130.711818:0:18518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22045b4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8db48c6c-a61a-41ec-9c3b-96530aeb2537+5:2394:x1874676433409664:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1787831130.711843:0:18518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22045b4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8db48c6c-a61a-41ec-9c3b-96530aeb2537+5:2394:x1874676433409664:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 25us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831130.711849:0:18518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 42 00000100:00100000:2.0:1787831130.711865:0:18610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433409280 00000100:00100000:2.0:1787831130.711869:0:18610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433409280 00000100:00100000:2.0:1787831130.711893:0:18610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433409792 00000100:00100000:2.0:1787831130.711896:0:18610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433409792 00000100:00100000:2.0:1787831130.711906:0:18610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433409408 00000100:00100000:2.0:1787831130.711908:0:18610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433409408 00000100:00100000:2.0:1787831130.711919:0:18610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433409920 00000100:00100000:2.0:1787831130.711920:0:18610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433409920 00000100:00100000:2.0:1787831130.711932:0:18610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 7 00000100:00100000:2.0:1787831130.711937:0:18610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22045b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+5:2394:x1874676433409280:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1787831130.711971:0:18610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22045b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+5:2394:x1874676433409280:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 34us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831130.711976:0:18610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 7 00000100:00100000:2.0:1787831130.711986:0:18610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 8 00000100:00100000:2.0:1787831130.711991:0:18610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22045b52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8db48c6c-a61a-41ec-9c3b-96530aeb2537+5:2394:x1874676433409792:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1787831130.712007:0:18610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22045b52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8db48c6c-a61a-41ec-9c3b-96530aeb2537+5:2394:x1874676433409792:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 16us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831130.712012:0:18610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 8 00000100:00100000:2.0:1787831130.712020:0:18610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 9 00000100:00100000:2.0:1787831130.712025:0:18610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22045b70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+5:2394:x1874676433409408:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1787831130.712041:0:18610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22045b70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+5:2394:x1874676433409408:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 16us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831130.712055:0:18610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 9 00000100:00100000:2.0:1787831130.712065:0:18610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 10 00000100:00100000:2.0:1787831130.712070:0:18610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22045b5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8db48c6c-a61a-41ec-9c3b-96530aeb2537+6:2394:x1874676433409920:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1787831130.712088:0:18610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22045b5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8db48c6c-a61a-41ec-9c3b-96530aeb2537+6:2394:x1874676433409920:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 18us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831130.712093:0:18610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 10 00000100:00080000:2.0:1787831130.712106:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787831130.712110:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787831130.712112:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787831130.712113:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:3.0:1787831130.857777:0:19422:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8db48c6c-a61a-41ec-9c3b-96530aeb2537 00010000:00010000:2.0:1787831131.047950:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787831131.688531:0:17102:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787831131.688563:0:17102:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d2204708800 from 13 10000000:01000000:1.0:1787831131.688568:0:17102:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787831131.688613:0:17102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d23344b7a00/0x95459fb9d1d29f61 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831131.688649:0:17102:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8d23344b7a00/0x95459fb9d1d29f61 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831131.688663:0:17102:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8d23344b7a00/0x95459fb9d1d29f61 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831131.688690:0:17102:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204557480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be45932f-3bcb-4e49-b61c-a2395180b0ee:17102:1874676443952128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787831131.688760:0:17102:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831131.688802:0:17102:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d23100e0180 going to sleep for 11 seconds 00000100:00100000:3.0:1787831131.688913:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443952128 00000100:00100000:3.0:1787831131.688921:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443952128 00000100:00100000:3.0:1787831131.688987:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1787831131.688997:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220377cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be45932f-3bcb-4e49-b61c-a2395180b0ee+20:17102:x1874676443952128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787831131.689012:0:17096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787831131.689027:0:17096:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2307c76600/0x95459fb9d1d29f68 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d29f61 expref: -99 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831131.689061:0:17096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2307c76600/0x95459fb9d1d29f68 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d29f61 expref: 21 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831131.689072:0:17096:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2307c76600/0x95459fb9d1d29f68 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d29f61 expref: 21 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831131.689081:0:17096:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2307c76600, rc 0) 00000100:00100000:3.0:1787831131.689134:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220377cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be45932f-3bcb-4e49-b61c-a2395180b0ee+21:17102:x1874676443952128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 139us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831131.689141:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787831131.689608:0:17102:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204557480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be45932f-3bcb-4e49-b61c-a2395180b0ee:17102:1874676443952128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787831131.689649:0:17102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8d23344b7a00/0x95459fb9d1d29f61 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d29f68 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831131.689660:0:17102:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8d23344b7a00/0x95459fb9d1d29f61 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d29f68 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831131.689731:0:17102:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204557480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be45932f-3bcb-4e49-b61c-a2395180b0ee:17102:1874676443952256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787831131.689768:0:17102:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831131.689808:0:17102:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d23100e0180 going to sleep for 11 seconds 00000100:00100000:2.0:1787831131.691218:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443952256 00000100:00100000:2.0:1787831131.691230:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443952256 00000100:00100000:2.0:1787831131.692124:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1787831131.692138:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220377d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be45932f-3bcb-4e49-b61c-a2395180b0ee+21:17102:x1874676443952256:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787831131.693099:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220377d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be45932f-3bcb-4e49-b61c-a2395180b0ee+21:17102:x1874676443952256:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 960us (3325us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831131.693111:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1787831131.693576:0:17102:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204557480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be45932f-3bcb-4e49-b61c-a2395180b0ee:17102:1874676443952256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787831131.693675:0:17102:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204557480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be45932f-3bcb-4e49-b61c-a2395180b0ee:17102:1874676443952384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787831131.693724:0:17102:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831131.693756:0:17102:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d23100e0180 going to sleep for 11 seconds 00000100:00100000:3.0:1787831131.693820:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443952384 00000100:00100000:3.0:1787831131.693828:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443952384 00000100:00100000:3.0:1787831131.693872:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1787831131.693880:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220377dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be45932f-3bcb-4e49-b61c-a2395180b0ee+21:17102:x1874676443952384:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787831131.693991:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220377dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be45932f-3bcb-4e49-b61c-a2395180b0ee+21:17102:x1874676443952384:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 112us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831131.693998:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1787831131.694081:0:17102:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204557480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be45932f-3bcb-4e49-b61c-a2395180b0ee:17102:1874676443952384:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787831131.696171:0:20208:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1787831131.699155:0:17102:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1787831131.699199:0:17102:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787831131.699213:0:17102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d23344b7a00/0x95459fb9d1d29f61 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d29f68 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831131.699225:0:17102:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8d23344b7a00/0x95459fb9d1d29f61 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d29f68 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787831131.699236:0:17102:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787831131.699239:0:17102:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d2202768800 from 13 10000000:01000000:1.0:1787831131.699242:0:17102:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787831131.699280:0:17102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d23344b6200/0x95459fb9d1d29f6f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831131.699289:0:17102:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8d23344b6200/0x95459fb9d1d29f6f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831131.699300:0:17102:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8d23344b6200/0x95459fb9d1d29f6f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831131.699327:0:17102:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22045570c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be45932f-3bcb-4e49-b61c-a2395180b0ee:17102:1874676443952512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787831131.699399:0:17102:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831131.699449:0:17102:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d23100e0cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787831131.699645:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443952512 00000100:00100000:2.0:1787831131.699653:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443952512 00000100:00100000:2.0:1787831131.699697:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1787831131.699705:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220377c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be45932f-3bcb-4e49-b61c-a2395180b0ee+21:17102:x1874676443952512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787831131.699716:0:17098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787831131.699734:0:17098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d22039c1200/0x95459fb9d1d29f76 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d29f6f expref: -99 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831131.699756:0:17098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22039c1200/0x95459fb9d1d29f76 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d29f6f expref: 22 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831131.699766:0:17098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d22039c1200/0x95459fb9d1d29f76 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d29f6f expref: 22 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831131.699774:0:17098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22039c1200, rc 0) 00000100:00100000:2.0:1787831131.699810:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220377c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be45932f-3bcb-4e49-b61c-a2395180b0ee+22:17102:x1874676443952512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831131.699817:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787831131.699964:0:17102:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22045570c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be45932f-3bcb-4e49-b61c-a2395180b0ee:17102:1874676443952512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787831131.699978:0:17102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8d23344b6200/0x95459fb9d1d29f6f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d29f76 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831131.699985:0:17102:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8d23344b6200/0x95459fb9d1d29f6f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d29f76 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831131.700045:0:17102:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22045570c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be45932f-3bcb-4e49-b61c-a2395180b0ee:17102:1874676443952640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787831131.700070:0:17102:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831131.700099:0:17102:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d23100e0cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787831131.700151:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443952640 00000100:00100000:3.0:1787831131.700156:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443952640 00000100:00100000:3.0:1787831131.700190:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1787831131.700197:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220377d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be45932f-3bcb-4e49-b61c-a2395180b0ee+22:17102:x1874676443952640:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787831131.700299:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220377d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be45932f-3bcb-4e49-b61c-a2395180b0ee+22:17102:x1874676443952640:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 102us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831131.700306:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787831131.700376:0:17102:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22045570c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be45932f-3bcb-4e49-b61c-a2395180b0ee:17102:1874676443952640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787831131.700402:0:17102:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22045570c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be45932f-3bcb-4e49-b61c-a2395180b0ee:17102:1874676443952768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787831131.700441:0:17102:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831131.700461:0:17102:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d23100e0cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787831131.700512:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443952768 00000100:00100000:3.0:1787831131.700524:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443952768 00000100:00100000:3.0:1787831131.700561:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1787831131.700567:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220377e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be45932f-3bcb-4e49-b61c-a2395180b0ee+22:17102:x1874676443952768:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787831131.700662:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220377e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be45932f-3bcb-4e49-b61c-a2395180b0ee+22:17102:x1874676443952768:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 95us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831131.700668:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1787831131.700730:0:17102:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22045570c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be45932f-3bcb-4e49-b61c-a2395180b0ee:17102:1874676443952768:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787831131.706057:0:20209:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1787831131.706739:0:17102:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1787831131.706769:0:17102:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787831131.706781:0:17102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d23344b6200/0x95459fb9d1d29f6f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d29f76 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831131.706793:0:17102:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8d23344b6200/0x95459fb9d1d29f6f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d29f76 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787831131.706806:0:17102:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787831131.706808:0:17102:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d233f43f000 from 13 10000000:01000000:1.0:1787831131.706811:0:17102:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787831131.706849:0:17102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d23344b7800/0x95459fb9d1d29f7d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831131.706858:0:17102:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8d23344b7800/0x95459fb9d1d29f7d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831131.706870:0:17102:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8d23344b7800/0x95459fb9d1d29f7d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831131.706907:0:17102:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204555680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be45932f-3bcb-4e49-b61c-a2395180b0ee:17102:1874676443952896:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787831131.706987:0:17102:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831131.707029:0:17102:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d23100e0840 going to sleep for 11 seconds 00000100:00100000:2.0:1787831131.707615:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443952896 00000100:00100000:2.0:1787831131.707682:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443952896 00000100:00100000:2.0:1787831131.707784:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1787831131.707793:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220377f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be45932f-3bcb-4e49-b61c-a2395180b0ee+22:17102:x1874676443952896:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787831131.707807:0:17098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787831131.707821:0:17098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d22039c0800/0x95459fb9d1d29f84 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d29f7d expref: -99 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831131.707844:0:17098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22039c0800/0x95459fb9d1d29f84 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d29f7d expref: 23 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831131.707854:0:17098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d22039c0800/0x95459fb9d1d29f84 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d29f7d expref: 23 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831131.707863:0:17098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22039c0800, rc 0) 00000100:00100000:2.0:1787831131.707920:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220377f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be45932f-3bcb-4e49-b61c-a2395180b0ee+23:17102:x1874676443952896:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (933us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831131.707944:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1787831131.708027:0:17102:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204555680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be45932f-3bcb-4e49-b61c-a2395180b0ee:17102:1874676443952896:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787831131.708044:0:17102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8d23344b7800/0x95459fb9d1d29f7d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d29f84 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831131.708054:0:17102:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8d23344b7800/0x95459fb9d1d29f7d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d29f84 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831131.708114:0:17102:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204555680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be45932f-3bcb-4e49-b61c-a2395180b0ee:17102:1874676443953024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787831131.708149:0:17102:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831131.709107:0:17102:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d23100e0840 going to sleep for 11 seconds 00000100:00100000:0.0:1787831131.709140:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443953024 00000100:00100000:0.0:1787831131.709146:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443953024 00000100:00100000:0.0:1787831131.709181:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1787831131.709188:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233f45a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be45932f-3bcb-4e49-b61c-a2395180b0ee+23:17102:x1874676443953024:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787831131.709338:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233f45a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be45932f-3bcb-4e49-b61c-a2395180b0ee+23:17102:x1874676443953024:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 149us (1187us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831131.709353:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1787831131.712355:0:17102:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204555680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be45932f-3bcb-4e49-b61c-a2395180b0ee:17102:1874676443953024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787831131.712418:0:17102:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204555680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be45932f-3bcb-4e49-b61c-a2395180b0ee:17102:1874676443953152:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787831131.712489:0:17102:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831131.712588:0:17102:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d23100e0840 going to sleep for 11 seconds 00000100:00100000:3.0:1787831131.712700:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443953152 00000100:00100000:3.0:1787831131.712707:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443953152 00000100:00100000:3.0:1787831131.712746:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1787831131.712756:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233f459450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be45932f-3bcb-4e49-b61c-a2395180b0ee+23:17102:x1874676443953152:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787831131.712862:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233f459450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be45932f-3bcb-4e49-b61c-a2395180b0ee+23:17102:x1874676443953152:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 107us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831131.712869:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787831131.712968:0:17102:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204555680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be45932f-3bcb-4e49-b61c-a2395180b0ee:17102:1874676443953152:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787831131.713849:0:20213:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1787831131.714040:0:17102:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1787831131.714063:0:17102:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787831131.714072:0:17102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d23344b7800/0x95459fb9d1d29f7d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d29f84 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831131.714083:0:17102:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8d23344b7800/0x95459fb9d1d29f7d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d29f84 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787831131.714093:0:17102:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787831131.714096:0:17102:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d23115b5000 from 13 10000000:01000000:3.0:1787831131.714098:0:17102:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787831131.714126:0:17102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d2307c76000/0x95459fb9d1d29f8b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831131.714133:0:17102:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8d2307c76000/0x95459fb9d1d29f8b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831131.714154:0:17102:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8d2307c76000/0x95459fb9d1d29f8b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787831131.714171:0:17102:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203afda40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be45932f-3bcb-4e49-b61c-a2395180b0ee:17102:1874676443953280:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787831131.714217:0:17102:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831131.714247:0:17102:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d232f7e7180 going to sleep for 11 seconds 00000100:00100000:3.0:1787831131.714263:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443953280 00000100:00100000:3.0:1787831131.714267:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443953280 00000100:00100000:3.0:1787831131.714298:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1787831131.714306:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233f45ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be45932f-3bcb-4e49-b61c-a2395180b0ee+23:17102:x1874676443953280:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787831131.714316:0:17097:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787831131.714329:0:17097:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2307c76c00/0x95459fb9d1d29f92 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d29f8b expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831131.714352:0:17097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2307c76c00/0x95459fb9d1d29f92 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d29f8b expref: 24 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831131.714362:0:17097:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2307c76c00/0x95459fb9d1d29f92 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d29f8b expref: 24 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831131.714370:0:17097:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2307c76c00, rc 0) 00000100:00100000:3.0:1787831131.714407:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233f45ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be45932f-3bcb-4e49-b61c-a2395180b0ee+24:17102:x1874676443953280:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 102us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831131.714413:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1787831131.714456:0:17102:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203afda40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be45932f-3bcb-4e49-b61c-a2395180b0ee:17102:1874676443953280:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787831131.714470:0:17102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8d2307c76000/0x95459fb9d1d29f8b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d29f92 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831131.714488:0:17102:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8d2307c76000/0x95459fb9d1d29f8b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d29f92 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787831131.714685:0:17102:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203afda40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be45932f-3bcb-4e49-b61c-a2395180b0ee:17102:1874676443953408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787831131.714709:0:17102:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831131.714723:0:17102:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2307cb9d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787831131.714776:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443953408 00000100:00100000:1.0:1787831131.714781:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443953408 00000100:00100000:1.0:1787831131.714810:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787831131.714817:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233f459050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be45932f-3bcb-4e49-b61c-a2395180b0ee+24:17102:x1874676443953408:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787831131.714923:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233f459050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be45932f-3bcb-4e49-b61c-a2395180b0ee+24:17102:x1874676443953408:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 106us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831131.715025:0:17102:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203afda40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be45932f-3bcb-4e49-b61c-a2395180b0ee:17102:1874676443953408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787831131.715050:0:17102:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203afda40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be45932f-3bcb-4e49-b61c-a2395180b0ee:17102:1874676443953536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787831131.715085:0:17102:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831131.715098:0:17102:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2307cb9d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787831131.715108:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443953536 00000100:00100000:3.0:1787831131.715111:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443953536 00000100:00100000:3.0:1787831131.715131:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787831131.715137:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233f458050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be45932f-3bcb-4e49-b61c-a2395180b0ee+25:17102:x1874676443953536:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787831131.715206:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233f458050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be45932f-3bcb-4e49-b61c-a2395180b0ee+25:17102:x1874676443953536:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 68us (119us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831131.715212:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787831131.715266:0:17102:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203afda40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be45932f-3bcb-4e49-b61c-a2395180b0ee:17102:1874676443953536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787831131.715586:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000040:00080000:3.0:1787831131.719085:0:20214:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1787831131.719476:0:17102:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1787831131.719565:0:17102:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787831131.719578:0:17102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d2307c76000/0x95459fb9d1d29f8b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d29f92 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831131.719590:0:17102:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8d2307c76000/0x95459fb9d1d29f8b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d29f92 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831132.070858:0:18633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787831132.496368:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831132.496606:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433410048 00000100:00100000:0.0:1787831132.496615:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433410048 00000100:00100000:0.0:1787831132.496758:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 154 00000100:00100000:0.0:1787831132.496769:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233f45b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f931f0c-5730-4db2-abdb-70a9ab2deeff+11:14876:x1874676433410048:12345-192.168.203.31@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787831132.496789:0:17096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787831132.496808:0:17096:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d233bf10400/0x95459fb9d1d29f99 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe558a92a99424206 expref: -99 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831132.496837:0:17096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d233bf10400/0x95459fb9d1d29f99 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424206 expref: 12 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831132.496849:0:17096:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d233bf10400/0x95459fb9d1d29f99 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424206 expref: 12 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831132.496857:0:17096:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233bf10400, rc 0) 00000100:00100000:0.0:1787831132.496920:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233f45b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f931f0c-5730-4db2-abdb-70a9ab2deeff+12:14876:x1874676433410048:12345-192.168.203.31@tcp:101:ll_cfg_requeue.0 Request processed in 153us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831132.496937:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 154 00000100:00100000:2.0:1787831132.500460:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831132.500543:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433410176 00000100:00100000:1.0:1787831132.500563:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433410176 00000100:00100000:1.0:1787831132.500700:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 155 00000100:00100000:1.0:1787831132.500711:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233f45b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f931f0c-5730-4db2-abdb-70a9ab2deeff+12:14876:x1874676433410176:12345-192.168.203.31@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787831132.501014:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233f45b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f931f0c-5730-4db2-abdb-70a9ab2deeff+12:14876:x1874676433410176:12345-192.168.203.31@tcp:501:ll_cfg_requeue.0 Request processed in 304us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831132.501023:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 155 00000100:00100000:2.0:1787831132.504169:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831132.504339:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433410304 00000100:00100000:0.0:1787831132.504348:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433410304 00000100:00100000:0.0:1787831132.504553:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 156 00000100:00100000:0.0:1787831132.504564:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233f459c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f931f0c-5730-4db2-abdb-70a9ab2deeff+12:14876:x1874676433410304:12345-192.168.203.31@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787831132.504776:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233f459c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f931f0c-5730-4db2-abdb-70a9ab2deeff+12:14876:x1874676433410304:12345-192.168.203.31@tcp:503:ll_cfg_requeue.0 Request processed in 213us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831132.504785:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 156 00000100:00100000:2.0:1787831132.510472:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831132.510574:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433410432 00000100:00100000:1.0:1787831132.510585:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433410432 00000100:00100000:3.0:1787831132.510970:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 157 00000100:00100000:3.0:1787831132.510984:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233f458c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f931f0c-5730-4db2-abdb-70a9ab2deeff+12:14876:x1874676433410432:12345-192.168.203.31@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787831132.511001:0:17097:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787831132.511031:0:17097:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2307c76a00/0x95459fb9d1d29fa0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xe558a92a9942420d expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831132.511059:0:17097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2307c76a00/0x95459fb9d1d29fa0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a9942420d expref: 13 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831132.511072:0:17097:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2307c76a00/0x95459fb9d1d29fa0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a9942420d expref: 13 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831132.511082:0:17097:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2307c76a00, rc 0) 00000100:00100000:3.0:1787831132.511140:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233f458c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f931f0c-5730-4db2-abdb-70a9ab2deeff+13:14876:x1874676433410432:12345-192.168.203.31@tcp:101:ll_cfg_requeue.0 Request processed in 161us (677us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831132.511148:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 157 00000100:00100000:2.0:1787831132.513923:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831132.514512:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433410560 00000100:00100000:0.0:1787831132.514522:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433410560 00000100:00100000:0.0:1787831132.514620:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 158 00000100:00100000:0.0:1787831132.514663:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233f458850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f931f0c-5730-4db2-abdb-70a9ab2deeff+13:14876:x1874676433410560:12345-192.168.203.31@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787831132.514811:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233f458850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f931f0c-5730-4db2-abdb-70a9ab2deeff+13:14876:x1874676433410560:12345-192.168.203.31@tcp:501:ll_cfg_requeue.0 Request processed in 161us (1190us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831132.514820:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 158 00000100:00100000:2.0:1787831132.519533:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831132.519721:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433410688 00000100:00100000:1.0:1787831132.519730:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433410688 00000100:00100000:1.0:1787831132.519779:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 159 00000100:00100000:1.0:1787831132.519788:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233f45b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f931f0c-5730-4db2-abdb-70a9ab2deeff+13:14876:x1874676433410688:12345-192.168.203.31@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787831132.519945:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233f45b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f931f0c-5730-4db2-abdb-70a9ab2deeff+13:14876:x1874676433410688:12345-192.168.203.31@tcp:503:ll_cfg_requeue.0 Request processed in 157us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831132.519953:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 159 00000100:00100000:2.0:1787831132.773154:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831132.774040:0:18518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433410816 00000100:00100000:0.0:1787831132.774052:0:18518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433410816 00000100:00100000:0.0:1787831132.774140:0:18518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 23 00000100:00100000:0.0:1787831132.774151:0:18518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22045b4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+6:15544:x1874676433410816:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787831132.774171:0:18518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787831132.774193:0:18518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10200/0x95459fb9d1d29fa7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99424214 expref: -99 pid: 18518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831132.774258:0:18518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11200/0x95459fb9d1d29fae lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831132.774272:0:18518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11200/0x95459fb9d1d29fae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831132.774301:0:18518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11200/0x95459fb9d1d29fae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831132.774318:0:18518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11a00/0x95459fb9d1d29fb5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831132.774325:0:18518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11a00/0x95459fb9d1d29fb5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831132.774332:0:18518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11a00/0x95459fb9d1d29fb5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831132.774421:0:18518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10800/0x95459fb9d1d29fbc lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831132.774430:0:18518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10800/0x95459fb9d1d29fbc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831132.774437:0:18518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10800/0x95459fb9d1d29fbc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787831132.774470:0:18518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787831132.774474:0:18518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787831132.774511:0:18518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10800/0x95459fb9d1d29fbc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831132.774589:0:18518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11200/0x95459fb9d1d29fae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831132.774597:0:18518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11200/0x95459fb9d1d29fae lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787831132.774599:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787831132.774618:0:18518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11200/0x95459fb9d1d29fae lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831132.774662:0:18518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233bf11200 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:0.0:1787831132.774667:0:18518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11200/0x95459fb9d1d29fae lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831132.774676:0:18518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11200/0x95459fb9d1d29fae lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831132.774688:0:18518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d233a6f9800) 00010000:00010000:0.0:1787831132.774691:0:18518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787831132.774696:0:18518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11200/0x95459fb9d1d29fae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831132.774702:0:18518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11200/0x95459fb9d1d29fae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831132.774717:0:18518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11a00/0x95459fb9d1d29fb5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831132.774724:0:18518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11a00/0x95459fb9d1d29fb5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831132.774729:0:18518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11a00/0x95459fb9d1d29fb5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831132.774733:0:18518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233bf11a00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:0.0:1787831132.774737:0:18518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11a00/0x95459fb9d1d29fb5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831132.774754:0:18518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11a00/0x95459fb9d1d29fb5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831132.774765:0:18518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8d2320608500) 00010000:00010000:0.0:1787831132.774768:0:18518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787831132.774771:0:18518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11a00/0x95459fb9d1d29fb5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831132.774777:0:18518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11a00/0x95459fb9d1d29fb5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831132.774813:0:18518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10200/0x95459fb9d1d29fa7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424214 expref: 8 pid: 18518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831132.774833:0:18518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10800/0x95459fb9d1d29fbc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424214 expref: 7 pid: 18518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831132.774841:0:18518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8d2320608a00) 00010000:00010000:0.0:1787831132.774844:0:18518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787831132.774846:0:18518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233bf10800, rc 0) 00000100:00100000:0.0:1787831132.774918:0:18518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22045b4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+7:15544:x1874676433410816:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 769us (1771us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831132.774936:0:18518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 23 00000100:00100000:2.0:1787831132.780263:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831132.781029:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433410944 00000100:00100000:3.0:1787831132.781048:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433410944 00000100:00100000:3.0:1787831132.781103:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 5 00000100:00100000:3.0:1787831132.781113:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22045b6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+7:15544:x1874676433410944:12345-192.168.203.31@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1787831132.781201:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22045b6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+7:15544:x1874676433410944:12345-192.168.203.31@tcp:900:lhsmtool_posix.0 Request processed in 91us (947us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831132.781209:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 5 00000100:00100000:2.0:1787831132.786586:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831132.786734:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433411200 00000100:00100000:1.0:1787831132.786744:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433411200 00000100:00100000:1.0:1787831132.786803:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 24 00000100:00100000:1.0:1787831132.786813:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22045b4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+7:15544:x1874676433411200:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787831132.786833:0:17104:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787831132.786866:0:17104:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6a00/0x95459fb9d1d29fc3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a9942421b expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831132.786978:0:17104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7600/0x95459fb9d1d29fca lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831132.786993:0:17104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7600/0x95459fb9d1d29fca lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831132.787007:0:17104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7600/0x95459fb9d1d29fca lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831132.787044:0:17104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95800/0x95459fb9d1d29fd1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831132.787052:0:17104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95800/0x95459fb9d1d29fd1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831132.787058:0:17104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95800/0x95459fb9d1d29fd1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831132.787169:0:17104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95600/0x95459fb9d1d29fd8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831132.787177:0:17104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95600/0x95459fb9d1d29fd8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831132.787183:0:17104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95600/0x95459fb9d1d29fd8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787831132.787193:0:17104:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1787831132.787342:0:17104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7600/0x95459fb9d1d29fca lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831132.787358:0:17104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7600/0x95459fb9d1d29fca lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831132.787366:0:17104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7600/0x95459fb9d1d29fca lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831132.787371:0:17104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d23344b7600 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:1.0:1787831132.787375:0:17104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7600/0x95459fb9d1d29fca lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831132.787383:0:17104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7600/0x95459fb9d1d29fca lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831132.787396:0:17104:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8d2320608a00) 00010000:00010000:1.0:1787831132.787399:0:17104:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787831132.787403:0:17104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7600/0x95459fb9d1d29fca lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831132.787409:0:17104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7600/0x95459fb9d1d29fca lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831132.787421:0:17104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95800/0x95459fb9d1d29fd1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831132.787427:0:17104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95800/0x95459fb9d1d29fd1 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831132.787433:0:17104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95800/0x95459fb9d1d29fd1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831132.787438:0:17104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233be95800 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:1.0:1787831132.787447:0:17104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95800/0x95459fb9d1d29fd1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831132.787453:0:17104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95800/0x95459fb9d1d29fd1 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831132.787461:0:17104:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8d220274cc00) 00010000:00010000:1.0:1787831132.787463:0:17104:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787831132.787466:0:17104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95800/0x95459fb9d1d29fd1 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831132.787472:0:17104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95800/0x95459fb9d1d29fd1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831132.792840:0:17104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6a00/0x95459fb9d1d29fc3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a9942421b expref: 10 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831132.793134:0:17104:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95600/0x95459fb9d1d29fd8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a9942421b expref: 9 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831132.793146:0:17104:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d220274c300) 00010000:00010000:1.0:1787831132.793150:0:17104:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787831132.793154:0:17104:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233be95600, rc 0) 00000100:00100000:1.0:1787831132.793226:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22045b4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+9:15544:x1874676433411200:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 6414us (6647us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1787831132.793235:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 24 00000100:00100000:2.0:1787831132.803585:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831132.803829:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433411328 00000100:00100000:0.0:1787831132.803838:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433411328 00000100:00100000:0.0:1787831132.803948:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 25 00000100:00100000:0.0:1787831132.803959:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22045b43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+9:15544:x1874676433411328:12345-192.168.203.31@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1787831132.804084:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22045b43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+9:15544:x1874676433411328:12345-192.168.203.31@tcp:59:lhsmtool_posix.0 Request processed in 127us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831132.804092:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 25 00000100:00100000:2.0:1787831132.809834:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831132.809945:0:18518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433411456 00000100:00100000:0.0:1787831132.809954:0:18518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433411456 00000100:00100000:0.0:1787831132.810029:0:18518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 26 00000100:00100000:0.0:1787831132.810040:0:18518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22045b7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+5:15544:x1874676433411456:12345-192.168.203.31@tcp:59:lhsmtool_posix.0 00000100:00080000:2.0:1787831132.810129:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:1.0:1787831132.810792:0:18518:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 709us 00000100:00100000:0.0:1787831132.818375:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831132.818411:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433411584 00000100:00100000:0.0:1787831132.819357:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433411584 00000100:00100000:0.0:1787831132.819421:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 27 00000100:00100000:0.0:1787831132.819431:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2309d0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+9:15550:x1874676433411584:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:0.0:1787831132.819451:0:17104:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787831132.819472:0:17104:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10200/0x95459fb9d1d29fe6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99424222 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831132.819533:0:17104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11a00/0x95459fb9d1d29fed lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831132.819547:0:17104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11a00/0x95459fb9d1d29fed lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831132.819558:0:17104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11a00/0x95459fb9d1d29fed lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831132.823508:0:17104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11200/0x95459fb9d1d29ff4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831132.823600:0:17104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11200/0x95459fb9d1d29ff4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831132.823612:0:17104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11200/0x95459fb9d1d29ff4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831132.823674:0:17104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11a00/0x95459fb9d1d29fed lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831132.823682:0:17104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11a00/0x95459fb9d1d29fed lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831132.823689:0:17104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11a00/0x95459fb9d1d29fed lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831132.823696:0:17104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233bf11a00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:0.0:1787831132.823701:0:17104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11a00/0x95459fb9d1d29fed lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831132.823708:0:17104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11a00/0x95459fb9d1d29fed lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831132.823723:0:17104:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d233a6f9800) 00010000:00010000:0.0:1787831132.823726:0:17104:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787831132.823731:0:17104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11a00/0x95459fb9d1d29fed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831132.823739:0:17104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11a00/0x95459fb9d1d29fed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831132.823750:0:17104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11200/0x95459fb9d1d29ff4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831132.823763:0:17104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11200/0x95459fb9d1d29ff4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831132.823768:0:17104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11200/0x95459fb9d1d29ff4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831132.823774:0:17104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233bf11200 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:0.0:1787831132.823777:0:17104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11200/0x95459fb9d1d29ff4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831132.823783:0:17104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11200/0x95459fb9d1d29ff4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831132.823792:0:17104:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8d2320608500) 00010000:00010000:0.0:1787831132.823795:0:17104:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787831132.823798:0:17104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11200/0x95459fb9d1d29ff4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831132.823803:0:17104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11200/0x95459fb9d1d29ff4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831132.823823:0:18518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22045b7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+5:15544:x1874676433411456:12345-192.168.203.31@tcp:59:lhsmtool_posix.0 Request processed in 13779us (13992us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831132.823843:0:18518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 26 00010000:00010000:0.0:1787831132.823917:0:17104:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10200/0x95459fb9d1d29fe6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424222 expref: 10 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831132.823941:0:17104:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d233a6f9800) 00010000:00010000:0.0:1787831132.823943:0:17104:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787831132.823947:0:17104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10200/0x95459fb9d1d29fe6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424222 expref: 10 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831132.823970:0:17104:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233bf10200, rc 0) 00000100:00100000:0.0:1787831132.823990:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2309d0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+9:15550:x1874676433411584:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 4563us (5626us total) trans 0 rc 301/301 00000100:00100000:0.0:1787831132.823995:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 27 00000100:00100000:2.0:1787831132.827477:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831132.827570:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433411712 00000100:00100000:3.0:1787831132.827586:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433411712 00000100:00100000:3.0:1787831132.827680:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 0 00000100:00100000:3.0:1787831132.827691:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22045b6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+9:15550:x1874676433411712:12345-192.168.203.31@tcp:700:lfs.0 00000100:00100000:3.0:1787831132.827772:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22045b6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+9:15550:x1874676433411712:12345-192.168.203.31@tcp:700:lfs.0 Request processed in 83us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831132.827780:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 0 00000100:00100000:2.0:1787831132.842103:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831132.842250:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433411968 00000100:00100000:0.0:1787831132.842261:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433411968 00000100:00100000:0.0:1787831132.842434:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 28 00000100:00100000:0.0:1787831132.842446:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22045b5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+9:15550:x1874676433411968:12345-192.168.203.31@tcp:36:lfs.0 00010000:00010000:0.0:1787831132.842513:0:17106:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787831132.842541:0:17106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77800/0x95459fb9d1d29f14 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a9942418f expref: 9 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831132.842559:0:17106:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d233a6f9800) 00010000:00010000:0.0:1787831132.842564:0:17106:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787831132.842621:0:17106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11200/0x95459fb9d1d29ffb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831132.842668:0:17106:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76200/0x95459fb9d1d29f53 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994241ff expref: 5 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831132.842678:0:17106:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11200/0x95459fb9d1d29ffb lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831132.842714:0:17106:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76200/0x95459fb9d1d29f53 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0xe558a92a994241ff expref: 5 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831132.842728:0:17106:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76200/0x95459fb9d1d29f53 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a994241ff expref: 5 pid: 17106 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831132.842756:0:17106:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2309d0ad00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17106:1874676443953664:192.168.203.31@tcp:104: 00000100:00100000:0.0:1787831132.842853:0:17106:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d232f73f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787831132.847075:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831132.847172:0:17106:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2309d0ad00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17106:1874676443953664:192.168.203.31@tcp:104: 00010000:00010000:1.0:1787831132.847201:0:17106:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11200/0x95459fb9d1d29ffb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831132.847275:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433412096 00000100:00100000:2.0:1787831132.847282:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433412096 00010000:00010000:2.0:1787831132.847363:0:17089:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76200/0x95459fb9d1d29f53 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a994241ff expref: 6 pid: 17106 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831132.847392:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 15 00000100:00100000:2.0:1787831132.847399:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2309d08f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8db48c6c-a61a-41ec-9c3b-96530aeb2537+6:2396:x1874676433412096:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787831132.847418:0:17089:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787831132.847428:0:17089:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76200/0x95459fb9d1d29f53 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a994241ff expref: 6 pid: 17106 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831132.847437:0:17089:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76200/0x95459fb9d1d29f53 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a994241ff expref: 6 pid: 17106 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831132.847467:0:17089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76200/0x95459fb9d1d29f53 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a994241ff expref: 6 pid: 17106 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831132.847479:0:17089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d233a6f9800) 00010000:00010000:2.0:1787831132.847483:0:17089:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11200/0x95459fb9d1d29ffb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831132.847489:0:17089:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11200/0x95459fb9d1d29ffb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831132.847496:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11200/0x95459fb9d1d29ffb lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831132.847525:0:17089:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787831132.847575:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2309d08f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8db48c6c-a61a-41ec-9c3b-96530aeb2537+5:2396:x1874676433412096:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 175us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831132.847583:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 15 00010000:00010000:3.0:1787831132.847848:0:17106:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11200/0x95459fb9d1d29ffb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831132.847856:0:17106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11200/0x95459fb9d1d29ffb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831132.847878:0:17106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d2a002 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831132.847886:0:17106:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d2a002 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831132.847894:0:17106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d2a002 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787831132.848514:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787831132.852191:0:17106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d2a009 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831132.852218:0:17106:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d2a009 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831132.852229:0:17106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d2a009 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787831132.852246:0:17106:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e2738e68 reply state 00000000196abd70 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d2a009 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831132.852257:0:17106:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d2a009 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831132.852264:0:17106:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d233a6f8800) 00010000:00010000:3.0:1787831132.852267:0:17106:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787831132.852271:0:17106:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787831132.852285:0:17106:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1787831132.852295:0:17106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11200/0x95459fb9d1d29ffb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831132.852303:0:17106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11200/0x95459fb9d1d29ffb lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831132.852310:0:17106:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11200/0x95459fb9d1d29ffb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831132.852316:0:17106:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233bf11200 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:3.0:1787831132.852320:0:17106:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11200/0x95459fb9d1d29ffb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831132.852327:0:17106:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11200/0x95459fb9d1d29ffb lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831132.852338:0:17106:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d233a6f9800) 00010000:00010000:3.0:1787831132.852340:0:17106:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787831132.852344:0:17106:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11200/0x95459fb9d1d29ffb lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831132.852350:0:17106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11200/0x95459fb9d1d29ffb lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787831132.852370:0:17106:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e2738e68 reply state 00000000196abd70 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d2a002 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831132.852379:0:17106:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d2a002 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831132.852385:0:17106:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8d233a6f8f00) 00010000:00010000:3.0:1787831132.852387:0:17106:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787831132.852396:0:17106:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1787831132.852509:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22045b5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+10:15550:x1874676433411968:12345-192.168.203.31@tcp:36:lfs.0 Request processed in 10061us (10409us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1787831132.852518:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 28 00000100:00100000:0.0:1787831132.932780:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831132.932881:0:19892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433412224 00000100:00100000:1.0:1787831132.932891:0:19892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433412224 00000100:00100000:1.0:1787831132.932990:0:19892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 29 00000100:00100000:1.0:1787831132.933000:0:19892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2309d0bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+10:15558:x1874676433412224:12345-192.168.203.31@tcp:101:lctl.0 00010000:00010000:1.0:1787831132.933026:0:19892:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787831132.933052:0:19892:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95800/0x95459fb9d1d2a010 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99424229 expref: -99 pid: 19892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831132.933116:0:19892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95200/0x95459fb9d1d2a017 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831132.933130:0:19892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95200/0x95459fb9d1d2a017 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831132.933141:0:19892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95200/0x95459fb9d1d2a017 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787831132.933188:0:19892:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787831132.933192:0:19892:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787831132.933229:0:19892:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95200/0x95459fb9d1d2a017 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831132.933252:0:19892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95800/0x95459fb9d1d2a010 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424229 expref: 12 pid: 19892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831132.933289:0:19892:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95200/0x95459fb9d1d2a017 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424229 expref: 11 pid: 19892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831132.933297:0:19892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d220274cc00) 00010000:00010000:1.0:1787831132.933300:0:19892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787831132.933303:0:19892:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233be95200, rc 0) 00000100:00100000:1.0:1787831132.933419:0:19892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2309d0bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+11:15558:x1874676433412224:12345-192.168.203.31@tcp:101:lctl.0 Request processed in 420us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831132.933427:0:19892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 29 00000100:00100000:2.0:1787831132.957855:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831132.958139:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433412352 00000100:00100000:0.0:1787831132.958149:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433412352 00000100:00100000:0.0:1787831132.958225:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 30 00000100:00100000:0.0:1787831132.958235:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22045b6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8db48c6c-a61a-41ec-9c3b-96530aeb2537+5:15559:x1874676433412352:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:0.0:1787831132.958256:0:17104:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787831132.958277:0:17104:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11a00/0x95459fb9d1d2a01e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99424230 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831132.958341:0:17104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10c00/0x95459fb9d1d2a025 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831132.958355:0:17104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10c00/0x95459fb9d1d2a025 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831132.958366:0:17104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10c00/0x95459fb9d1d2a025 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787831132.959969:0:17104:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787831132.959977:0:17104:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787831132.960013:0:17104:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10c00/0x95459fb9d1d2a025 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831132.960052:0:17104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11a00/0x95459fb9d1d2a01e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424230 expref: 7 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831132.960092:0:17104:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10c00/0x95459fb9d1d2a025 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424230 expref: 6 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831132.960102:0:17104:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d220274cc00) 00010000:00010000:0.0:1787831132.960105:0:17104:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787831132.960108:0:17104:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233bf10c00, rc 0) 00000100:00100000:0.0:1787831132.960242:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22045b6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8db48c6c-a61a-41ec-9c3b-96530aeb2537+6:15559:x1874676433412352:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 2007us (2395us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831132.960251:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 30 00000100:00100000:2.0:1787831132.963759:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831132.964214:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433412480 00000100:00100000:3.0:1787831132.964228:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433412480 00000100:00100000:3.0:1787831132.964355:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 31 00000100:00100000:3.0:1787831132.964368:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233448bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8db48c6c-a61a-41ec-9c3b-96530aeb2537+6:15559:x1874676433412480:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:3.0:1787831132.964406:0:17106:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787831132.964433:0:17106:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d2a02c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99424237 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831132.964518:0:17106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76200/0x95459fb9d1d2a033 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831132.964538:0:17106:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76200/0x95459fb9d1d2a033 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831132.964552:0:17106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76200/0x95459fb9d1d2a033 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831132.964566:0:17106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77800/0x95459fb9d1d2a03a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831132.964573:0:17106:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77800/0x95459fb9d1d2a03a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831132.964581:0:17106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77800/0x95459fb9d1d2a03a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831132.964706:0:17106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669e00/0x95459fb9d1d2a041 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831132.964733:0:17106:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669e00/0x95459fb9d1d2a041 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831132.964741:0:17106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669e00/0x95459fb9d1d2a041 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787831132.964788:0:17106:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787831132.964793:0:17106:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787831132.964815:0:17106:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669e00/0x95459fb9d1d2a041 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831132.964829:0:17106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76200/0x95459fb9d1d2a033 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831132.964836:0:17106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76200/0x95459fb9d1d2a033 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831132.964843:0:17106:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76200/0x95459fb9d1d2a033 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831132.964849:0:17106:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2307c76200 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:3.0:1787831132.964854:0:17106:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76200/0x95459fb9d1d2a033 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831132.964863:0:17106:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76200/0x95459fb9d1d2a033 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831132.964877:0:17106:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d220274cc00) 00010000:00010000:3.0:1787831132.964881:0:17106:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787831132.964886:0:17106:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76200/0x95459fb9d1d2a033 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831132.964903:0:17106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76200/0x95459fb9d1d2a033 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831132.964937:0:17106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77800/0x95459fb9d1d2a03a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831132.964945:0:17106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77800/0x95459fb9d1d2a03a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831132.964950:0:17106:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77800/0x95459fb9d1d2a03a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831132.964955:0:17106:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2307c77800 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:3.0:1787831132.964958:0:17106:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77800/0x95459fb9d1d2a03a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831132.964964:0:17106:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77800/0x95459fb9d1d2a03a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831132.964972:0:17106:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8d233a6f8f00) 00010000:00010000:3.0:1787831132.964974:0:17106:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787831132.964977:0:17106:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77800/0x95459fb9d1d2a03a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831132.964983:0:17106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77800/0x95459fb9d1d2a03a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831132.965023:0:17106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77400/0x95459fb9d1d2a02c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424237 expref: 8 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831132.965050:0:17106:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669e00/0x95459fb9d1d2a041 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424237 expref: 7 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831132.965058:0:17106:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d233a6f8800) 00010000:00010000:3.0:1787831132.965064:0:17106:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787831132.965067:0:17106:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2301669e00, rc 0) 00000100:00100000:3.0:1787831132.965159:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233448bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8db48c6c-a61a-41ec-9c3b-96530aeb2537+7:15559:x1874676433412480:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 792us (1415us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831132.965170:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 31 00000100:00100000:2.0:1787831132.968000:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831132.968205:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433412608 00000100:00100000:0.0:1787831132.968218:0:17116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433412608 00000100:00100000:0.0:1787831132.968311:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 6 00000100:00100000:0.0:1787831132.968322:0:17116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d23344883c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:8db48c6c-a61a-41ec-9c3b-96530aeb2537+5:15559:x1874676433412608:12345-192.168.203.31@tcp:900:lfs.0 00000100:00100000:0.0:1787831132.968541:0:17116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d23344883c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:8db48c6c-a61a-41ec-9c3b-96530aeb2537+5:15559:x1874676433412608:12345-192.168.203.31@tcp:900:lfs.0 Request processed in 220us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831132.968550:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 6 00000100:00080000:2.0:1787831132.968611:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787831132.974309:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831132.974440:0:19892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433412864 00000100:00100000:1.0:1787831132.974454:0:19892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433412864 00000100:00100000:1.0:1787831132.974542:0:19892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 32 00000100:00100000:1.0:1787831132.974558:0:19892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2334488780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8db48c6c-a61a-41ec-9c3b-96530aeb2537+7:15559:x1874676433412864:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:1.0:1787831132.974600:0:19892:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787831132.974661:0:19892:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95a00/0x95459fb9d1d2a048 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a9942423e expref: -99 pid: 19892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787831132.974824:0:19892:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1787831132.974973:0:19892:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95a00/0x95459fb9d1d2a048 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a9942423e expref: 9 pid: 19892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831132.974993:0:19892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d220274cc00) 00010000:00010000:1.0:1787831132.974997:0:19892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787831132.975003:0:19892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95a00/0x95459fb9d1d2a048 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a9942423e expref: 9 pid: 19892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831132.975044:0:19892:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233be95a00, rc 0) 00000100:00100000:1.0:1787831132.975343:0:19892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2334488780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8db48c6c-a61a-41ec-9c3b-96530aeb2537+8:15559:x1874676433412864:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 788us (1049us total) trans 8589934595 rc 301/301 00000100:00100000:1.0:1787831132.975354:0:19892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 32 00000100:00100000:1.0:1787831132.978378:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831132.978495:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433413120 00000100:00100000:0.0:1787831132.978509:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433413120 00000100:00100000:0.0:1787831132.978583:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 33 00000100:00100000:0.0:1787831132.978596:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204555680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8db48c6c-a61a-41ec-9c3b-96530aeb2537+8:15559:x1874676433413120:12345-192.168.203.31@tcp:36:lfs.0 00010000:00010000:0.0:1787831132.978692:0:17104:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787831132.978729:0:17104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669e00/0x95459fb9d1d2a041 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424237 expref: 8 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831132.978754:0:17104:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d233a6f8800) 00010000:00010000:0.0:1787831132.978780:0:17104:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787831132.978813:0:17104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11a00/0x95459fb9d1d2a056 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831132.978831:0:17104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11a00/0x95459fb9d1d2a056 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831132.978843:0:17104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11a00/0x95459fb9d1d2a056 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787831132.979189:0:17104:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f2071ba5 reply state 000000006d5ab316 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11a00/0x95459fb9d1d2a056 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831132.979205:0:17104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11a00/0x95459fb9d1d2a056 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831132.979211:0:17104:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d233a6f8800) 00010000:00010000:0.0:1787831132.979214:0:17104:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:0.0:1787831132.979217:0:17104:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1787831132.979225:0:17104:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1787831132.979389:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204555680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8db48c6c-a61a-41ec-9c3b-96530aeb2537+9:15559:x1874676433413120:12345-192.168.203.31@tcp:36:lfs.0 Request processed in 795us (1023us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1787831132.979398:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 33 00000100:00100000:2.0:1787831132.983038:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831132.983150:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433413376 00000100:00100000:1.0:1787831132.983164:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433413376 00000100:00100000:1.0:1787831132.983271:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 2 00000100:00100000:1.0:1787831132.983283:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2334489680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8db48c6c-a61a-41ec-9c3b-96530aeb2537+9:15559:x1874676433413376:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:1.0:1787831132.984095:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2334489680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8db48c6c-a61a-41ec-9c3b-96530aeb2537+10:15559:x1874676433413376:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 810us (1069us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1787831132.984107:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 2 00000100:00100000:2.0:1787831132.987120:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831132.987499:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433413632 00000100:00100000:3.0:1787831132.987513:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433413632 00000100:00100000:3.0:1787831132.987647:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 34 00000100:00100000:3.0:1787831132.987660:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2334488000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8db48c6c-a61a-41ec-9c3b-96530aeb2537+10:15559:x1874676433413632:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:3.0:1787831132.987692:0:17106:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787831132.987719:0:17106:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669800/0x95459fb9d1d2a05d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99424245 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831132.987814:0:17106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669c00/0x95459fb9d1d2a064 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831132.987831:0:17106:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669c00/0x95459fb9d1d2a064 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831132.987845:0:17106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669c00/0x95459fb9d1d2a064 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831132.987857:0:17106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669200/0x95459fb9d1d2a06b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831132.987885:0:17106:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669200/0x95459fb9d1d2a06b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831132.987892:0:17106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669200/0x95459fb9d1d2a06b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787831132.988038:0:17106:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1787831132.988133:0:17106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669c00/0x95459fb9d1d2a064 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831132.988141:0:17106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669c00/0x95459fb9d1d2a064 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831132.988148:0:17106:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669c00/0x95459fb9d1d2a064 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831132.988155:0:17106:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2301669c00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:3.0:1787831132.988160:0:17106:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669c00/0x95459fb9d1d2a064 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831132.988169:0:17106:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669c00/0x95459fb9d1d2a064 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831132.988183:0:17106:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d220274cc00) 00010000:00010000:3.0:1787831132.988186:0:17106:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787831132.988192:0:17106:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669c00/0x95459fb9d1d2a064 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831132.988198:0:17106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669c00/0x95459fb9d1d2a064 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831132.988227:0:17106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669200/0x95459fb9d1d2a06b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831132.988233:0:17106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669200/0x95459fb9d1d2a06b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831132.988239:0:17106:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669200/0x95459fb9d1d2a06b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831132.988244:0:17106:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2301669200 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:3.0:1787831132.988247:0:17106:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669200/0x95459fb9d1d2a06b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831132.988254:0:17106:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669200/0x95459fb9d1d2a06b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831132.988261:0:17106:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8d233a6f8f00) 00010000:00010000:3.0:1787831132.988263:0:17106:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787831132.988265:0:17106:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669200/0x95459fb9d1d2a06b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831132.988271:0:17106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669200/0x95459fb9d1d2a06b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831132.988307:0:17106:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669800/0x95459fb9d1d2a05d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424245 expref: 12 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831132.988318:0:17106:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d220274cc00) 00010000:00010000:3.0:1787831132.988320:0:17106:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787831132.988330:0:17106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669800/0x95459fb9d1d2a05d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424245 expref: 12 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831132.988341:0:17106:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2301669800, rc 0) 00000100:00100000:3.0:1787831132.988455:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2334488000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8db48c6c-a61a-41ec-9c3b-96530aeb2537+11:15559:x1874676433413632:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 797us (1348us total) trans 8589934598 rc 301/301 00000100:00100000:3.0:1787831132.988464:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 34 00000100:00100000:2.0:1787831132.991117:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831132.991235:0:19892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433413760 00000100:00100000:1.0:1787831132.991248:0:19892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433413760 00000100:00100000:1.0:1787831132.991328:0:19892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 35 00000100:00100000:1.0:1787831132.991341:0:19892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233448ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8db48c6c-a61a-41ec-9c3b-96530aeb2537+11:15559:x1874676433413760:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:1.0:1787831132.991528:0:19892:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787831132.991560:0:19892:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95a00/0x95459fb9d1d2a079 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a9942424c expref: -99 pid: 19892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831132.991858:0:19892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94000/0x95459fb9d1d2a080 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831132.991876:0:19892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94000/0x95459fb9d1d2a080 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831132.991912:0:19892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94000/0x95459fb9d1d2a080 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787831132.992019:0:19892:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787831132.992023:0:19892:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787831132.992046:0:19892:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94000/0x95459fb9d1d2a080 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831132.992078:0:19892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95a00/0x95459fb9d1d2a079 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a9942424c expref: 13 pid: 19892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831132.992097:0:19892:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94000/0x95459fb9d1d2a080 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a9942424c expref: 12 pid: 19892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831132.992107:0:19892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d233a6f8800) 00010000:00010000:1.0:1787831132.992110:0:19892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787831132.992114:0:19892:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233be94000, rc 0) 00000100:00100000:1.0:1787831132.992239:0:19892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233448ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8db48c6c-a61a-41ec-9c3b-96530aeb2537+12:15559:x1874676433413760:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 901us (1138us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831132.992247:0:19892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 35 00000100:00100000:0.0:1787831132.995799:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831132.996567:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433413888 00000100:00100000:2.0:1787831132.996583:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433413888 00000100:00100000:2.0:1787831132.996686:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 3 00000100:00100000:2.0:1787831132.996718:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2309d092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8db48c6c-a61a-41ec-9c3b-96530aeb2537+12:15559:x1874676433413888:12345-192.168.203.31@tcp:37:lfs.0 00000100:00100000:0.0:1787831133.005644:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2309d092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8db48c6c-a61a-41ec-9c3b-96530aeb2537+12:15559:x1874676433413888:12345-192.168.203.31@tcp:37:lfs.0 Request processed in 8893us (9820us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831133.005663:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 3 00000100:00100000:1.0:1787831133.009051:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831133.009153:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433414144 00000100:00100000:0.0:1787831133.009165:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433414144 00000100:00100000:0.0:1787831133.009266:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 4 00000100:00100000:0.0:1787831133.009277:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220385c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8db48c6c-a61a-41ec-9c3b-96530aeb2537+12:15559:x1874676433414144:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:0.0:1787831133.009595:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220385c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8db48c6c-a61a-41ec-9c3b-96530aeb2537+13:15559:x1874676433414144:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 317us (558us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1787831133.009604:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 4 00000100:00100000:2.0:1787831133.056674:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831133.056788:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433414272 00000100:00100000:0.0:1787831133.056803:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433414272 00000100:00100000:0.0:1787831133.056931:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 36 00000100:00100000:0.0:1787831133.056945:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233448a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+11:15565:x1874676433414272:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:0.0:1787831133.056972:0:17104:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787831133.057014:0:17104:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11600/0x95459fb9d1d2a087 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99424253 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831133.057104:0:17104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10600/0x95459fb9d1d2a08e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831133.057122:0:17104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10600/0x95459fb9d1d2a08e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831133.057138:0:17104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10600/0x95459fb9d1d2a08e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831133.057157:0:17104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11c00/0x95459fb9d1d2a095 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831133.057166:0:17104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11c00/0x95459fb9d1d2a095 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831133.057173:0:17104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11c00/0x95459fb9d1d2a095 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831133.057280:0:17104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10e00/0x95459fb9d1d2a09c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831133.057305:0:17104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10e00/0x95459fb9d1d2a09c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831133.057313:0:17104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10e00/0x95459fb9d1d2a09c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787831133.057359:0:17104:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787831133.057364:0:17104:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787831133.057414:0:17104:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10e00/0x95459fb9d1d2a09c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831133.057429:0:17104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10600/0x95459fb9d1d2a08e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831133.057437:0:17104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10600/0x95459fb9d1d2a08e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831133.057444:0:17104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10600/0x95459fb9d1d2a08e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831133.057451:0:17104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233bf10600 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:0.0:1787831133.057456:0:17104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10600/0x95459fb9d1d2a08e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831133.057464:0:17104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10600/0x95459fb9d1d2a08e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831133.057477:0:17104:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d220274cc00) 00010000:00010000:0.0:1787831133.057481:0:17104:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787831133.057487:0:17104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10600/0x95459fb9d1d2a08e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831133.057504:0:17104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10600/0x95459fb9d1d2a08e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831133.057522:0:17104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11c00/0x95459fb9d1d2a095 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831133.057528:0:17104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11c00/0x95459fb9d1d2a095 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831133.057533:0:17104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11c00/0x95459fb9d1d2a095 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831133.057538:0:17104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233bf11c00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:0.0:1787831133.057541:0:17104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11c00/0x95459fb9d1d2a095 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831133.057547:0:17104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11c00/0x95459fb9d1d2a095 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831133.057554:0:17104:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8d233a6f8f00) 00010000:00010000:0.0:1787831133.057556:0:17104:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787831133.057559:0:17104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11c00/0x95459fb9d1d2a095 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831133.057564:0:17104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11c00/0x95459fb9d1d2a095 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831133.057597:0:17104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11600/0x95459fb9d1d2a087 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424253 expref: 13 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831133.057723:0:17104:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10e00/0x95459fb9d1d2a09c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424253 expref: 12 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831133.057732:0:17104:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d233a6f8800) 00010000:00010000:0.0:1787831133.057734:0:17104:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787831133.057737:0:17104:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233bf10e00, rc 0) 00000100:00100000:0.0:1787831133.057818:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233448a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+12:15565:x1874676433414272:12345-192.168.203.31@tcp:101:bash.0 Request processed in 875us (1212us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831133.057828:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 36 00000100:00100000:2.0:1787831133.060380:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831133.060468:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433414400 00000100:00100000:3.0:1787831133.060480:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433414400 00000100:00100000:3.0:1787831133.060548:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 7 00000100:00100000:3.0:1787831133.060560:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2334489e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+5:15565:x1874676433414400:12345-192.168.203.31@tcp:900:bash.0 00000100:00100000:3.0:1787831133.060964:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2334489e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+5:15565:x1874676433414400:12345-192.168.203.31@tcp:900:bash.0 Request processed in 405us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831133.060974:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 7 00000100:00100000:1.0:1787831133.066758:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831133.067726:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433414656 00000100:00100000:3.0:1787831133.067743:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433414656 00000100:00100000:3.0:1787831133.067819:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 37 00000100:00100000:3.0:1787831133.067831:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204554000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+12:15565:x1874676433414656:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:3.0:1787831133.067857:0:17106:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787831133.067887:0:17106:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669800/0x95459fb9d1d2a0a3 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a9942425a expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831133.068051:0:17106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669200/0x95459fb9d1d2a0aa lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831133.068071:0:17106:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94000/0x95459fb9d1d2a080 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a9942424c expref: 12 pid: 19892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831133.068104:0:17106:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669200/0x95459fb9d1d2a0aa lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831133.068147:0:17106:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94000/0x95459fb9d1d2a080 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0xe558a92a9942424c expref: 12 pid: 19892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831133.068163:0:17106:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94000/0x95459fb9d1d2a080 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a9942424c expref: 12 pid: 19892 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787831133.068180:0:17106:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203afda40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17106:1874676443953792:192.168.203.31@tcp:104: 00000100:00100000:3.0:1787831133.068291:0:17106:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2305811000 going to sleep for 11 seconds 00000100:00100000:2.0:1787831133.072531:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831133.072697:0:17106:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203afda40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17106:1874676443953792:192.168.203.31@tcp:104: 00010000:00010000:3.0:1787831133.072743:0:17106:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669200/0x95459fb9d1d2a0aa lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831133.072871:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433414784 00000100:00100000:0.0:1787831133.072881:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433414784 00010000:00010000:0.0:1787831133.072949:0:17090:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94000/0x95459fb9d1d2a080 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a9942424c expref: 13 pid: 19892 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831133.073037:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 16 00000100:00100000:0.0:1787831133.073049:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2334488f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8db48c6c-a61a-41ec-9c3b-96530aeb2537+13:2396:x1874676433414784:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787831133.073070:0:17090:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787831133.073079:0:17090:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94000/0x95459fb9d1d2a080 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a9942424c expref: 13 pid: 19892 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831133.073094:0:17090:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94000/0x95459fb9d1d2a080 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a9942424c expref: 13 pid: 19892 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831133.073125:0:17090:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94000/0x95459fb9d1d2a080 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a9942424c expref: 13 pid: 19892 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831133.073170:0:17090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d233a6f8800) 00010000:00010000:0.0:1787831133.073176:0:17090:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669200/0x95459fb9d1d2a0aa lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831133.073188:0:17090:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669200/0x95459fb9d1d2a0aa lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831133.073199:0:17090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669200/0x95459fb9d1d2a0aa lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831133.073239:0:17090:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787831133.073314:0:17106:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669200/0x95459fb9d1d2a0aa lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831133.073321:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2334488f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8db48c6c-a61a-41ec-9c3b-96530aeb2537+12:2396:x1874676433414784:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 274us (917us total) trans 0 rc 0/0 00010000:00010000:1.0:1787831133.073323:0:17106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669200/0x95459fb9d1d2a0aa lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831133.073329:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 16 00010000:00010000:1.0:1787831133.073358:0:17106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94600/0x95459fb9d1d2a0b1 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831133.073385:0:17106:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94600/0x95459fb9d1d2a0b1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831133.073394:0:17106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94600/0x95459fb9d1d2a0b1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831133.074018:0:17106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95c00/0x95459fb9d1d2a0b8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831133.074219:0:17106:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95c00/0x95459fb9d1d2a0b8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831133.074229:0:17106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95c00/0x95459fb9d1d2a0b8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787831133.074243:0:17106:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787831133.074279:0:17106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669200/0x95459fb9d1d2a0aa lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831133.074286:0:17106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669200/0x95459fb9d1d2a0aa lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831133.074294:0:17106:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669200/0x95459fb9d1d2a0aa lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831133.074300:0:17106:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2301669200 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:1.0:1787831133.074305:0:17106:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669200/0x95459fb9d1d2a0aa lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831133.074313:0:17106:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669200/0x95459fb9d1d2a0aa lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831133.074343:0:17106:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d233a6f8800) 00010000:00010000:1.0:1787831133.074347:0:17106:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787831133.074350:0:17106:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669200/0x95459fb9d1d2a0aa lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831133.074358:0:17106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669200/0x95459fb9d1d2a0aa lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787831133.074370:0:17106:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006539710c reply state 000000008d3191d1 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94600/0x95459fb9d1d2a0b1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831133.074381:0:17106:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94600/0x95459fb9d1d2a0b1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831133.074388:0:17106:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8d220274c100) 00010000:00010000:1.0:1787831133.074390:0:17106:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787831133.074393:0:17106:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787831133.074438:0:17106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669800/0x95459fb9d1d2a0a3 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a9942425a expref: 15 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831133.074454:0:17106:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95c00/0x95459fb9d1d2a0b8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a9942425a expref: 14 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831133.074462:0:17106:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d220274c900) 00010000:00010000:1.0:1787831133.074464:0:17106:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1787831133.074466:0:17106:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233be95c00, rc 0) 00000100:00100000:1.0:1787831133.074579:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204554000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+15:15565:x1874676433414656:12345-192.168.203.31@tcp:101:bash.0 Request processed in 6749us (7836us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1787831133.074587:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 37 00000100:00100000:2.0:1787831133.088514:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831133.088669:0:19892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433414912 00000100:00100000:1.0:1787831133.088682:0:19892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433414912 00000100:00100000:1.0:1787831133.088760:0:19892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 38 00000100:00100000:1.0:1787831133.088772:0:19892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233448b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+15:15565:x1874676433414912:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:1.0:1787831133.088804:0:19892:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787831133.088832:0:19892:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94e00/0x95459fb9d1d2a0c6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99424261 expref: -99 pid: 19892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831133.088920:0:19892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94400/0x95459fb9d1d2a0cd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831133.088948:0:19892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94400/0x95459fb9d1d2a0cd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831133.088963:0:19892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94400/0x95459fb9d1d2a0cd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787831133.089140:0:19892:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1787831133.089144:0:19892:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787831133.089165:0:19892:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94400/0x95459fb9d1d2a0cd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831133.089176:0:19892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94400/0x95459fb9d1d2a0cd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831133.089209:0:19892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94e00/0x95459fb9d1d2a0c6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424261 expref: 17 pid: 19892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831133.089232:0:19892:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94400/0x95459fb9d1d2a0cd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424261 expref: 16 pid: 19892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831133.089266:0:19892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d220274c900) 00010000:00010000:1.0:1787831133.089270:0:19892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787831133.089274:0:19892:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233be94400, rc 0) 00000100:00100000:1.0:1787831133.089378:0:19892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233448b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+16:15565:x1874676433414912:12345-192.168.203.31@tcp:101:bash.0 Request processed in 607us (879us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831133.089386:0:19892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 38 00000100:00100000:2.0:1787831133.092168:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831133.092379:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433415168 00000100:00100000:0.0:1787831133.092576:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433415168 00000100:00100000:0.0:1787831133.092701:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 5 00000100:00100000:0.0:1787831133.092714:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233448a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+16:15565:x1874676433415168:12345-192.168.203.31@tcp:35:bash.0 00000100:00100000:0.0:1787831133.093960:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233448a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+17:15565:x1874676433415168:12345-192.168.203.31@tcp:35:bash.0 Request processed in 1236us (1795us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1787831133.093974:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 5 00010000:00010000:0.0:1787831133.096216:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787831133.139585:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831133.139748:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433415424 00000100:00100000:0.0:1787831133.139762:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433415424 00000100:00100000:0.0:1787831133.139872:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 39 00000100:00100000:0.0:1787831133.139883:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233448b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+17:15575:x1874676433415424:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:0.0:1787831133.139953:0:17104:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787831133.139984:0:17104:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11600/0x95459fb9d1d2a0d4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99424268 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787831133.140119:0:17104:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1787831133.140250:0:17104:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11600/0x95459fb9d1d2a0d4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424268 expref: 19 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831133.140266:0:17104:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d220274cc00) 00010000:00010000:0.0:1787831133.140270:0:17104:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787831133.140276:0:17104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11600/0x95459fb9d1d2a0d4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424268 expref: 19 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831133.140300:0:17104:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233bf11600, rc 0) 00000100:00100000:0.0:1787831133.140381:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233448b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+18:15575:x1874676433415424:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 500us (812us total) trans 8589934602 rc 301/301 00000100:00100000:0.0:1787831133.140390:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 39 00000100:00100000:2.0:1787831133.143216:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831133.143365:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433415680 00000100:00100000:1.0:1787831133.143384:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433415680 00000100:00100000:1.0:1787831133.143697:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 6 00000100:00100000:1.0:1787831133.143710:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233448a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+18:15575:x1874676433415680:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:1.0:1787831133.144043:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233448a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+19:15575:x1874676433415680:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 335us (840us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1787831133.144052:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 6 00000100:00100000:2.0:1787831133.172502:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831133.173072:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433415936 00000100:00100000:1.0:1787831133.173085:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433415936 00000100:00100000:1.0:1787831133.173243:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 40 00000100:00100000:1.0:1787831133.173256:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d23344892c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+19:15578:x1874676433415936:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:1.0:1787831133.173291:0:17106:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787831133.173320:0:17106:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94e00/0x95459fb9d1d2a0e2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a9942426f expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831133.173477:0:17106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94800/0x95459fb9d1d2a0e9 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831133.173496:0:17106:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94800/0x95459fb9d1d2a0e9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831133.173530:0:17106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94800/0x95459fb9d1d2a0e9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787831133.173543:0:17106:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787831133.173717:0:17106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94e00/0x95459fb9d1d2a0e2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a9942426f expref: 22 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831133.173738:0:17106:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94800/0x95459fb9d1d2a0e9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a9942426f expref: 21 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831133.173749:0:17106:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d220274c900) 00010000:00010000:1.0:1787831133.173810:0:17106:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787831133.173815:0:17106:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233be94800, rc 0) 00000100:00100000:1.0:1787831133.173990:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d23344892c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+21:15578:x1874676433415936:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 735us (1502us total) trans 8589934604 rc 0/0 00000100:00100000:1.0:1787831133.173998:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 40 00000100:00100000:3.0:1787831133.176262:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831133.176388:0:19892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433416064 00000100:00100000:1.0:1787831133.176399:0:19892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433416064 00000100:00100000:1.0:1787831133.176515:0:19892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 41 00000100:00100000:1.0:1787831133.176527:0:19892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203afda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+21:15578:x1874676433416064:12345-192.168.203.31@tcp:54:lfs.0 00010000:00010000:1.0:1787831133.176614:0:19892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94c00/0x95459fb9d1d2a0f7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831133.176683:0:19892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94c00/0x95459fb9d1d2a0f7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831133.176698:0:19892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94c00/0x95459fb9d1d2a0f7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831133.176876:0:19892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94c00/0x95459fb9d1d2a0f7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831133.176886:0:19892:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94c00/0x95459fb9d1d2a0f7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831133.176893:0:19892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94c00/0x95459fb9d1d2a0f7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831133.176900:0:19892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233be94c00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:1.0:1787831133.176905:0:19892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94c00/0x95459fb9d1d2a0f7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831133.176929:0:19892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94c00/0x95459fb9d1d2a0f7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831133.176945:0:19892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d220274c900) 00010000:00010000:1.0:1787831133.176949:0:19892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787831133.176954:0:19892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94c00/0x95459fb9d1d2a0f7 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831133.176960:0:19892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94c00/0x95459fb9d1d2a0f7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831133.177051:0:19892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203afda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+21:15578:x1874676433416064:12345-192.168.203.31@tcp:54:lfs.0 Request processed in 525us (800us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831133.177060:0:19892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 41 00000040:00080000:3.0:1787831133.352659:0:17139:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1787831133.353716:0:17855:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787831133.419156:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831133.421430:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433416320 00000100:00100000:1.0:1787831133.421453:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433416320 00000100:00100000:1.0:1787831133.421553:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 42 00000100:00100000:1.0:1787831133.421584:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2309d092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+21:15615:x1874676433416320:12345-192.168.203.31@tcp:101:dd.0 00010000:00010000:1.0:1787831133.421614:0:17104:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787831133.421658:0:17104:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94c00/0x95459fb9d1d2a0fe lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99424276 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831133.421818:0:17104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94e00/0x95459fb9d1d2a105 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831133.421847:0:17104:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95c00/0x95459fb9d1d2a0b8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a9942425a expref: 22 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831133.421856:0:17104:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94400/0x95459fb9d1d2a0cd lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424261 expref: 22 pid: 19892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831133.421866:0:17104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94e00/0x95459fb9d1d2a105 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831133.421913:0:17104:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94400/0x95459fb9d1d2a0cd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424261 expref: 22 pid: 19892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831133.422159:0:17104:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94400/0x95459fb9d1d2a0cd lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424261 expref: 22 pid: 19892 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831133.422175:0:17104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22045570c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17104:1874676443953920:192.168.203.31@tcp:104: 00010000:00010000:1.0:1787831133.422360:0:17104:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95c00/0x95459fb9d1d2a0b8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0xe558a92a9942425a expref: 22 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831133.422370:0:17104:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95c00/0x95459fb9d1d2a0b8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a9942425a expref: 22 pid: 17106 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831133.422395:0:17104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204557480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17104:1874676443954048:192.168.203.31@tcp:104: 00000100:00100000:1.0:1787831133.422417:0:17104:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d23100e0240 going to sleep for 11 seconds 00000100:00100000:2.0:1787831133.425897:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831133.425947:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831133.426340:0:20128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433416448 00000100:00100000:0.0:1787831133.426358:0:20128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433416448 00010000:00010000:0.0:1787831133.426431:0:20128:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94400/0x95459fb9d1d2a0cd lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424261 expref: 23 pid: 19892 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831133.426487:0:20128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433416576 00000100:00100000:0.0:1787831133.426490:0:20128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433416576 00010000:00010000:0.0:1787831133.426504:0:20128:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95c00/0x95459fb9d1d2a0b8 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a9942425a expref: 24 pid: 17106 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831133.426706:0:20128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 17 00000100:00100000:0.0:1787831133.426718:0:20128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2334488b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+24:2397:x1874676433416448:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787831133.426738:0:20128:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787831133.426747:0:20128:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94400/0x95459fb9d1d2a0cd lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424261 expref: 24 pid: 19892 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831133.426764:0:20128:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94400/0x95459fb9d1d2a0cd lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424261 expref: 24 pid: 19892 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831133.426799:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d220274c900) 00000100:00100000:3.0:1787831133.426808:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 18 00010000:00010000:0.0:1787831133.426808:0:20128:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94e00/0x95459fb9d1d2a105 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831133.426835:0:20128:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94e00/0x95459fb9d1d2a105 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787831133.426840:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2334489a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+24:2396:x1874676433416576:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787831133.426855:0:20128:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787831133.426881:0:17089:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787831133.426894:0:17089:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95c00/0x95459fb9d1d2a0b8 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a9942425a expref: 24 pid: 17106 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831133.426911:0:17089:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95c00/0x95459fb9d1d2a0b8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a9942425a expref: 24 pid: 17106 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831133.426949:0:20128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2334488b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+24:2397:x1874676433416448:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 231us (1059us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831133.426960:0:20128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 17 00010000:00010000:3.0:1787831133.426965:0:17089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d220274c900) 00010000:00010000:3.0:1787831133.426973:0:17089:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94e00/0x95459fb9d1d2a105 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831133.426983:0:17089:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94e00/0x95459fb9d1d2a105 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831133.426992:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94e00/0x95459fb9d1d2a105 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831133.427014:0:17089:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787831133.427063:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2334489a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+23:2396:x1874676433416576:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 236us (1114us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831133.427072:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 18 00010000:00010000:1.0:1787831133.427444:0:17104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94400/0x95459fb9d1d2a0cd lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424261 expref: 22 pid: 19892 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831133.427461:0:17104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22045570c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17104:1874676443953920:192.168.203.31@tcp:104: 00010000:00010000:1.0:1787831133.427473:0:17104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95c00/0x95459fb9d1d2a0b8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a9942425a expref: 21 pid: 17106 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831133.427481:0:17104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204557480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17104:1874676443954048:192.168.203.31@tcp:104: 00010000:00010000:1.0:1787831133.427503:0:17104:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94e00/0x95459fb9d1d2a105 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831133.427511:0:17104:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94e00/0x95459fb9d1d2a105 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831133.427518:0:17104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94e00/0x95459fb9d1d2a105 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787831133.427549:0:17104:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787831133.427760:0:17104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94c00/0x95459fb9d1d2a0fe lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424276 expref: 22 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831133.427778:0:17104:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94e00/0x95459fb9d1d2a105 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424276 expref: 21 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831133.427799:0:17104:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d220274c900) 00010000:00010000:1.0:1787831133.427802:0:17104:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787831133.427805:0:17104:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233be94e00, rc 0) 00000100:00100000:1.0:1787831133.427846:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2309d092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+21:15615:x1874676433416320:12345-192.168.203.31@tcp:101:dd.0 Request processed in 6266us (8708us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1787831133.427985:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 42 00000100:00100000:2.0:1787831133.433264:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831133.433358:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433416704 00000100:00100000:1.0:1787831133.433368:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433416704 00000100:00100000:1.0:1787831133.433438:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 43 00000100:00100000:1.0:1787831133.433448:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2334489680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+21:15615:x1874676433416704:12345-192.168.203.31@tcp:101:dd.0 00010000:00010000:1.0:1787831133.433473:0:17106:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787831133.433497:0:17106:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94200/0x95459fb9d1d2a113 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a9942427d expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831133.433532:0:17106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95000/0x95459fb9d1d2a11a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831133.433564:0:17106:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95000/0x95459fb9d1d2a11a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831133.433575:0:17106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95000/0x95459fb9d1d2a11a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831133.433740:0:17106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94200/0x95459fb9d1d2a113 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a9942427d expref: 23 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831133.433759:0:17106:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95000/0x95459fb9d1d2a11a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a9942427d expref: 22 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831133.433775:0:17106:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d220274c900) 00010000:00010000:1.0:1787831133.433778:0:17106:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787831133.433782:0:17106:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233be95000, rc 0) 00000100:00100000:1.0:1787831133.433838:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2334489680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+22:15615:x1874676433416704:12345-192.168.203.31@tcp:101:dd.0 Request processed in 392us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831133.433846:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 43 00000100:00100000:3.0:1787831133.436398:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831133.436850:0:19892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433416960 00000100:00100000:1.0:1787831133.436944:0:19892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433416960 00000100:00100000:1.0:1787831133.437019:0:19892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 44 00000100:00100000:1.0:1787831133.437029:0:19892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203afe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+22:15615:x1874676433416960:12345-192.168.203.31@tcp:36:dd.0 00010000:00010000:1.0:1787831133.437261:0:19892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95c00/0x95459fb9d1d2a121 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831133.437278:0:19892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95c00/0x95459fb9d1d2a121 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831133.437290:0:19892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95c00/0x95459fb9d1d2a121 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787831133.437336:0:19892:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934606 00000004:00010000:1.0:1787831133.437359:0:19892:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000016856efc reply state 00000000b57f6a2e transno 8589934607 ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95c00/0x95459fb9d1d2a121 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831133.437371:0:19892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95c00/0x95459fb9d1d2a121 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831133.437378:0:19892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d220274c900) 00010000:00010000:1.0:1787831133.437381:0:19892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787831133.437398:0:19892:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787831133.439467:0:19892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203afe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+25:15615:x1874676433416960:12345-192.168.203.31@tcp:36:dd.0 Request processed in 2429us (3072us total) trans 8589934607 rc 0/0 00000100:00100000:1.0:1787831133.439479:0:19892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 44 00000020:00080000:1.0:1787831133.439487:0:19892:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787831133.648379:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831133.648476:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433417088 00000100:00100000:1.0:1787831133.648487:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433417088 00000100:00100000:1.0:1787831133.648551:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 45 00000100:00100000:1.0:1787831133.648561:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2314e71a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+25:15629:x1874676433417088:12345-192.168.203.31@tcp:101:stat.0 00010000:00010000:1.0:1787831133.648585:0:17104:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787831133.648606:0:17104:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94200/0x95459fb9d1d2a128 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99424284 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831133.648717:0:17104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94c00/0x95459fb9d1d2a12f lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831133.648732:0:17104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94c00/0x95459fb9d1d2a12f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831133.648742:0:17104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94c00/0x95459fb9d1d2a12f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831133.648754:0:17104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94400/0x95459fb9d1d2a136 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831133.648761:0:17104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94400/0x95459fb9d1d2a136 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831133.648768:0:17104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94400/0x95459fb9d1d2a136 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831133.648842:0:17104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94a00/0x95459fb9d1d2a13d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831133.648860:0:17104:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94e00/0x95459fb9d1d2a105 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424276 expref: 26 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831133.648869:0:17104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94a00/0x95459fb9d1d2a13d lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831133.648903:0:17104:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94e00/0x95459fb9d1d2a105 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424276 expref: 26 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831133.648917:0:17104:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94e00/0x95459fb9d1d2a105 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424276 expref: 26 pid: 17104 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831133.648940:0:17104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204557480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17104:1874676443954176:192.168.203.31@tcp:104: 00000100:00100000:1.0:1787831133.649112:0:17104:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d23100e0240 going to sleep for 11 seconds 00000100:00100000:1.0:1787831133.655870:0:17104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204557480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17104:1874676443954176:192.168.203.31@tcp:104: 00010000:00010000:1.0:1787831133.655903:0:17104:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94a00/0x95459fb9d1d2a13d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831133.660552:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831133.660697:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433417344 00000100:00100000:1.0:1787831133.660707:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433417344 00000100:00100000:1.0:1787831133.660770:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 7 00000100:00100000:1.0:1787831133.660781:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2314e70780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+27:14874:x1874676433417344:12345-192.168.203.31@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787831133.661023:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2314e70780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+28:14874:x1874676433417344:12345-192.168.203.31@tcp:35:ldlm_bl.0 Request processed in 243us (480us total) trans 8589934608 rc 0/0 00000100:00100000:1.0:1787831133.661031:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 7 00000100:00100000:3.0:1787831133.666843:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831133.668134:0:20128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433417472 00000100:00100000:0.0:1787831133.668148:0:20128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433417472 00010000:00010000:0.0:1787831133.668197:0:20128:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94e00/0x95459fb9d1d2a105 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424276 expref: 28 pid: 17104 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831133.668762:0:20128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 19 00000100:00100000:0.0:1787831133.668774:0:20128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203afc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+28:2394:x1874676433417472:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787831133.668804:0:20128:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787831133.668813:0:20128:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94e00/0x95459fb9d1d2a105 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424276 expref: 28 pid: 17104 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831133.668827:0:20128:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94e00/0x95459fb9d1d2a105 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424276 expref: 28 pid: 17104 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831133.668930:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94e00/0x95459fb9d1d2a105 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424276 expref: 28 pid: 17104 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831133.668950:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d220274c900) 00010000:00010000:0.0:1787831133.668954:0:20128:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94a00/0x95459fb9d1d2a13d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831133.668964:0:20128:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94a00/0x95459fb9d1d2a13d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831133.668971:0:20128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94a00/0x95459fb9d1d2a13d lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831133.669005:0:20128:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787831133.669133:0:20128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203afc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+27:2394:x1874676433417472:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 360us (2298us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831133.669141:0:20128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 19 00010000:00010000:1.0:1787831133.669662:0:17104:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94a00/0x95459fb9d1d2a13d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831133.669680:0:17104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94a00/0x95459fb9d1d2a13d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787831133.669735:0:17104:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1787831133.669740:0:17104:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787831133.669792:0:17104:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94a00/0x95459fb9d1d2a13d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831133.669804:0:17104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94a00/0x95459fb9d1d2a13d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831133.669812:0:17104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94c00/0x95459fb9d1d2a12f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831133.669819:0:17104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94c00/0x95459fb9d1d2a12f lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831133.669825:0:17104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94c00/0x95459fb9d1d2a12f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831133.669831:0:17104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233be94c00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:1.0:1787831133.669835:0:17104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94c00/0x95459fb9d1d2a12f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831133.669841:0:17104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94c00/0x95459fb9d1d2a12f lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831133.670145:0:17104:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d233a6f8800) 00010000:00010000:1.0:1787831133.670150:0:17104:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787831133.670154:0:17104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94c00/0x95459fb9d1d2a12f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831133.670169:0:17104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94c00/0x95459fb9d1d2a12f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831133.670183:0:17104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94400/0x95459fb9d1d2a136 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831133.670188:0:17104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94400/0x95459fb9d1d2a136 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831133.670194:0:17104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94400/0x95459fb9d1d2a136 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831133.670198:0:17104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233be94400 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:1.0:1787831133.670200:0:17104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94400/0x95459fb9d1d2a136 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831133.670206:0:17104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94400/0x95459fb9d1d2a136 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831133.670224:0:17104:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8d220274c100) 00010000:00010000:1.0:1787831133.670227:0:17104:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787831133.670230:0:17104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94400/0x95459fb9d1d2a136 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831133.670236:0:17104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94400/0x95459fb9d1d2a136 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831133.670277:0:17104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94200/0x95459fb9d1d2a128 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424284 expref: 27 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831133.670316:0:17104:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94a00/0x95459fb9d1d2a13d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424284 expref: 26 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831133.670324:0:17104:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d220274c900) 00010000:00010000:1.0:1787831133.670327:0:17104:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787831133.670329:0:17104:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233be94a00, rc 0) 00000100:00100000:1.0:1787831133.670384:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2314e71a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+26:15629:x1874676433417088:12345-192.168.203.31@tcp:101:stat.0 Request processed in 21825us (22015us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831133.670392:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 45 00000100:00100000:3.0:1787831133.734153:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831133.734260:0:18518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433417728 00000100:00100000:0.0:1787831133.734270:0:18518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433417728 00000100:00100000:0.0:1787831133.734331:0:18518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 46 00000100:00100000:0.0:1787831133.734341:0:18518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203afd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+26:15635:x1874676433417728:12345-192.168.203.31@tcp:36:truncate.0 00010000:00010000:0.0:1787831133.734412:0:18518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787831133.734437:0:18518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94a00/0x95459fb9d1d2a13d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424284 expref: 26 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831133.734455:0:18518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d220274c900) 00010000:00010000:0.0:1787831133.734459:0:18518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787831133.734707:0:18518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11e00/0x95459fb9d1d2a144 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831133.734721:0:18518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11e00/0x95459fb9d1d2a144 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831133.734731:0:18518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11e00/0x95459fb9d1d2a144 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787831133.734792:0:18518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:0.0:1787831133.734814:0:18518:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000931364a4 reply state 00000000df7d74b8 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11e00/0x95459fb9d1d2a144 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831133.734826:0:18518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11e00/0x95459fb9d1d2a144 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831133.734832:0:18518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d220274c900) 00010000:00010000:0.0:1787831133.734835:0:18518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787831133.734837:0:18518:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787831133.734947:0:18518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203afd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+28:15635:x1874676433417728:12345-192.168.203.31@tcp:36:truncate.0 Request processed in 607us (803us total) trans 8589934610 rc 0/0 00000100:00100000:0.0:1787831133.734955:0:18518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 46 00000020:00080000:0.0:1787831133.734960:0:18518:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787831133.888249:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831133.888358:0:19892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433417856 00000100:00100000:1.0:1787831133.888379:0:19892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433417856 00000100:00100000:1.0:1787831133.888439:0:19892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 47 00000100:00100000:1.0:1787831133.888450:0:19892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2314e703c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+28:15649:x1874676433417856:12345-192.168.203.31@tcp:101:stat.0 00010000:00010000:1.0:1787831133.888472:0:19892:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787831133.888493:0:19892:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94200/0x95459fb9d1d2a14b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a9942428b expref: -99 pid: 19892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831133.888552:0:19892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94400/0x95459fb9d1d2a152 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831133.888567:0:19892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94400/0x95459fb9d1d2a152 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831133.888577:0:19892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94400/0x95459fb9d1d2a152 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831133.888588:0:19892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94c00/0x95459fb9d1d2a159 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831133.888610:0:19892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94c00/0x95459fb9d1d2a159 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831133.888618:0:19892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94c00/0x95459fb9d1d2a159 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831133.888721:0:19892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95e00/0x95459fb9d1d2a160 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831133.888730:0:19892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95e00/0x95459fb9d1d2a160 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831133.888736:0:19892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95e00/0x95459fb9d1d2a160 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787831133.888778:0:19892:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00000004:00200000:1.0:1787831133.888782:0:19892:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787831133.888800:0:19892:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95e00/0x95459fb9d1d2a160 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831133.888810:0:19892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95e00/0x95459fb9d1d2a160 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831133.888818:0:19892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94400/0x95459fb9d1d2a152 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831133.888834:0:19892:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94400/0x95459fb9d1d2a152 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831133.888841:0:19892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94400/0x95459fb9d1d2a152 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831133.888859:0:19892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233be94400 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:1.0:1787831133.888863:0:19892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94400/0x95459fb9d1d2a152 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831133.888870:0:19892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94400/0x95459fb9d1d2a152 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831133.888883:0:19892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d233a6f8800) 00010000:00010000:1.0:1787831133.888886:0:19892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787831133.888890:0:19892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94400/0x95459fb9d1d2a152 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831133.888896:0:19892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94400/0x95459fb9d1d2a152 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831133.888910:0:19892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94c00/0x95459fb9d1d2a159 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831133.888915:0:19892:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94c00/0x95459fb9d1d2a159 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831133.888931:0:19892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94c00/0x95459fb9d1d2a159 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831133.888936:0:19892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233be94c00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:1.0:1787831133.888939:0:19892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94c00/0x95459fb9d1d2a159 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831133.888944:0:19892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94c00/0x95459fb9d1d2a159 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831133.888962:0:19892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8d220274c100) 00010000:00010000:1.0:1787831133.888964:0:19892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787831133.888967:0:19892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94c00/0x95459fb9d1d2a159 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831133.888972:0:19892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94c00/0x95459fb9d1d2a159 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831133.889010:0:19892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94200/0x95459fb9d1d2a14b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a9942428b expref: 30 pid: 19892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831133.889023:0:19892:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95e00/0x95459fb9d1d2a160 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a9942428b expref: 29 pid: 19892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831133.889029:0:19892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d220274c900) 00010000:00010000:1.0:1787831133.889031:0:19892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787831133.889033:0:19892:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233be95e00, rc 0) 00000100:00100000:1.0:1787831133.889100:0:19892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2314e703c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+29:15649:x1874676433417856:12345-192.168.203.31@tcp:101:stat.0 Request processed in 653us (862us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831133.889107:0:19892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 47 00000100:00100000:2.0:1787831133.977966:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831133.978475:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433418112 00000100:00100000:1.0:1787831133.978484:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433418112 00000100:00100000:1.0:1787831133.978563:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 48 00000100:00100000:1.0:1787831133.978577:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2314e70b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+29:15659:x1874676433418112:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:1.0:1787831133.978596:0:17104:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787831133.978615:0:17104:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94200/0x95459fb9d1d2a167 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99424292 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787831133.978988:0:17104:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1787831133.979345:0:17104:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94200/0x95459fb9d1d2a167 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424292 expref: 31 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831133.979409:0:17104:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d220274cc00) 00010000:00010000:1.0:1787831133.979413:0:17104:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787831133.979419:0:17104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94200/0x95459fb9d1d2a167 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424292 expref: 31 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831133.979434:0:17104:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233be94200, rc 0) 00000100:00100000:1.0:1787831133.979562:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2314e70b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+30:15659:x1874676433418112:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 991us (1605us total) trans 8589934611 rc 301/301 00000100:00100000:1.0:1787831133.979571:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 48 00000100:00100000:2.0:1787831133.983318:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831133.984431:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433418368 00000100:00100000:1.0:1787831133.984446:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433418368 00000100:00100000:1.0:1787831133.984535:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 8 00000100:00100000:1.0:1787831133.984548:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2314e71680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+30:15659:x1874676433418368:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:1.0:1787831133.985669:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2314e71680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+31:15659:x1874676433418368:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 1112us (2352us total) trans 8589934612 rc 0/0 00000100:00100000:1.0:1787831133.985683:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 8 00000100:00100000:2.0:1787831134.055260:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831134.056009:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433418624 00000100:00100000:1.0:1787831134.056021:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433418624 00000100:00100000:0.0:1787831134.056291:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 49 00000100:00100000:0.0:1787831134.056318:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2314e71e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+31:15665:x1874676433418624:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:0.0:1787831134.056344:0:17105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787831134.056374:0:17105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11400/0x95459fb9d1d2a175 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99424299 expref: -99 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831134.056492:0:17105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10600/0x95459fb9d1d2a17c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831134.056506:0:17105:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95e00/0x95459fb9d1d2a160 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a9942428b expref: 32 pid: 19892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831134.056514:0:17105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10600/0x95459fb9d1d2a17c lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831134.056549:0:17105:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95e00/0x95459fb9d1d2a160 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0xe558a92a9942428b expref: 32 pid: 19892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831134.056563:0:17105:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95e00/0x95459fb9d1d2a160 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a9942428b expref: 32 pid: 19892 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831134.056574:0:17105:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2309d08780 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17105:1874676443954304:192.168.203.31@tcp:104: 00000100:00100000:0.0:1787831134.056685:0:17105:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2338238840 going to sleep for 11 seconds 00000100:00080000:2.0:1787831134.057994:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787831134.059512:0:17105:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2309d08780 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17105:1874676443954304:192.168.203.31@tcp:104: 00010000:00010000:0.0:1787831134.059542:0:17105:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10600/0x95459fb9d1d2a17c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831134.060717:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831134.060955:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433418752 00000100:00100000:3.0:1787831134.060962:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433418752 00010000:00010000:3.0:1787831134.060999:0:17089:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95e00/0x95459fb9d1d2a160 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a9942428b expref: 33 pid: 19892 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787831134.061040:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 20 00000100:00100000:3.0:1787831134.061050:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233c0e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+33:2397:x1874676433418752:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787831134.061065:0:17089:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787831134.061072:0:17089:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95e00/0x95459fb9d1d2a160 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a9942428b expref: 33 pid: 19892 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831134.061099:0:17089:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95e00/0x95459fb9d1d2a160 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a9942428b expref: 33 pid: 19892 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831134.061122:0:17089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95e00/0x95459fb9d1d2a160 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a9942428b expref: 33 pid: 19892 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831134.061138:0:17089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d220274c900) 00010000:00010000:3.0:1787831134.061144:0:17089:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10600/0x95459fb9d1d2a17c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831134.061154:0:17089:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10600/0x95459fb9d1d2a17c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831134.061162:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10600/0x95459fb9d1d2a17c lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831134.061193:0:17089:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787831134.061256:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233c0e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+32:2397:x1874676433418752:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 207us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831134.061264:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 20 00010000:00010000:0.0:1787831134.061376:0:17105:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10600/0x95459fb9d1d2a17c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831134.061394:0:17105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10600/0x95459fb9d1d2a17c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787831134.061413:0:17105:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00010000:00010000:0.0:1787831134.061544:0:17105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11400/0x95459fb9d1d2a175 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424299 expref: 33 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831134.061560:0:17105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10600/0x95459fb9d1d2a17c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424299 expref: 32 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831134.061568:0:17105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d220274c900) 00010000:00010000:0.0:1787831134.061572:0:17105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787831134.061574:0:17105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233bf10600, rc 0) 00000100:00100000:0.0:1787831134.061602:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2314e71e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+32:15665:x1874676433418624:12345-192.168.203.31@tcp:101:bash.0 Request processed in 5288us (6351us total) trans 8589934613 rc 0/0 00000100:00100000:0.0:1787831134.061609:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 49 00000100:00100000:2.0:1787831134.065048:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831134.065131:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433419008 00000100:00100000:3.0:1787831134.065140:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433419008 00000100:00100000:3.0:1787831134.065201:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 50 00000100:00100000:3.0:1787831134.065211:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2314e72d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+32:15665:x1874676433419008:12345-192.168.203.31@tcp:36:bash.0 00010000:00010000:3.0:1787831134.065468:0:17106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669c00/0x95459fb9d1d2a18a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831134.065486:0:17106:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669c00/0x95459fb9d1d2a18a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831134.065509:0:17106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669c00/0x95459fb9d1d2a18a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787831134.065552:0:17106:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934614 00000004:00010000:3.0:1787831134.065573:0:17106:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008718ef3d reply state 00000000ed78cfc8 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669c00/0x95459fb9d1d2a18a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831134.065586:0:17106:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669c00/0x95459fb9d1d2a18a lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831134.065593:0:17106:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d220274c900) 00010000:00010000:3.0:1787831134.065596:0:17106:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787831134.065599:0:17106:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787831134.065734:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2314e72d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+35:15665:x1874676433419008:12345-192.168.203.31@tcp:36:bash.0 Request processed in 519us (689us total) trans 8589934615 rc 0/0 00000100:00100000:3.0:1787831134.065742:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 50 00000020:00080000:3.0:1787831134.065747:0:17106:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787831134.076180:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831134.076301:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433419136 00000100:00100000:0.0:1787831134.076310:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433419136 00000100:00100000:0.0:1787831134.076555:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 51 00000100:00100000:0.0:1787831134.076567:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204557480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+35:15665:x1874676433419136:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:0.0:1787831134.076590:0:17104:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787831134.076610:0:17104:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11400/0x95459fb9d1d2a191 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a994242a0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831134.076728:0:17104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11c00/0x95459fb9d1d2a198 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831134.076759:0:17104:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10600/0x95459fb9d1d2a17c lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424299 expref: 36 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831134.076768:0:17104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11c00/0x95459fb9d1d2a198 lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831134.076803:0:17104:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10600/0x95459fb9d1d2a17c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424299 expref: 36 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831134.076816:0:17104:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10600/0x95459fb9d1d2a17c lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424299 expref: 36 pid: 17105 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831134.076829:0:17104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2309d08780 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17104:1874676443954432:192.168.203.31@tcp:104: 00000100:00100000:0.0:1787831134.076905:0:17104:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2338238840 going to sleep for 11 seconds 00000100:00100000:0.0:1787831134.085429:0:17104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2309d08780 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17104:1874676443954432:192.168.203.31@tcp:104: 00010000:00010000:0.0:1787831134.085464:0:17104:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11c00/0x95459fb9d1d2a198 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831134.086407:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831134.086482:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433419264 00000100:00100000:2.0:1787831134.086489:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433419264 00010000:00010000:2.0:1787831134.086529:0:17090:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10600/0x95459fb9d1d2a17c lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424299 expref: 37 pid: 17105 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831134.086567:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 21 00000100:00100000:2.0:1787831134.086588:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22045570c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+37:2397:x1874676433419264:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787831134.086603:0:17090:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787831134.086610:0:17090:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10600/0x95459fb9d1d2a17c lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424299 expref: 37 pid: 17105 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831134.086648:0:17090:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10600/0x95459fb9d1d2a17c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424299 expref: 37 pid: 17105 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831134.086670:0:17090:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10600/0x95459fb9d1d2a17c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424299 expref: 37 pid: 17105 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831134.086686:0:17090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d220274c900) 00010000:00010000:2.0:1787831134.086691:0:17090:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11c00/0x95459fb9d1d2a198 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831134.086700:0:17090:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11c00/0x95459fb9d1d2a198 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831134.086708:0:17090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11c00/0x95459fb9d1d2a198 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831134.086737:0:17090:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787831134.086784:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22045570c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+36:2397:x1874676433419264:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 197us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831134.086791:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 21 00010000:00010000:1.0:1787831134.086847:0:17104:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11c00/0x95459fb9d1d2a198 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831134.086861:0:17104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11c00/0x95459fb9d1d2a198 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787831134.086935:0:17104:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1787831134.086940:0:17104:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787831134.086961:0:17104:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11c00/0x95459fb9d1d2a198 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831134.086991:0:17104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11400/0x95459fb9d1d2a191 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994242a0 expref: 36 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831134.087006:0:17104:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11c00/0x95459fb9d1d2a198 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994242a0 expref: 35 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831134.087012:0:17104:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d220274c900) 00010000:00010000:1.0:1787831134.087014:0:17104:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787831134.087017:0:17104:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233bf11c00, rc 0) 00000100:00100000:1.0:1787831134.087043:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204557480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+35:15665:x1874676433419136:12345-192.168.203.31@tcp:101:bash.0 Request processed in 10479us (10872us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831134.087049:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 51 00000100:00100000:2.0:1787831134.090529:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831134.090620:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433419520 00000100:00100000:0.0:1787831134.090667:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433419520 00000100:00100000:0.0:1787831134.090716:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 9 00000100:00100000:0.0:1787831134.090725:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2314e70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+35:15665:x1874676433419520:12345-192.168.203.31@tcp:35:bash.0 00000100:00100000:0.0:1787831134.090966:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2314e70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+36:15665:x1874676433419520:12345-192.168.203.31@tcp:35:bash.0 Request processed in 240us (445us total) trans 8589934616 rc 0/0 00000100:00100000:0.0:1787831134.090974:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 9 00010000:00010000:2.0:1787831134.118784:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787831134.167858:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831134.168032:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433419776 00000100:00100000:0.0:1787831134.168054:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433419776 00000100:00100000:0.0:1787831134.168115:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 52 00000100:00100000:0.0:1787831134.168125:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203afc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+36:15675:x1874676433419776:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:0.0:1787831134.168149:0:17105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787831134.168168:0:17105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11600/0x95459fb9d1d2a19f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a994242a7 expref: -99 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787831134.168266:0:17105:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1787831134.168556:0:17105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11600/0x95459fb9d1d2a19f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994242a7 expref: 38 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831134.168574:0:17105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d220274cc00) 00010000:00010000:0.0:1787831134.168577:0:17105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787831134.168584:0:17105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11600/0x95459fb9d1d2a19f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994242a7 expref: 38 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831134.168601:0:17105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233bf11600, rc 0) 00000100:00100000:0.0:1787831134.168810:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203afc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+37:15675:x1874676433419776:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 685us (959us total) trans 8589934617 rc 301/301 00000100:00100000:0.0:1787831134.168818:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 52 00000100:00100000:3.0:1787831134.171577:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831134.171682:0:18518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433419904 00000100:00100000:0.0:1787831134.171692:0:18518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433419904 00000100:00100000:0.0:1787831134.171752:0:18518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 53 00000100:00100000:0.0:1787831134.171762:0:18518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203afd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+37:15675:x1874676433419904:12345-192.168.203.31@tcp:34:lfs.0 00010000:00010000:0.0:1787831134.171835:0:18518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11800/0x95459fb9d1d2a1ad lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831134.171851:0:18518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11800/0x95459fb9d1d2a1ad lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831134.171875:0:18518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11800/0x95459fb9d1d2a1ad lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831134.171887:0:18518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11200/0x95459fb9d1d2a1b4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831134.171895:0:18518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11200/0x95459fb9d1d2a1b4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831134.171901:0:18518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11200/0x95459fb9d1d2a1b4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831134.172000:0:18518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10200/0x95459fb9d1d2a1bb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831134.172010:0:18518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10200/0x95459fb9d1d2a1bb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831134.172017:0:18518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10200/0x95459fb9d1d2a1bb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787831134.172065:0:18518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10200/0x95459fb9d1d2a1bb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831134.172075:0:18518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11800/0x95459fb9d1d2a1ad lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831134.172082:0:18518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11800/0x95459fb9d1d2a1ad lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831134.172088:0:18518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11800/0x95459fb9d1d2a1ad lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831134.172102:0:18518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233bf11800 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:0.0:1787831134.172106:0:18518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11800/0x95459fb9d1d2a1ad lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831134.172114:0:18518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11800/0x95459fb9d1d2a1ad lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831134.172126:0:18518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d233a6f8800) 00010000:00010000:0.0:1787831134.172129:0:18518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787831134.172134:0:18518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11800/0x95459fb9d1d2a1ad lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831134.172140:0:18518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11800/0x95459fb9d1d2a1ad lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831134.172155:0:18518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11200/0x95459fb9d1d2a1b4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831134.172161:0:18518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11200/0x95459fb9d1d2a1b4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831134.172168:0:18518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11200/0x95459fb9d1d2a1b4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831134.172172:0:18518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233bf11200 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:0.0:1787831134.172175:0:18518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11200/0x95459fb9d1d2a1b4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831134.172182:0:18518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11200/0x95459fb9d1d2a1b4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831134.172200:0:18518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8d220274c100) 00010000:00010000:0.0:1787831134.172203:0:18518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787831134.172206:0:18518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11200/0x95459fb9d1d2a1b4 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831134.172212:0:18518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11200/0x95459fb9d1d2a1b4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831134.172222:0:18518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10200/0x95459fb9d1d2a1bb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831134.172227:0:18518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10200/0x95459fb9d1d2a1bb lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831134.172233:0:18518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10200/0x95459fb9d1d2a1bb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831134.172238:0:18518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233bf10200 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:0.0:1787831134.172241:0:18518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10200/0x95459fb9d1d2a1bb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831134.172246:0:18518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10200/0x95459fb9d1d2a1bb lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831134.172253:0:18518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d220274c900) 00010000:00010000:0.0:1787831134.172255:0:18518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787831134.172257:0:18518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10200/0x95459fb9d1d2a1bb lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831134.172263:0:18518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10200/0x95459fb9d1d2a1bb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831134.172706:0:18518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203afd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+37:15675:x1874676433419904:12345-192.168.203.31@tcp:34:lfs.0 Request processed in 943us (1135us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831134.172714:0:18518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 53 00000100:00100000:2.0:1787831134.175291:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831134.175381:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433420160 00000100:00100000:0.0:1787831134.175390:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433420160 00000100:00100000:0.0:1787831134.175454:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 10 00000100:00100000:0.0:1787831134.175464:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220385cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+37:15675:x1874676433420160:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:0.0:1787831134.175704:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220385cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+38:15675:x1874676433420160:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 240us (421us total) trans 8589934618 rc 0/0 00000100:00100000:0.0:1787831134.175712:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 10 00000100:00100000:3.0:1787831134.222828:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831134.222930:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433420416 00000100:00100000:1.0:1787831134.222948:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433420416 00000100:00100000:1.0:1787831134.223068:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 54 00000100:00100000:1.0:1787831134.223080:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203afcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+38:15678:x1874676433420416:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:1.0:1787831134.223105:0:17104:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787831134.223127:0:17104:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94c00/0x95459fb9d1d2a1c2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a994242ae expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831134.223218:0:17104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94400/0x95459fb9d1d2a1c9 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831134.223234:0:17104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94400/0x95459fb9d1d2a1c9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831134.223244:0:17104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94400/0x95459fb9d1d2a1c9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831134.223268:0:17104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95e00/0x95459fb9d1d2a1d0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831134.223275:0:17104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95e00/0x95459fb9d1d2a1d0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831134.223282:0:17104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95e00/0x95459fb9d1d2a1d0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831134.223389:0:17104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94200/0x95459fb9d1d2a1d7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831134.223399:0:17104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94200/0x95459fb9d1d2a1d7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831134.223407:0:17104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94200/0x95459fb9d1d2a1d7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787831134.223416:0:17104:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787831134.223486:0:17104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94400/0x95459fb9d1d2a1c9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831134.223503:0:17104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94400/0x95459fb9d1d2a1c9 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831134.223510:0:17104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94400/0x95459fb9d1d2a1c9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831134.223515:0:17104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233be94400 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:1.0:1787831134.223519:0:17104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94400/0x95459fb9d1d2a1c9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831134.223527:0:17104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94400/0x95459fb9d1d2a1c9 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831134.223540:0:17104:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d233a6f8800) 00010000:00010000:1.0:1787831134.223543:0:17104:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787831134.223547:0:17104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94400/0x95459fb9d1d2a1c9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831134.223553:0:17104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94400/0x95459fb9d1d2a1c9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831134.223567:0:17104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95e00/0x95459fb9d1d2a1d0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831134.223573:0:17104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95e00/0x95459fb9d1d2a1d0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831134.223579:0:17104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95e00/0x95459fb9d1d2a1d0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831134.223584:0:17104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233be95e00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:1.0:1787831134.223591:0:17104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95e00/0x95459fb9d1d2a1d0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831134.223598:0:17104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95e00/0x95459fb9d1d2a1d0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831134.223606:0:17104:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8d220274c100) 00010000:00010000:1.0:1787831134.223608:0:17104:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787831134.223611:0:17104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95e00/0x95459fb9d1d2a1d0 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831134.223618:0:17104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95e00/0x95459fb9d1d2a1d0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831134.224337:0:17104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94c00/0x95459fb9d1d2a1c2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994242ae expref: 41 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831134.224353:0:17104:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94200/0x95459fb9d1d2a1d7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994242ae expref: 40 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831134.224361:0:17104:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d220274c900) 00010000:00010000:1.0:1787831134.224363:0:17104:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787831134.224366:0:17104:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233be94200, rc 0) 00000100:00100000:1.0:1787831134.224483:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203afcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+40:15678:x1874676433420416:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 1405us (1663us total) trans 8589934619 rc 0/0 00000100:00100000:1.0:1787831134.224491:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 54 00000100:00100000:3.0:1787831134.227397:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831134.227708:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433420672 00000100:00100000:2.0:1787831134.227732:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433420672 00000100:00100000:2.0:1787831134.227798:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 0 00000100:00100000:2.0:1787831134.227808:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22045b7c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+40:2397:x1874676433420672:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787831134.227823:0:17089:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787831134.227848:0:17089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94200/0x95459fb9d1d2a1d7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994242ae expref: 40 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831134.227867:0:17089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d220274c900) 00010000:00010000:2.0:1787831134.227872:0:17089:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787831134.227954:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22045b7c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+39:2397:x1874676433420672:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 147us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831134.227962:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 0 00000100:00100000:2.0:1787831134.230283:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831134.230380:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433420800 00000100:00100000:0.0:1787831134.230389:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433420800 00000100:00100000:0.0:1787831134.230446:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 11 00000100:00100000:0.0:1787831134.230456:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2314e73840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+39:15678:x1874676433420800:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:0.0:1787831134.231046:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2314e73840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+40:15678:x1874676433420800:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 589us (767us total) trans 8589934620 rc 0/0 00000100:00100000:0.0:1787831134.231055:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 11 00000100:00100000:0.0:1787831134.237720:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831134.244232:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433420928 00000100:00100000:2.0:1787831134.244245:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433420928 00000100:00100000:2.0:1787831134.244350:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 55 00000100:00100000:2.0:1787831134.244370:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2309d08780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+40:15678:x1874676433420928:12345-192.168.203.31@tcp:54:lfs.0 00010000:00010000:2.0:1787831134.244447:0:17105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1a00/0x95459fb9d1d2a1e5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831134.244466:0:17105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1a00/0x95459fb9d1d2a1e5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831134.244477:0:17105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1a00/0x95459fb9d1d2a1e5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831134.244517:0:17105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1a00/0x95459fb9d1d2a1e5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831134.244543:0:17105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1a00/0x95459fb9d1d2a1e5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831134.244549:0:17105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1a00/0x95459fb9d1d2a1e5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831134.244555:0:17105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22039c1a00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:2.0:1787831134.244560:0:17105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1a00/0x95459fb9d1d2a1e5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831134.244567:0:17105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1a00/0x95459fb9d1d2a1e5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831134.244581:0:17105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d220274c900) 00010000:00010000:2.0:1787831134.244584:0:17105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787831134.244588:0:17105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1a00/0x95459fb9d1d2a1e5 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831134.244593:0:17105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1a00/0x95459fb9d1d2a1e5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831134.244712:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2309d08780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+40:15678:x1874676433420928:12345-192.168.203.31@tcp:54:lfs.0 Request processed in 353us (7094us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831134.244720:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 55 00000100:00100000:3.0:1787831134.425039:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831134.425141:0:19892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433421056 00000100:00100000:1.0:1787831134.425150:0:19892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433421056 00000100:00100000:1.0:1787831134.425213:0:19892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 56 00000100:00100000:1.0:1787831134.425223:0:19892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233448a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+40:15697:x1874676433421056:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:1.0:1787831134.425261:0:19892:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787831134.425284:0:19892:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94c00/0x95459fb9d1d2a1ec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a994242b5 expref: -99 pid: 19892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831134.425351:0:19892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95e00/0x95459fb9d1d2a1f3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831134.425366:0:19892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95e00/0x95459fb9d1d2a1f3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831134.425378:0:19892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95e00/0x95459fb9d1d2a1f3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787831134.425424:0:19892:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787831134.425428:0:19892:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787831134.425445:0:19892:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95e00/0x95459fb9d1d2a1f3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831134.425474:0:19892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94c00/0x95459fb9d1d2a1ec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994242b5 expref: 42 pid: 19892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831134.425493:0:19892:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95e00/0x95459fb9d1d2a1f3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994242b5 expref: 41 pid: 19892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831134.425502:0:19892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d233a6f8800) 00010000:00010000:1.0:1787831134.425505:0:19892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787831134.425509:0:19892:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233be95e00, rc 0) 00000100:00100000:1.0:1787831134.425573:0:19892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233448a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+41:15697:x1874676433421056:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 352us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831134.425580:0:19892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 56 00000100:00100000:3.0:1787831134.430185:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831134.430320:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433421440 00000100:00100000:1.0:1787831134.430332:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433421440 00000100:00100000:1.0:1787831134.430396:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 12 00000100:00100000:1.0:1787831134.430408:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233448a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+41:15697:x1874676433421440:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:1.0:1787831134.430773:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233448a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+42:15697:x1874676433421440:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 367us (596us total) trans 8589934621 rc 0/0 00000100:00100000:1.0:1787831134.430782:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 12 00000100:00100000:0.0:1787831134.432972:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831134.433657:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433421568 00000100:00100000:2.0:1787831134.433667:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433421568 00000100:00100000:2.0:1787831134.433734:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 1 00000100:00100000:2.0:1787831134.433744:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2309d0a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+42:15697:x1874676433421568:12345-192.168.203.31@tcp:103:lfs.0 00010000:00010000:2.0:1787831134.433759:0:17090:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1787831134.433797:0:17090:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11c00/0x95459fb9d1d2a198 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994242a0 expref: 42 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831134.433820:0:17090:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94800/0x95459fb9d1d2a0e9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a9942426f expref: 41 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831134.433829:0:17090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d220274c900) 00010000:00010000:2.0:1787831134.433834:0:17090:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787831134.433894:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2309d0a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+40:15697:x1874676433421568:12345-192.168.203.31@tcp:103:lfs.0 Request processed in 152us (929us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831134.433902:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 1 00000100:00100000:1.0:1787831134.438788:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2309d08f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676443954816:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787831134.438789:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2314e70f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1874676443954560:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787831134.438801:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22045552c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443954688:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787831134.439055:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2309d0ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443954944:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787831134.441051:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831134.441101:0:18611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443954688 00000100:00100000:2.0:1787831134.441110:0:18611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443954688 00000100:00100000:0.0:1787831134.441123:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2334488b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443955200:0@lo:400:kworker.0 00000100:00100000:0.0:1787831134.441164:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831134.441180:0:18611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787831134.441188:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2309cf8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443955712:0@lo:400:kworker.0 00000100:00100000:2.0:1787831134.441193:0:18611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2309d08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443954688:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787831134.441227:0:18611:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787831134.441233:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831134.441256:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2309cfa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3621:1874676443956224:0@lo:400:kworker.0 00000100:00100000:2.0:1787831134.441281:0:18611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2309d08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443954688:12345-0@lo:13:osp-pre-1-1.0 Request processed in 91us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831134.441289:0:18611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787831134.441316:0:19224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443955200 00000100:00100000:2.0:1787831134.441319:0:19224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443955200 00000100:00100000:2.0:1787831134.441341:0:19224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443955712 00000100:00100000:2.0:1787831134.441344:0:19224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443955712 00000100:00100000:0.0:1787831134.441352:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831134.441361:0:19224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787831134.441371:0:19224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2309d0a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1874676443955200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787831134.441410:0:19224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2309d0a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1874676443955200:12345-0@lo:400:kworker.0 Request processed in 41us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831134.441423:0:19224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787831134.441437:0:19224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787831134.441443:0:19224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2309d08b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443955712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787831134.441469:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22045552c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443954688:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787831134.441477:0:19224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2309d08b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443955712:12345-0@lo:400:kworker.0 Request processed in 32us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831134.441484:0:19224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787831134.441506:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2334488b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443955200:0@lo:400:kworker.0 00000100:00080000:2.0:1787831134.441510:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787831134.441520:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2309cf8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443955712:0@lo:400:kworker.0 00000100:00100000:2.0:1787831134.441527:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831134.441538:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1787831134.441548:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2334489a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443955328:0@lo:400:kworker.0 00000100:00100000:2.0:1787831134.441558:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2334488f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:be45932f-3bcb-4e49-b61c-a2395180b0ee:3620:1874676443955072:0@lo:400:kworker.0 00000100:00100000:0.0:1787831134.441584:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831134.441601:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831134.441611:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2309cf9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443955840:0@lo:400:kworker.0 00000100:00100000:2.0:1787831134.441659:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2309cfa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3620:1874676443955584:0@lo:400:kworker.0 00000100:00100000:0.0:1787831134.441671:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831134.441692:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831134.441697:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2309cf83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3621:1874676443956352:0@lo:400:kworker.0 00000100:00100000:2.0:1787831134.441718:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2309cf8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3620:1874676443956096:0@lo:400:kworker.0 00000100:00100000:0.0:1787831134.441729:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831134.441751:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831134.441774:0:18610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443955328 00000100:00100000:2.0:1787831134.441777:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2309cf8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3620:1874676443956608:0@lo:400:kworker.0 00000100:00100000:0.0:1787831134.441780:0:18610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443955328 00000100:00100000:2.0:1787831134.441804:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831134.441827:0:18610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443955840 00000100:00100000:0.0:1787831134.441832:0:18610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443955840 00000100:00100000:0.0:1787831134.441854:0:18610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787831134.441861:0:18610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2309d0b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1874676443955328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787831134.442052:0:18610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2309d0b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1874676443955328:12345-0@lo:400:kworker.0 Request processed in 191us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831134.442055:0:18608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787831134.442066:0:18610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787831134.442073:0:18608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2334488b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443955840:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787831134.442088:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787831134.442102:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443955072 00000100:00100000:0.0:1787831134.442106:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443955072 00000100:00100000:2.0:1787831134.442113:0:18608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2334488b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443955840:12345-0@lo:400:kworker.0 Request processed in 46us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831134.442123:0:18608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787831134.442149:0:18611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443954560 00000100:00100000:0.0:1787831134.442153:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1787831134.442155:0:18611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443954560 00000100:00100000:0.0:1787831134.442163:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203527850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be45932f-3bcb-4e49-b61c-a2395180b0ee+24:3620:x1874676443955072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787831134.442192:0:18611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787831134.442200:0:18611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2314e730c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1874676443954560:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787831134.442211:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203527850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be45932f-3bcb-4e49-b61c-a2395180b0ee+24:3620:x1874676443955072:12345-0@lo:400:kworker.0 Request processed in 48us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831134.442219:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00002000:00000024:2.0:1787831134.442222:0:18611:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1787831134.442268:0:18611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2314e730c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1874676443954560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (741us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831134.442269:0:18518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443956224 00000100:00100000:0.0:1787831134.442274:0:18518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443956224 00000100:00100000:2.0:1787831134.442279:0:18611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:2.0:1787831134.442301:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787831134.442304:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787831134.442321:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2334488f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:be45932f-3bcb-4e49-b61c-a2395180b0ee:3620:1874676443955072:0@lo:400:kworker.0 00000100:00100000:2.0:1787831134.442338:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2314e70f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1874676443954560:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787831134.442361:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443955584 00000100:00100000:2.0:1787831134.442365:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443955584 00000100:00100000:2.0:1787831134.442384:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443956352 00000100:00100000:2.0:1787831134.442386:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443956352 00000100:00100000:2.0:1787831134.442403:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443956096 00000100:00100000:2.0:1787831134.442406:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443956096 00000100:00100000:2.0:1787831134.442417:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443956608 00000100:00100000:2.0:1787831134.442419:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443956608 00000100:00100000:2.0:1787831134.442433:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787831134.442439:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2314e72580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1874676443955584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787831134.442476:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2314e72580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1874676443955584:12345-0@lo:400:kworker.0 Request processed in 38us (786us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831134.442483:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787831134.442494:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787831134.442500:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22038fa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1874676443956352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787831134.442526:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22038fa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1874676443956352:12345-0@lo:400:kworker.0 Request processed in 27us (799us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831134.442531:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787831134.442543:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787831134.442555:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2314e72940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1874676443956096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787831134.442581:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2314e72940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1874676443956096:12345-0@lo:400:kworker.0 Request processed in 27us (832us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831134.442587:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787831134.442599:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787831134.442604:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2314e712c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1874676443956608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787831134.442655:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2314e712c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1874676443956608:12345-0@lo:400:kworker.0 Request processed in 51us (851us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831134.442661:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:2.0:1787831134.442674:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787831134.442690:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2309cfa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3620:1874676443955584:0@lo:400:kworker.0 00000100:00100000:2.0:1787831134.442703:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2309cf8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3620:1874676443956096:0@lo:400:kworker.0 00010000:00080000:2.0:1787831134.442714:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2309cf8f00 x1874676443956608/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787831150 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787831134.442724:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2309cf8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3620:1874676443956608:0@lo:400:kworker.0 00000100:00100000:0.0:1787831134.442768:0:18518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787831134.442780:0:18518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2309d09e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1874676443956224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787831134.442788:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831134.442788:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831134.442819:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2309cfbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443955456:0@lo:400:kworker.0 00000100:00100000:0.0:1787831134.442833:0:18518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2309d09e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1874676443956224:12345-0@lo:400:kworker.0 Request processed in 56us (1480us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831134.442841:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443954816 00000100:00100000:0.0:1787831134.442842:0:18518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787831134.442847:0:17110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443954816 00000100:00100000:3.0:1787831134.442849:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831134.442870:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2309cfb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443955968:0@lo:400:kworker.0 00000100:00100000:1.0:1787831134.442878:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787831134.442885:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2334489a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443955328:0@lo:400:kworker.0 00000100:00100000:1.0:1787831134.442887:0:17110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204557c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676443954816:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787831134.442905:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2309cf9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443955840:0@lo:400:kworker.0 00000004:00000024:1.0:1787831134.442926:0:17110:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00010000:00080000:0.0:1787831134.442929:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2309cf83c0 x1874676443956352/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787831150 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787831134.442941:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2309cf83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3621:1874676443956352:0@lo:400:kworker.0 00000100:00100000:0.0:1787831134.442956:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2309cfa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3621:1874676443956224:0@lo:400:kworker.0 00000100:00100000:1.0:1787831134.442975:0:17110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204557c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676443954816:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831134.442983:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787831134.443017:0:18914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443955456 00000100:00100000:0.0:1787831134.443021:0:18914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443955456 00000100:00100000:1.0:1787831134.443027:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2309d08f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676443954816:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787831134.443051:0:18914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787831134.443060:0:18914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2309cf8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676443955456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787831134.443076:0:18611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443954944 00000100:00100000:1.0:1787831134.443082:0:18611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443954944 00000100:00100000:2.0:1787831134.443111:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831134.443111:0:18611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787831134.443112:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831134.443117:0:18914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2309cf8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676443955456:12345-0@lo:400:kworker.0 Request processed in 56us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831134.443125:0:18611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2309cf8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443954944:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787831134.443138:0:18914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787831134.443143:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2309cfb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3619:1874676443956480:0@lo:400:kworker.0 00002000:00000024:1.0:1787831134.443144:0:18611:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787831134.443146:0:19892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433421696 00000100:00100000:2.0:1787831134.443152:0:19892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433421696 00000100:00100000:0.0:1787831134.443155:0:18914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443955968 00000100:00100000:0.0:1787831134.443161:0:18914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443955968 00000100:00100000:2.0:1787831134.443185:0:19892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 57 00000100:00100000:0.0:1787831134.443192:0:18914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787831134.443197:0:19892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2314e70f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+40:15697:x1874676433421696:12345-192.168.203.31@tcp:58:lfs.0 00000100:00100000:0.0:1787831134.443204:0:18914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2309cfa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443955968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787831134.443239:0:18914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2309cfa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443955968:12345-0@lo:400:kworker.0 Request processed in 38us (130us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831134.443245:0:18914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787831134.443291:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787831134.443296:0:19892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1a00/0x95459fb9d1d2a1fa lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831134.443313:0:19892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1a00/0x95459fb9d1d2a1fa lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787831134.443324:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2309cfbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443955456:0@lo:400:kworker.0 00000100:00100000:3.0:1787831134.443342:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2309cfb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443955968:0@lo:400:kworker.0 00010000:00010000:2.0:1787831134.443344:0:19892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1a00/0x95459fb9d1d2a1fa lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787831134.443371:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443956480 00000100:00100000:3.0:1787831134.443376:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443956480 00000100:00100000:3.0:1787831134.444051:0:18518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787831134.444060:0:18518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2309cf8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874676443956480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787831134.444110:0:18518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2309cf8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874676443956480:12345-0@lo:400:kworker.0 Request processed in 52us (820us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831134.444116:0:18518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:0.0:1787831134.444333:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787831134.444518:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2309cfb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3619:1874676443956480:0@lo:400:kworker.0 00000100:00100000:1.0:1787831134.445344:0:18611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2309cf8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443954944:12345-0@lo:13:osp-pre-0-1.0 Request processed in 2221us (2557us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831134.445350:0:18611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787831134.445708:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2309d0ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443954944:0@lo:13:osp-pre-0-1.0 00000040:00080000:3.0:1787831134.447783:0:19892:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787831134.448574:0:19892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:3.0:1787831134.448744:0:19892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:3.0:1787831134.448844:0:19892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2314e70f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+40:15697:x1874676433421696:12345-192.168.203.31@tcp:58:lfs.0 Request processed in 5646us (5735us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831134.448855:0:19892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 57 00000100:00100000:3.0:1787831134.463866:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831134.464067:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433421824 00000100:00100000:0.0:1787831134.464078:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433421824 00000100:00100000:0.0:1787831134.464145:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 58 00000100:00100000:0.0:1787831134.464156:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2309cfb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+40:15699:x1874676433421824:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:0.0:1787831134.464176:0:17104:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787831134.464199:0:17104:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11600/0x95459fb9d1d2a201 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a994242bc expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831134.464281:0:17104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11800/0x95459fb9d1d2a208 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831134.464296:0:17104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11800/0x95459fb9d1d2a208 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831134.464307:0:17104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11800/0x95459fb9d1d2a208 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831134.464320:0:17104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11c00/0x95459fb9d1d2a20f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831134.464345:0:17104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11c00/0x95459fb9d1d2a20f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831134.464352:0:17104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11c00/0x95459fb9d1d2a20f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831134.464443:0:17104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11200/0x95459fb9d1d2a216 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831134.464453:0:17104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11200/0x95459fb9d1d2a216 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831134.464460:0:17104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11200/0x95459fb9d1d2a216 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787831134.464502:0:17104:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1787831134.464507:0:17104:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787831134.464536:0:17104:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11200/0x95459fb9d1d2a216 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831134.464549:0:17104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11200/0x95459fb9d1d2a216 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831134.464557:0:17104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11800/0x95459fb9d1d2a208 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831134.464563:0:17104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11800/0x95459fb9d1d2a208 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831134.464570:0:17104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11800/0x95459fb9d1d2a208 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831134.464586:0:17104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233bf11800 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:0.0:1787831134.464591:0:17104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11800/0x95459fb9d1d2a208 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831134.464599:0:17104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11800/0x95459fb9d1d2a208 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831134.464617:0:17104:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d233a6f8800) 00010000:00010000:0.0:1787831134.464621:0:17104:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787831134.464663:0:17104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11800/0x95459fb9d1d2a208 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831134.464670:0:17104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11800/0x95459fb9d1d2a208 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831134.464686:0:17104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11c00/0x95459fb9d1d2a20f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831134.464693:0:17104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11c00/0x95459fb9d1d2a20f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831134.464699:0:17104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11c00/0x95459fb9d1d2a20f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831134.464704:0:17104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233bf11c00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:0.0:1787831134.464707:0:17104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11c00/0x95459fb9d1d2a20f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831134.464713:0:17104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11c00/0x95459fb9d1d2a20f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831134.464731:0:17104:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8d220274c100) 00010000:00010000:0.0:1787831134.464733:0:17104:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787831134.464737:0:17104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11c00/0x95459fb9d1d2a20f lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831134.464742:0:17104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11c00/0x95459fb9d1d2a20f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831134.464768:0:17104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11600/0x95459fb9d1d2a201 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994242bc expref: 42 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831134.464781:0:17104:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11200/0x95459fb9d1d2a216 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994242bc expref: 41 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831134.464788:0:17104:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d220274c900) 00010000:00010000:0.0:1787831134.464790:0:17104:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787831134.464797:0:17104:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233bf11200, rc 0) 00000100:00100000:0.0:1787831134.464862:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2309cfb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+41:15699:x1874676433421824:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 707us (1006us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831134.464869:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 58 00000100:00100000:1.0:1787831134.951799:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a20f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443956736:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787831134.951982:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831134.952105:0:18612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443956736 00000100:00100000:2.0:1787831134.952115:0:18612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443956736 00000100:00100000:2.0:1787831134.952200:0:18612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787831134.952213:0:18612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204556580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1874676443956736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787831134.952314:0:18612:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787831134.953073:0:18612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204556580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1874676443956736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 784us (1012us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831134.953084:0:18612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787831134.953859:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a20f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443956736:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1787831135.078241:0:20279:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787831135.078252:0:20279:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787831135.078285:0:20279:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1787831135.078292:0:20279:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1787831135.143071:0:18633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787831135.398969:0:17139:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787831135.398981:0:17139:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787831135.399030:0:17139:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1787831135.399041:0:17139:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000040:00080000:2.0:1787831135.399384:0:17855:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787831135.399564:0:17139:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2309cfbc00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17139:1874676443956864:192.168.203.31@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787831135.399735:0:17139:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2335786480 going to sleep for 11 seconds 00000100:00100000:0.0:1787831135.411306:0:17139:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2309cfbc00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17139:1874676443956864:192.168.203.31@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787831135.411705:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831135.411772:0:18518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433421952 00000100:00100000:0.0:1787831135.411786:0:18518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433421952 00000100:00100000:0.0:1787831135.411993:0:18518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 59 00000100:00100000:0.0:1787831135.412006:0:18518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2309cfbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+41:15711:x1874676433421952:12345-192.168.203.31@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787831135.412074:0:18518:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787831135.412244:0:18518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2309cfbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+41:15711:x1874676433421952:12345-192.168.203.31@tcp:53:lhsmtool_posix.0 Request processed in 240us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831135.412253:0:18518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 59 00000100:00100000:3.0:1787831135.416998:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831135.417110:0:19892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433422080 00000100:00100000:2.0:1787831135.417124:0:19892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433422080 00000100:00100000:2.0:1787831135.417261:0:19892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 60 00000100:00100000:2.0:1787831135.417275:0:19892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2309cfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+41:15711:x1874676433422080:12345-192.168.203.31@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787831135.417377:0:19892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d2a21d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831135.417398:0:19892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d2a21d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831135.417438:0:19892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d2a21d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831135.419464:0:19892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0000/0x95459fb9d1d2a224 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831135.419487:0:19892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0000/0x95459fb9d1d2a224 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831135.419500:0:19892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0000/0x95459fb9d1d2a224 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831135.419660:0:19892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1000/0x95459fb9d1d2a22b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831135.419670:0:19892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1000/0x95459fb9d1d2a22b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831135.419678:0:19892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1000/0x95459fb9d1d2a22b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787831135.419741:0:19892:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1787831135.419745:0:19892:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787831135.419762:0:19892:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1000/0x95459fb9d1d2a22b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831135.419782:0:19892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d2a21d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831135.419792:0:19892:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d2a21d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831135.419815:0:19892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d2a21d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831135.419821:0:19892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22039c0a00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:2.0:1787831135.419824:0:19892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d2a21d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831135.419832:0:19892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d2a21d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831135.419843:0:19892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d220274c300) 00010000:00010000:2.0:1787831135.419846:0:19892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787831135.419850:0:19892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d2a21d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831135.419857:0:19892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d2a21d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831135.419871:0:19892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0000/0x95459fb9d1d2a224 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831135.419877:0:19892:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0000/0x95459fb9d1d2a224 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831135.419883:0:19892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0000/0x95459fb9d1d2a224 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831135.419888:0:19892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22039c0000 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:2.0:1787831135.419891:0:19892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0000/0x95459fb9d1d2a224 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831135.419916:0:19892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0000/0x95459fb9d1d2a224 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831135.419925:0:19892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff8d2303e42400) 00010000:00010000:2.0:1787831135.419927:0:19892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787831135.419930:0:19892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0000/0x95459fb9d1d2a224 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831135.419937:0:19892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0000/0x95459fb9d1d2a224 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831135.419957:0:19892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1000/0x95459fb9d1d2a22b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831135.419963:0:19892:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1000/0x95459fb9d1d2a22b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831135.419968:0:19892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1000/0x95459fb9d1d2a22b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831135.419974:0:19892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22039c1000 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:2.0:1787831135.419977:0:19892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1000/0x95459fb9d1d2a22b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831135.419982:0:19892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1000/0x95459fb9d1d2a22b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831135.419988:0:19892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d220274c900) 00010000:00010000:2.0:1787831135.419990:0:19892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787831135.419993:0:19892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1000/0x95459fb9d1d2a22b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831135.420007:0:19892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1000/0x95459fb9d1d2a22b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831135.420095:0:19892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2309cfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+41:15711:x1874676433422080:12345-192.168.203.31@tcp:34:lhsmtool_posix.0 Request processed in 2819us (3106us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831135.420106:0:19892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 60 00000100:00100000:1.0:1787831135.423234:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831135.423620:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433422336 00000100:00100000:3.0:1787831135.423680:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433422336 00000100:00100000:3.0:1787831135.423757:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 61 00000100:00100000:3.0:1787831135.423768:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22045543c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+41:15711:x1874676433422336:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787831135.423795:0:17105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787831135.423822:0:17105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668800/0x95459fb9d1d2a232 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a994242c3 expref: -99 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831135.424470:0:17105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669600/0x95459fb9d1d2a239 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831135.424491:0:17105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669600/0x95459fb9d1d2a239 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831135.424504:0:17105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669600/0x95459fb9d1d2a239 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787831135.424518:0:17105:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1787831135.427196:0:17105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669600/0x95459fb9d1d2a239 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831135.427218:0:17105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669600/0x95459fb9d1d2a239 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831135.427228:0:17105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669600/0x95459fb9d1d2a239 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831135.427236:0:17105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2301669600 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:3.0:1787831135.427267:0:17105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669600/0x95459fb9d1d2a239 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831135.427277:0:17105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669600/0x95459fb9d1d2a239 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831135.427301:0:17105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d220274c900) 00010000:00010000:3.0:1787831135.427305:0:17105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787831135.427311:0:17105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669600/0x95459fb9d1d2a239 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831135.427318:0:17105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669600/0x95459fb9d1d2a239 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831135.427402:0:17105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668800/0x95459fb9d1d2a232 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994242c3 expref: 43 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831135.427415:0:17105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d220274c300) 00010000:00010000:3.0:1787831135.427418:0:17105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787831135.427422:0:17105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668800/0x95459fb9d1d2a232 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994242c3 expref: 43 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831135.427433:0:17105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2301668800, rc 0) 00000100:00100000:3.0:1787831135.427536:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22045543c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+42:15711:x1874676433422336:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 3767us (4316us total) trans 8589934622 rc 301/301 00000100:00100000:3.0:1787831135.427546:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 61 00000100:00100000:3.0:1787831135.433993:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831135.434337:0:18518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433422464 00000100:00100000:0.0:1787831135.434351:0:18518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433422464 00000100:00100000:0.0:1787831135.434699:0:18518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 62 00000100:00100000:0.0:1787831135.434713:0:18518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2309cfa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+42:15711:x1874676433422464:12345-192.168.203.31@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787831135.434769:0:18518:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787831135.434957:0:18518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2309cfa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+42:15711:x1874676433422464:12345-192.168.203.31@tcp:53:lhsmtool_posix.0 Request processed in 247us (978us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831135.434967:0:18518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 62 00000100:00100000:2.0:1787831135.438341:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831135.438509:0:19892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433422720 00000100:00100000:3.0:1787831135.438522:0:19892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433422720 00000100:00100000:3.0:1787831135.438730:0:19892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 63 00000100:00100000:3.0:1787831135.438762:0:19892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2314e71680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+42:15711:x1874676433422720:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787831135.438790:0:19892:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787831135.438795:0:19892:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787831135.438835:0:19892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95e00/0x95459fb9d1d2a1f3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994242b5 expref: 42 pid: 19892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831135.438863:0:19892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d233a6f8800) 00010000:00010000:3.0:1787831135.438869:0:19892:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787831135.438890:0:19892:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668600/0x95459fb9d1d2a247 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a994242ca expref: -99 pid: 19892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787831135.439945:0:19892:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x6:0x0], count =28 00000004:00080000:3.0:1787831135.439958:0:19892:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x6:0x0]+28 in llog 00000004:00080000:3.0:1787831135.439984:0:19892:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x22:0x0], index 0: 0 00010000:00010000:3.0:1787831135.440185:0:19892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668e00/0x95459fb9d1d2a24e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831135.440203:0:19892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668e00/0x95459fb9d1d2a24e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831135.440215:0:19892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668e00/0x95459fb9d1d2a24e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831135.440291:0:19892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668600/0x95459fb9d1d2a247 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994242ca expref: 44 pid: 19892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831135.440313:0:19892:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668e00/0x95459fb9d1d2a24e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994242ca expref: 43 pid: 19892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831135.440343:0:19892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d233a6f8c00) 00010000:00010000:3.0:1787831135.440346:0:19892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787831135.440349:0:19892:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2301668e00, rc 0) 00000100:00100000:3.0:1787831135.441208:0:19892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2314e71680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+43:15711:x1874676433422720:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 2441us (2873us total) trans 8589934623 rc 0/0 00000100:00100000:3.0:1787831135.441221:0:19892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 63 00000100:00100000:2.0:1787831135.447743:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831135.447878:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433422976 00000100:00100000:3.0:1787831135.447892:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433422976 00000100:00100000:3.0:1787831135.447979:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 64 00000100:00100000:3.0:1787831135.447992:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2314e70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+43:15711:x1874676433422976:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787831135.448077:0:17105:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787831135.448119:0:17105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668e00/0x95459fb9d1d2a24e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994242ca expref: 43 pid: 19892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831135.448144:0:17105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d233a6f8c00) 00010000:00010000:3.0:1787831135.448158:0:17105:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787831135.448188:0:17105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668600/0x95459fb9d1d2a25c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831135.448206:0:17105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668600/0x95459fb9d1d2a25c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831135.448218:0:17105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668600/0x95459fb9d1d2a25c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831135.448233:0:17105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668800/0x95459fb9d1d2a263 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x695f48d7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831135.448266:0:17105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668800/0x95459fb9d1d2a263 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x695f48d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831135.448274:0:17105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668800/0x95459fb9d1d2a263 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x695f48d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831135.448341:0:17105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668600/0x95459fb9d1d2a25c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831135.449596:0:17105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668600/0x95459fb9d1d2a25c lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831135.449606:0:17105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668600/0x95459fb9d1d2a25c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831135.449613:0:17105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2301668600 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:3.0:1787831135.449619:0:17105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668600/0x95459fb9d1d2a25c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831135.449645:0:17105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668600/0x95459fb9d1d2a25c lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831135.449663:0:17105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d233a6f8800) 00010000:00010000:3.0:1787831135.449667:0:17105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787831135.449672:0:17105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668600/0x95459fb9d1d2a25c lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831135.449679:0:17105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668600/0x95459fb9d1d2a25c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831135.449701:0:17105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668800/0x95459fb9d1d2a263 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x695f48d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831135.449728:0:17105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668800/0x95459fb9d1d2a263 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x695f48d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831135.449734:0:17105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668800/0x95459fb9d1d2a263 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x695f48d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831135.449739:0:17105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2301668800 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:3.0:1787831135.449743:0:17105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668800/0x95459fb9d1d2a263 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x695f48d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831135.449749:0:17105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668800/0x95459fb9d1d2a263 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x695f48d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831135.449759:0:17105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x695f48d7 (ffff8d233a6f8100) 00010000:00010000:3.0:1787831135.449761:0:17105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787831135.449764:0:17105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668800/0x95459fb9d1d2a263 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x695f48d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831135.449770:0:17105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668800/0x95459fb9d1d2a263 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x695f48d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831135.450950:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2314e70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+42:15711:x1874676433422976:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 Request processed in 2945us (3207us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787831135.450967:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 64 00000100:00100000:2.0:1787831135.456373:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831135.456471:0:18518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433423104 00000100:00100000:0.0:1787831135.456485:0:18518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433423104 00000100:00100000:0.0:1787831135.456571:0:18518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 65 00000100:00100000:0.0:1787831135.456583:0:18518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2314e70780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+42:15711:x1874676433423104:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787831135.456703:0:18518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787831135.456734:0:18518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11800/0x95459fb9d1d2a26a lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a994242d1 expref: -99 pid: 18518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831135.456782:0:18518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10200/0x95459fb9d1d2a271 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831135.456800:0:18518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10200/0x95459fb9d1d2a271 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831135.456814:0:18518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10200/0x95459fb9d1d2a271 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831135.457006:0:18518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11800/0x95459fb9d1d2a26a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994242d1 expref: 44 pid: 18518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831135.457034:0:18518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10200/0x95459fb9d1d2a271 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994242d1 expref: 43 pid: 18518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831135.457044:0:18518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d2320608500) 00010000:00010000:0.0:1787831135.457048:0:18518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787831135.457052:0:18518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233bf10200, rc 0) 00000100:00100000:0.0:1787831135.457137:0:18518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2314e70780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+43:15711:x1874676433423104:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 556us (791us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831135.457145:0:18518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 65 00000100:00100000:0.0:1787831135.462880:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22045552c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676443956992:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787831135.463386:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831135.463685:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443956992 00000100:00100000:1.0:1787831135.463696:0:17110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443956992 00000100:00100000:1.0:1787831135.463775:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787831135.463797:0:17110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a20f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1874676443956992:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787831135.463842:0:17110:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787831135.463926:0:17110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a20f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1874676443956992:12345-0@lo:41:osp-pre-1-0.0 Request processed in 131us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831135.463933:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787831135.464084:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22045552c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676443956992:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787831135.464265:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831135.464323:0:19892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433423360 00000100:00100000:2.0:1787831135.464330:0:19892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433423360 00000100:00100000:2.0:1787831135.464379:0:19892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 66 00000100:00100000:2.0:1787831135.464388:0:19892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2309cf83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+43:15711:x1874676433423360:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787831135.464489:0:19892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1800/0x95459fb9d1d2a278 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831135.464525:0:19892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1800/0x95459fb9d1d2a278 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831135.464540:0:19892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1800/0x95459fb9d1d2a278 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787831135.465356:0:19892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:2.0:1787831135.465373:0:19892:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 426465747177ns, next at 427465744135ns, rc = 0 00000004:00010000:2.0:1787831135.465457:0:19892:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f45e5929 reply state 00000000c4ddb66d transno 8589934624 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1800/0x95459fb9d1d2a278 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831135.465493:0:19892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1800/0x95459fb9d1d2a278 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831135.465503:0:19892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d2320608500) 00010000:00010000:2.0:1787831135.465506:0:19892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1787831135.465512:0:19892:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787831135.465683:0:19892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2309cf83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+45:15711:x1874676433423360:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 Request processed in 1293us (1417us total) trans 8589934624 rc 0/0 00000100:00100000:2.0:1787831135.465693:0:19892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 66 00000100:00100000:2.0:1787831135.469064:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831135.469152:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433423488 00000100:00100000:0.0:1787831135.469164:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433423488 00000100:00100000:0.0:1787831135.469239:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 67 00000100:00100000:0.0:1787831135.469252:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2334489a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+45:15711:x1874676433423488:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787831135.469284:0:17105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787831135.469314:0:17105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11800/0x95459fb9d1d2a27f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a994242d8 expref: -99 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831135.469391:0:17105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11800/0x95459fb9d1d2a27f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994242d8 expref: 46 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831135.469429:0:17105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11800/0x95459fb9d1d2a27f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994242d8 expref: 46 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831135.469454:0:17105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d2320608500) 00010000:00010000:0.0:1787831135.469458:0:17105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787831135.469462:0:17105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233bf11800, rc 0) 00000100:00100000:0.0:1787831135.469842:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2334489a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+46:15711:x1874676433423488:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 591us (1062us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831135.469850:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 67 00000100:00100000:2.0:1787831135.474156:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831135.474385:0:18610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433423616 00000100:00100000:1.0:1787831135.474397:0:18610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433423616 00000100:00100000:1.0:1787831135.474511:0:18610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 21 00000100:00100000:1.0:1787831135.474525:0:18610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2334488f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+5:2396:x1874676433423616:12345-192.168.203.31@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1787831135.474939:0:18610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2334488f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+6:2396:x1874676433423616:12345-192.168.203.31@tcp:2:lhsmtool_posix.0 Request processed in 415us (794us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1787831135.474948:0:18610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 21 00000100:00080000:0.0:1787831135.475107:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787831135.480014:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831135.480243:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433423872 00000100:00100000:0.0:1787831135.480257:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433423872 00000100:00100000:0.0:1787831135.480379:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 13 00000100:00100000:0.0:1787831135.480390:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2309cf9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+46:15711:x1874676433423872:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787831135.480731:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2309cf9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+47:15711:x1874676433423872:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 Request processed in 342us (731us total) trans 8589934625 rc 0/0 00000100:00100000:0.0:1787831135.480739:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 13 00000100:00100000:3.0:1787831135.483566:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831135.484902:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433424128 00000100:00100000:1.0:1787831135.484934:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433424128 00000100:00100000:1.0:1787831135.485297:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 68 00000100:00100000:1.0:1787831135.485314:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2318d543c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+47:15711:x1874676433424128:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787831135.485706:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2318d543c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+47:15711:x1874676433424128:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 Request processed in 396us (2155us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831135.485738:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 68 00000100:00100000:2.0:1787831135.492148:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831135.492275:0:19892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433424256 00000100:00100000:3.0:1787831135.493103:0:19892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433424256 00000100:00100000:3.0:1787831135.493197:0:19892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 69 00000100:00100000:3.0:1787831135.493209:0:19892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fa4bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+47:15711:x1874676433424256:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787831135.493239:0:19892:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787831135.493281:0:19892:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668800/0x95459fb9d1d2a286 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a994242df expref: -99 pid: 19892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831135.493378:0:19892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668600/0x95459fb9d1d2a28d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831135.493396:0:19892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668600/0x95459fb9d1d2a28d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831135.493411:0:19892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668600/0x95459fb9d1d2a28d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787831135.493472:0:19892:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787831135.493497:0:19892:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668600/0x95459fb9d1d2a28d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831135.493530:0:19892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668800/0x95459fb9d1d2a286 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994242df expref: 49 pid: 19892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831135.493553:0:19892:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668600/0x95459fb9d1d2a28d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994242df expref: 48 pid: 19892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831135.493563:0:19892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d2320608500) 00010000:00010000:3.0:1787831135.493567:0:19892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787831135.493571:0:19892:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2301668600, rc 0) 00000100:00100000:3.0:1787831135.493770:0:19892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fa4bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+48:15711:x1874676433424256:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 564us (1638us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831135.493780:0:19892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 69 00000100:00100000:3.0:1787831135.500521:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831135.501829:0:19566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433424384 00000100:00100000:0.0:1787831135.501848:0:19566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433424384 00000100:00100000:1.0:1787831135.502390:0:19566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 22 00000100:00100000:1.0:1787831135.502403:0:19566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2318d57840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+6:2397:x1874676433424384:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787831135.502428:0:19566:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787831135.502458:0:19566:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5b405b6/0x95459fb9d1d2a294 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a994242e6 expref: -99 pid: 19566 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787831135.502495:0:19566:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a90235f, blocks: 0x0 00010000:00010000:1.0:1787831135.502524:0:19566:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=426s v=(0 0) 00010000:00010000:1.0:1787831135.502530:0:19566:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787831135.502734:0:19566:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5b405b6/0x95459fb9d1d2a294 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994242e6 expref: 7 pid: 19566 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831135.502761:0:19566:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b5b405b6/0x95459fb9d1d2a294 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994242e6 expref: 7 pid: 19566 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831135.502780:0:19566:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233be95a00, rc 0) 00000100:00100000:1.0:1787831135.502865:0:19566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2318d57840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+7:2397:x1874676433424384:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 464us (2364us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831135.502872:0:19566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 22 00000100:00100000:2.0:1787831135.507298:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831135.507394:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433424640 00000100:00100000:0.0:1787831135.507407:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433424640 00000100:00100000:0.0:1787831135.507487:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 70 00000100:00100000:0.0:1787831135.507497:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fa48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+48:15711:x1874676433424640:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787831135.510175:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fa48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+48:15711:x1874676433424640:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 Request processed in 2659us (2871us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831135.510219:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 70 00000100:00100000:2.0:1787831135.515307:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831135.515482:0:18608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433424768 00000100:00100000:0.0:1787831135.515498:0:18608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433424768 00000100:00100000:0.0:1787831135.515664:0:18608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 23 00000100:00100000:0.0:1787831135.515676:0:18608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fa49e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+7:15711:x1874676433424768:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787831135.515700:0:18608:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787831135.515725:0:18608:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005a8e188d/0x95459fb9d1d2a29b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a994242ed expref: -99 pid: 18608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831135.515766:0:18608:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b5b405b6/0x95459fb9d1d2a294 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994242e6 expref: 8 pid: 19566 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831135.515776:0:18608:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787831135.515781:0:18608:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787831135.515786:0:18608:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a8e188d/0x95459fb9d1d2a29b lrc: 4/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994242ed expref: 8 pid: 18608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831135.515864:0:18608:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b5b405b6/0x95459fb9d1d2a294 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.31@tcp remote: 0xe558a92a994242e6 expref: 8 pid: 19566 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831135.515880:0:18608:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b5b405b6/0x95459fb9d1d2a294 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a994242e6 expref: 8 pid: 19566 timeout: 526 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831135.515897:0:18608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233fb11680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:18608:1874676443957120:192.168.203.31@tcp:104: 00000100:00100000:0.0:1787831135.516013:0:18608:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d233bcbca80 going to sleep for 11 seconds 00000100:00100000:2.0:1787831135.519544:0:18608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233fb11680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:18608:1874676443957120:192.168.203.31@tcp:104: 00010000:00010000:2.0:1787831135.519597:0:18608:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005a8e188d/0x95459fb9d1d2a29b lrc: 3/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xe558a92a994242ed expref: 8 pid: 18608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831135.520053:0:18608:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233bf10600, rc 0) 00000100:00100000:2.0:1787831135.520420:0:18608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fa49e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+8:15711:x1874676433424768:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 4741us (5136us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831135.520432:0:18608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 23 00000100:00100000:3.0:1787831135.520711:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831135.520870:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433424896 00000100:00100000:2.0:1787831135.520879:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433424896 00010000:00010000:2.0:1787831135.520931:0:17089:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b5b405b6/0x95459fb9d1d2a294 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a994242e6 expref: 8 pid: 19566 timeout: 526 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831135.520986:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 22 00000100:00100000:2.0:1787831135.520996:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233faea940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+8:2396:x1874676433424896:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787831135.521015:0:17089:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787831135.521044:0:17089:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b5b405b6/0x95459fb9d1d2a294 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a994242e6 expref: 8 pid: 19566 timeout: 526 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831135.521060:0:17089:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b5b405b6/0x95459fb9d1d2a294 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a994242e6 expref: 8 pid: 19566 timeout: 526 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831135.521097:0:17089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5b405b6/0x95459fb9d1d2a294 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a994242e6 expref: 8 pid: 19566 timeout: 526 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831135.521226:0:17089:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787831135.521233:0:17089:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787831135.521245:0:17089:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005a8e188d/0x95459fb9d1d2a29b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0xe558a92a994242ed expref: 7 pid: 18608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831135.521257:0:17089:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a8e188d/0x95459fb9d1d2a29b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0xe558a92a994242ed expref: 7 pid: 18608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831135.521304:0:17089:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000005a8e188d/0x95459fb9d1d2a29b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xe558a92a994242ed expref: 7 pid: 18608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831135.521322:0:17089:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233fa49a40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:17089:1874676443957248:192.168.203.31@tcp:105: 00000100:00100000:2.0:1787831135.521427:0:17089:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d230879af00 going to sleep for 11 seconds 00000100:00100000:0.0:1787831135.528404:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831135.529226:0:18613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433425024 00000100:00100000:3.0:1787831135.529244:0:18613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433425024 00002000:00100000:3.0:1787831135.529320:0:18613:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x22:0x0] (0->8) req@ffff8d233fb112c0 x1874676433425024/t0(0) o4->2240faf2-2a81-4e92-bb4c-b58ed0f19f2a@192.168.203.31@tcp:206/0 lens 504/0 e 0 to 0 dl 1787831146 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:100 00002000:00100000:3.0:1787831135.529333:0:18613:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d233fb112c0 with x1874676433425024 ext(0->8) 00002000:00010000:3.0:1787831135.529342:0:18613:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d233fb112c0 00000100:00100000:2.0:1787831135.529364:0:17089:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233fa49a40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:17089:1874676443957248:192.168.203.31@tcp:105: 00010000:00010000:2.0:1787831135.529399:0:17089:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787831135.529400:0:18613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 0 00000100:00100000:3.0:1787831135.529414:0:18613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb112c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+8:2397:x1874676433425024:12345-192.168.203.31@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787831135.529485:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233faea940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+8:2396:x1874676433424896:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 8488us (8774us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831135.529500:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 22 00000100:00100000:2.0:1787831135.531813:0:18613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb112c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+9:2397:x1874676433425024:12345-192.168.203.31@tcp:4:lhsmtool_posix.0 Request processed in 2386us (3410us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1787831135.531837:0:18613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 0 00002000:00100000:2.0:1787831135.531853:0:18613:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x22:0x0] (0->8) req@ffff8d233fb112c0 x1874676433425024/t8589934596(0) o4->2240faf2-2a81-4e92-bb4c-b58ed0f19f2a@192.168.203.31@tcp:206/0 lens 504/448 e 0 to 0 dl 1787831146 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:100 00002000:00100000:2.0:1787831135.531864:0:18613:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d233fb112c0 with x1874676433425024 ext(0->8) 00002000:00010000:2.0:1787831135.531872:0:18613:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d233fb112c0 00000100:00100000:1.0:1787831135.539919:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831135.540083:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433425152 00000100:00100000:3.0:1787831135.540095:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433425152 00000100:00100000:3.0:1787831135.540178:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 71 00000100:00100000:3.0:1787831135.540195:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22045552c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+48:15711:x1874676433425152:12345-192.168.203.31@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1787831135.545400:0:17084:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934625 is committed 00000004:00080000:3.0:1787831135.545423:0:17084:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:2.0:1787831135.545727:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233fa49a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443957376:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1787831135.545821:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831135.545914:0:18914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443957376 00000100:00100000:2.0:1787831135.545925:0:18914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443957376 00010000:00010000:0.0:1787831135.546113:0:3606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d2a002 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831135.546127:0:3606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d2a002 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831135.546136:0:3606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d2a002 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831135.546144:0:3606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2307c76400 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:0.0:1787831135.546149:0:3606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d2a002 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831135.546159:0:3606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d2a002 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831135.546180:0:3606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8d233a6f8f00) 00010000:00010000:0.0:1787831135.546184:0:3606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787831135.546191:0:3606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d2a002 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831135.546198:0:3606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c76400/0x95459fb9d1d2a002 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831135.546225:0:3606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d2a009 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831135.546231:0:3606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d2a009 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831135.546238:0:3606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d2a009 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831135.546257:0:3606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2307c77a00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:0.0:1787831135.546261:0:3606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d2a009 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831135.546267:0:3606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d2a009 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831135.546275:0:3606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d233a6f8800) 00010000:00010000:0.0:1787831135.546278:0:3606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787831135.546281:0:3606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d2a009 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831135.546286:0:3606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2307c77a00/0x95459fb9d1d2a009 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831135.546301:0:3606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94600/0x95459fb9d1d2a0b1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831135.546307:0:3606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94600/0x95459fb9d1d2a0b1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831135.546313:0:3606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94600/0x95459fb9d1d2a0b1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831135.546318:0:3606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233be94600 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:0.0:1787831135.546321:0:3606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94600/0x95459fb9d1d2a0b1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831135.546328:0:3606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94600/0x95459fb9d1d2a0b1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831135.546347:0:3606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8d220274c100) 00010000:00010000:0.0:1787831135.546350:0:3606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787831135.546353:0:3606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94600/0x95459fb9d1d2a0b1 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831135.546360:0:3606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94600/0x95459fb9d1d2a0b1 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831135.546377:0:3606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95c00/0x95459fb9d1d2a121 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831135.546383:0:3606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95c00/0x95459fb9d1d2a121 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831135.546389:0:3606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95c00/0x95459fb9d1d2a121 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831135.546394:0:3606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233be95c00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:0.0:1787831135.546397:0:3606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95c00/0x95459fb9d1d2a121 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831135.546402:0:3606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95c00/0x95459fb9d1d2a121 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831135.546409:0:3606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d220274c900) 00010000:00010000:0.0:1787831135.546412:0:3606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787831135.546415:0:3606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95c00/0x95459fb9d1d2a121 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831135.546421:0:3606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95c00/0x95459fb9d1d2a121 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831135.546443:0:3606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11e00/0x95459fb9d1d2a144 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831135.546449:0:3606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11e00/0x95459fb9d1d2a144 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831135.546455:0:3606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11e00/0x95459fb9d1d2a144 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831135.546460:0:3606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233bf11e00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:0.0:1787831135.546463:0:3606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11e00/0x95459fb9d1d2a144 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831135.546470:0:3606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11e00/0x95459fb9d1d2a144 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831135.546479:0:3606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d220274c900) 00010000:00010000:0.0:1787831135.546481:0:3606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787831135.546484:0:3606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11e00/0x95459fb9d1d2a144 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831135.546489:0:3606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11e00/0x95459fb9d1d2a144 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831135.546502:0:3606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669c00/0x95459fb9d1d2a18a lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831135.546508:0:3606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669c00/0x95459fb9d1d2a18a lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831135.546515:0:3606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669c00/0x95459fb9d1d2a18a lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831135.546527:0:3606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2301669c00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:0.0:1787831135.546531:0:3606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669c00/0x95459fb9d1d2a18a lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831135.546537:0:3606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669c00/0x95459fb9d1d2a18a lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831135.546546:0:3606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d220274c900) 00010000:00010000:0.0:1787831135.546548:0:3606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787831135.546551:0:3606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669c00/0x95459fb9d1d2a18a lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831135.546557:0:3606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669c00/0x95459fb9d1d2a18a lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831135.546571:0:3606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1800/0x95459fb9d1d2a278 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831135.546577:0:3606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1800/0x95459fb9d1d2a278 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831135.546584:0:3606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1800/0x95459fb9d1d2a278 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831135.546590:0:3606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22039c1800 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:0.0:1787831135.546593:0:3606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1800/0x95459fb9d1d2a278 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831135.546599:0:3606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1800/0x95459fb9d1d2a278 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831135.546618:0:3606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d2320608500) 00010000:00010000:0.0:1787831135.546620:0:3606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787831135.546670:0:3606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1800/0x95459fb9d1d2a278 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831135.546677:0:3606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1800/0x95459fb9d1d2a278 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831135.546712:0:18609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787831135.546726:0:18609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fa48780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676443957376:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1787831135.546894:0:18609:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1787831135.546898:0:18609:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1787831136 00002000:00010000:0.0:1787831135.546901:0:18609:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1787831135.546903:0:18609:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1787831135 -> 1787831136 00002000:00010000:0.0:1787831135.546922:0:18609:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1787831135.547008:0:18609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fa48780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3619:x1874676443957376:12345-0@lo:2:osp-syn-0-0.0 Request processed in 286us (1186us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1787831135.547018:0:18609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000004:00080000:0.0:1787831135.547078:0:3619:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d233fa49a40/2, rc 0, transno 8589934597 00000100:00100000:0.0:1787831135.547084:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233fa49a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443957376:0@lo:2:osp-syn-0-0.0 00000001:00080000:3.0:1787831135.547295:0:17084:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:2.0:1787831135.547545:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22045552c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+14:15711:x1874676433425152:12345-192.168.203.31@tcp:44:lhsmtool_posix.0 Request processed in 7354us (7648us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831135.547556:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 71 00010000:00010000:1.0:1787831135.548759:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11a00/0x95459fb9d1d2a056 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831135.548776:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11a00/0x95459fb9d1d2a056 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831135.548791:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11a00/0x95459fb9d1d2a056 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831135.548798:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233bf11a00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:1.0:1787831135.548804:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11a00/0x95459fb9d1d2a056 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831135.548813:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11a00/0x95459fb9d1d2a056 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831135.548830:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d233a6f8800) 00010000:00010000:1.0:1787831135.548833:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1787831135.548838:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11a00/0x95459fb9d1d2a056 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831135.548844:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11a00/0x95459fb9d1d2a056 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831135.551293:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831135.551896:0:19566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433425280 00000100:00100000:1.0:1787831135.551920:0:19566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433425280 00000100:00100000:1.0:1787831135.552105:0:19566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 25 00000100:00100000:1.0:1787831135.552176:0:19566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb10f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+9:2395:x1874676433425280:12345-192.168.203.31@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1787831135.554567:0:18604:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00000001:00080000:2.0:1787831135.554583:0:18604:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934596 is committed 00000100:00100000:1.0:1787831135.554801:0:19566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb10f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+6:2395:x1874676433425280:12345-192.168.203.31@tcp:16:lhsmtool_posix.0 Request processed in 2623us (3515us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831135.554813:0:19566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 25 00000100:00100000:0.0:1787831135.559949:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831135.560150:0:18518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433425536 00000100:00100000:3.0:1787831135.560164:0:18518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433425536 00000100:00100000:3.0:1787831135.560248:0:18518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 72 00000100:00100000:3.0:1787831135.560259:0:18518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb130c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+14:15711:x1874676433425536:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787831135.560338:0:18518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787831135.560374:0:18518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668600/0x95459fb9d1d2a28d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994242df expref: 14 pid: 19892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831135.560401:0:18518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d2320608500) 00010000:00010000:3.0:1787831135.560407:0:18518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787831135.560453:0:18518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668800/0x95459fb9d1d2a2a2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831135.560490:0:18518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668800/0x95459fb9d1d2a2a2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831135.560503:0:18518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668800/0x95459fb9d1d2a2a2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787831135.561092:0:18518:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003f598ef5 reply state 00000000ce3c90c1 transno 8589934626 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668800/0x95459fb9d1d2a2a2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831135.561122:0:18518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668800/0x95459fb9d1d2a2a2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831135.561147:0:18518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d2320608500) 00010000:00010000:2.0:1787831135.561150:0:18518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787831135.561154:0:18518:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787831135.561296:0:18518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb130c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+15:15711:x1874676433425536:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 Request processed in 1034us (1360us total) trans 8589934626 rc 0/0 00000100:00100000:2.0:1787831135.561305:0:18518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 72 00000100:00100000:2.0:1787831135.566266:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831135.570724:0:18608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433425664 00000100:00100000:0.0:1787831135.570741:0:18608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433425664 00000100:00100000:0.0:1787831135.570822:0:18608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 26 00000100:00100000:0.0:1787831135.570833:0:18608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2306e24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+6:2396:x1874676433425664:12345-192.168.203.31@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1787831135.571043:0:18608:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1787831135.571048:0:18608:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 1787831136 -> 1787831134 00002000:00010000:0.0:1787831135.571050:0:18608:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 0 -> 1787831133 00002000:00010000:0.0:1787831135.571052:0:18608:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1787831136 -> 1787831134 00002000:00010000:0.0:1787831135.571054:0:18608:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1787831135.571124:0:18608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2306e24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+7:2396:x1874676433425664:12345-192.168.203.31@tcp:2:lhsmtool_posix.0 Request processed in 292us (4866us total) trans 8589934598 rc 0/0 00000100:00100000:0.0:1787831135.571131:0:18608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 26 00000100:00100000:0.0:1787831135.576956:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831135.577244:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433425920 00000100:00100000:2.0:1787831135.577257:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433425920 00000100:00100000:2.0:1787831135.577525:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 73 00000100:00100000:2.0:1787831135.577540:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb10f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+15:15711:x1874676433425920:12345-192.168.203.31@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1787831135.577667:0:17105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1000/0x95459fb9d1d2a2a9 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831135.577689:0:17105:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10200/0x95459fb9d1d2a271 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994242d1 expref: 15 pid: 18518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831135.577700:0:17105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1000/0x95459fb9d1d2a2a9 lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831135.577744:0:17105:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10200/0x95459fb9d1d2a271 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0xe558a92a994242d1 expref: 15 pid: 18518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831135.577760:0:17105:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10200/0x95459fb9d1d2a271 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a994242d1 expref: 15 pid: 18518 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831135.577778:0:17105:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233fa4a940 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17105:1874676443957504:192.168.203.31@tcp:104: 00000100:00100000:2.0:1787831135.577944:0:17105:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d230879a000 going to sleep for 11 seconds 00000100:00100000:2.0:1787831135.580365:0:17105:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233fa4a940 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17105:1874676443957504:192.168.203.31@tcp:104: 00010000:00010000:2.0:1787831135.580404:0:17105:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1000/0x95459fb9d1d2a2a9 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831135.583527:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831135.583673:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433426048 00000100:00100000:2.0:1787831135.583695:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433426048 00010000:00010000:2.0:1787831135.583754:0:17090:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10200/0x95459fb9d1d2a271 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a994242d1 expref: 16 pid: 18518 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831135.583792:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 23 00000100:00100000:2.0:1787831135.583802:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb121c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+16:2396:x1874676433426048:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787831135.583834:0:17090:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787831135.583842:0:17090:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10200/0x95459fb9d1d2a271 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a994242d1 expref: 16 pid: 18518 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831135.583857:0:17090:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10200/0x95459fb9d1d2a271 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a994242d1 expref: 16 pid: 18518 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831135.583885:0:17090:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10200/0x95459fb9d1d2a271 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a994242d1 expref: 16 pid: 18518 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831135.584012:0:17090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d2320608500) 00010000:00010000:2.0:1787831135.584020:0:17090:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1000/0x95459fb9d1d2a2a9 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831135.584033:0:17090:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1000/0x95459fb9d1d2a2a9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831135.584067:0:17090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1000/0x95459fb9d1d2a2a9 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831135.584223:0:17090:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787831135.584310:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb121c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+15:2396:x1874676433426048:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 507us (796us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831135.584319:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 23 00010000:00010000:0.0:1787831135.585987:0:17105:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1000/0x95459fb9d1d2a2a9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831135.586008:0:17105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1000/0x95459fb9d1d2a2a9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831135.586240:0:17105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1000/0x95459fb9d1d2a2a9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831135.586250:0:17105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1000/0x95459fb9d1d2a2a9 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831135.586279:0:17105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1000/0x95459fb9d1d2a2a9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831135.586286:0:17105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22039c1000 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:1.0:1787831135.586291:0:17105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1000/0x95459fb9d1d2a2a9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831135.586300:0:17105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1000/0x95459fb9d1d2a2a9 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831135.586328:0:17105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d2320608500) 00010000:00010000:1.0:1787831135.586332:0:17105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787831135.586517:0:17105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1000/0x95459fb9d1d2a2a9 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831135.586526:0:17105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1000/0x95459fb9d1d2a2a9 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831135.587271:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb10f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+14:15711:x1874676433425920:12345-192.168.203.31@tcp:55:lhsmtool_posix.0 Request processed in 9725us (10320us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787831135.587285:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 73 00000100:00100000:0.0:1787831135.593000:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831135.593248:0:18914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433426176 00000100:00100000:1.0:1787831135.593264:0:18914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433426176 00000100:00100000:1.0:1787831135.593342:0:18914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 27 00000100:00100000:1.0:1787831135.593355:0:18914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb13c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+7:2397:x1874676433426176:12345-192.168.203.31@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787831135.593420:0:18914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005d39b78a/0x95459fb9d1d2a2b0 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831135.593448:0:18914:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005a8e188d/0x95459fb9d1d2a29b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xe558a92a994242ed expref: 7 pid: 18608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831135.593473:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787831135.593479:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787831135.593485:0:18914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d39b78a/0x95459fb9d1d2a2b0 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831135.593534:0:18914:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005a8e188d/0x95459fb9d1d2a29b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.31@tcp remote: 0xe558a92a994242ed expref: 7 pid: 18608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831135.593552:0:18914:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005a8e188d/0x95459fb9d1d2a29b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.31@tcp remote: 0xe558a92a994242ed expref: 7 pid: 18608 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831135.593573:0:18914:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2309d0b0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:18914:1874676443957632:192.168.203.31@tcp:104: 00000100:00100000:1.0:1787831135.593719:0:18914:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d23100e0540 going to sleep for 11 seconds 00000100:00100000:1.0:1787831135.596431:0:18914:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2309d0b0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:18914:1874676443957632:192.168.203.31@tcp:104: 00010000:00010000:1.0:1787831135.596478:0:18914:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005d39b78a/0x95459fb9d1d2a2b0 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831135.597972:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831135.598223:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433426304 00000100:00100000:3.0:1787831135.598234:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433426304 00010000:00010000:3.0:1787831135.598286:0:17091:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005a8e188d/0x95459fb9d1d2a29b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0xe558a92a994242ed expref: 8 pid: 18608 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787831135.598329:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 24 00000100:00100000:3.0:1787831135.598338:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb10000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+8:2397:x1874676433426304:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787831135.598358:0:17091:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787831135.598385:0:17091:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005a8e188d/0x95459fb9d1d2a29b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0xe558a92a994242ed expref: 8 pid: 18608 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831135.598400:0:17091:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005a8e188d/0x95459fb9d1d2a29b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.31@tcp remote: 0xe558a92a994242ed expref: 8 pid: 18608 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831135.598431:0:17091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005a8e188d/0x95459fb9d1d2a29b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.31@tcp remote: 0xe558a92a994242ed expref: 8 pid: 18608 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831135.598464:0:17091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787831135.598471:0:17091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787831135.598476:0:17091:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005d39b78a/0x95459fb9d1d2a2b0 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831135.598510:0:17091:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d39b78a/0x95459fb9d1d2a2b0 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831135.598548:0:17091:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787831135.598595:0:18914:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005d39b78a/0x95459fb9d1d2a2b0 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831135.598609:0:18914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005d39b78a/0x95459fb9d1d2a2b0 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787831135.598616:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb10000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+7:2397:x1874676433426304:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 278us (664us total) trans 0 rc 0/0 00010000:00010000:1.0:1787831135.598820:0:18914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005d39b78a/0x95459fb9d1d2a2b0 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831135.598839:0:18914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005d39b78a/0x95459fb9d1d2a2b0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831135.598848:0:18914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005d39b78a/0x95459fb9d1d2a2b0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831135.598856:0:18914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233be95800 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:1.0:1787831135.598861:0:18914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005d39b78a/0x95459fb9d1d2a2b0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831135.598872:0:18914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005d39b78a/0x95459fb9d1d2a2b0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787831135.598887:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 24 00010000:00010000:1.0:1787831135.598890:0:18914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005d39b78a/0x95459fb9d1d2a2b0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831135.598900:0:18914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d39b78a/0x95459fb9d1d2a2b0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831135.598989:0:18914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb13c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+6:2397:x1874676433426176:12345-192.168.203.31@tcp:1:lhsmtool_posix.0 Request processed in 5637us (6006us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831135.598999:0:18914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 27 00000100:00100000:0.0:1787831135.602085:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831135.602219:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433426560 00000100:00100000:2.0:1787831135.602232:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433426560 00000100:00100000:2.0:1787831135.602362:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 74 00000100:00100000:2.0:1787831135.602387:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb11e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+14:15711:x1874676433426560:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787831135.602503:0:17106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d2a2b7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831135.602521:0:17106:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95000/0x95459fb9d1d2a11a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a9942427d expref: 14 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831135.602532:0:17106:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d2a2b7 lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831135.602579:0:17106:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95000/0x95459fb9d1d2a11a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0xe558a92a9942427d expref: 14 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831135.602596:0:17106:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95000/0x95459fb9d1d2a11a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a9942427d expref: 14 pid: 17106 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831135.602614:0:17106:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233fa4a940 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17106:1874676443957760:192.168.203.31@tcp:104: 00000100:00100000:2.0:1787831135.602795:0:17106:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d230879a000 going to sleep for 11 seconds 00000100:00100000:2.0:1787831135.606104:0:17106:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233fa4a940 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17106:1874676443957760:192.168.203.31@tcp:104: 00010000:00010000:2.0:1787831135.606148:0:17106:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d2a2b7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831135.618257:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831135.618665:0:20128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433426688 00000100:00100000:0.0:1787831135.618679:0:20128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433426688 00010000:00010000:0.0:1787831135.618749:0:20128:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95000/0x95459fb9d1d2a11a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a9942427d expref: 15 pid: 17106 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831135.618800:0:20128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 25 00000100:00100000:0.0:1787831135.618811:0:20128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233c0e8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+15:2397:x1874676433426688:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787831135.618827:0:20128:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787831135.618850:0:20128:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95000/0x95459fb9d1d2a11a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a9942427d expref: 15 pid: 17106 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831135.618862:0:20128:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95000/0x95459fb9d1d2a11a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a9942427d expref: 15 pid: 17106 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831135.618886:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95000/0x95459fb9d1d2a11a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a9942427d expref: 15 pid: 17106 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831135.618918:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d220274c900) 00010000:00010000:0.0:1787831135.618926:0:20128:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d2a2b7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831135.618941:0:20128:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d2a2b7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831135.618950:0:20128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d2a2b7 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831135.618985:0:20128:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787831135.619137:0:17106:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d2a2b7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831135.619147:0:17106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d2a2b7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831135.619486:0:20128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233c0e8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+15:2397:x1874676433426688:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 673us (1243us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831135.619507:0:20128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 25 00010000:00010000:3.0:1787831135.619791:0:17106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668600/0x95459fb9d1d2a2be lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831135.619806:0:17106:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11800/0x95459fb9d1d2a27f lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994242d8 expref: 14 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831135.619814:0:17106:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668600/0x95459fb9d1d2a2be lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831135.619850:0:17106:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11800/0x95459fb9d1d2a27f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.31@tcp remote: 0xe558a92a994242d8 expref: 14 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831135.619865:0:17106:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11800/0x95459fb9d1d2a27f lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a994242d8 expref: 14 pid: 17105 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787831135.619902:0:17106:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233fae8b40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17106:1874676443957888:192.168.203.31@tcp:104: 00000100:00100000:3.0:1787831135.620324:0:17106:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2335786600 going to sleep for 11 seconds 00000100:00100000:2.0:1787831135.623093:0:17106:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233fae8b40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17106:1874676443957888:192.168.203.31@tcp:104: 00010000:00010000:2.0:1787831135.623138:0:17106:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668600/0x95459fb9d1d2a2be lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831135.624967:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831135.625332:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433426816 00000100:00100000:3.0:1787831135.625522:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433426816 00010000:00010000:3.0:1787831135.625581:0:17089:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11800/0x95459fb9d1d2a27f lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a994242d8 expref: 15 pid: 17105 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831135.625729:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 26 00000100:00100000:2.0:1787831135.625743:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fa4a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+15:2397:x1874676433426816:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787831135.625764:0:17091:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787831135.625773:0:17091:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11800/0x95459fb9d1d2a27f lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a994242d8 expref: 15 pid: 17105 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831135.625789:0:17091:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11800/0x95459fb9d1d2a27f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a994242d8 expref: 15 pid: 17105 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831135.625817:0:17091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11800/0x95459fb9d1d2a27f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a994242d8 expref: 15 pid: 17105 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831135.625839:0:17091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d2320608500) 00010000:00010000:2.0:1787831135.625846:0:17091:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668600/0x95459fb9d1d2a2be lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831135.625881:0:17091:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668600/0x95459fb9d1d2a2be lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831135.625891:0:17091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668600/0x95459fb9d1d2a2be lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831135.626113:0:17091:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787831135.626184:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fa4a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+14:2397:x1874676433426816:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 443us (1229us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831135.626193:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 26 00010000:00010000:3.0:1787831135.627274:0:17106:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668600/0x95459fb9d1d2a2be lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831135.627289:0:17106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668600/0x95459fb9d1d2a2be lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787831135.627570:0:17106:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934627 00000001:00080000:3.0:1787831135.627755:0:17106:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934628 00000001:00080000:3.0:1787831135.627785:0:17106:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934629 00000100:00100000:3.0:1787831135.627874:0:17106:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233faeb480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17106:1874676443958016:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787831135.628136:0:17106:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831135.628231:0:17106:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d23357869c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787831135.628280:0:19224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443958016 00000100:00100000:0.0:1787831135.628288:0:19224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443958016 00000100:00100000:0.0:1787831135.628577:0:19224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787831135.628589:0:19224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fae83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:17106:x1874676443958016:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787831135.628950:0:19224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fae83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:17106:x1874676443958016:12345-0@lo:1000:mdt00_002.0 Request processed in 362us (813us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831135.628959:0:19224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787831135.629163:0:17106:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:3.0:1787831135.629172:0:17106:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d233fa49a40, transno 8589934597 00000100:00100000:3.0:1787831135.629231:0:17106:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233faeb480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17106:1874676443958016:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1787831135.629453:0:17106:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934630 00000100:00100000:3.0:1787831135.629520:0:17106:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233faeb480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17106:1874676443958144:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787831135.629566:0:17106:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831135.629601:0:17106:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2335786b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787831135.629847:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443958144 00000100:00100000:1.0:1787831135.629855:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443958144 00000100:00100000:1.0:1787831135.629923:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787831135.629933:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233faeb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:17106:x1874676443958144:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787831135.630220:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233faeb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17106:x1874676443958144:12345-0@lo:1000:mdt00_002.0 Request processed in 288us (651us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1787831135.630227:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787831135.630677:0:17106:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233faeb480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17106:1874676443958144:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1787831135.630750:0:17106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668600/0x95459fb9d1d2a2be lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831135.630763:0:17106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668600/0x95459fb9d1d2a2be lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831135.630772:0:17106:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668600/0x95459fb9d1d2a2be lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831135.630779:0:17106:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2301668600 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:3.0:1787831135.630784:0:17106:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668600/0x95459fb9d1d2a2be lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831135.630794:0:17106:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668600/0x95459fb9d1d2a2be lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831135.630816:0:17106:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d2320608500) 00010000:00010000:3.0:1787831135.630820:0:17106:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787831135.630826:0:17106:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668600/0x95459fb9d1d2a2be lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831135.630833:0:17106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668600/0x95459fb9d1d2a2be lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831135.630875:0:17106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1a00/0x95459fb9d1d2a1fa lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831135.630882:0:17106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1a00/0x95459fb9d1d2a1fa lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831135.630888:0:17106:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1a00/0x95459fb9d1d2a1fa lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831135.631140:0:17106:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22039c1a00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:3.0:1787831135.631144:0:17106:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1a00/0x95459fb9d1d2a1fa lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831135.631151:0:17106:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1a00/0x95459fb9d1d2a1fa lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831135.631161:0:17106:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d220274c900) 00010000:00010000:3.0:1787831135.631164:0:17106:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787831135.631167:0:17106:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1a00/0x95459fb9d1d2a1fa lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831135.631172:0:17106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1a00/0x95459fb9d1d2a1fa lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831135.631234:0:17106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668e00/0x95459fb9d1d2a2c5 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831135.631249:0:17106:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11200/0x95459fb9d1d2a216 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994242bc expref: 17 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831135.631259:0:17106:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668e00/0x95459fb9d1d2a2c5 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831135.631294:0:17106:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11200/0x95459fb9d1d2a216 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0xe558a92a994242bc expref: 17 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831135.631311:0:17106:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11200/0x95459fb9d1d2a216 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a994242bc expref: 17 pid: 17104 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787831135.631450:0:17106:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233faea580 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17106:1874676443958272:192.168.203.31@tcp:104: 00000100:00100000:3.0:1787831135.631561:0:17106:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2335786240 going to sleep for 11 seconds 00000100:00100000:2.0:1787831135.636189:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831135.636307:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433426944 00000100:00100000:0.0:1787831135.636318:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433426944 00010000:00010000:0.0:1787831135.636559:0:17090:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11200/0x95459fb9d1d2a216 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a994242bc expref: 18 pid: 17104 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831135.636822:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 27 00000100:00100000:0.0:1787831135.636836:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fa49a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+18:2397:x1874676433426944:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787831135.636856:0:17090:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787831135.636865:0:17090:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11200/0x95459fb9d1d2a216 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a994242bc expref: 18 pid: 17104 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831135.636881:0:17090:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11200/0x95459fb9d1d2a216 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a994242bc expref: 18 pid: 17104 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831135.636923:0:17090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d220274c900) 00010000:00010000:0.0:1787831135.636929:0:17090:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668e00/0x95459fb9d1d2a2c5 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831135.636940:0:17090:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668e00/0x95459fb9d1d2a2c5 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831135.636948:0:17090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668e00/0x95459fb9d1d2a2c5 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831135.636972:0:17090:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787831135.637037:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fa49a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+18:2397:x1874676433426944:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 205us (862us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831135.637045:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 27 00010000:00010000:3.0:1787831135.638699:0:17106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11200/0x95459fb9d1d2a216 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a994242bc expref: 17 pid: 17104 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787831135.638734:0:17106:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233faea580 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17106:1874676443958272:192.168.203.31@tcp:104: 00010000:00010000:3.0:1787831135.638763:0:17106:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668e00/0x95459fb9d1d2a2c5 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831135.638880:0:17106:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668e00/0x95459fb9d1d2a2c5 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831135.638888:0:17106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668e00/0x95459fb9d1d2a2c5 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831135.638919:0:17106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668e00/0x95459fb9d1d2a2c5 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831135.638928:0:17106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668e00/0x95459fb9d1d2a2c5 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831135.638936:0:17106:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668e00/0x95459fb9d1d2a2c5 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831135.638943:0:17106:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2301668e00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:2.0:1787831135.638948:0:17106:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668e00/0x95459fb9d1d2a2c5 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831135.638957:0:17106:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668e00/0x95459fb9d1d2a2c5 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831135.638997:0:17106:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d220274c900) 00010000:00010000:2.0:1787831135.639001:0:17106:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787831135.639006:0:17106:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668e00/0x95459fb9d1d2a2c5 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831135.639013:0:17106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668e00/0x95459fb9d1d2a2c5 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831135.639028:0:17106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d2a2b7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831135.639035:0:17106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d2a2b7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831135.639041:0:17106:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d2a2b7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831135.639048:0:17106:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22039c0a00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:2.0:1787831135.639051:0:17106:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d2a2b7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831135.639058:0:17106:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d2a2b7 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831135.639067:0:17106:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d220274c900) 00010000:00010000:2.0:1787831135.639069:0:17106:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787831135.639073:0:17106:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d2a2b7 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831135.639078:0:17106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d2a2b7 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787831135.639754:0:17139:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787831135.639762:0:17139:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787831135.639780:0:17139:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1787831135.639787:0:17139:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1787831135.639990:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb11e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+16:15711:x1874676433426560:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 Request processed in 37613us (37914us total) trans 8589934631 rc 0/0 00000100:00100000:2.0:1787831135.640003:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 74 00000020:00080000:2.0:1787831135.640010:0:17106:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1787831135.642859:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831135.642976:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433427200 00000100:00100000:1.0:1787831135.642999:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433427200 00000100:00100000:1.0:1787831135.643109:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 14 00000100:00100000:1.0:1787831135.643120:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fa48b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+16:15711:x1874676433427200:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1787831135.643756:0:17107:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1787831135.643796:0:17107:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934632 00010000:00010000:1.0:1787831135.643840:0:17107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95c00/0x95459fb9d1d2a2cc lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831135.643859:0:17107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95c00/0x95459fb9d1d2a2cc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 17107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831135.643872:0:17107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95c00/0x95459fb9d1d2a2cc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 17107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831135.643881:0:17107:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95c00/0x95459fb9d1d2a2cc lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 17107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831135.643889:0:17107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95c00/0x95459fb9d1d2a2cc lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 17107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831135.643932:0:17107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95c00/0x95459fb9d1d2a2cc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 17107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831135.643957:0:17107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787831135.644080:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fa48b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+18:15711:x1874676433427200:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 Request processed in 959us (1235us total) trans 8589934633 rc 0/0 00000100:00100000:1.0:1787831135.644090:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 14 00000020:00080000:1.0:1787831135.644097:0:17107:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787831135.644534:0:17092:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787831135.644545:0:17092:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95c00/0x95459fb9d1d2a2cc lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 17107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831135.644568:0:17092:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233be95c00 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:0.0:1787831135.644573:0:17092:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95c00/0x95459fb9d1d2a2cc lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 17107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831135.644583:0:17092:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95c00/0x95459fb9d1d2a2cc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 17107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831135.644601:0:17092:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d2320608500) 00010000:00010000:0.0:1787831135.644604:0:17092:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787831135.644610:0:17092:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95c00/0x95459fb9d1d2a2cc lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 17107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831135.644616:0:17092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95c00/0x95459fb9d1d2a2cc lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 17107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831135.644668:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787831135.644670:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787831135.644672:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787831135.825677:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831135.825732:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831135.825767:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831135.825817:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831135.825967:0:18518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433427456 00000100:00100000:2.0:1787831135.825980:0:18518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433427456 00000100:00080000:2.0:1787831135.826019:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787831135.826068:0:18518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433427712 00000100:00100000:2.0:1787831135.826071:0:18518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433427712 00000100:00080000:2.0:1787831135.826083:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787831135.826121:0:18518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 49 00000100:00100000:2.0:1787831135.826131:0:18518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233faea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+5:2395:x1874676433427456:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1787831135.826145:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433427328 00000100:00100000:1.0:1787831135.826153:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433427328 00000100:00100000:1.0:1787831135.826195:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 161 00000100:00100000:1.0:1787831135.826205:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203524050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f931f0c-5730-4db2-abdb-70a9ab2deeff+13:2394:x1874676433427328:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1787831135.826237:0:18518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233faea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+5:2395:x1874676433427456:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 106us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831135.826244:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203524050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f931f0c-5730-4db2-abdb-70a9ab2deeff+13:2394:x1874676433427328:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 39us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831135.826251:0:18518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 49 00000100:00100000:1.0:1787831135.826259:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 161 00000100:00100000:2.0:1787831135.826279:0:18518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 50 00000100:00100000:2.0:1787831135.826290:0:18518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233faead00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8db48c6c-a61a-41ec-9c3b-96530aeb2537+6:2395:x1874676433427712:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1787831135.826321:0:18518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233faead00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8db48c6c-a61a-41ec-9c3b-96530aeb2537+6:2395:x1874676433427712:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 35us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831135.826327:0:18518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 50 00000100:00100000:1.0:1787831135.829108:0:19566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433427968 00000100:00100000:1.0:1787831135.829196:0:19566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433427968 00000100:00100000:3.0:1787831135.829290:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831135.829349:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831135.829358:0:19566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433427584 00000100:00100000:1.0:1787831135.829365:0:19566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433427584 00000100:00100000:0.0:1787831135.829367:0:18608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 15 00000100:00100000:0.0:1787831135.829384:0:18608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fae9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8db48c6c-a61a-41ec-9c3b-96530aeb2537+5:2395:x1874676433427968:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1787831135.829557:0:18608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fae9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8db48c6c-a61a-41ec-9c3b-96530aeb2537+5:2395:x1874676433427968:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 169us (3730us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831135.829566:0:18608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 15 00000100:00100000:0.0:1787831135.829658:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433427840 00000100:00100000:0.0:1787831135.829662:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433427840 00000100:00080000:2.0:1787831135.830001:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787831135.830008:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787831135.830011:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787831135.830081:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 51 00000100:00100000:1.0:1787831135.830096:0:19566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 16 00000100:00100000:1.0:1787831135.830107:0:19566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fae92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+5:2394:x1874676433427584:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1787831135.830186:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fae8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8db48c6c-a61a-41ec-9c3b-96530aeb2537+5:2394:x1874676433427840:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1787831135.830242:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fae8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8db48c6c-a61a-41ec-9c3b-96530aeb2537+5:2394:x1874676433427840:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 70us (892us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831135.830247:0:19566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fae92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+5:2394:x1874676433427584:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 142us (965us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831135.830255:0:19566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 16 00000100:00100000:0.0:1787831135.830271:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 51 00000100:00100000:3.0:1787831135.830603:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831135.830705:0:18914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433428096 00000100:00100000:1.0:1787831135.830712:0:18914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433428096 00000100:00100000:1.0:1787831135.830992:0:18914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 17 00000100:00100000:1.0:1787831135.831004:0:18914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233faeb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8db48c6c-a61a-41ec-9c3b-96530aeb2537+5:2394:x1874676433428096:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1787831135.831061:0:18914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233faeb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8db48c6c-a61a-41ec-9c3b-96530aeb2537+5:2394:x1874676433428096:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 60us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831135.831069:0:18914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 17 00000100:00080000:2.0:1787831135.831224:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787831136.166832:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787831136.858269:0:20330:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787831136.858285:0:20330:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787831136.858314:0:20330:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1787831136.858321:0:20330:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1787831136.946755:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831136.946996:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433428352 00000100:00100000:1.0:1787831136.947010:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433428352 00000100:00100000:1.0:1787831136.948255:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 75 00000100:00100000:1.0:1787831136.948272:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb11a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+18:15729:x1874676433428352:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:1.0:1787831136.948305:0:17104:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787831136.948332:0:17104:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95e00/0x95459fb9d1d2a2d3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a994242f4 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787831136.948457:0:17104:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1787831136.948589:0:17104:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95e00/0x95459fb9d1d2a2d3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994242f4 expref: 20 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831136.948607:0:17104:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d220274cc00) 00010000:00010000:1.0:1787831136.948611:0:17104:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787831136.948617:0:17104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95e00/0x95459fb9d1d2a2d3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994242f4 expref: 20 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831136.948656:0:17104:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233be95e00, rc 0) 00000100:00100000:1.0:1787831136.948741:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb11a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+19:15729:x1874676433428352:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 474us (2001us total) trans 8589934634 rc 301/301 00000100:00100000:1.0:1787831136.948749:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 75 00000100:00080000:3.0:1787831136.951388:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787831136.962763:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831136.964734:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433428480 00000100:00100000:1.0:1787831136.964758:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433428480 00000100:00100000:1.0:1787831136.964880:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 76 00000100:00100000:1.0:1787831136.964892:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb10780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+19:15729:x1874676433428480:12345-192.168.203.31@tcp:34:lfs.0 00010000:00010000:1.0:1787831136.965006:0:17105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95e00/0x95459fb9d1d2a2e1 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831136.965029:0:17105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95e00/0x95459fb9d1d2a2e1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831136.965045:0:17105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95e00/0x95459fb9d1d2a2e1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831136.965062:0:17105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94000/0x95459fb9d1d2a2e8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831136.965069:0:17105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94000/0x95459fb9d1d2a2e8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831136.965075:0:17105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94000/0x95459fb9d1d2a2e8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831136.965168:0:17105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94e00/0x95459fb9d1d2a2ef lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831136.965176:0:17105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94e00/0x95459fb9d1d2a2ef lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831136.965182:0:17105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94e00/0x95459fb9d1d2a2ef lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787831136.965235:0:17105:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94e00/0x95459fb9d1d2a2ef lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831136.965262:0:17105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95e00/0x95459fb9d1d2a2e1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831136.965268:0:17105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95e00/0x95459fb9d1d2a2e1 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831136.965274:0:17105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95e00/0x95459fb9d1d2a2e1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831136.965280:0:17105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233be95e00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:1.0:1787831136.965285:0:17105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95e00/0x95459fb9d1d2a2e1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831136.965292:0:17105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95e00/0x95459fb9d1d2a2e1 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831136.965307:0:17105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d233a6f8800) 00010000:00010000:1.0:1787831136.965311:0:17105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787831136.965317:0:17105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95e00/0x95459fb9d1d2a2e1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831136.965323:0:17105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95e00/0x95459fb9d1d2a2e1 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831136.965334:0:17105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94000/0x95459fb9d1d2a2e8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831136.965340:0:17105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94000/0x95459fb9d1d2a2e8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831136.965358:0:17105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94000/0x95459fb9d1d2a2e8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831136.965370:0:17105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233be94000 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:1.0:1787831136.965373:0:17105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94000/0x95459fb9d1d2a2e8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831136.965379:0:17105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94000/0x95459fb9d1d2a2e8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831136.965387:0:17105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8d233a6f7e00) 00010000:00010000:1.0:1787831136.965389:0:17105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787831136.965392:0:17105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94000/0x95459fb9d1d2a2e8 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831136.965397:0:17105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94000/0x95459fb9d1d2a2e8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831136.965412:0:17105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94e00/0x95459fb9d1d2a2ef lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831136.965418:0:17105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94e00/0x95459fb9d1d2a2ef lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831136.965423:0:17105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94e00/0x95459fb9d1d2a2ef lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831136.965428:0:17105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233be94e00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:1.0:1787831136.965431:0:17105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94e00/0x95459fb9d1d2a2ef lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831136.965437:0:17105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94e00/0x95459fb9d1d2a2ef lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831136.965455:0:17105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d233a6f7300) 00010000:00010000:1.0:1787831136.965458:0:17105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787831136.965461:0:17105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94e00/0x95459fb9d1d2a2ef lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831136.965466:0:17105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94e00/0x95459fb9d1d2a2ef lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831136.965573:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb10780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+19:15729:x1874676433428480:12345-192.168.203.31@tcp:34:lfs.0 Request processed in 682us (2823us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831136.965583:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 76 00000100:00100000:2.0:1787831136.973103:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831136.973337:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433428736 00000100:00100000:1.0:1787831136.973360:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433428736 00000100:00100000:1.0:1787831136.973442:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 15 00000100:00100000:1.0:1787831136.973455:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fa4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+19:15729:x1874676433428736:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:1.0:1787831136.973787:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fa4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+20:15729:x1874676433428736:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 334us (698us total) trans 8589934635 rc 0/0 00000100:00100000:1.0:1787831136.973797:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 15 00000100:00100000:2.0:1787831137.010013:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831137.010077:0:18518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433428992 00000100:00100000:2.0:1787831137.010090:0:18518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433428992 00000100:00100000:2.0:1787831137.010158:0:18518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 77 00000100:00100000:2.0:1787831137.010170:0:18518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fa483c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+20:15732:x1874676433428992:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:2.0:1787831137.010207:0:18518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787831137.010237:0:18518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1000/0x95459fb9d1d2a2f6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a994242fb expref: -99 pid: 18518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.010337:0:18518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0000/0x95459fb9d1d2a2fd lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.010357:0:18518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0000/0x95459fb9d1d2a2fd lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.010374:0:18518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0000/0x95459fb9d1d2a2fd lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.011575:0:18518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0600/0x95459fb9d1d2a304 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.011593:0:18518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0600/0x95459fb9d1d2a304 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.011605:0:18518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0600/0x95459fb9d1d2a304 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.011777:0:18518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1a00/0x95459fb9d1d2a30b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.011786:0:18518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1a00/0x95459fb9d1d2a30b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.011801:0:18518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1a00/0x95459fb9d1d2a30b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787831137.011814:0:18518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 9 00010000:00010000:2.0:1787831137.011923:0:18518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0000/0x95459fb9d1d2a2fd lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.011931:0:18518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0000/0x95459fb9d1d2a2fd lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.011938:0:18518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0000/0x95459fb9d1d2a2fd lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.011945:0:18518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22039c0000 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:2.0:1787831137.011950:0:18518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0000/0x95459fb9d1d2a2fd lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.011959:0:18518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0000/0x95459fb9d1d2a2fd lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.011976:0:18518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d233a6f8800) 00010000:00010000:2.0:1787831137.011979:0:18518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787831137.011984:0:18518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0000/0x95459fb9d1d2a2fd lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.011991:0:18518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0000/0x95459fb9d1d2a2fd lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.012004:0:18518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0600/0x95459fb9d1d2a304 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.012011:0:18518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0600/0x95459fb9d1d2a304 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.012024:0:18518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0600/0x95459fb9d1d2a304 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.012030:0:18518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22039c0600 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:2.0:1787831137.012033:0:18518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0600/0x95459fb9d1d2a304 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.012040:0:18518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0600/0x95459fb9d1d2a304 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.012048:0:18518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8d2303e42900) 00010000:00010000:2.0:1787831137.012050:0:18518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787831137.012053:0:18518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0600/0x95459fb9d1d2a304 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.012059:0:18518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0600/0x95459fb9d1d2a304 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.012123:0:18518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1000/0x95459fb9d1d2a2f6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994242fb expref: 23 pid: 18518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.012140:0:18518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1a00/0x95459fb9d1d2a30b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994242fb expref: 22 pid: 18518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.012147:0:18518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d2303e42500) 00010000:00010000:2.0:1787831137.012150:0:18518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787831137.012152:0:18518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22039c1a00, rc 0) 00000100:00100000:2.0:1787831137.012280:0:18518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fa483c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+22:15732:x1874676433428992:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 2110us (2282us total) trans 8589934636 rc 0/0 00000100:00100000:2.0:1787831137.012299:0:18518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 77 00000100:00100000:0.0:1787831137.017216:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831137.017308:0:19892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433429120 00000100:00100000:1.0:1787831137.017321:0:19892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433429120 00000100:00100000:1.0:1787831137.018082:0:19892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 78 00000100:00100000:1.0:1787831137.018099:0:19892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb12940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+22:15732:x1874676433429120:12345-192.168.203.31@tcp:54:lfs.0 00010000:00010000:1.0:1787831137.018197:0:19892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94e00/0x95459fb9d1d2a319 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831137.018216:0:19892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94e00/0x95459fb9d1d2a319 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831137.018240:0:19892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94e00/0x95459fb9d1d2a319 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831137.018282:0:19892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94e00/0x95459fb9d1d2a319 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831137.018289:0:19892:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94e00/0x95459fb9d1d2a319 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831137.018296:0:19892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94e00/0x95459fb9d1d2a319 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831137.018302:0:19892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233be94e00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:1.0:1787831137.018307:0:19892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94e00/0x95459fb9d1d2a319 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831137.018315:0:19892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94e00/0x95459fb9d1d2a319 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831137.018329:0:19892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d2303e42500) 00010000:00010000:1.0:1787831137.018332:0:19892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787831137.018337:0:19892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94e00/0x95459fb9d1d2a319 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831137.018344:0:19892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94e00/0x95459fb9d1d2a319 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831137.018431:0:19892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb12940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+22:15732:x1874676433429120:12345-192.168.203.31@tcp:54:lfs.0 Request processed in 337us (1595us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831137.018439:0:19892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 78 00000100:00100000:0.0:1787831137.023038:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831137.023228:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433429376 00000100:00100000:3.0:1787831137.023241:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433429376 00000100:00100000:3.0:1787831137.023319:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 16 00000100:00100000:3.0:1787831137.023332:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220385c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+22:15732:x1874676433429376:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:3.0:1787831137.023795:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220385c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+23:15732:x1874676433429376:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 465us (836us total) trans 8589934637 rc 0/0 00000100:00100000:3.0:1787831137.023824:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 16 00000100:00100000:2.0:1787831137.059375:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831137.059453:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433429632 00000100:00100000:1.0:1787831137.059466:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433429632 00000100:00100000:1.0:1787831137.059592:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 79 00000100:00100000:1.0:1787831137.059606:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fa4b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+23:12957:x1874676433429632:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:1.0:1787831137.059693:0:17105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787831137.059725:0:17105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94e00/0x95459fb9d1d2a320 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99424302 expref: -99 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831137.059886:0:17105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94000/0x95459fb9d1d2a327 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831137.059925:0:17105:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1a00/0x95459fb9d1d2a30b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994242fb expref: 24 pid: 18518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831137.059937:0:17105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94000/0x95459fb9d1d2a327 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831137.059982:0:17105:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1a00/0x95459fb9d1d2a30b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0xe558a92a994242fb expref: 24 pid: 18518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831137.059999:0:17105:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1a00/0x95459fb9d1d2a30b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a994242fb expref: 24 pid: 18518 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831137.060016:0:17105:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2309d0b0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17105:1874676443958400:192.168.203.31@tcp:104: 00000100:00100000:1.0:1787831137.060113:0:17105:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d23100e0b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787831137.063561:0:17105:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2309d0b0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17105:1874676443958400:192.168.203.31@tcp:104: 00000100:00100000:0.0:1787831137.063577:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00010000:00010000:1.0:1787831137.063608:0:17105:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94000/0x95459fb9d1d2a327 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787831137.063677:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433429760 00000100:00100000:3.0:1787831137.063686:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433429760 00010000:00010000:3.0:1787831137.063733:0:17089:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1a00/0x95459fb9d1d2a30b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a994242fb expref: 25 pid: 18518 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787831137.063786:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 28 00000100:00100000:3.0:1787831137.063798:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb10b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+25:2397:x1874676433429760:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787831137.063816:0:17089:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787831137.063824:0:17089:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1a00/0x95459fb9d1d2a30b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a994242fb expref: 25 pid: 18518 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831137.063843:0:17089:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1a00/0x95459fb9d1d2a30b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a994242fb expref: 25 pid: 18518 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831137.063870:0:17089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1a00/0x95459fb9d1d2a30b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a994242fb expref: 25 pid: 18518 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831137.063886:0:17089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d2303e42500) 00010000:00010000:3.0:1787831137.063891:0:17089:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94000/0x95459fb9d1d2a327 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831137.063912:0:17089:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94000/0x95459fb9d1d2a327 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831137.063921:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94000/0x95459fb9d1d2a327 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831137.064058:0:17089:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787831137.064242:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb10b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+24:2397:x1874676433429760:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 445us (670us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831137.064252:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 28 00010000:00010000:1.0:1787831137.064489:0:17105:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94000/0x95459fb9d1d2a327 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831137.064498:0:17105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94000/0x95459fb9d1d2a327 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787831137.064521:0:17105:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 9 00010000:00010000:1.0:1787831137.064741:0:17105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94e00/0x95459fb9d1d2a320 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424302 expref: 25 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831137.064761:0:17105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94000/0x95459fb9d1d2a327 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424302 expref: 24 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831137.064769:0:17105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d2303e42500) 00010000:00010000:1.0:1787831137.064773:0:17105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787831137.064775:0:17105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233be94000, rc 0) 00000100:00100000:1.0:1787831137.064815:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fa4b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+24:12957:x1874676433429632:12345-192.168.203.31@tcp:101:bash.0 Request processed in 5213us (5454us total) trans 8589934638 rc 0/0 00000100:00100000:1.0:1787831137.064823:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 79 00000100:00100000:0.0:1787831137.067591:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831137.067813:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433429888 00000100:00100000:2.0:1787831137.067826:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433429888 00000100:00100000:2.0:1787831137.068029:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 80 00000100:00100000:2.0:1787831137.068043:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+24:12957:x1874676433429888:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:2.0:1787831137.068081:0:17104:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787831137.068111:0:17104:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1000/0x95459fb9d1d2a335 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99424309 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.068158:0:17104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0600/0x95459fb9d1d2a33c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.068176:0:17104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0600/0x95459fb9d1d2a33c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.068200:0:17104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0600/0x95459fb9d1d2a33c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.068373:0:17104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1000/0x95459fb9d1d2a335 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424309 expref: 26 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.068396:0:17104:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0600/0x95459fb9d1d2a33c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424309 expref: 25 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.068406:0:17104:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d2303e42500) 00010000:00010000:2.0:1787831137.068410:0:17104:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787831137.068414:0:17104:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22039c0600, rc 0) 00000100:00100000:2.0:1787831137.068506:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+25:12957:x1874676433429888:12345-192.168.203.31@tcp:101:bash.0 Request processed in 466us (929us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831137.068515:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 80 00000100:00100000:1.0:1787831137.071616:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831137.071893:0:19892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433430144 00000100:00100000:0.0:1787831137.071914:0:19892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433430144 00000100:00100000:0.0:1787831137.071998:0:19892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 81 00000100:00100000:0.0:1787831137.072010:0:19892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2309d0b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+25:12957:x1874676433430144:12345-192.168.203.31@tcp:36:bash.0 00010000:00010000:1.0:1787831137.072946:0:19892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94400/0x95459fb9d1d2a343 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831137.073044:0:19892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94400/0x95459fb9d1d2a343 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831137.073059:0:19892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94400/0x95459fb9d1d2a343 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787831137.073137:0:19892:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934639 00000004:00010000:1.0:1787831137.073166:0:19892:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ed063b87 reply state 000000003e86170e transno 8589934640 ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94400/0x95459fb9d1d2a343 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831137.073180:0:19892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94400/0x95459fb9d1d2a343 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831137.073188:0:19892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d2303e42500) 00010000:00010000:1.0:1787831137.073191:0:19892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787831137.073196:0:19892:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1787831137.073285:0:19892:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934640 00000100:00100000:1.0:1787831137.074220:0:19892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2309d0b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+29:12957:x1874676433430144:12345-192.168.203.31@tcp:36:bash.0 Request processed in 2202us (2609us total) trans 8589934641 rc 0/0 00000100:00100000:1.0:1787831137.074232:0:19892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 81 00000020:00080000:1.0:1787831137.074240:0:19892:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1787831137.083596:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831137.088278:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433430272 00000100:00100000:0.0:1787831137.088302:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433430272 00000100:00100000:0.0:1787831137.088533:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 82 00000100:00100000:0.0:1787831137.088549:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2309d0ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+29:12957:x1874676433430272:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:0.0:1787831137.088583:0:17105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787831137.088611:0:17105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11400/0x95459fb9d1d2a34a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99424310 expref: -99 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831137.088722:0:17105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11400/0x95459fb9d1d2a34a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424310 expref: 30 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831137.088740:0:17105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11400/0x95459fb9d1d2a34a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424310 expref: 30 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831137.088784:0:17105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d2303e42500) 00010000:00010000:0.0:1787831137.088788:0:17105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787831137.088793:0:17105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233bf11400, rc 0) 00000100:00100000:0.0:1787831137.088879:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2309d0ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+30:12957:x1874676433430272:12345-192.168.203.31@tcp:101:bash.0 Request processed in 334us (5298us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831137.090031:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 82 00000100:00100000:2.0:1787831137.093888:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831137.094123:0:18609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433430400 00000100:00100000:0.0:1787831137.094135:0:18609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433430400 00000100:00100000:0.0:1787831137.094270:0:18609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 28 00000100:00100000:0.0:1787831137.094284:0:18609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fa4a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+6:12957:x1874676433430400:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:0.0:1787831137.094307:0:18609:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787831137.094336:0:18609:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e4a63826/0x95459fb9d1d2a351 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99424317 expref: -99 pid: 18609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787831137.094368:0:18609:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 9, mtime: 0x6a90235e, atime: 0x6a90235d, ctime: 0x6a90235e, blocks: 0x8 00010000:00010000:0.0:1787831137.094411:0:18609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=428s v=(0 0) 00010000:00010000:0.0:1787831137.094417:0:18609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787831137.094427:0:18609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4a63826/0x95459fb9d1d2a351 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424317 expref: 7 pid: 18609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831137.094449:0:18609:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e4a63826/0x95459fb9d1d2a351 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424317 expref: 7 pid: 18609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831137.094465:0:18609:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233bf11c00, rc 0) 00000100:00100000:0.0:1787831137.094568:0:18609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fa4a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+7:12957:x1874676433430400:12345-192.168.203.31@tcp:101:bash.0 Request processed in 286us (694us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831137.094577:0:18609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 28 00000100:00080000:2.0:1787831137.094860:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787831137.099264:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831137.100078:0:18615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433430528 00000100:00100000:1.0:1787831137.100093:0:18615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433430528 00002000:00010000:1.0:1787831137.100145:0:18615:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/34 (0->18446744073709551615) 00002000:00100000:1.0:1787831137.100150:0:18615:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d233faebc00 with x1874676433430528 ext(0->18446744073709551615) 00002000:00010000:1.0:1787831137.100166:0:18615:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d233faebc00. 00000100:00100000:1.0:1787831137.100206:0:18615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 1 00000100:00100000:1.0:1787831137.100217:0:18615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233faebc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+7:2397:x1874676433430528:12345-192.168.203.31@tcp:10:bash.0 00002000:00010000:1.0:1787831137.102986:0:18615:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1787831137.103000:0:18615:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 1787831134 -> 1787831137 00002000:00010000:1.0:1787831137.103004:0:18615:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 1787831133 -> 1787831133 00002000:00010000:1.0:1787831137.103007:0:18615:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1787831134 -> 1787831137 00002000:00010000:1.0:1787831137.103029:0:18615:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:1.0:1787831137.103146:0:18615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233faebc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+8:2397:x1874676433430528:12345-192.168.203.31@tcp:10:bash.0 Request processed in 2922us (3888us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1787831137.103160:0:18615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 1 00002000:00010000:1.0:1787831137.103167:0:18615:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/34 (0->18446744073709551615) 00002000:00100000:1.0:1787831137.103171:0:18615:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d233faebc00 with x1874676433430528 ext(0->18446744073709551615) 00002000:00010000:1.0:1787831137.103180:0:18615:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d233faebc00. 00000100:00100000:3.0:1787831137.192253:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831137.192575:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433430784 00000100:00100000:2.0:1787831137.192589:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433430784 00000100:00100000:2.0:1787831137.192701:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 83 00000100:00100000:2.0:1787831137.192714:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fae8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+30:15746:x1874676433430784:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:2.0:1787831137.192744:0:17104:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787831137.192768:0:18633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787831137.192774:0:17104:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1800/0x95459fb9d1d2a358 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a9942431e expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.192937:0:17104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0000/0x95459fb9d1d2a35f lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.192958:0:17104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0000/0x95459fb9d1d2a35f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.192972:0:17104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0000/0x95459fb9d1d2a35f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787831137.192986:0:17104:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1787831137.193129:0:17104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1800/0x95459fb9d1d2a358 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a9942431e expref: 33 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.193150:0:17104:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0000/0x95459fb9d1d2a35f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a9942431e expref: 32 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.193182:0:17104:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d233a6f8800) 00010000:00010000:2.0:1787831137.193186:0:17104:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787831137.193189:0:17104:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22039c0000, rc 0) 00000100:00100000:2.0:1787831137.193274:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fae8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+32:15746:x1874676433430784:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 563us (1038us total) trans 8589934642 rc 0/0 00000100:00100000:2.0:1787831137.193283:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 83 00000100:00100000:2.0:1787831137.198401:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831137.198589:0:19892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433430912 00000100:00100000:1.0:1787831137.198602:0:19892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433430912 00000100:00100000:1.0:1787831137.199148:0:19892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 84 00000100:00100000:1.0:1787831137.199164:0:19892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fa4ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+32:15746:x1874676433430912:12345-192.168.203.31@tcp:34:lfs.0 00010000:00010000:1.0:1787831137.199272:0:19892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94e00/0x95459fb9d1d2a36d lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831137.199791:0:19892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94e00/0x95459fb9d1d2a36d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831137.200104:0:19892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94e00/0x95459fb9d1d2a36d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831137.200131:0:19892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94c00/0x95459fb9d1d2a374 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831137.200139:0:19892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94c00/0x95459fb9d1d2a374 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831137.200146:0:19892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94c00/0x95459fb9d1d2a374 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831137.200262:0:19892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94800/0x95459fb9d1d2a37b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831137.200272:0:19892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94800/0x95459fb9d1d2a37b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831137.200773:0:19892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94800/0x95459fb9d1d2a37b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787831137.201159:0:19892:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94800/0x95459fb9d1d2a37b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831137.201175:0:19892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94e00/0x95459fb9d1d2a36d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831137.201182:0:19892:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94e00/0x95459fb9d1d2a36d lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831137.201190:0:19892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94e00/0x95459fb9d1d2a36d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831137.201199:0:19892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233be94e00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:1.0:1787831137.201204:0:19892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94e00/0x95459fb9d1d2a36d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831137.201213:0:19892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94e00/0x95459fb9d1d2a36d lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831137.201229:0:19892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d233a6f8800) 00010000:00010000:1.0:1787831137.201232:0:19892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787831137.201238:0:19892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94e00/0x95459fb9d1d2a36d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831137.201259:0:19892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94e00/0x95459fb9d1d2a36d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831137.201278:0:19892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94c00/0x95459fb9d1d2a374 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831137.202089:0:19892:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94c00/0x95459fb9d1d2a374 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831137.202099:0:19892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94c00/0x95459fb9d1d2a374 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831137.202106:0:19892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233be94c00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:1.0:1787831137.202110:0:19892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94c00/0x95459fb9d1d2a374 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831137.202120:0:19892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94c00/0x95459fb9d1d2a374 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831137.202311:0:19892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8d233a6f7300) 00010000:00010000:1.0:1787831137.202315:0:19892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787831137.202321:0:19892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94c00/0x95459fb9d1d2a374 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831137.202328:0:19892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94c00/0x95459fb9d1d2a374 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831137.202357:0:19892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94800/0x95459fb9d1d2a37b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831137.202364:0:19892:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94800/0x95459fb9d1d2a37b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831137.202387:0:19892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94800/0x95459fb9d1d2a37b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831137.202393:0:19892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233be94800 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:1.0:1787831137.202395:0:19892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94800/0x95459fb9d1d2a37b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831137.202467:0:19892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94800/0x95459fb9d1d2a37b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831137.202478:0:19892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d2303e42500) 00010000:00010000:1.0:1787831137.202481:0:19892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787831137.202484:0:19892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94800/0x95459fb9d1d2a37b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831137.202490:0:19892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94800/0x95459fb9d1d2a37b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831137.202610:0:19892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fa4ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+32:15746:x1874676433430912:12345-192.168.203.31@tcp:34:lfs.0 Request processed in 3447us (4230us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831137.202620:0:19892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 84 00000100:00100000:3.0:1787831137.244483:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831137.244656:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433431168 00000100:00100000:0.0:1787831137.244667:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433431168 00000100:00100000:0.0:1787831137.244728:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 85 00000100:00100000:0.0:1787831137.244738:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fae9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+32:15749:x1874676433431168:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:0.0:1787831137.244757:0:17105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787831137.244778:0:17105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11600/0x95459fb9d1d2a382 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99424325 expref: -99 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831137.244851:0:17105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11a00/0x95459fb9d1d2a389 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831137.244866:0:17105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11a00/0x95459fb9d1d2a389 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831137.244877:0:17105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11a00/0x95459fb9d1d2a389 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831137.244891:0:17105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11e00/0x95459fb9d1d2a390 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831137.244910:0:17105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11e00/0x95459fb9d1d2a390 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831137.244916:0:17105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11e00/0x95459fb9d1d2a390 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831137.245038:0:17105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10200/0x95459fb9d1d2a397 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831137.245062:0:17105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10200/0x95459fb9d1d2a397 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831137.245070:0:17105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10200/0x95459fb9d1d2a397 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787831137.245081:0:17105:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787831137.245158:0:17105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11a00/0x95459fb9d1d2a389 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831137.245166:0:17105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11a00/0x95459fb9d1d2a389 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831137.245172:0:17105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11a00/0x95459fb9d1d2a389 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831137.245178:0:17105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233bf11a00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:0.0:1787831137.245182:0:17105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11a00/0x95459fb9d1d2a389 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831137.245190:0:17105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11a00/0x95459fb9d1d2a389 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831137.245202:0:17105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d233a6f8800) 00010000:00010000:0.0:1787831137.245206:0:17105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787831137.245210:0:17105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11a00/0x95459fb9d1d2a389 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831137.245217:0:17105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11a00/0x95459fb9d1d2a389 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831137.245232:0:17105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11e00/0x95459fb9d1d2a390 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831137.245245:0:17105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11e00/0x95459fb9d1d2a390 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831137.245251:0:17105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11e00/0x95459fb9d1d2a390 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831137.245257:0:17105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233bf11e00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:0.0:1787831137.245260:0:17105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11e00/0x95459fb9d1d2a390 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831137.245267:0:17105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11e00/0x95459fb9d1d2a390 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831137.245276:0:17105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8d2320608800) 00010000:00010000:0.0:1787831137.245278:0:17105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787831137.245281:0:17105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11e00/0x95459fb9d1d2a390 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831137.245287:0:17105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11e00/0x95459fb9d1d2a390 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831137.245329:0:17105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11600/0x95459fb9d1d2a382 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424325 expref: 35 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831137.245343:0:17105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10200/0x95459fb9d1d2a397 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424325 expref: 34 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831137.245351:0:17105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d2303e42500) 00010000:00010000:0.0:1787831137.245353:0:17105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787831137.245363:0:17105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233bf10200, rc 0) 00000100:00100000:0.0:1787831137.245427:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fae9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+34:15749:x1874676433431168:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 691us (955us total) trans 8589934643 rc 0/0 00000100:00100000:0.0:1787831137.245435:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 85 00000100:00100000:3.0:1787831137.250189:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831137.250319:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433431296 00000100:00100000:2.0:1787831137.250333:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433431296 00000100:00100000:2.0:1787831137.250488:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 86 00000100:00100000:2.0:1787831137.250503:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fae9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+34:15749:x1874676433431296:12345-192.168.203.31@tcp:54:lfs.0 00010000:00010000:2.0:1787831137.250603:0:17104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1000/0x95459fb9d1d2a3a5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.250748:0:17104:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94000/0x95459fb9d1d2a327 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424302 expref: 34 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.250762:0:17104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1000/0x95459fb9d1d2a3a5 lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.250811:0:17104:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94000/0x95459fb9d1d2a327 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424302 expref: 34 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.250828:0:17104:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94000/0x95459fb9d1d2a327 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424302 expref: 34 pid: 17105 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831137.250847:0:17104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233fa49680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17104:1874676443958528:192.168.203.31@tcp:104: 00000100:00100000:2.0:1787831137.251028:0:17104:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d230879ac00 going to sleep for 11 seconds 00000100:00100000:2.0:1787831137.259324:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831137.259488:0:17104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233fa49680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17104:1874676443958528:192.168.203.31@tcp:104: 00010000:00010000:3.0:1787831137.259526:0:17104:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1000/0x95459fb9d1d2a3a5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831137.260050:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433431552 00000100:00100000:0.0:1787831137.260061:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433431552 00000100:00100000:0.0:1787831137.260144:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 17 00000100:00100000:0.0:1787831137.260157:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fa492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+35:14874:x1874676433431552:12345-192.168.203.31@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787831137.260540:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fa492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+36:14874:x1874676433431552:12345-192.168.203.31@tcp:35:ldlm_bl.0 Request processed in 384us (1231us total) trans 8589934644 rc 0/0 00000100:00100000:0.0:1787831137.260550:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 17 00000100:00100000:3.0:1787831137.263597:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831137.263786:0:20128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433431680 00000100:00100000:1.0:1787831137.263799:0:20128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433431680 00010000:00010000:1.0:1787831137.263856:0:20128:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94000/0x95459fb9d1d2a327 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424302 expref: 36 pid: 17105 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831137.264040:0:20128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 29 00000100:00100000:1.0:1787831137.264052:0:20128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fae8780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+36:2397:x1874676433431680:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787831137.264070:0:20128:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787831137.264100:0:20128:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94000/0x95459fb9d1d2a327 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424302 expref: 36 pid: 17105 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831137.264117:0:20128:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94000/0x95459fb9d1d2a327 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424302 expref: 36 pid: 17105 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831137.264152:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94000/0x95459fb9d1d2a327 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424302 expref: 36 pid: 17105 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831137.264170:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d2303e42500) 00010000:00010000:1.0:1787831137.264177:0:20128:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1000/0x95459fb9d1d2a3a5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831137.264188:0:20128:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1000/0x95459fb9d1d2a3a5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831137.264198:0:20128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1000/0x95459fb9d1d2a3a5 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831137.264236:0:20128:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787831137.264517:0:20128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fae8780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+35:2397:x1874676433431680:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 464us (936us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831137.264527:0:20128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 29 00010000:00010000:3.0:1787831137.264562:0:17104:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1000/0x95459fb9d1d2a3a5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831137.264573:0:17104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1000/0x95459fb9d1d2a3a5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831137.264647:0:17104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1000/0x95459fb9d1d2a3a5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831137.264655:0:17104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1000/0x95459fb9d1d2a3a5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831137.264662:0:17104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1000/0x95459fb9d1d2a3a5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831137.264669:0:17104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22039c1000 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:3.0:1787831137.264685:0:17104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1000/0x95459fb9d1d2a3a5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831137.264696:0:17104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1000/0x95459fb9d1d2a3a5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831137.264709:0:17104:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d2303e42500) 00010000:00010000:3.0:1787831137.264712:0:17104:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787831137.264716:0:17104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1000/0x95459fb9d1d2a3a5 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831137.264724:0:17104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1000/0x95459fb9d1d2a3a5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787831137.264774:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fae9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+34:15749:x1874676433431296:12345-192.168.203.31@tcp:54:lfs.0 Request processed in 14276us (14600us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831137.264782:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 86 00000100:00100000:3.0:1787831137.267740:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831137.267926:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433431936 00000100:00100000:0.0:1787831137.267940:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433431936 00000100:00100000:0.0:1787831137.268011:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 18 00000100:00100000:0.0:1787831137.268023:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233faea1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+34:15749:x1874676433431936:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:0.0:1787831137.268797:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233faea1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+35:15749:x1874676433431936:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 770us (1065us total) trans 8589934645 rc 0/0 00000100:00100000:0.0:1787831137.268808:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 18 00000100:00100000:2.0:1787831137.348292:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831137.348548:0:19892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433432192 00000100:00100000:1.0:1787831137.348560:0:19892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433432192 00000100:00100000:1.0:1787831137.348711:0:19892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 87 00000100:00100000:1.0:1787831137.348722:0:19892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fa48f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+35:15760:x1874676433432192:12345-192.168.203.31@tcp:101:cat.0 00010000:00010000:1.0:1787831137.348751:0:19892:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787831137.348778:0:19892:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94000/0x95459fb9d1d2a3ac lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a9942432c expref: -99 pid: 19892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831137.348885:0:19892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94800/0x95459fb9d1d2a3b3 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831137.349145:0:19892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94800/0x95459fb9d1d2a3b3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831137.349159:0:19892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94800/0x95459fb9d1d2a3b3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831137.349179:0:19892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94c00/0x95459fb9d1d2a3ba lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831137.349186:0:19892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94c00/0x95459fb9d1d2a3ba lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831137.349192:0:19892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94c00/0x95459fb9d1d2a3ba lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831137.349330:0:19892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94e00/0x95459fb9d1d2a3c1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831137.349340:0:19892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94e00/0x95459fb9d1d2a3c1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831137.349346:0:19892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94e00/0x95459fb9d1d2a3c1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787831137.349357:0:19892:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 8 00010000:00010000:1.0:1787831137.349711:0:19892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94800/0x95459fb9d1d2a3b3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831137.349733:0:19892:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94800/0x95459fb9d1d2a3b3 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831137.349740:0:19892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94800/0x95459fb9d1d2a3b3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831137.349747:0:19892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233be94800 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:1.0:1787831137.349752:0:19892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94800/0x95459fb9d1d2a3b3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831137.349760:0:19892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94800/0x95459fb9d1d2a3b3 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831137.349775:0:19892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d233a6f8800) 00010000:00010000:1.0:1787831137.349778:0:19892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787831137.349785:0:19892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94800/0x95459fb9d1d2a3b3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831137.349792:0:19892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94800/0x95459fb9d1d2a3b3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831137.349807:0:19892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94c00/0x95459fb9d1d2a3ba lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831137.349812:0:19892:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94c00/0x95459fb9d1d2a3ba lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831137.349817:0:19892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94c00/0x95459fb9d1d2a3ba lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831137.349823:0:19892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233be94c00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:1.0:1787831137.349832:0:19892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94c00/0x95459fb9d1d2a3ba lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831137.349838:0:19892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94c00/0x95459fb9d1d2a3ba lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831137.349846:0:19892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8d233a6f7300) 00010000:00010000:1.0:1787831137.349849:0:19892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787831137.349852:0:19892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94c00/0x95459fb9d1d2a3ba lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831137.349858:0:19892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94c00/0x95459fb9d1d2a3ba lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831137.350192:0:19892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94000/0x95459fb9d1d2a3ac lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a9942432c expref: 38 pid: 19892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831137.350211:0:19892:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94e00/0x95459fb9d1d2a3c1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a9942432c expref: 37 pid: 19892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831137.350218:0:19892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d2303e42500) 00010000:00010000:1.0:1787831137.350220:0:19892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787831137.350223:0:19892:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233be94e00, rc 0) 00000100:00100000:1.0:1787831137.350310:0:19892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fa48f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+37:15760:x1874676433432192:12345-192.168.203.31@tcp:101:cat.0 Request processed in 1590us (2032us total) trans 8589934646 rc 0/0 00000100:00100000:1.0:1787831137.350319:0:19892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 87 00000100:00100000:3.0:1787831137.354928:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831137.355208:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433432448 00000100:00100000:1.0:1787831137.355221:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433432448 00000100:00100000:1.0:1787831137.355337:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 19 00000100:00100000:1.0:1787831137.355358:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fae8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+37:15760:x1874676433432448:12345-192.168.203.31@tcp:35:cat.0 00000100:00100000:1.0:1787831137.356241:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fae8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+38:15760:x1874676433432448:12345-192.168.203.31@tcp:35:cat.0 Request processed in 881us (1325us total) trans 8589934647 rc 0/0 00000100:00100000:1.0:1787831137.356250:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 19 00000100:00100000:3.0:1787831137.374346:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831137.375699:0:18518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433432704 00000100:00100000:2.0:1787831137.375714:0:18518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433432704 00000100:00100000:2.0:1787831137.375805:0:18518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 88 00000100:00100000:2.0:1787831137.375817:0:18518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233faea940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+38:15761:x1874676433432704:12345-192.168.203.31@tcp:36:rm.0 00010000:00010000:2.0:1787831137.375906:0:18518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1787831137.375943:0:18518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11400/0x95459fb9d1d2a34a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424310 expref: 38 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.375974:0:18518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94e00/0x95459fb9d1d2a3c1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a9942432c expref: 37 pid: 19892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.375989:0:18518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10200/0x95459fb9d1d2a397 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424325 expref: 36 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.376003:0:18518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0600/0x95459fb9d1d2a33c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424309 expref: 35 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.376015:0:18518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d2303e42500) 00010000:00010000:2.0:1787831137.376022:0:18518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787831137.376050:0:18518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d2a3cf lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.376067:0:18518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d2a3cf lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.376079:0:18518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d2a3cf lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.376124:0:18518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1000/0x95459fb9d1d2a3d6 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.376132:0:18518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1000/0x95459fb9d1d2a3d6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.376140:0:18518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1000/0x95459fb9d1d2a3d6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.376239:0:18518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1a00/0x95459fb9d1d2a3dd lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.376248:0:18518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1a00/0x95459fb9d1d2a3dd lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.376255:0:18518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1a00/0x95459fb9d1d2a3dd lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787831137.376535:0:18518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].3, 64 off8408 00000004:00080000:2.0:1787831137.376547:0:18518:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 428376921478ns, next at 429376918606ns, rc = 0 00010000:00010000:2.0:1787831137.376603:0:18518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1800/0x95459fb9d1d2a3e4 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.376612:0:18518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1800/0x95459fb9d1d2a3e4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.376620:0:18518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1800/0x95459fb9d1d2a3e4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.376693:0:18518:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1800/0x95459fb9d1d2a3e4 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.376712:0:18518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1800/0x95459fb9d1d2a3e4 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.376718:0:18518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1800/0x95459fb9d1d2a3e4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.376746:0:18518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787831137.376792:0:18518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1a00/0x95459fb9d1d2a3dd lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.376798:0:18518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1a00/0x95459fb9d1d2a3dd lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.376805:0:18518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1a00/0x95459fb9d1d2a3dd lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.376811:0:18518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22039c1a00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:2.0:1787831137.376816:0:18518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1a00/0x95459fb9d1d2a3dd lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.376823:0:18518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1a00/0x95459fb9d1d2a3dd lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.376834:0:18518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d2303e42500) 00010000:00010000:2.0:1787831137.376837:0:18518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787831137.376841:0:18518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1a00/0x95459fb9d1d2a3dd lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.376846:0:18518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1a00/0x95459fb9d1d2a3dd lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.376862:0:18518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d2a3cf lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.376875:0:18518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d2a3cf lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.376881:0:18518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d2a3cf lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.376886:0:18518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22039c0a00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:2.0:1787831137.376889:0:18518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d2a3cf lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.376904:0:18518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d2a3cf lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.376913:0:18518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d233a6f8800) 00010000:00010000:2.0:1787831137.376915:0:18518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787831137.376918:0:18518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d2a3cf lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.376924:0:18518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d2a3cf lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787831137.376935:0:18518:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004c7039ab reply state 000000003195b145 transno 8589934648 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1000/0x95459fb9d1d2a3d6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.376949:0:18518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1000/0x95459fb9d1d2a3d6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.376955:0:18518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8d2303e42900) 00010000:00010000:2.0:1787831137.376957:0:18518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787831137.376960:0:18518:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787831137.377062:0:18518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233faea940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+36:15761:x1874676433432704:12345-192.168.203.31@tcp:36:rm.0 Request processed in 1246us (2730us total) trans 8589934648 rc 0/0 00000100:00100000:2.0:1787831137.377077:0:18518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 88 00010000:00010000:3.0:1787831137.377243:0:17092:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787831137.377252:0:17092:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1800/0x95459fb9d1d2a3e4 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831137.377260:0:17092:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22039c1800 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:3.0:1787831137.377263:0:17092:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1800/0x95459fb9d1d2a3e4 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831137.377269:0:17092:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1800/0x95459fb9d1d2a3e4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831137.377279:0:17092:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d2303e42500) 00010000:00010000:3.0:1787831137.377288:0:17092:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787831137.377292:0:17092:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1800/0x95459fb9d1d2a3e4 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831137.377298:0:17092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1800/0x95459fb9d1d2a3e4 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831137.377311:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787831137.377313:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787831137.377315:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787831137.413557:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831137.413667:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433432960 00000100:00100000:3.0:1787831137.413679:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433432960 00000100:00100000:3.0:1787831137.413802:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 89 00000100:00100000:3.0:1787831137.413815:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fa4b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+36:15767:x1874676433432960:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:3.0:1787831137.413849:0:17104:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787831137.413878:0:17104:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669600/0x95459fb9d1d2a3eb lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99424333 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831137.414041:0:17104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668600/0x95459fb9d1d2a3f2 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831137.414061:0:17104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668600/0x95459fb9d1d2a3f2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831137.414076:0:17104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668600/0x95459fb9d1d2a3f2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831137.414089:0:17104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669a00/0x95459fb9d1d2a3f9 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831137.414096:0:17104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669a00/0x95459fb9d1d2a3f9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831137.414122:0:17104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669a00/0x95459fb9d1d2a3f9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831137.414710:0:17104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668e00/0x95459fb9d1d2a400 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831137.414724:0:17104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668e00/0x95459fb9d1d2a400 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831137.414732:0:17104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668e00/0x95459fb9d1d2a400 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787831137.414743:0:17104:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00010000:00010000:3.0:1787831137.414777:0:17104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668600/0x95459fb9d1d2a3f2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831137.414785:0:17104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668600/0x95459fb9d1d2a3f2 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831137.414791:0:17104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668600/0x95459fb9d1d2a3f2 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831137.414798:0:17104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2301668600 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:3.0:1787831137.414803:0:17104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668600/0x95459fb9d1d2a3f2 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831137.414813:0:17104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668600/0x95459fb9d1d2a3f2 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831137.414826:0:17104:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d233a6f8800) 00010000:00010000:3.0:1787831137.414829:0:17104:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787831137.414841:0:17104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668600/0x95459fb9d1d2a3f2 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831137.414860:0:17104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668600/0x95459fb9d1d2a3f2 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787831137.414878:0:17104:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008a96b308 reply state 00000000344db799 transno 8589934649 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669a00/0x95459fb9d1d2a3f9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831137.414900:0:17104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669a00/0x95459fb9d1d2a3f9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831137.414909:0:17104:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8d2303e42900) 00010000:00010000:3.0:1787831137.414911:0:17104:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787831137.414915:0:17104:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787831137.414950:0:17104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669600/0x95459fb9d1d2a3eb lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424333 expref: 39 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831137.414968:0:17104:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668e00/0x95459fb9d1d2a400 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424333 expref: 38 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831137.414975:0:17104:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff8d233a6f8c00) 00010000:00010000:3.0:1787831137.414978:0:17104:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1787831137.414980:0:17104:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2301668e00, rc 0) 00000100:00100000:3.0:1787831137.415061:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fa4b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+39:15767:x1874676433432960:12345-192.168.203.31@tcp:101:bash.0 Request processed in 1248us (1518us total) trans 8589934649 rc 0/0 00000100:00100000:3.0:1787831137.415069:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 89 00000100:00100000:3.0:1787831137.418547:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831137.419606:0:19892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433433088 00000100:00100000:1.0:1787831137.419622:0:19892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433433088 00000100:00100000:1.0:1787831137.419724:0:19892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 90 00000100:00100000:1.0:1787831137.419736:0:19892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2314e73840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+39:15767:x1874676433433088:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:1.0:1787831137.419779:0:19892:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787831137.419809:0:19892:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94c00/0x95459fb9d1d2a40e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a9942433a expref: -99 pid: 19892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831137.419911:0:19892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94800/0x95459fb9d1d2a415 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831137.419928:0:19892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94800/0x95459fb9d1d2a415 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831137.419943:0:19892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94800/0x95459fb9d1d2a415 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787831137.420006:0:19892:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00000004:00200000:1.0:1787831137.420011:0:19892:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787831137.420036:0:19892:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94800/0x95459fb9d1d2a415 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831137.420062:0:19892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94800/0x95459fb9d1d2a415 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831137.420108:0:19892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94c00/0x95459fb9d1d2a40e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a9942433a expref: 41 pid: 19892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831137.420155:0:19892:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94800/0x95459fb9d1d2a415 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a9942433a expref: 40 pid: 19892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831137.420164:0:19892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff8d233a6f8c00) 00010000:00010000:1.0:1787831137.420168:0:19892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787831137.420172:0:19892:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233be94800, rc 0) 00000100:00100000:1.0:1787831137.420265:0:19892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2314e73840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+40:15767:x1874676433433088:12345-192.168.203.31@tcp:101:bash.0 Request processed in 533us (1734us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831137.420274:0:19892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 90 00000100:00100000:1.0:1787831137.425107:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831137.425239:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433433344 00000100:00100000:0.0:1787831137.425252:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433433344 00000100:00100000:0.0:1787831137.425364:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 20 00000100:00100000:0.0:1787831137.425376:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2309d08f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+40:15767:x1874676433433344:12345-192.168.203.31@tcp:35:bash.0 00000100:00100000:0.0:1787831137.425788:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2309d08f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+41:15767:x1874676433433344:12345-192.168.203.31@tcp:35:bash.0 Request processed in 414us (696us total) trans 8589934650 rc 0/0 00000100:00100000:0.0:1787831137.425798:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 20 00000100:00100000:3.0:1787831137.514621:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831137.515021:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433433600 00000100:00100000:0.0:1787831137.515043:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433433600 00000100:00100000:0.0:1787831137.515134:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 91 00000100:00100000:0.0:1787831137.515149:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233cd15e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+41:15780:x1874676433433600:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:0.0:1787831137.515183:0:17106:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787831137.515212:0:17106:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11600/0x95459fb9d1d2a41c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99424341 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831137.515379:0:17106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11e00/0x95459fb9d1d2a423 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831137.515396:0:17106:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11e00/0x95459fb9d1d2a423 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831137.515410:0:17106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11e00/0x95459fb9d1d2a423 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787831137.515422:0:17106:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00010000:00010000:0.0:1787831137.515549:0:17106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11600/0x95459fb9d1d2a41c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424341 expref: 44 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831137.515574:0:17106:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11e00/0x95459fb9d1d2a423 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424341 expref: 43 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831137.515583:0:17106:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff8d233a6f8c00) 00010000:00010000:0.0:1787831137.515586:0:17106:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787831137.515590:0:17106:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233bf11e00, rc 0) 00000100:00100000:0.0:1787831137.515729:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233cd15e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+43:15780:x1874676433433600:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 583us (1121us total) trans 8589934651 rc 0/0 00000100:00100000:0.0:1787831137.515740:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 91 00000100:00100000:3.0:1787831137.518964:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831137.519187:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433433728 00000100:00100000:2.0:1787831137.519198:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433433728 00000100:00100000:2.0:1787831137.519291:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 92 00000100:00100000:2.0:1787831137.519300:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233cd15a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+43:15780:x1874676433433728:12345-192.168.203.31@tcp:54:lfs.0 00010000:00010000:2.0:1787831137.519378:0:17104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d2a431 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.519396:0:17104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d2a431 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.519415:0:17104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d2a431 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.519453:0:17104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d2a431 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.519458:0:17104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d2a431 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.519463:0:17104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d2a431 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.519467:0:17104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22039c0a00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:2.0:1787831137.519471:0:17104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d2a431 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.519476:0:17104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d2a431 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.519497:0:17104:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff8d233a6f8c00) 00010000:00010000:2.0:1787831137.519506:0:17104:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787831137.519510:0:17104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d2a431 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.519515:0:17104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d2a431 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831137.519599:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233cd15a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+43:15780:x1874676433433728:12345-192.168.203.31@tcp:54:lfs.0 Request processed in 300us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831137.519607:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 92 00000100:00100000:3.0:1787831137.580293:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831137.580621:0:18518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433433984 00000100:00100000:2.0:1787831137.580662:0:18518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433433984 00000100:00100000:2.0:1787831137.580794:0:18518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 93 00000100:00100000:2.0:1787831137.580806:0:18518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233cd14780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+43:15790:x1874676433433984:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:2.0:1787831137.580834:0:18518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787831137.580861:0:18518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d2a438 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99424348 expref: -99 pid: 18518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.581009:0:18518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1a00/0x95459fb9d1d2a43f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.581028:0:18518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668e00/0x95459fb9d1d2a400 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424333 expref: 44 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.581037:0:18518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94800/0x95459fb9d1d2a415 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a9942433a expref: 44 pid: 19892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.581081:0:18518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1a00/0x95459fb9d1d2a43f lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.581125:0:18518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94800/0x95459fb9d1d2a415 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0xe558a92a9942433a expref: 44 pid: 19892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.581140:0:18518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94800/0x95459fb9d1d2a415 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a9942433a expref: 44 pid: 19892 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831137.581157:0:18518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233fa4a1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18518:1874676443958656:192.168.203.31@tcp:104: 00010000:00010000:2.0:1787831137.581274:0:18518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668e00/0x95459fb9d1d2a400 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424333 expref: 44 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.581283:0:18518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668e00/0x95459fb9d1d2a400 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424333 expref: 44 pid: 17104 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831137.581293:0:18518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233fa49680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18518:1874676443958784:192.168.203.31@tcp:104: 00000100:00100000:2.0:1787831137.581316:0:18518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2338238480 going to sleep for 11 seconds 00000100:00100000:2.0:1787831137.584940:0:18518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233fa49680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18518:1874676443958784:192.168.203.31@tcp:104: 00000100:00100000:3.0:1787831137.584941:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831137.585124:0:18518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233fa4a1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18518:1874676443958656:192.168.203.31@tcp:104: 00010000:00010000:2.0:1787831137.585169:0:18518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1a00/0x95459fb9d1d2a43f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787831137.585178:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831137.587182:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433434112 00000100:00100000:2.0:1787831137.587194:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433434240 00000100:00100000:0.0:1787831137.587199:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433434112 00000100:00100000:2.0:1787831137.587202:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433434240 00010000:00010000:2.0:1787831137.587270:0:17089:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94800/0x95459fb9d1d2a415 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a9942433a expref: 46 pid: 19892 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831137.587270:0:17091:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668e00/0x95459fb9d1d2a400 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424333 expref: 46 pid: 17104 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831137.587336:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 30 00000100:00100000:2.0:1787831137.587349:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233cd14b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+46:2397:x1874676433434240:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787831137.587368:0:17089:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787831137.587386:0:17089:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94800/0x95459fb9d1d2a415 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a9942433a expref: 46 pid: 19892 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.587538:0:17089:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94800/0x95459fb9d1d2a415 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a9942433a expref: 46 pid: 19892 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.587569:0:17089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94800/0x95459fb9d1d2a415 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a9942433a expref: 46 pid: 19892 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.587591:0:17089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff8d233a6f8c00) 00010000:00010000:2.0:1787831137.587597:0:17089:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1a00/0x95459fb9d1d2a43f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.587607:0:17089:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1a00/0x95459fb9d1d2a43f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.587615:0:17089:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787831137.587689:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 31 00000100:00100000:0.0:1787831137.587699:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233cd16940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+45:2396:x1874676433434112:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787831137.587709:0:17091:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787831137.587715:0:17091:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668e00/0x95459fb9d1d2a400 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424333 expref: 45 pid: 17104 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831137.587727:0:17091:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668e00/0x95459fb9d1d2a400 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424333 expref: 45 pid: 17104 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831137.587737:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233cd14b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+45:2397:x1874676433434240:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 390us (2561us total) trans 0 rc 0/0 00010000:00010000:0.0:1787831137.587744:0:17091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668e00/0x95459fb9d1d2a400 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424333 expref: 45 pid: 17104 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831137.587749:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 30 00010000:00010000:0.0:1787831137.587882:0:17091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff8d233a6f8c00) 00010000:00010000:0.0:1787831137.587952:0:17091:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1a00/0x95459fb9d1d2a43f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831137.587967:0:17091:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1a00/0x95459fb9d1d2a43f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831137.587976:0:17091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1a00/0x95459fb9d1d2a43f lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831137.588072:0:17091:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787831137.588102:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233cd16940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+43:2396:x1874676433434112:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 406us (3175us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831137.588118:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 31 00010000:00010000:2.0:1787831137.588170:0:18518:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1a00/0x95459fb9d1d2a43f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.588185:0:18518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1a00/0x95459fb9d1d2a43f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787831137.588206:0:18518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00010000:00010000:2.0:1787831137.588433:0:18518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d2a438 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424348 expref: 44 pid: 18518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.588452:0:18518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1a00/0x95459fb9d1d2a43f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424348 expref: 43 pid: 18518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.588465:0:18518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff8d233a6f8c00) 00010000:00010000:2.0:1787831137.588469:0:18518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787831137.588472:0:18518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22039c1a00, rc 0) 00000100:00100000:2.0:1787831137.588500:0:18518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233cd14780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+43:15790:x1874676433433984:12345-192.168.203.31@tcp:101:bash.0 Request processed in 7698us (8222us total) trans 8589934652 rc 0/0 00000100:00100000:2.0:1787831137.588509:0:18518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 93 00000100:00100000:3.0:1787831137.590730:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831137.590963:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433434368 00000100:00100000:1.0:1787831137.590975:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433434368 00000100:00100000:1.0:1787831137.591074:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 94 00000100:00100000:1.0:1787831137.591086:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233cd17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+43:15790:x1874676433434368:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:1.0:1787831137.591114:0:17105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787831137.591140:0:17105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94c00/0x95459fb9d1d2a44d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a9942434f expref: -99 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831137.591182:0:17105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94200/0x95459fb9d1d2a454 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831137.591197:0:17105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94200/0x95459fb9d1d2a454 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831137.591210:0:17105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94200/0x95459fb9d1d2a454 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831137.591585:0:17105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94c00/0x95459fb9d1d2a44d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a9942434f expref: 45 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831137.591608:0:17105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94200/0x95459fb9d1d2a454 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a9942434f expref: 44 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831137.591617:0:17105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff8d233a6f8c00) 00010000:00010000:1.0:1787831137.593104:0:17105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787831137.593119:0:17105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233be94200, rc 0) 00000100:00100000:1.0:1787831137.593370:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233cd17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+44:15790:x1874676433434368:12345-192.168.203.31@tcp:101:bash.0 Request processed in 2280us (2647us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831137.593381:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 94 00000100:00100000:3.0:1787831137.596369:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831137.596599:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433434624 00000100:00100000:2.0:1787831137.596613:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433434624 00000100:00100000:2.0:1787831137.596702:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 95 00000100:00100000:2.0:1787831137.596712:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233cd143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+44:15790:x1874676433434624:12345-192.168.203.31@tcp:36:bash.0 00010000:00010000:2.0:1787831137.597293:0:17104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0600/0x95459fb9d1d2a45b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.597317:0:17104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0600/0x95459fb9d1d2a45b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.597332:0:17104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0600/0x95459fb9d1d2a45b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787831137.598917:0:17104:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934653 00000004:00010000:2.0:1787831137.598970:0:17104:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000048e0165d reply state 000000005d059e8b transno 8589934654 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0600/0x95459fb9d1d2a45b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.598993:0:17104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0600/0x95459fb9d1d2a45b lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.599005:0:17104:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff8d233a6f8c00) 00010000:00010000:2.0:1787831137.599008:0:17104:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787831137.599013:0:17104:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787831137.599167:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233cd143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+47:15790:x1874676433434624:12345-192.168.203.31@tcp:36:bash.0 Request processed in 2451us (2804us total) trans 8589934654 rc 0/0 00000100:00100000:2.0:1787831137.599177:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 95 00000020:00080000:2.0:1787831137.599185:0:17104:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787831137.605195:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831137.605583:0:18518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433434752 00000100:00100000:2.0:1787831137.605597:0:18518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433434752 00000100:00100000:2.0:1787831137.605716:0:18518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 96 00000100:00100000:2.0:1787831137.605729:0:18518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233cd17840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+47:15790:x1874676433434752:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:2.0:1787831137.605762:0:18518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787831137.605788:0:18518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d2a462 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99424356 expref: -99 pid: 18518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.605915:0:18518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1800/0x95459fb9d1d2a469 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.605932:0:18518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1a00/0x95459fb9d1d2a43f lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424348 expref: 48 pid: 18518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.605965:0:18518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1800/0x95459fb9d1d2a469 lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.606009:0:18518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1a00/0x95459fb9d1d2a43f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424348 expref: 48 pid: 18518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.606024:0:18518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1a00/0x95459fb9d1d2a43f lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424348 expref: 48 pid: 18518 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831137.606040:0:18518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233fa4a1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18518:1874676443958912:192.168.203.31@tcp:104: 00000100:00100000:2.0:1787831137.606150:0:18518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d232f7e7c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787831137.609164:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831137.609460:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433434880 00000100:00100000:1.0:1787831137.609481:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433434880 00010000:00010000:1.0:1787831137.609534:0:17090:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1a00/0x95459fb9d1d2a43f lrc: 5/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424348 expref: 49 pid: 18518 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831137.609585:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 32 00000100:00100000:1.0:1787831137.609601:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233554a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+49:2397:x1874676433434880:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787831137.609621:0:17090:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787831137.609664:0:17090:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1a00/0x95459fb9d1d2a43f lrc: 5/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424348 expref: 49 pid: 18518 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831137.609680:0:17090:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1a00/0x95459fb9d1d2a43f lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424348 expref: 49 pid: 18518 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831137.609734:0:17090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff8d233a6f8c00) 00010000:00010000:1.0:1787831137.609739:0:17090:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1800/0x95459fb9d1d2a469 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831137.609750:0:17090:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1800/0x95459fb9d1d2a469 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831137.609758:0:17090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1800/0x95459fb9d1d2a469 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831137.609784:0:17090:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787831137.609860:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233554a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+49:2397:x1874676433434880:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 261us (711us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831137.609869:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 32 00010000:00010000:2.0:1787831137.610003:0:18518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1a00/0x95459fb9d1d2a43f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424348 expref: 48 pid: 18518 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831137.610026:0:18518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233fa4a1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18518:1874676443958912:192.168.203.31@tcp:104: 00010000:00010000:2.0:1787831137.610159:0:18518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1800/0x95459fb9d1d2a469 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.610170:0:18518:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1800/0x95459fb9d1d2a469 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.610177:0:18518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1800/0x95459fb9d1d2a469 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787831137.610237:0:18518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00000004:00200000:2.0:1787831137.610241:0:18518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787831137.610264:0:18518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1800/0x95459fb9d1d2a469 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.610305:0:18518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d2a462 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424356 expref: 48 pid: 18518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.610319:0:18518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1800/0x95459fb9d1d2a469 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424356 expref: 47 pid: 18518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.610327:0:18518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff8d233a6f8c00) 00010000:00010000:2.0:1787831137.610330:0:18518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787831137.610333:0:18518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22039c1800, rc 0) 00000100:00100000:2.0:1787831137.610358:0:18518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233cd17840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+47:15790:x1874676433434752:12345-192.168.203.31@tcp:101:bash.0 Request processed in 4634us (5181us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831137.610365:0:18518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 96 00000100:00100000:3.0:1787831137.615607:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831137.617223:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433435136 00000100:00100000:1.0:1787831137.617243:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433435136 00000100:00100000:1.0:1787831137.617334:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 21 00000100:00100000:1.0:1787831137.617346:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233cd16580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+47:15790:x1874676433435136:12345-192.168.203.31@tcp:35:bash.0 00000100:00100000:1.0:1787831137.617805:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233cd16580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+48:15790:x1874676433435136:12345-192.168.203.31@tcp:35:bash.0 Request processed in 459us (2210us total) trans 8589934655 rc 0/0 00000100:00100000:1.0:1787831137.617816:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 21 00000100:00100000:0.0:1787831137.693145:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831137.693289:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433435264 00000100:00100000:1.0:1787831137.693305:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433435264 00000100:00100000:1.0:1787831137.693994:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 97 00000100:00100000:1.0:1787831137.694009:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb103c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+48:15796:x1874676433435264:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:1.0:1787831137.694046:0:17105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787831137.694097:0:17105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94c00/0x95459fb9d1d2a470 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a9942435d expref: -99 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831137.694204:0:17105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94800/0x95459fb9d1d2a477 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831137.694221:0:17105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94800/0x95459fb9d1d2a477 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831137.694235:0:17105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94800/0x95459fb9d1d2a477 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787831137.694512:0:17105:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787831137.694516:0:17105:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787831137.694541:0:17105:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94800/0x95459fb9d1d2a477 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831137.694568:0:17105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94c00/0x95459fb9d1d2a470 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a9942435d expref: 50 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831137.694588:0:17105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94800/0x95459fb9d1d2a477 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a9942435d expref: 49 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831137.694598:0:17105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d233a6f8800) 00010000:00010000:1.0:1787831137.694601:0:17105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787831137.694605:0:17105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233be94800, rc 0) 00000100:00100000:0.0:1787831137.695681:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb103c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+49:15796:x1874676433435264:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 1665us (2542us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831137.695695:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 97 00000100:00100000:3.0:1787831137.700042:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831137.700157:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433435392 00000100:00100000:2.0:1787831137.700170:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433435392 00000100:00100000:2.0:1787831137.700249:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 98 00000100:00100000:2.0:1787831137.700263:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233cd16d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+49:15796:x1874676433435392:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:2.0:1787831137.700290:0:17104:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787831137.700330:0:17104:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d2a47e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99424364 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.700426:0:17104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1a00/0x95459fb9d1d2a485 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.700445:0:17104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1a00/0x95459fb9d1d2a485 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.700460:0:17104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1a00/0x95459fb9d1d2a485 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.700499:0:17104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3c00/0x95459fb9d1d2a48c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.700507:0:17104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3c00/0x95459fb9d1d2a48c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.700515:0:17104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3c00/0x95459fb9d1d2a48c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.700612:0:17104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2a00/0x95459fb9d1d2a493 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.700665:0:17104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2a00/0x95459fb9d1d2a493 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.700674:0:17104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2a00/0x95459fb9d1d2a493 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787831137.700729:0:17104:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00000004:00200000:2.0:1787831137.700735:0:17104:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787831137.700758:0:17104:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2a00/0x95459fb9d1d2a493 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.700771:0:17104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2a00/0x95459fb9d1d2a493 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.700780:0:17104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1a00/0x95459fb9d1d2a485 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.700788:0:17104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1a00/0x95459fb9d1d2a485 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.700807:0:17104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1a00/0x95459fb9d1d2a485 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.700814:0:17104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22039c1a00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:2.0:1787831137.700818:0:17104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1a00/0x95459fb9d1d2a485 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.700827:0:17104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1a00/0x95459fb9d1d2a485 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.700842:0:17104:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d233a6f8800) 00010000:00010000:2.0:1787831137.700845:0:17104:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787831137.700851:0:17104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1a00/0x95459fb9d1d2a485 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.700858:0:17104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1a00/0x95459fb9d1d2a485 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.700872:0:17104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3c00/0x95459fb9d1d2a48c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.700878:0:17104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3c00/0x95459fb9d1d2a48c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.700885:0:17104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3c00/0x95459fb9d1d2a48c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.700901:0:17104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2303aa3c00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:2.0:1787831137.700904:0:17104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3c00/0x95459fb9d1d2a48c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.700921:0:17104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3c00/0x95459fb9d1d2a48c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.700930:0:17104:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8d2303e42900) 00010000:00010000:2.0:1787831137.700932:0:17104:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787831137.700936:0:17104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3c00/0x95459fb9d1d2a48c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.700942:0:17104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3c00/0x95459fb9d1d2a48c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.700976:0:17104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0a00/0x95459fb9d1d2a47e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424364 expref: 51 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.700991:0:17104:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2a00/0x95459fb9d1d2a493 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424364 expref: 50 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.700999:0:17104:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff8d233a6f8c00) 00010000:00010000:2.0:1787831137.701002:0:17104:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787831137.701005:0:17104:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2303aa2a00, rc 0) 00000100:00100000:2.0:1787831137.701077:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233cd16d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+50:15796:x1874676433435392:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 817us (1049us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831137.701086:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 98 00000100:00100000:3.0:1787831137.709459:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831137.709548:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831137.709665:0:20128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433435520 00000100:00100000:1.0:1787831137.709678:0:20128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433435520 00000100:00100000:1.0:1787831137.709761:0:20128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 2 00000100:00100000:1.0:1787831137.709774:0:20128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233cd15680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+50:2397:x1874676433435520:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787831137.709834:0:20128:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787831137.709873:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2a00/0x95459fb9d1d2a493 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424364 expref: 50 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831137.709914:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff8d233a6f8c00) 00010000:00010000:1.0:1787831137.709921:0:20128:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787831137.709996:0:20128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233cd15680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+49:2397:x1874676433435520:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 225us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831137.710006:0:20128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 2 00000100:00100000:2.0:1787831137.710111:0:18518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433435776 00000100:00100000:2.0:1787831137.710117:0:18518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433435776 00000100:00100000:2.0:1787831137.710163:0:18518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 99 00000100:00100000:2.0:1787831137.710172:0:18518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233cd152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+49:15796:x1874676433435776:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:2.0:1787831137.710203:0:18518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787831137.710225:0:18518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3c00/0x95459fb9d1d2a49a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a9942436b expref: -99 pid: 18518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.710396:0:18518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3800/0x95459fb9d1d2a4a1 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.710414:0:18518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1800/0x95459fb9d1d2a469 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424356 expref: 50 pid: 18518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.710424:0:18518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3800/0x95459fb9d1d2a4a1 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.710465:0:18518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1800/0x95459fb9d1d2a469 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424356 expref: 50 pid: 18518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.710480:0:18518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1800/0x95459fb9d1d2a469 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424356 expref: 50 pid: 18518 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831137.710496:0:18518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233fa4a1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18518:1874676443959040:192.168.203.31@tcp:104: 00000100:00100000:2.0:1787831137.710571:0:18518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d232f7e7c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787831137.718416:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831137.720277:0:18518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233fa4a1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18518:1874676443959040:192.168.203.31@tcp:104: 00010000:00010000:2.0:1787831137.720308:0:18518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3800/0x95459fb9d1d2a4a1 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787831137.720853:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433435904 00000100:00100000:3.0:1787831137.720861:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433435904 00010000:00010000:3.0:1787831137.720913:0:17089:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1800/0x95459fb9d1d2a469 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424356 expref: 51 pid: 18518 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787831137.720952:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 33 00000100:00100000:3.0:1787831137.720961:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb13840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+51:2395:x1874676433435904:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787831137.720977:0:17089:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787831137.720984:0:17089:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1800/0x95459fb9d1d2a469 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424356 expref: 51 pid: 18518 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831137.720998:0:17089:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1800/0x95459fb9d1d2a469 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424356 expref: 51 pid: 18518 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831137.721021:0:17089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1800/0x95459fb9d1d2a469 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424356 expref: 51 pid: 18518 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831137.721126:0:17089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff8d233a6f8c00) 00010000:00010000:3.0:1787831137.721132:0:17089:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3800/0x95459fb9d1d2a4a1 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831137.721142:0:17089:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3800/0x95459fb9d1d2a4a1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831137.721150:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3800/0x95459fb9d1d2a4a1 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831137.721226:0:17089:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787831137.721297:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb13840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+50:2395:x1874676433435904:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 336us (2899us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831137.721306:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 33 00010000:00010000:2.0:1787831137.722074:0:18518:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3800/0x95459fb9d1d2a4a1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.722085:0:18518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3800/0x95459fb9d1d2a4a1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787831137.722338:0:18518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00010000:00010000:2.0:1787831137.722480:0:18518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3c00/0x95459fb9d1d2a49a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a9942436b expref: 51 pid: 18518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.722498:0:18518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3800/0x95459fb9d1d2a4a1 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a9942436b expref: 50 pid: 18518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.722508:0:18518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff8d233a6f8c00) 00010000:00010000:2.0:1787831137.722511:0:18518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787831137.722514:0:18518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2303aa3800, rc 0) 00000100:00100000:2.0:1787831137.722737:0:18518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233cd152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+50:15796:x1874676433435776:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 12565us (13187us total) trans 8589934656 rc 0/0 00000100:00100000:2.0:1787831137.722747:0:18518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 99 00000100:00100000:3.0:1787831137.725694:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831137.725789:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433436288 00000100:00100000:1.0:1787831137.725799:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433436288 00000100:00100000:1.0:1787831137.725852:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 22 00000100:00100000:1.0:1787831137.725859:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220385f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+50:15796:x1874676433436288:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:1.0:1787831137.726065:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220385f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+51:15796:x1874676433436288:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 205us (379us total) trans 8589934657 rc 0/0 00000100:00100000:1.0:1787831137.726073:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 22 00000100:00100000:0.0:1787831137.728678:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831137.728719:0:20128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433436416 00000100:00100000:1.0:1787831137.728728:0:20128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433436416 00000100:00100000:1.0:1787831137.728791:0:20128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 3 00000100:00100000:1.0:1787831137.728802:0:20128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb12580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+51:15796:x1874676433436416:12345-192.168.203.31@tcp:103:lfs.0 00010000:00010000:1.0:1787831137.728817:0:20128:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787831137.728841:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11e00/0x95459fb9d1d2a423 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424341 expref: 51 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831137.728860:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff8d233a6f8c00) 00010000:00010000:1.0:1787831137.728866:0:20128:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787831137.728942:0:20128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb12580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+50:15796:x1874676433436416:12345-192.168.203.31@tcp:103:lfs.0 Request processed in 142us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831137.728951:0:20128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 3 00000100:00100000:0.0:1787831137.731472:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831137.731650:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433436544 00000100:00100000:2.0:1787831137.731660:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433436544 00000100:00100000:2.0:1787831137.731717:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 100 00000100:00100000:2.0:1787831137.731728:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb12d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+50:15796:x1874676433436544:12345-192.168.203.31@tcp:58:lfs.0 00010000:00010000:2.0:1787831137.731838:0:17105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3e00/0x95459fb9d1d2a4af lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.731857:0:17105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3e00/0x95459fb9d1d2a4af lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831137.731870:0:17105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3e00/0x95459fb9d1d2a4af lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787831137.731986:0:17105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].2, 136 off8464 00000100:00100000:2.0:1787831137.732081:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb12d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+50:15796:x1874676433436544:12345-192.168.203.31@tcp:58:lfs.0 Request processed in 354us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831137.732089:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 100 00000100:00100000:3.0:1787831137.735013:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831137.735273:0:19892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433436672 00000100:00100000:1.0:1787831137.735284:0:19892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433436672 00000100:00100000:1.0:1787831137.735409:0:19892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 101 00000100:00100000:1.0:1787831137.735426:0:19892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233cd14f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+50:15796:x1874676433436672:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:1.0:1787831137.735444:0:19892:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787831137.735465:0:19892:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94c00/0x95459fb9d1d2a4b6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99424372 expref: -99 pid: 19892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831137.735521:0:19892:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3e00/0x95459fb9d1d2a4af lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831137.735532:0:19892:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94c00/0x95459fb9d1d2a4b6 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424372 expref: 51 pid: 19892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831137.735551:0:19892:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3e00/0x95459fb9d1d2a4af lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831137.735563:0:19892:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94c00/0x95459fb9d1d2a4b6 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424372 expref: 51 pid: 19892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831137.735575:0:19892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff8d233a6f8c00) 00010000:00010000:1.0:1787831137.735578:0:19892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787831137.735582:0:19892:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94c00/0x95459fb9d1d2a4b6 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424372 expref: 51 pid: 19892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831137.735590:0:19892:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233be94c00, rc 0) 00000100:00100000:1.0:1787831137.735694:0:19892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233cd14f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+51:15796:x1874676433436672:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 277us (690us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831137.735701:0:19892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 101 00010000:00010000:2.0:1787831138.214783:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787831138.726996:0:17139:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787831138.727009:0:17139:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787831138.727035:0:17139:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:0.0:1787831138.727043:0:17139:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1787831138.728284:0:17139:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233fb10b40 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17139:1874676443959168:192.168.203.31@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787831138.728381:0:17139:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d233bcbcb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787831138.732948:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831138.733171:0:18518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433436800 00000100:00100000:2.0:1787831138.733180:0:18518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433436800 00000100:00100000:0.0:1787831138.733180:0:17139:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233fb10b40 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17139:1874676443959168:192.168.203.31@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787831138.733258:0:18518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 102 00000100:00100000:2.0:1787831138.733270:0:18518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233cd170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+51:15798:x1874676433436800:12345-192.168.203.31@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787831138.733303:0:18518:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787831138.733413:0:18518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233cd170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+51:15798:x1874676433436800:12345-192.168.203.31@tcp:53:lhsmtool_posix.0 Request processed in 146us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831138.733421:0:18518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 102 00000100:00080000:2.0:1787831138.734282:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787831138.737316:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831138.737461:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433436928 00000100:00100000:2.0:1787831138.737476:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433436928 00000100:00100000:2.0:1787831138.737726:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 103 00000100:00100000:2.0:1787831138.737737:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233cd161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+51:15798:x1874676433436928:12345-192.168.203.31@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787831138.738022:0:17105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3c00/0x95459fb9d1d2a4bd lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831138.738041:0:17105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3c00/0x95459fb9d1d2a4bd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831138.738052:0:17105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3c00/0x95459fb9d1d2a4bd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831138.738119:0:17105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2200/0x95459fb9d1d2a4c4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831138.738144:0:17105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2200/0x95459fb9d1d2a4c4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831138.738152:0:17105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2200/0x95459fb9d1d2a4c4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831138.738183:0:17105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2600/0x95459fb9d1d2a4cb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831138.738193:0:17105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2600/0x95459fb9d1d2a4cb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831138.738199:0:17105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2600/0x95459fb9d1d2a4cb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787831138.738244:0:17105:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00000004:00200000:2.0:1787831138.738248:0:17105:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787831138.738260:0:17105:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2600/0x95459fb9d1d2a4cb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831138.738272:0:17105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3c00/0x95459fb9d1d2a4bd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831138.738278:0:17105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3c00/0x95459fb9d1d2a4bd lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831138.738284:0:17105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3c00/0x95459fb9d1d2a4bd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831138.738290:0:17105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2303aa3c00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:2.0:1787831138.738293:0:17105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3c00/0x95459fb9d1d2a4bd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831138.739901:0:17105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3c00/0x95459fb9d1d2a4bd lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831138.740374:0:17105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d220274c300) 00010000:00010000:2.0:1787831138.740378:0:17105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787831138.740383:0:17105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3c00/0x95459fb9d1d2a4bd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831138.740391:0:17105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3c00/0x95459fb9d1d2a4bd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831138.740411:0:17105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2200/0x95459fb9d1d2a4c4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831138.740418:0:17105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2200/0x95459fb9d1d2a4c4 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831138.740425:0:17105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2200/0x95459fb9d1d2a4c4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831138.740430:0:17105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2303aa2200 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:2.0:1787831138.740433:0:17105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2200/0x95459fb9d1d2a4c4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831138.740439:0:17105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2200/0x95459fb9d1d2a4c4 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831138.740446:0:17105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdfbec3e4 (ffff8d2303e42200) 00010000:00010000:2.0:1787831138.740449:0:17105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787831138.740452:0:17105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2200/0x95459fb9d1d2a4c4 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831138.740478:0:17105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2200/0x95459fb9d1d2a4c4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831138.740498:0:17105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2600/0x95459fb9d1d2a4cb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831138.740503:0:17105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2600/0x95459fb9d1d2a4cb lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831138.740521:0:17105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2600/0x95459fb9d1d2a4cb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831138.740527:0:17105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2303aa2600 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:2.0:1787831138.740530:0:17105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2600/0x95459fb9d1d2a4cb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831138.740537:0:17105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2600/0x95459fb9d1d2a4cb lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831138.740545:0:17105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff8d233a6f8c00) 00010000:00010000:2.0:1787831138.740548:0:17105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787831138.740551:0:17105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2600/0x95459fb9d1d2a4cb lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831138.740556:0:17105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2600/0x95459fb9d1d2a4cb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831138.740704:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233cd161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+51:15798:x1874676433436928:12345-192.168.203.31@tcp:34:lhsmtool_posix.0 Request processed in 2965us (3400us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831138.740714:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 103 00000100:00100000:0.0:1787831138.747744:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831138.747913:0:19892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433437184 00000100:00100000:1.0:1787831138.747927:0:19892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433437184 00000100:00100000:1.0:1787831138.748101:0:19892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 104 00000100:00100000:1.0:1787831138.748114:0:19892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb10b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+51:15798:x1874676433437184:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787831138.748146:0:19892:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787831138.748178:0:19892:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94e00/0x95459fb9d1d2a4d2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99424379 expref: -99 pid: 19892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831138.748349:0:19892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95e00/0x95459fb9d1d2a4d9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831138.748369:0:19892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95e00/0x95459fb9d1d2a4d9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831138.748384:0:19892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95e00/0x95459fb9d1d2a4d9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787831138.748397:0:19892:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00010000:00010000:1.0:1787831138.748507:0:19892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95e00/0x95459fb9d1d2a4d9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831138.748515:0:19892:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95e00/0x95459fb9d1d2a4d9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831138.748524:0:19892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95e00/0x95459fb9d1d2a4d9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831138.748530:0:19892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233be95e00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:1.0:1787831138.748555:0:19892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95e00/0x95459fb9d1d2a4d9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831138.748564:0:19892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95e00/0x95459fb9d1d2a4d9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831138.748580:0:19892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff8d233a6f8c00) 00010000:00010000:1.0:1787831138.748584:0:19892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787831138.748591:0:19892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95e00/0x95459fb9d1d2a4d9 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831138.748598:0:19892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95e00/0x95459fb9d1d2a4d9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831138.748715:0:19892:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94e00/0x95459fb9d1d2a4d2 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424379 expref: 53 pid: 19892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831138.748728:0:19892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d220274c300) 00010000:00010000:1.0:1787831138.748730:0:19892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787831138.748733:0:19892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94e00/0x95459fb9d1d2a4d2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424379 expref: 53 pid: 19892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831138.748743:0:19892:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233be94e00, rc 0) 00000100:00100000:1.0:1787831138.748826:0:19892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb10b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+52:15798:x1874676433437184:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 715us (1098us total) trans 8589934658 rc 301/301 00000100:00100000:1.0:1787831138.748835:0:19892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 104 00000100:00100000:3.0:1787831138.757502:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831138.757588:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433437312 00000100:00100000:0.0:1787831138.757600:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433437312 00000100:00100000:0.0:1787831138.757715:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 105 00000100:00100000:0.0:1787831138.757726:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233cd17c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+52:15798:x1874676433437312:12345-192.168.203.31@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787831138.757783:0:17104:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787831138.757961:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233cd17c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+52:15798:x1874676433437312:12345-192.168.203.31@tcp:53:lhsmtool_posix.0 Request processed in 236us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831138.757970:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 105 00000100:00100000:0.0:1787831138.762789:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831138.763528:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433437568 00000100:00100000:2.0:1787831138.763544:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433437568 00000100:00100000:2.0:1787831138.763719:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 106 00000100:00100000:2.0:1787831138.763731:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb121c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+52:15798:x1874676433437568:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787831138.763760:0:17105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787831138.763764:0:17105:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787831138.763803:0:17105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94800/0x95459fb9d1d2a477 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a9942435d expref: 52 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831138.763827:0:17105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d233a6f8800) 00010000:00010000:2.0:1787831138.763834:0:17105:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787831138.763853:0:17105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2600/0x95459fb9d1d2a4e7 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99424380 expref: -99 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787831138.766869:0:17105:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x7:0x0], count =27 00000004:00080000:2.0:1787831138.766893:0:17105:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x7:0x0]+27 in llog 00000004:00080000:2.0:1787831138.766914:0:17105:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x22:0x0], index 1: 0 00010000:00010000:2.0:1787831138.769501:0:17105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2200/0x95459fb9d1d2a4ee lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831138.769537:0:17105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2200/0x95459fb9d1d2a4ee lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831138.769554:0:17105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2200/0x95459fb9d1d2a4ee lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831138.769692:0:17105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2600/0x95459fb9d1d2a4e7 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424380 expref: 54 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831138.769719:0:17105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2200/0x95459fb9d1d2a4ee lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424380 expref: 53 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831138.769748:0:17105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff8d2303e42200) 00010000:00010000:2.0:1787831138.769752:0:17105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787831138.769758:0:17105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2303aa2200, rc 0) 00000100:00100000:2.0:1787831138.769867:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb121c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+53:15798:x1874676433437568:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 6137us (7095us total) trans 8589934659 rc 0/0 00000100:00100000:2.0:1787831138.769879:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 106 00000100:00100000:3.0:1787831138.776147:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831138.776455:0:19892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433437824 00000100:00100000:1.0:1787831138.776472:0:19892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433437824 00000100:00100000:1.0:1787831138.776557:0:19892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 107 00000100:00100000:1.0:1787831138.776570:0:19892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233cd14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+53:15798:x1874676433437824:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787831138.776897:0:19892:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787831138.776939:0:19892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2200/0x95459fb9d1d2a4ee lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424380 expref: 53 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831138.777369:0:19892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff8d2303e42200) 00010000:00010000:1.0:1787831138.777386:0:19892:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787831138.777430:0:19892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94e00/0x95459fb9d1d2a4fc lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831138.777448:0:19892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94e00/0x95459fb9d1d2a4fc lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831138.777461:0:19892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94e00/0x95459fb9d1d2a4fc lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831138.777478:0:19892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95e00/0x95459fb9d1d2a503 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x9ed4f664 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831138.777485:0:19892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95e00/0x95459fb9d1d2a503 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x9ed4f664 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831138.777492:0:19892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95e00/0x95459fb9d1d2a503 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x9ed4f664 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831138.777555:0:19892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94e00/0x95459fb9d1d2a4fc lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831138.777563:0:19892:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94e00/0x95459fb9d1d2a4fc lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831138.777570:0:19892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94e00/0x95459fb9d1d2a4fc lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831138.777587:0:19892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233be94e00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:1.0:1787831138.777592:0:19892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94e00/0x95459fb9d1d2a4fc lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831138.777600:0:19892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94e00/0x95459fb9d1d2a4fc lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831138.777609:0:19892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d233a6f8800) 00010000:00010000:1.0:1787831138.777612:0:19892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787831138.777616:0:19892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94e00/0x95459fb9d1d2a4fc lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831138.777657:0:19892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94e00/0x95459fb9d1d2a4fc lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831138.777669:0:19892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95e00/0x95459fb9d1d2a503 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x9ed4f664 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831138.777676:0:19892:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95e00/0x95459fb9d1d2a503 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x9ed4f664 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831138.777682:0:19892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95e00/0x95459fb9d1d2a503 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x9ed4f664 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831138.777687:0:19892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233be95e00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:1.0:1787831138.777689:0:19892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95e00/0x95459fb9d1d2a503 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x9ed4f664 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831138.778799:0:19892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95e00/0x95459fb9d1d2a503 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x9ed4f664 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831138.778835:0:19892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x9ed4f664 (ffff8d233a6f7300) 00010000:00010000:1.0:1787831138.778838:0:19892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787831138.778843:0:19892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95e00/0x95459fb9d1d2a503 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x9ed4f664 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831138.778851:0:19892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95e00/0x95459fb9d1d2a503 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x9ed4f664 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831138.779275:0:19892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233cd14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+52:15798:x1874676433437824:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 Request processed in 2700us (3137us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787831138.779286:0:19892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 107 00000100:00100000:2.0:1787831138.786057:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831138.786331:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433437952 00000100:00100000:0.0:1787831138.786345:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433437952 00000100:00100000:0.0:1787831138.786457:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 108 00000100:00100000:0.0:1787831138.786470:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fa4a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+52:15798:x1874676433437952:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787831138.786501:0:17106:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787831138.786533:0:17106:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10200/0x95459fb9d1d2a50a lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99424387 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831138.786581:0:17106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11400/0x95459fb9d1d2a511 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831138.786599:0:17106:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11400/0x95459fb9d1d2a511 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831138.786612:0:17106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11400/0x95459fb9d1d2a511 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831138.787177:0:17106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10200/0x95459fb9d1d2a50a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424387 expref: 54 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831138.787203:0:17106:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11400/0x95459fb9d1d2a511 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424387 expref: 53 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831138.787213:0:17106:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff8d2320608800) 00010000:00010000:0.0:1787831138.787217:0:17106:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787831138.787221:0:17106:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233bf11400, rc 0) 00000100:00100000:0.0:1787831138.787364:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fa4a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+53:15798:x1874676433437952:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 897us (1327us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831138.787372:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 108 00000100:00100000:0.0:1787831138.793113:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831138.793356:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433438208 00000100:00100000:2.0:1787831138.793370:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433438208 00000100:00100000:2.0:1787831138.793448:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 109 00000100:00100000:2.0:1787831138.793460:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+53:15798:x1874676433438208:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787831138.793581:0:17105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2600/0x95459fb9d1d2a518 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831138.793604:0:17105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2600/0x95459fb9d1d2a518 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831138.793620:0:17105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2600/0x95459fb9d1d2a518 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787831138.793900:0:17105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:2.0:1787831138.793912:0:17105:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 429794286685ns, next at 430794283675ns, rc = 0 00000004:00010000:2.0:1787831138.793970:0:17105:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000004325a64 reply state 000000007fe2e38f transno 8589934660 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2600/0x95459fb9d1d2a518 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831138.793985:0:17105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2600/0x95459fb9d1d2a518 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831138.794013:0:17105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff8d2320608800) 00010000:00010000:2.0:1787831138.794016:0:17105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1787831138.794022:0:17105:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787831138.794164:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+55:15798:x1874676433438208:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 Request processed in 707us (1065us total) trans 8589934660 rc 0/0 00000100:00100000:2.0:1787831138.794173:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 109 00000100:00100000:1.0:1787831138.801069:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831138.802117:0:19892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433438336 00000100:00100000:2.0:1787831138.802134:0:19892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433438336 00000100:00100000:2.0:1787831138.802226:0:19892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 110 00000100:00100000:2.0:1787831138.802238:0:19892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2309d08f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+55:15798:x1874676433438336:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787831138.802269:0:19892:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787831138.802299:0:19892:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3c00/0x95459fb9d1d2a51f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a9942438e expref: -99 pid: 19892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831138.802391:0:19892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3c00/0x95459fb9d1d2a51f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a9942438e expref: 56 pid: 19892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831138.802409:0:19892:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3c00/0x95459fb9d1d2a51f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a9942438e expref: 56 pid: 19892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831138.802434:0:19892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff8d2320608800) 00010000:00010000:2.0:1787831138.802437:0:19892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787831138.802444:0:19892:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2303aa3c00, rc 0) 00000100:00100000:2.0:1787831138.802544:0:19892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2309d08f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+56:15798:x1874676433438336:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 309us (1493us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831138.802553:0:19892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 110 00000100:00100000:1.0:1787831138.806896:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831138.807173:0:19566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433438464 00000100:00100000:2.0:1787831138.807186:0:19566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433438464 00000100:00100000:2.0:1787831138.807290:0:19566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 29 00000100:00100000:2.0:1787831138.807303:0:19566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2309d0a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+5:2396:x1874676433438464:12345-192.168.203.31@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1787831138.807331:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787831138.808157:0:19566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2309d0a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+6:2396:x1874676433438464:12345-192.168.203.31@tcp:2:lhsmtool_posix.0 Request processed in 850us (1285us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1787831138.808170:0:19566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 29 00000100:00100000:0.0:1787831138.810834:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831138.811331:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433438720 00000100:00100000:1.0:1787831138.811346:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433438720 00000100:00100000:1.0:1787831138.811426:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 23 00000100:00100000:1.0:1787831138.811438:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb11680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+56:15798:x1874676433438720:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787831138.812775:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb11680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+57:15798:x1874676433438720:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 Request processed in 1326us (1943us total) trans 8589934661 rc 0/0 00000100:00100000:1.0:1787831138.812793:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 23 00000100:00100000:3.0:1787831138.820556:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831138.820792:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433438976 00000100:00100000:0.0:1787831138.820806:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433438976 00000100:00100000:0.0:1787831138.820940:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 111 00000100:00100000:0.0:1787831138.820953:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233cd16580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+57:15798:x1874676433438976:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787831138.821115:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233cd16580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+57:15798:x1874676433438976:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 Request processed in 164us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831138.821123:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 111 00000100:00100000:3.0:1787831138.823804:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831138.824526:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433439104 00000100:00100000:0.0:1787831138.824540:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433439104 00000100:00100000:0.0:1787831138.824721:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 112 00000100:00100000:0.0:1787831138.824735:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233cd14b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+57:15798:x1874676433439104:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787831138.824765:0:17104:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787831138.824807:0:17104:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10200/0x95459fb9d1d2a526 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99424395 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831138.824937:0:17104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11600/0x95459fb9d1d2a52d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831138.824957:0:17104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11600/0x95459fb9d1d2a52d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831138.824972:0:17104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11600/0x95459fb9d1d2a52d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787831138.825594:0:17104:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787831138.825669:0:17104:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11600/0x95459fb9d1d2a52d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831138.825730:0:17104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10200/0x95459fb9d1d2a526 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424395 expref: 59 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831138.825756:0:17104:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11600/0x95459fb9d1d2a52d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424395 expref: 58 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831138.825766:0:17104:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff8d2320608800) 00010000:00010000:0.0:1787831138.825769:0:17104:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787831138.825773:0:17104:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233bf11600, rc 0) 00000100:00100000:0.0:1787831138.825868:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233cd14b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+58:15798:x1874676433439104:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 1135us (2075us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831138.825876:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 112 00000100:00100000:0.0:1787831138.832089:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831138.832412:0:18608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433439232 00000100:00100000:2.0:1787831138.832426:0:18608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433439232 00000100:00100000:2.0:1787831138.833470:0:18608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 30 00000100:00100000:2.0:1787831138.833494:0:18608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204625a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+6:2396:x1874676433439232:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787831138.833748:0:18608:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787831138.833782:0:18608:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009360e7aa/0x95459fb9d1d2a534 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a9942439c expref: -99 pid: 18608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787831138.833818:0:18608:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a902363, blocks: 0x0 00010000:00010000:2.0:1787831138.833846:0:18608:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=429s v=(0 0) 00010000:00010000:2.0:1787831138.833852:0:18608:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787831138.833865:0:18608:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009360e7aa/0x95459fb9d1d2a534 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a9942439c expref: 7 pid: 18608 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831138.833901:0:18608:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009360e7aa/0x95459fb9d1d2a534 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a9942439c expref: 7 pid: 18608 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831138.833918:0:18608:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2303aa2200, rc 0) 00000100:00100000:2.0:1787831138.834071:0:18608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204625a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+7:2396:x1874676433439232:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 588us (2113us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831138.834099:0:18608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 30 00000100:00100000:1.0:1787831138.837504:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831138.838079:0:18518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433439488 00000100:00100000:3.0:1787831138.838094:0:18518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433439488 00000100:00100000:3.0:1787831138.838230:0:18518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 113 00000100:00100000:3.0:1787831138.838242:0:18518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233faea1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+58:15798:x1874676433439488:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787831138.838406:0:18518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233faea1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+58:15798:x1874676433439488:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 Request processed in 166us (921us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831138.838434:0:18518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 113 00000100:00100000:3.0:1787831138.846464:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831138.847044:0:18610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433439616 00000100:00100000:1.0:1787831138.847060:0:18610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433439616 00000100:00100000:1.0:1787831138.847199:0:18610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 31 00000100:00100000:1.0:1787831138.847211:0:18610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233cd16940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+7:15798:x1874676433439616:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787831138.847234:0:18610:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787831138.847295:0:18610:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000053add3e/0x95459fb9d1d2a53b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a994243a3 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831138.847524:0:18610:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009360e7aa/0x95459fb9d1d2a534 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a9942439c expref: 8 pid: 18608 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831138.847536:0:18610:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787831138.847542:0:18610:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787831138.847549:0:18610:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000053add3e/0x95459fb9d1d2a53b lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994243a3 expref: 8 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831138.847599:0:18610:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009360e7aa/0x95459fb9d1d2a534 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.31@tcp remote: 0xe558a92a9942439c expref: 8 pid: 18608 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831138.847615:0:18610:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009360e7aa/0x95459fb9d1d2a534 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a9942439c expref: 8 pid: 18608 timeout: 529 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831138.847669:0:18610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233fae8b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:18610:1874676443959296:192.168.203.31@tcp:104: 00000100:00100000:1.0:1787831138.847781:0:18610:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2335786240 going to sleep for 11 seconds 00000100:00100000:3.0:1787831138.854861:0:18610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233fae8b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:18610:1874676443959296:192.168.203.31@tcp:104: 00010000:00010000:3.0:1787831138.854926:0:18610:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000053add3e/0x95459fb9d1d2a53b lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xe558a92a994243a3 expref: 8 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831138.854954:0:18610:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233be94a00, rc 0) 00000100:00100000:3.0:1787831138.855025:0:18610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233cd16940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+8:15798:x1874676433439616:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 7815us (8575us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831138.855035:0:18610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 31 00000100:00100000:3.0:1787831138.860088:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831138.860253:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433439744 00000100:00100000:1.0:1787831138.860266:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433439744 00010000:00010000:1.0:1787831138.860765:0:17090:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009360e7aa/0x95459fb9d1d2a534 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a9942439c expref: 8 pid: 18608 timeout: 529 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831138.861130:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 34 00000100:00100000:1.0:1787831138.861145:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb1cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+8:2396:x1874676433439744:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787831138.861181:0:17090:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787831138.861210:0:17090:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009360e7aa/0x95459fb9d1d2a534 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a9942439c expref: 8 pid: 18608 timeout: 529 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831138.861227:0:17090:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009360e7aa/0x95459fb9d1d2a534 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a9942439c expref: 8 pid: 18608 timeout: 529 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831138.861260:0:17090:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009360e7aa/0x95459fb9d1d2a534 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a9942439c expref: 8 pid: 18608 timeout: 529 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831138.861295:0:17090:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787831138.861301:0:17090:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787831138.861313:0:17090:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000053add3e/0x95459fb9d1d2a53b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0xe558a92a994243a3 expref: 7 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831138.861325:0:17090:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000053add3e/0x95459fb9d1d2a53b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0xe558a92a994243a3 expref: 7 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831138.861378:0:17090:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000053add3e/0x95459fb9d1d2a53b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xe558a92a994243a3 expref: 7 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831138.861397:0:17090:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233fae8780 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:17090:1874676443959424:192.168.203.31@tcp:105: 00000100:00100000:1.0:1787831138.861528:0:17090:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2335786300 going to sleep for 11 seconds 00000100:00100000:0.0:1787831138.865774:0:17090:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233fae8780 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:17090:1874676443959424:192.168.203.31@tcp:105: 00010000:00010000:0.0:1787831138.865814:0:17090:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787831138.865898:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb1cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+7:2396:x1874676433439744:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 4756us (5827us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831138.865911:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 34 00000100:00100000:0.0:1787831138.871044:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831138.871164:0:18613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433439872 00000100:00100000:2.0:1787831138.871178:0:18613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433439872 00002000:00100000:2.0:1787831138.871250:0:18613:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x22:0x0] (0->12) req@ffff8d2204624f00 x1874676433439872/t0(0) o4->2240faf2-2a81-4e92-bb4c-b58ed0f19f2a@192.168.203.31@tcp:209/0 lens 504/0 e 0 to 0 dl 1787831149 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:100 00002000:00100000:2.0:1787831138.871265:0:18613:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d2204624f00 with x1874676433439872 ext(0->12) 00002000:00010000:2.0:1787831138.871272:0:18613:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d2204624f00 00000100:00100000:2.0:1787831138.871372:0:18613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 2 00000100:00100000:2.0:1787831138.871384:0:18613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204624f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+7:2397:x1874676433439872:12345-192.168.203.31@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787831138.872528:0:18613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204624f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+9:2397:x1874676433439872:12345-192.168.203.31@tcp:4:lhsmtool_posix.0 Request processed in 1137us (1495us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1787831138.872542:0:18613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 2 00002000:00100000:2.0:1787831138.872554:0:18613:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x22:0x0] (0->12) req@ffff8d2204624f00 x1874676433439872/t8589934596(0) o4->2240faf2-2a81-4e92-bb4c-b58ed0f19f2a@192.168.203.31@tcp:209/0 lens 504/448 e 0 to 0 dl 1787831149 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:100 00002000:00100000:2.0:1787831138.872563:0:18613:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d2204624f00 with x1874676433439872 ext(0->12) 00002000:00010000:2.0:1787831138.872569:0:18613:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d2204624f00 00000100:00100000:2.0:1787831138.883515:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831138.883596:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433440000 00000100:00100000:0.0:1787831138.883608:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433440000 00000100:00100000:0.0:1787831138.883727:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 114 00000100:00100000:0.0:1787831138.883738:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fa49680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+58:15798:x1874676433440000:12345-192.168.203.31@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1787831138.891905:0:17084:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934661 is committed 00000004:00080000:0.0:1787831138.891930:0:17084:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000004:00080000:0.0:1787831138.891997:0:17084:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:0.0:1787831138.892055:0:17084:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d23357869c0 refcount 2 committed 0 result 0 batchid 4294967529 00000020:00080000:0.0:1787831138.892073:0:17084:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d2203623b00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d2335786f00 00000020:00080000:0.0:1787831138.892076:0:17084:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d2203623e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d2204805e00 00000020:00080000:0.0:1787831138.892113:0:17143:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967529 committed batchid 8 00000020:00080000:0.0:1787831138.892239:0:17143:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00100000:1.0:1787831138.892438:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233fae8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1874676443959552:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787831138.892460:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fa49680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+22:15798:x1874676433440000:12345-192.168.203.31@tcp:44:lhsmtool_posix.0 Request processed in 8716us (8953us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831138.892476:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 114 00000100:00100000:2.0:1787831138.892516:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233fa48b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443959680:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1787831138.892534:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831138.892577:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831138.892656:0:18914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443959552 00000100:00100000:1.0:1787831138.892664:0:18914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443959552 00000100:00100000:2.0:1787831138.892668:0:18609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443959680 00000100:00100000:2.0:1787831138.892674:0:18609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443959680 00010000:00010000:3.0:1787831138.892719:0:3606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668800/0x95459fb9d1d2a2a2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831138.892727:0:18914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00010000:00010000:3.0:1787831138.892738:0:3606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668800/0x95459fb9d1d2a2a2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831138.892738:0:18609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787831138.892744:0:18914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fae8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3620:x1874676443959552:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787831138.892753:0:18609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fa4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1874676443959680:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1787831138.892758:0:3606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668800/0x95459fb9d1d2a2a2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831138.892767:0:3606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2301668800 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:3.0:1787831138.892774:0:3606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668800/0x95459fb9d1d2a2a2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1787831138.892780:0:18914:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:34 count 1 00010000:00010000:3.0:1787831138.892784:0:3606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668800/0x95459fb9d1d2a2a2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831138.892806:0:3606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d2320608500) 00010000:00010000:1.0:1787831138.892808:0:18914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2e5169c/0x95459fb9d1d2a542 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831138.892822:0:3606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787831138.892831:0:3606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668800/0x95459fb9d1d2a2a2 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831138.892838:0:18914:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e4a63826/0x95459fb9d1d2a351 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424317 expref: 7 pid: 18609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831138.892840:0:3606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668800/0x95459fb9d1d2a2a2 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831138.892861:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1787831138.892868:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787831138.892873:0:18914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2e5169c/0x95459fb9d1d2a542 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787831138.892878:0:18609:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1787831138.892899:0:18609:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1787831139 00002000:00010000:2.0:1787831138.892902:0:18609:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787831138.892904:0:18609:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1787831139 -> 1787831139 00002000:00010000:2.0:1787831138.892908:0:18609:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1787831138.892920:0:18914:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e4a63826/0x95459fb9d1d2a351 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424317 expref: 7 pid: 18609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831138.892938:0:18914:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e4a63826/0x95459fb9d1d2a351 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424317 expref: 7 pid: 18609 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831138.892952:0:18914:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22045570c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:18914:1874676443959808:192.168.203.31@tcp:104: 00000100:00100000:2.0:1787831138.892958:0:18609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fa4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3621:x1874676443959680:12345-0@lo:2:osp-syn-1-0.0 Request processed in 209us (379us total) trans 8589934597 rc 0/0 00010000:00010000:3.0:1787831138.892964:0:3606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94400/0x95459fb9d1d2a343 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831138.892970:0:18609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00010000:3.0:1787831138.892978:0:3606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94400/0x95459fb9d1d2a343 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831138.892985:0:3606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94400/0x95459fb9d1d2a343 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831138.892990:0:3606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233be94400 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:3.0:1787831138.892994:0:3606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94400/0x95459fb9d1d2a343 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831138.893000:0:3606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94400/0x95459fb9d1d2a343 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831138.893011:0:3606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d2303e42500) 00010000:00010000:3.0:1787831138.893014:0:3606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787831138.893017:0:18914:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2335786600 going to sleep for 11 seconds 00010000:00010000:3.0:1787831138.893018:0:3606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94400/0x95459fb9d1d2a343 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831138.893027:0:3606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94400/0x95459fb9d1d2a343 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787831138.893035:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787831138.893041:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787831138.893046:0:3606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1000/0x95459fb9d1d2a3d6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831138.893065:0:3606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1000/0x95459fb9d1d2a3d6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831138.893070:0:3606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1000/0x95459fb9d1d2a3d6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831138.893075:0:3606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22039c1000 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:3.0:1787831138.893078:0:3606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1000/0x95459fb9d1d2a3d6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831138.893084:0:3606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1000/0x95459fb9d1d2a3d6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831138.893092:0:3606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8d2303e42900) 00010000:00010000:3.0:1787831138.893096:0:3606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787831138.893099:0:3606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1000/0x95459fb9d1d2a3d6 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831138.893105:0:3606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1000/0x95459fb9d1d2a3d6 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831138.893120:0:3606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669a00/0x95459fb9d1d2a3f9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831138.893126:0:3606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669a00/0x95459fb9d1d2a3f9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831138.893131:0:3606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669a00/0x95459fb9d1d2a3f9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831138.893137:0:3606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2301669a00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:3.0:1787831138.893146:0:3606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669a00/0x95459fb9d1d2a3f9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831138.893153:0:3606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669a00/0x95459fb9d1d2a3f9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831138.893160:0:3606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8d2303e42900) 00010000:00010000:3.0:1787831138.893163:0:3606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787831138.893166:0:3606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669a00/0x95459fb9d1d2a3f9 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831138.893171:0:3606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669a00/0x95459fb9d1d2a3f9 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831138.893188:0:3606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0600/0x95459fb9d1d2a45b lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831138.893194:0:3606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0600/0x95459fb9d1d2a45b lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831138.893200:0:3606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0600/0x95459fb9d1d2a45b lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831138.893205:0:3606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22039c0600 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:3.0:1787831138.893207:0:3606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0600/0x95459fb9d1d2a45b lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831138.893213:0:3606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0600/0x95459fb9d1d2a45b lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831138.893221:0:3606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff8d233a6f8c00) 00010000:00010000:3.0:1787831138.893223:0:3606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787831138.893233:0:3606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0600/0x95459fb9d1d2a45b lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831138.893239:0:3606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0600/0x95459fb9d1d2a45b lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831138.893252:0:3606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2600/0x95459fb9d1d2a518 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831138.893259:0:3606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2600/0x95459fb9d1d2a518 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831138.893264:0:3606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2600/0x95459fb9d1d2a518 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831138.893269:0:3606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2303aa2600 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:3.0:1787831138.893272:0:3606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2600/0x95459fb9d1d2a518 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831138.893278:0:3606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2600/0x95459fb9d1d2a518 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831138.893286:0:3606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff8d2320608800) 00010000:00010000:3.0:1787831138.893288:0:3606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787831138.893291:0:3606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2600/0x95459fb9d1d2a518 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831138.893296:0:3606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2600/0x95459fb9d1d2a518 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787831138.894373:0:3621:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d233fa48b40/2, rc 0, transno 8589934597 00000100:00100000:0.0:1787831138.894389:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233fa48b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443959680:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1787831138.897183:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831138.897254:0:18610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433440128 00000100:00100000:3.0:1787831138.897269:0:18610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433440128 00000100:00100000:3.0:1787831138.897349:0:18610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 34 00000100:00100000:3.0:1787831138.897381:0:18610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fa49e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+9:2396:x1874676433440128:12345-192.168.203.31@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1787831138.897398:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831138.897444:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433440256 00000100:00100000:2.0:1787831138.897448:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433440256 00010000:00010000:2.0:1787831138.897478:0:17091:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e4a63826/0x95459fb9d1d2a351 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424317 expref: 8 pid: 18609 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831138.897508:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 35 00000100:00100000:2.0:1787831138.897514:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fa48780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+8:2396:x1874676433440256:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787831138.897527:0:17091:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787831138.897533:0:17091:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e4a63826/0x95459fb9d1d2a351 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424317 expref: 8 pid: 18609 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831138.897549:0:17091:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e4a63826/0x95459fb9d1d2a351 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424317 expref: 8 pid: 18609 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831138.897584:0:17091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787831138.897590:0:17091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787831138.897596:0:17091:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c2e5169c/0x95459fb9d1d2a542 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831138.897621:0:17091:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2e5169c/0x95459fb9d1d2a542 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831138.897691:0:17091:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787831138.897756:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fa48780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+8:2396:x1874676433440256:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 241us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831138.897764:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 35 00010000:00010000:1.0:1787831138.898844:0:18914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e4a63826/0x95459fb9d1d2a351 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424317 expref: 7 pid: 18609 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831138.898898:0:18914:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22045570c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:18914:1874676443959808:192.168.203.31@tcp:104: 00010000:00010000:1.0:1787831138.898932:0:18914:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c2e5169c/0x95459fb9d1d2a542 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831138.898945:0:18914:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c2e5169c/0x95459fb9d1d2a542 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831138.898953:0:18914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2e5169c/0x95459fb9d1d2a542 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831138.898966:0:18914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2e5169c/0x95459fb9d1d2a542 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831138.898976:0:18914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c2e5169c/0x95459fb9d1d2a542 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831138.899129:0:18914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787831138.899408:0:18914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fae8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3620:x1874676443959552:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6660us (6864us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1787831138.899418:0:18914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000004:00080000:2.0:1787831138.899530:0:3620:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d233fae8780/2, rc 0, transno 8589934601 00000100:00100000:2.0:1787831138.899536:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233fae8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1874676443959552:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1787831138.900151:0:18633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787831138.900162:0:18633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c2e5169c/0x95459fb9d1d2a542 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831138.900174:0:18633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233be95c00 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:3.0:1787831138.900179:0:18633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2e5169c/0x95459fb9d1d2a542 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831138.900190:0:18633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2e5169c/0x95459fb9d1d2a542 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831138.900212:0:18633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c2e5169c/0x95459fb9d1d2a542 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831138.900219:0:18633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2e5169c/0x95459fb9d1d2a542 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831138.900238:0:18633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787831138.900239:0:18633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787831138.900241:0:18633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787831138.901612:0:19422:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00000001:00080000:3.0:1787831138.901791:0:19422:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934596 is committed 00000100:00100000:1.0:1787831138.902092:0:18610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fa49e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+6:2396:x1874676433440128:12345-192.168.203.31@tcp:16:lhsmtool_posix.0 Request processed in 4707us (4916us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831138.902107:0:18610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 34 00000100:00100000:2.0:1787831138.906955:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831138.907131:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433440512 00000100:00100000:0.0:1787831138.907145:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433440512 00000100:00100000:0.0:1787831138.907219:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 115 00000100:00100000:0.0:1787831138.907230:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fa492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+16:15798:x1874676433440512:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787831138.907305:0:17104:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787831138.907343:0:17104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11600/0x95459fb9d1d2a52d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424395 expref: 16 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831138.907368:0:17104:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff8d2320608800) 00010000:00010000:0.0:1787831138.907374:0:17104:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787831138.907436:0:17104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11800/0x95459fb9d1d2a549 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831138.907452:0:17104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11800/0x95459fb9d1d2a549 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831138.907488:0:17104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11800/0x95459fb9d1d2a549 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787831138.907942:0:17104:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ef38f0f0 reply state 00000000838a5e95 transno 8589934662 ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11800/0x95459fb9d1d2a549 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831138.907968:0:17104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11800/0x95459fb9d1d2a549 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831138.907975:0:17104:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff8d2320608800) 00010000:00010000:1.0:1787831138.907978:0:17104:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787831138.907981:0:17104:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787831138.908325:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fa492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+17:15798:x1874676433440512:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 Request processed in 1094us (1442us total) trans 8589934662 rc 0/0 00000100:00100000:1.0:1787831138.908335:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 115 00000100:00100000:2.0:1787831138.911354:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831138.912937:0:19566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433440640 00000100:00100000:0.0:1787831138.912958:0:19566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433440640 00000100:00100000:0.0:1787831138.913203:0:19566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 35 00000100:00100000:0.0:1787831138.913216:0:19566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fa4a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+6:2396:x1874676433440640:12345-192.168.203.31@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1787831138.913463:0:19566:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1787831138.913468:0:19566:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 1787831139 -> 1787831138 00002000:00010000:0.0:1787831138.913471:0:19566:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 1787831137 00002000:00010000:0.0:1787831138.913473:0:19566:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1787831139 -> 1787831138 00002000:00010000:0.0:1787831138.913475:0:19566:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1787831138.913626:0:19566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fa4a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+7:2396:x1874676433440640:12345-192.168.203.31@tcp:2:lhsmtool_posix.0 Request processed in 411us (2284us total) trans 8589934598 rc 0/0 00000100:00100000:0.0:1787831138.913670:0:19566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 35 00000100:00100000:1.0:1787831138.917441:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831138.917566:0:18518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433440896 00000100:00100000:3.0:1787831138.917579:0:18518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433440896 00000100:00100000:2.0:1787831138.917844:0:19892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 116 00000100:00100000:2.0:1787831138.917858:0:19892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22045570c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+17:15798:x1874676433440896:12345-192.168.203.31@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1787831138.918156:0:19892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2200/0x95459fb9d1d2a550 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831138.918179:0:19892:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11400/0x95459fb9d1d2a511 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424387 expref: 17 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831138.918191:0:19892:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2200/0x95459fb9d1d2a550 lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831138.918246:0:19892:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11400/0x95459fb9d1d2a511 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424387 expref: 17 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831138.918265:0:19892:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11400/0x95459fb9d1d2a511 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424387 expref: 17 pid: 17106 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831138.918304:0:19892:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233fa49a40 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:19892:1874676443959936:192.168.203.31@tcp:104: 00000100:00100000:2.0:1787831138.918473:0:19892:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d232f7e79c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787831138.921852:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831138.922044:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433441024 00000100:00100000:3.0:1787831138.922057:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433441024 00010000:00010000:3.0:1787831138.922120:0:17089:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11400/0x95459fb9d1d2a511 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424387 expref: 18 pid: 17106 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787831138.922229:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 36 00000100:00100000:3.0:1787831138.922241:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb41a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+18:2396:x1874676433441024:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787831138.922261:0:17089:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787831138.922270:0:17089:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11400/0x95459fb9d1d2a511 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424387 expref: 18 pid: 17106 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831138.922285:0:17089:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11400/0x95459fb9d1d2a511 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424387 expref: 18 pid: 17106 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831138.922315:0:17089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff8d2320608800) 00010000:00010000:3.0:1787831138.922322:0:17089:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2200/0x95459fb9d1d2a550 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831138.922343:0:17089:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2200/0x95459fb9d1d2a550 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831138.922352:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2200/0x95459fb9d1d2a550 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831138.922376:0:17089:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787831138.922459:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb41a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+18:2396:x1874676433441024:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 219us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831138.922467:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 36 00010000:00010000:1.0:1787831138.922577:0:19892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11400/0x95459fb9d1d2a511 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424387 expref: 17 pid: 17106 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831138.922600:0:19892:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233fa49a40 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:19892:1874676443959936:192.168.203.31@tcp:104: 00010000:00010000:1.0:1787831138.922685:0:19892:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2200/0x95459fb9d1d2a550 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831138.922697:0:19892:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2200/0x95459fb9d1d2a550 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831138.922703:0:19892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2200/0x95459fb9d1d2a550 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831138.922752:0:19892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2200/0x95459fb9d1d2a550 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831138.922759:0:19892:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2200/0x95459fb9d1d2a550 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831138.922779:0:19892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2200/0x95459fb9d1d2a550 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831138.922785:0:19892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2303aa2200 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:1.0:1787831138.922790:0:19892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2200/0x95459fb9d1d2a550 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831138.922799:0:19892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2200/0x95459fb9d1d2a550 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831138.922809:0:19892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff8d2320608800) 00010000:00010000:1.0:1787831138.922812:0:19892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787831138.922816:0:19892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2200/0x95459fb9d1d2a550 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831138.922823:0:19892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2200/0x95459fb9d1d2a550 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831138.922897:0:19892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22045570c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+16:15798:x1874676433440896:12345-192.168.203.31@tcp:55:lhsmtool_posix.0 Request processed in 5042us (5472us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787831138.922906:0:19892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 116 00000100:00100000:2.0:1787831138.925990:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831138.926075:0:18609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433441152 00000100:00100000:0.0:1787831138.926088:0:18609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433441152 00000100:00100000:0.0:1787831138.926157:0:18609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 36 00000100:00100000:0.0:1787831138.926168:0:18609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb40780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+7:2395:x1874676433441152:12345-192.168.203.31@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787831138.926249:0:18609:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000188990d4/0x95459fb9d1d2a557 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831138.926275:0:18609:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000053add3e/0x95459fb9d1d2a53b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xe558a92a994243a3 expref: 7 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831138.926285:0:18609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787831138.926309:0:18609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787831138.926315:0:18609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000188990d4/0x95459fb9d1d2a557 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831138.926375:0:18609:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000053add3e/0x95459fb9d1d2a53b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.31@tcp remote: 0xe558a92a994243a3 expref: 7 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831138.926391:0:18609:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000053add3e/0x95459fb9d1d2a53b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.31@tcp remote: 0xe558a92a994243a3 expref: 7 pid: 18610 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831138.926418:0:18609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204705a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:18609:1874676443960064:192.168.203.31@tcp:104: 00000100:00100000:0.0:1787831138.926519:0:18609:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d233bcbc180 going to sleep for 11 seconds 00000100:00100000:2.0:1787831138.929760:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831138.929936:0:18609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204705a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:18609:1874676443960064:192.168.203.31@tcp:104: 00010000:00010000:0.0:1787831138.929971:0:18609:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000188990d4/0x95459fb9d1d2a557 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787831138.930049:0:20128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433441280 00000100:00100000:3.0:1787831138.930058:0:20128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433441280 00010000:00010000:3.0:1787831138.930105:0:20128:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000053add3e/0x95459fb9d1d2a53b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0xe558a92a994243a3 expref: 8 pid: 18610 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787831138.930170:0:20128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 37 00000100:00100000:3.0:1787831138.930180:0:20128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2335549c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+8:2397:x1874676433441280:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787831138.930199:0:20128:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787831138.930225:0:20128:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000053add3e/0x95459fb9d1d2a53b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0xe558a92a994243a3 expref: 8 pid: 18610 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831138.930238:0:20128:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000053add3e/0x95459fb9d1d2a53b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.31@tcp remote: 0xe558a92a994243a3 expref: 8 pid: 18610 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831138.930268:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000053add3e/0x95459fb9d1d2a53b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.31@tcp remote: 0xe558a92a994243a3 expref: 8 pid: 18610 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831138.930288:0:20128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787831138.930293:0:20128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787831138.930299:0:20128:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000188990d4/0x95459fb9d1d2a557 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831138.930309:0:20128:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000188990d4/0x95459fb9d1d2a557 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831138.930350:0:20128:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787831138.930419:0:20128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2335549c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+7:2397:x1874676433441280:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 241us (674us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831138.930428:0:20128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 37 00010000:00010000:0.0:1787831138.930917:0:18609:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000188990d4/0x95459fb9d1d2a557 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831138.930929:0:18609:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000188990d4/0x95459fb9d1d2a557 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831138.930954:0:18609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000188990d4/0x95459fb9d1d2a557 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831138.930962:0:18609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000188990d4/0x95459fb9d1d2a557 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831138.930979:0:18609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000188990d4/0x95459fb9d1d2a557 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831138.930987:0:18609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233bf11600 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:0.0:1787831138.930991:0:18609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000188990d4/0x95459fb9d1d2a557 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831138.931001:0:18609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000188990d4/0x95459fb9d1d2a557 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831138.931017:0:18609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000188990d4/0x95459fb9d1d2a557 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831138.931025:0:18609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000188990d4/0x95459fb9d1d2a557 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831138.931103:0:18609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb40780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+6:2395:x1874676433441152:12345-192.168.203.31@tcp:1:lhsmtool_posix.0 Request processed in 4937us (5128us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831138.931112:0:18609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 36 00000100:00100000:2.0:1787831138.939920:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831138.940018:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433441536 00000100:00100000:0.0:1787831138.940032:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433441536 00000100:00100000:0.0:1787831138.940116:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 117 00000100:00100000:0.0:1787831138.940129:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb42940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+16:15798:x1874676433441536:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787831138.940240:0:17106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11600/0x95459fb9d1d2a55e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831138.940286:0:17106:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94200/0x95459fb9d1d2a454 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a9942434f expref: 16 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831138.940299:0:17106:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11600/0x95459fb9d1d2a55e lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831138.940360:0:17106:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94200/0x95459fb9d1d2a454 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0xe558a92a9942434f expref: 16 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831138.940377:0:17106:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94200/0x95459fb9d1d2a454 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a9942434f expref: 16 pid: 17105 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831138.940395:0:17106:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204705a40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17106:1874676443960192:192.168.203.31@tcp:104: 00000100:00100000:0.0:1787831138.940508:0:17106:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d233bcbc180 going to sleep for 11 seconds 00000100:00100000:0.0:1787831138.944120:0:17106:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204705a40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17106:1874676443960192:192.168.203.31@tcp:104: 00010000:00010000:0.0:1787831138.944188:0:17106:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11600/0x95459fb9d1d2a55e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831138.945971:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831138.946112:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433441664 00000100:00100000:0.0:1787831138.946121:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433441664 00010000:00010000:0.0:1787831138.946165:0:17090:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94200/0x95459fb9d1d2a454 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a9942434f expref: 17 pid: 17105 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787831138.946257:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 38 00000100:00100000:3.0:1787831138.946274:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb40b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+17:2397:x1874676433441664:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787831138.946296:0:17089:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787831138.946306:0:17089:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94200/0x95459fb9d1d2a454 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a9942434f expref: 17 pid: 17105 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831138.946323:0:17089:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94200/0x95459fb9d1d2a454 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a9942434f expref: 17 pid: 17105 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831138.946354:0:17089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94200/0x95459fb9d1d2a454 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a9942434f expref: 17 pid: 17105 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831138.946388:0:17089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff8d233a6f8c00) 00010000:00010000:3.0:1787831138.946396:0:17089:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94c00/0x95459fb9d1d2a4b6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424372 expref: 16 pid: 19892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831138.946408:0:17089:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11600/0x95459fb9d1d2a55e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831138.946417:0:17089:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11600/0x95459fb9d1d2a55e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831138.946426:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11600/0x95459fb9d1d2a55e lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831138.946470:0:17089:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787831138.946501:0:17106:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11600/0x95459fb9d1d2a55e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831138.946510:0:17106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11600/0x95459fb9d1d2a55e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787831138.946547:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb40b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+16:2397:x1874676433441664:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 278us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831138.946557:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 38 00010000:00010000:0.0:1787831138.946792:0:17106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10600/0x95459fb9d1d2a565 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831138.946808:0:17106:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3c00/0x95459fb9d1d2a51f lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a9942438e expref: 16 pid: 19892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831138.946818:0:17106:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10600/0x95459fb9d1d2a565 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831138.947040:0:17106:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3c00/0x95459fb9d1d2a51f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.31@tcp remote: 0xe558a92a9942438e expref: 16 pid: 19892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831138.947056:0:17106:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3c00/0x95459fb9d1d2a51f lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a9942438e expref: 16 pid: 19892 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831138.947072:0:17106:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204705a40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17106:1874676443960320:192.168.203.31@tcp:104: 00000100:00100000:1.0:1787831138.947258:0:17106:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d233bcbc0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787831138.948779:0:17106:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204705a40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17106:1874676443960320:192.168.203.31@tcp:104: 00010000:00010000:1.0:1787831138.948813:0:17106:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10600/0x95459fb9d1d2a565 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831138.950297:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831138.950708:0:20128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433441792 00000100:00100000:3.0:1787831138.950718:0:20128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433441792 00010000:00010000:3.0:1787831138.950780:0:20128:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3c00/0x95459fb9d1d2a51f lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a9942438e expref: 17 pid: 19892 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787831138.951076:0:20128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 39 00000100:00100000:3.0:1787831138.951089:0:20128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fa48780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+17:2396:x1874676433441792:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787831138.951110:0:20128:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787831138.951118:0:20128:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3c00/0x95459fb9d1d2a51f lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a9942438e expref: 17 pid: 19892 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831138.951133:0:20128:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3c00/0x95459fb9d1d2a51f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a9942438e expref: 17 pid: 19892 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831138.951163:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3c00/0x95459fb9d1d2a51f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a9942438e expref: 17 pid: 19892 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831138.951181:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff8d2320608800) 00010000:00010000:3.0:1787831138.951187:0:20128:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10600/0x95459fb9d1d2a565 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831138.951198:0:20128:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10600/0x95459fb9d1d2a565 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831138.951207:0:20128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10600/0x95459fb9d1d2a565 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831138.951242:0:20128:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787831138.951307:0:17106:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10600/0x95459fb9d1d2a565 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787831138.951315:0:20128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fa48780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+16:2396:x1874676433441792:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 229us (1037us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831138.951337:0:20128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 39 00010000:00010000:1.0:1787831138.951743:0:17106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10600/0x95459fb9d1d2a565 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787831138.951955:0:17106:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934663 00000001:00080000:1.0:1787831138.952098:0:17106:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934664 00000001:00080000:1.0:1787831138.952135:0:17106:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934665 00000100:00100000:1.0:1787831138.952231:0:17106:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233fa49a40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17106:1874676443960448:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787831138.952734:0:17106:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831138.952833:0:17106:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2335786240 going to sleep for 11 seconds 00000100:00100000:3.0:1787831138.952914:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443960448 00000100:00100000:3.0:1787831138.952924:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443960448 00000100:00100000:3.0:1787831138.953111:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787831138.953123:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204647840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:17106:x1874676443960448:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787831138.953234:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204647840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:17106:x1874676443960448:12345-0@lo:1000:mdt00_002.0 Request processed in 114us (935us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831138.953242:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787831138.953307:0:17106:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:1.0:1787831138.953314:0:17106:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d233fa48b40, transno 8589934597 00000100:00100000:1.0:1787831138.953335:0:17106:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233fa49a40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17106:1874676443960448:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1787831138.953502:0:17106:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934666 00000100:00100000:1.0:1787831138.953566:0:17106:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204644000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17106:1874676443960576:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787831138.953872:0:17106:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831138.954047:0:17106:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2307cb9d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787831138.954094:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443960576 00000100:00100000:3.0:1787831138.954100:0:17110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443960576 00000100:00100000:1.0:1787831138.954212:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787831138.954221:0:17110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204644780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:17106:x1874676443960576:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787831138.957745:0:17110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204644780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17106:x1874676443960576:12345-0@lo:1000:mdt00_002.0 Request processed in 3508us (3855us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1787831138.957825:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787831138.957999:0:17106:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204644000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17106:1874676443960576:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1787831138.958078:0:17106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10600/0x95459fb9d1d2a565 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831138.958090:0:17106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10600/0x95459fb9d1d2a565 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831138.958099:0:17106:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10600/0x95459fb9d1d2a565 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831138.958106:0:17106:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233bf10600 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:2.0:1787831138.958112:0:17106:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10600/0x95459fb9d1d2a565 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831138.958122:0:17106:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10600/0x95459fb9d1d2a565 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831138.958142:0:17106:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff8d2320608800) 00010000:00010000:2.0:1787831138.958146:0:17106:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787831138.958151:0:17106:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10600/0x95459fb9d1d2a565 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831138.958187:0:17106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10600/0x95459fb9d1d2a565 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831138.958224:0:17106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3e00/0x95459fb9d1d2a4af lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831138.958231:0:17106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3e00/0x95459fb9d1d2a4af lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831138.958237:0:17106:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3e00/0x95459fb9d1d2a4af lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831138.958242:0:17106:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2303aa3e00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:2.0:1787831138.958245:0:17106:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3e00/0x95459fb9d1d2a4af lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831138.958251:0:17106:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3e00/0x95459fb9d1d2a4af lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831138.958259:0:17106:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff8d233a6f8c00) 00010000:00010000:2.0:1787831138.958261:0:17106:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787831138.958271:0:17106:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94c00/0x95459fb9d1d2a4b6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424372 expref: 19 pid: 19892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831138.958284:0:17106:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94c00/0x95459fb9d1d2a4b6 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424372 expref: 19 pid: 19892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831138.958293:0:17106:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94c00/0x95459fb9d1d2a4b6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424372 expref: 19 pid: 19892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831138.958360:0:17106:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94c00/0x95459fb9d1d2a4b6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424372 expref: 19 pid: 19892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831138.958377:0:17106:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233fb43480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17106:1874676443960704:192.168.203.31@tcp:105: 00000100:00100000:2.0:1787831138.958512:0:17106:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d232f7e7180 going to sleep for 11 seconds 00000100:00100000:2.0:1787831138.963955:0:17106:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233fb43480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17106:1874676443960704:192.168.203.31@tcp:105: 00010000:00010000:2.0:1787831138.963997:0:17106:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3e00/0x95459fb9d1d2a4af lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831138.964011:0:17106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3e00/0x95459fb9d1d2a4af lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831138.964057:0:17106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2600/0x95459fb9d1d2a56c lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831138.964076:0:17106:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2600/0x95459fb9d1d2a56c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831138.964089:0:17106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2600/0x95459fb9d1d2a56c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831138.964102:0:17106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2600/0x95459fb9d1d2a56c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831138.964109:0:17106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2600/0x95459fb9d1d2a56c lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831138.964115:0:17106:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2600/0x95459fb9d1d2a56c lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831138.964143:0:17106:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2303aa2600 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:2.0:1787831138.964147:0:17106:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2600/0x95459fb9d1d2a56c lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831138.964155:0:17106:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2600/0x95459fb9d1d2a56c lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831138.964171:0:17106:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff8d233a6f8c00) 00010000:00010000:2.0:1787831138.964174:0:17106:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787831138.964178:0:17106:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2600/0x95459fb9d1d2a56c lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831138.964185:0:17106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2600/0x95459fb9d1d2a56c lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831138.964196:0:17106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11600/0x95459fb9d1d2a55e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831138.964203:0:17106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11600/0x95459fb9d1d2a55e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831138.964209:0:17106:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11600/0x95459fb9d1d2a55e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831138.964214:0:17106:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233bf11600 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:2.0:1787831138.964218:0:17106:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11600/0x95459fb9d1d2a55e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831138.964225:0:17106:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11600/0x95459fb9d1d2a55e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831138.964245:0:17106:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff8d233a6f8c00) 00010000:00010000:2.0:1787831138.964247:0:17106:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787831138.964250:0:17106:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11600/0x95459fb9d1d2a55e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831138.964256:0:17106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11600/0x95459fb9d1d2a55e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17106 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831138.964710:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb42940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+19:15798:x1874676433441536:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 Request processed in 24580us (24805us total) trans 8589934667 rc 0/0 00000100:00100000:2.0:1787831138.964725:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 117 00000020:00080000:2.0:1787831138.964734:0:17106:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1787831138.965353:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000040:00080000:0.0:1787831138.965386:0:17139:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787831138.965393:0:17139:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787831138.965411:0:17139:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:0.0:1787831138.965417:0:17139:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1787831138.965514:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433441920 00000100:00100000:2.0:1787831138.965566:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433441920 00000100:00100000:2.0:1787831138.965620:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 24 00000100:00100000:2.0:1787831138.965730:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22046452c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+19:15796:x1874676433441920:12345-192.168.203.31@tcp:49:lfs.0 00000100:00100000:2.0:1787831138.965932:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22046452c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+19:15796:x1874676433441920:12345-192.168.203.31@tcp:49:lfs.0 Request processed in 204us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831138.965940:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 24 00000100:00100000:1.0:1787831138.968242:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831138.968350:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433442176 00000100:00100000:2.0:1787831138.968362:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433442176 00000100:00100000:2.0:1787831138.968428:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 25 00000100:00100000:2.0:1787831138.968440:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204646940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+19:15798:x1874676433442176:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787831138.969332:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831138.969430:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433442432 00000100:00100000:3.0:1787831138.969438:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433442432 00000100:00100000:3.0:1787831138.969499:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 118 00000100:00100000:3.0:1787831138.969509:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204645e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+20:15796:x1874676433442432:12345-192.168.203.31@tcp:58:lfs.0 00000040:00080000:3.0:1787831138.969711:0:17104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].3, 136 off8600 00000100:00100000:3.0:1787831138.969813:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204645e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+20:15796:x1874676433442432:12345-192.168.203.31@tcp:58:lfs.0 Request processed in 306us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831138.969822:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 118 00000004:00080000:2.0:1787831138.970832:0:17107:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787831138.970876:0:17107:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934668 00010000:00010000:2.0:1787831138.971766:0:17107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3c00/0x95459fb9d1d2a573 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831138.971819:0:17107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3c00/0x95459fb9d1d2a573 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 17107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831138.971833:0:17107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3c00/0x95459fb9d1d2a573 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 17107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831138.971845:0:17107:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3c00/0x95459fb9d1d2a573 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 17107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831138.971852:0:17107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3c00/0x95459fb9d1d2a573 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 17107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831138.971859:0:17107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3c00/0x95459fb9d1d2a573 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 17107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831138.971952:0:17107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787831138.972097:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204646940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+21:15798:x1874676433442176:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 Request processed in 3654us (3861us total) trans 8589934669 rc 0/0 00000100:00100000:2.0:1787831138.972110:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 25 00000020:00080000:2.0:1787831138.972118:0:17107:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787831138.973035:0:17092:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787831138.973048:0:17092:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3c00/0x95459fb9d1d2a573 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 17107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831138.973061:0:17092:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2303aa3c00 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:3.0:1787831138.973066:0:17092:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3c00/0x95459fb9d1d2a573 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 17107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831138.973078:0:17092:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3c00/0x95459fb9d1d2a573 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 17107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831138.973113:0:17092:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff8d2320608800) 00010000:00010000:3.0:1787831138.973117:0:17092:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787831138.973123:0:17092:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3c00/0x95459fb9d1d2a573 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 17107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831138.973129:0:17092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3c00/0x95459fb9d1d2a573 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 17107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831138.973146:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787831138.973147:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787831138.973149:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787831139.001196:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831139.001379:0:19892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433442560 00000100:00100000:2.0:1787831139.001393:0:19892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433442560 00000100:00100000:2.0:1787831139.001474:0:19892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 119 00000100:00100000:2.0:1787831139.001487:0:19892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204647480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+21:15800:x1874676433442560:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:2.0:1787831139.001522:0:19892:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787831139.001551:0:19892:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2600/0x95459fb9d1d2a57a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a994243aa expref: -99 pid: 19892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831139.001685:0:19892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3e00/0x95459fb9d1d2a581 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831139.001722:0:19892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3e00/0x95459fb9d1d2a581 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831139.001739:0:19892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3e00/0x95459fb9d1d2a581 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831139.001757:0:19892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2200/0x95459fb9d1d2a588 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831139.001764:0:19892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2200/0x95459fb9d1d2a588 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831139.001772:0:19892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2200/0x95459fb9d1d2a588 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831139.001891:0:19892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2a00/0x95459fb9d1d2a58f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831139.001903:0:19892:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3800/0x95459fb9d1d2a4a1 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a9942436b expref: 22 pid: 18518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831139.001913:0:19892:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2a00/0x95459fb9d1d2a58f lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831139.001958:0:19892:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3800/0x95459fb9d1d2a4a1 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0xe558a92a9942436b expref: 22 pid: 18518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831139.002155:0:19892:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3800/0x95459fb9d1d2a4a1 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a9942436b expref: 22 pid: 18518 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831139.002188:0:19892:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233fb43480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:19892:1874676443960832:192.168.203.31@tcp:104: 00000100:00100000:2.0:1787831139.002350:0:19892:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d232f7e7d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787831139.004862:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831139.005227:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433442816 00000100:00100000:3.0:1787831139.005239:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433442816 00000100:00100000:3.0:1787831139.005315:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 26 00000100:00100000:3.0:1787831139.005334:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204646580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+23:14874:x1874676433442816:12345-192.168.203.31@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787831139.005379:0:19892:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233fb43480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:19892:1874676443960832:192.168.203.31@tcp:104: 00000100:00100000:3.0:1787831139.005689:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204646580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+24:14874:x1874676433442816:12345-192.168.203.31@tcp:35:ldlm_bl.0 Request processed in 364us (842us total) trans 8589934670 rc 0/0 00000100:00100000:3.0:1787831139.005698:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 26 00010000:00010000:2.0:1787831139.005715:0:19892:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2a00/0x95459fb9d1d2a58f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831139.008490:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831139.008564:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433442944 00000100:00100000:0.0:1787831139.008577:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433442944 00010000:00010000:0.0:1787831139.008834:0:17090:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3800/0x95459fb9d1d2a4a1 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a9942436b expref: 24 pid: 18518 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831139.008948:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 40 00000100:00100000:0.0:1787831139.008962:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204644b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+24:2397:x1874676433442944:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787831139.009012:0:17090:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787831139.009021:0:17090:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3800/0x95459fb9d1d2a4a1 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a9942436b expref: 24 pid: 18518 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831139.009038:0:17090:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3800/0x95459fb9d1d2a4a1 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a9942436b expref: 24 pid: 18518 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831139.009067:0:17090:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3800/0x95459fb9d1d2a4a1 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a9942436b expref: 24 pid: 18518 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831139.009088:0:17090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff8d233a6f8c00) 00010000:00010000:0.0:1787831139.009094:0:17090:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2a00/0x95459fb9d1d2a58f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831139.009104:0:17090:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2a00/0x95459fb9d1d2a58f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831139.009113:0:17090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2a00/0x95459fb9d1d2a58f lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831139.009152:0:17090:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787831139.009224:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204644b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+23:2397:x1874676433442944:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 266us (751us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831139.009233:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 40 00010000:00010000:2.0:1787831139.009315:0:19892:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2a00/0x95459fb9d1d2a58f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831139.009323:0:19892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2a00/0x95459fb9d1d2a58f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787831139.009394:0:19892:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00000004:00200000:2.0:1787831139.009400:0:19892:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787831139.009427:0:19892:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2a00/0x95459fb9d1d2a58f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831139.009442:0:19892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2a00/0x95459fb9d1d2a58f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831139.009465:0:19892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3e00/0x95459fb9d1d2a581 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831139.009472:0:19892:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3e00/0x95459fb9d1d2a581 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831139.009480:0:19892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3e00/0x95459fb9d1d2a581 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831139.009486:0:19892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2303aa3e00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:2.0:1787831139.009501:0:19892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3e00/0x95459fb9d1d2a581 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831139.009509:0:19892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3e00/0x95459fb9d1d2a581 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831139.009522:0:19892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d233a6f8800) 00010000:00010000:2.0:1787831139.009525:0:19892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787831139.009530:0:19892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3e00/0x95459fb9d1d2a581 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831139.009537:0:19892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3e00/0x95459fb9d1d2a581 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831139.009551:0:19892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2200/0x95459fb9d1d2a588 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831139.009557:0:19892:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2200/0x95459fb9d1d2a588 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831139.009563:0:19892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2200/0x95459fb9d1d2a588 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831139.009568:0:19892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2303aa2200 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:2.0:1787831139.009571:0:19892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2200/0x95459fb9d1d2a588 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831139.009577:0:19892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2200/0x95459fb9d1d2a588 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831139.009584:0:19892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8d2303e42f00) 00010000:00010000:2.0:1787831139.009586:0:19892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787831139.009596:0:19892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2200/0x95459fb9d1d2a588 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831139.009614:0:19892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2200/0x95459fb9d1d2a588 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831139.009717:0:19892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2600/0x95459fb9d1d2a57a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994243aa expref: 23 pid: 19892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831139.009734:0:19892:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2a00/0x95459fb9d1d2a58f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994243aa expref: 22 pid: 19892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831139.009741:0:19892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff8d233a6f8c00) 00010000:00010000:2.0:1787831139.009744:0:19892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787831139.009746:0:19892:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2303aa2a00, rc 0) 00000100:00100000:2.0:1787831139.009789:0:19892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204647480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+22:15800:x1874676433442560:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 8306us (8610us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831139.009798:0:19892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 119 00010000:00010000:2.0:1787831139.239781:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787831139.558976:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233fb1f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676443960960:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787831139.559052:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831139.559303:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22038f9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443961344:0@lo:400:kworker.0 00000100:00100000:3.0:1787831139.559411:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22047070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:be45932f-3bcb-4e49-b61c-a2395180b0ee:3619:1874676443961088:0@lo:400:kworker.0 00000100:00100000:3.0:1787831139.560464:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831139.560517:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22038f8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874676443961600:0@lo:400:kworker.0 00000100:00100000:3.0:1787831139.560549:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831139.560566:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220390f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3619:1874676443962112:0@lo:400:kworker.0 00000100:00100000:3.0:1787831139.560586:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831139.560640:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233fb43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443962624:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787831139.560642:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443961088 00000100:00100000:2.0:1787831139.560650:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443961088 00000100:00100000:3.0:1787831139.560665:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831139.560683:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1787831139.560689:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443961216:0@lo:400:kworker.0 00000100:00100000:2.0:1787831139.560694:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1787831139.560702:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203524c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be45932f-3bcb-4e49-b61c-a2395180b0ee+24:3619:x1874676443961088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787831139.560712:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831139.560728:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22038fb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443961728:0@lo:400:kworker.0 00000100:00100000:3.0:1787831139.560744:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831139.560749:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203524c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be45932f-3bcb-4e49-b61c-a2395180b0ee+24:3619:x1874676443961088:12345-0@lo:400:kworker.0 Request processed in 49us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831139.560759:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220390ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3619:1874676443962240:0@lo:400:kworker.0 00000100:00100000:2.0:1787831139.560770:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1787831139.560779:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831139.560808:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22047070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:be45932f-3bcb-4e49-b61c-a2395180b0ee:3619:1874676443961088:0@lo:400:kworker.0 00000100:00100000:3.0:1787831139.560836:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443961216 00000100:00100000:3.0:1787831139.560840:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443961216 00000100:00100000:3.0:1787831139.560866:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443961728 00000100:00100000:3.0:1787831139.560869:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443961728 00000100:00100000:3.0:1787831139.560898:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787831139.560904:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb1da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676443961216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787831139.564735:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443961600 00000100:00100000:2.0:1787831139.564749:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443961600 00000100:00100000:2.0:1787831139.564803:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443962112 00000100:00100000:2.0:1787831139.564813:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443962112 00000100:00100000:2.0:1787831139.564837:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443962240 00000100:00100000:2.0:1787831139.564839:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443962240 00000100:00100000:2.0:1787831139.564857:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787831139.564866:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb1fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874676443961600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787831139.564967:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb1fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874676443961600:12345-0@lo:400:kworker.0 Request processed in 102us (4416us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831139.564974:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787831139.564992:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787831139.564998:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874676443962112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787831139.565027:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874676443962112:12345-0@lo:400:kworker.0 Request processed in 30us (4441us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831139.565032:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787831139.565044:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787831139.565049:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb1e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874676443962240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787831139.565076:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb1e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874676443962240:12345-0@lo:400:kworker.0 Request processed in 28us (4296us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831139.565082:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787831139.565100:0:18612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443960960 00000100:00100000:2.0:1787831139.565104:0:18612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443960960 00000100:00100000:2.0:1787831139.565122:0:18612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443962624 00000100:00100000:2.0:1787831139.565126:0:18612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443962624 00000100:00100000:2.0:1787831139.565137:0:18612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787831139.565143:0:18612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb1e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676443960960:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787831139.565171:0:18612:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25562816 pending 0 free 3923505152 avail 3691954176 00000100:00100000:2.0:1787831139.565204:0:18612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb1e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676443960960:12345-0@lo:13:osp-pre-1-1.0 Request processed in 60us (6152us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831139.565217:0:18612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787831139.565231:0:18612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787831139.565236:0:18612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb1de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3619:x1874676443962624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787831139.565245:0:18612:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25562816 pending 0 free 3923505152 avail 3691954176 00000100:00100000:2.0:1787831139.565271:0:18612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb1de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3619:x1874676443962624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 36us (4605us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831139.565277:0:18612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:2.0:1787831139.565299:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787831139.565304:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787831139.565306:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787831139.566620:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d220390ed00 x1874676443962240/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787831155 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787831139.566652:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220390ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3619:1874676443962240:0@lo:400:kworker.0 00000100:00100000:2.0:1787831139.566681:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233fb43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443962624:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787831139.566696:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22038f8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874676443961600:0@lo:400:kworker.0 00000100:00100000:2.0:1787831139.566708:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220390f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3619:1874676443962112:0@lo:400:kworker.0 00000100:00100000:2.0:1787831139.566863:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22038fad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676443961472:0@lo:400:kworker.0 00000100:00100000:2.0:1787831139.566933:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831139.566966:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220390f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3622:1874676443961984:0@lo:400:kworker.0 00000100:00100000:2.0:1787831139.566990:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831139.567009:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220390c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3622:1874676443962496:0@lo:400:kworker.0 00000100:00100000:2.0:1787831139.567031:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831139.567060:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233fb1f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676443960960:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787831139.567112:0:18610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443961472 00000100:00100000:2.0:1787831139.567117:0:18610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443961472 00000100:00100000:2.0:1787831139.567169:0:18610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787831139.567178:0:18610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3622:x1874676443961472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787831139.567227:0:18610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3622:x1874676443961472:12345-0@lo:400:kworker.0 Request processed in 50us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831139.567235:0:18610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787831139.567869:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443961984 00000100:00100000:2.0:1787831139.567874:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443961984 00000100:00100000:2.0:1787831139.567913:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443962496 00000100:00100000:2.0:1787831139.567916:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443962496 00000100:00100000:2.0:1787831139.567938:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787831139.567943:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1874676443961984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787831139.567982:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1874676443961984:12345-0@lo:400:kworker.0 Request processed in 39us (991us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831139.567989:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787831139.568001:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787831139.568006:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb43840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1874676443962496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787831139.568029:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb43840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1874676443962496:12345-0@lo:400:kworker.0 Request processed in 24us (998us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831139.568035:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:2.0:1787831139.568055:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787831139.568081:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22038fad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676443961472:0@lo:400:kworker.0 00000100:00100000:2.0:1787831139.568089:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220390f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3622:1874676443961984:0@lo:400:kworker.0 00010000:00080000:2.0:1787831139.568099:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d220390c3c0 x1874676443962496/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787831155 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787831139.568120:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220390c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3622:1874676443962496:0@lo:400:kworker.0 00000100:00100000:3.0:1787831139.569251:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb1da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676443961216:12345-0@lo:400:kworker.0 Request processed in 8342us (8532us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831139.569265:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787831139.569315:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443961216:0@lo:400:kworker.0 00000100:00100000:3.0:1787831139.569350:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787831139.569360:0:17110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb1c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443961728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787831139.569405:0:17110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb1c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443961728:12345-0@lo:400:kworker.0 Request processed in 48us (8659us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831139.569411:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787831139.569441:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22038fb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443961728:0@lo:400:kworker.0 00000100:00100000:3.0:1787831139.569671:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233fb1cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1874676443962752:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787831139.569705:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831139.569742:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443962752 00000100:00100000:3.0:1787831139.569748:0:17110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443962752 00000100:00100000:3.0:1787831139.569774:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787831139.569781:0:17110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb1c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1874676443962752:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787831139.569807:0:17110:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:3.0:1787831139.569843:0:17110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb1c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1874676443962752:12345-0@lo:41:osp-pre-0-1.0 Request processed in 62us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831139.569849:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787831139.569874:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233fb1cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1874676443962752:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787831139.569946:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787831139.569956:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233fb1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676443962880:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787831139.569989:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831139.570017:0:18612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443962880 00000100:00100000:3.0:1787831139.570021:0:18612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443962880 00000100:00100000:3.0:1787831139.570063:0:18612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787831139.570070:0:18612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb42580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676443962880:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787831139.570089:0:18612:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25562816 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787831139.570120:0:18612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb42580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676443962880:12345-0@lo:13:osp-pre-0-1.0 Request processed in 51us (131us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831139.570126:0:18612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:2.0:1787831139.570505:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787831139.570534:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233fb1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676443962880:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787831139.571511:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831139.571598:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22038f9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443961856:0@lo:400:kworker.0 00000100:00100000:0.0:1787831139.571658:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831139.578298:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220390c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3621:1874676443962368:0@lo:400:kworker.0 00000100:00100000:0.0:1787831139.578377:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831139.578409:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443962368 00000100:00100000:0.0:1787831139.578416:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443962368 00000100:00100000:0.0:1787831139.578484:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787831139.578493:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220390f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1874676443962368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787831139.578542:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220390f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1874676443962368:12345-0@lo:400:kworker.0 Request processed in 51us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831139.578549:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:0.0:1787831139.578574:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787831139.578607:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220390c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3621:1874676443962368:0@lo:400:kworker.0 00000100:00100000:2.0:1787831139.578796:0:18608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443961344 00000100:00100000:2.0:1787831139.578801:0:18608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443961344 00000100:00100000:2.0:1787831139.578842:0:18608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443961856 00000100:00100000:2.0:1787831139.578845:0:18608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443961856 00000100:00100000:2.0:1787831139.578871:0:18610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787831139.578890:0:18610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220390e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3621:x1874676443961344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787831139.578935:0:18610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220390e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3621:x1874676443961344:12345-0@lo:400:kworker.0 Request processed in 57us (7427us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831139.578942:0:18610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787831139.578958:0:18610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787831139.578965:0:18610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220390c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443961856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787831139.578992:0:18610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220390c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443961856:12345-0@lo:400:kworker.0 Request processed in 29us (7334us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831139.578998:0:18610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787831139.579081:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22038f9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443961344:0@lo:400:kworker.0 00000100:00100000:0.0:1787831139.579091:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22038f9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443961856:0@lo:400:kworker.0 00000040:00080000:0.0:1787831139.661602:0:20382:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787831139.661611:0:20382:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787831139.661664:0:20382:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 4 count 4 00000040:00080000:0.0:1787831139.661671:0:20382:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000040:00080000:0.0:1787831140.009235:0:17139:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787831140.009244:0:17139:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787831140.009330:0:17139:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 4 count 4 00000040:00080000:0.0:1787831140.009339:0:17139:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1787831140.009473:0:17139:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220390c000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17139:1874676443963008:192.168.203.31@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787831140.009615:0:17139:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d233bcbc6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787831140.019065:0:17139:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220390c000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17139:1874676443963008:192.168.203.31@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787831140.020055:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831140.021249:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433443072 00000100:00100000:2.0:1787831140.021262:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433443072 00000100:00100000:2.0:1787831140.021408:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 120 00000100:00100000:2.0:1787831140.021420:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fa49a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+22:15812:x1874676433443072:12345-192.168.203.31@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787831140.021455:0:17106:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787831140.021609:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fa49a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+22:15812:x1874676433443072:12345-192.168.203.31@tcp:53:lhsmtool_posix.0 Request processed in 179us (1547us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831140.021617:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 120 00000100:00080000:0.0:1787831140.021700:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787831140.031683:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831140.032718:0:18518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433443328 00000100:00100000:0.0:1787831140.032745:0:18518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433443328 00000100:00100000:0.0:1787831140.032814:0:18518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 121 00000100:00100000:0.0:1787831140.032824:0:18518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb1cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+22:15812:x1874676433443328:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787831140.032845:0:18518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787831140.032865:0:18518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10600/0x95459fb9d1d2a596 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a994243b1 expref: -99 pid: 18518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831140.032993:0:18518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11400/0x95459fb9d1d2a59d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831140.033007:0:18518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11400/0x95459fb9d1d2a59d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831140.033021:0:18518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11400/0x95459fb9d1d2a59d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787831140.033031:0:18518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00010000:00010000:0.0:1787831140.033139:0:18518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10600/0x95459fb9d1d2a596 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994243b1 expref: 25 pid: 18518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831140.033159:0:18518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11400/0x95459fb9d1d2a59d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994243b1 expref: 24 pid: 18518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831140.033168:0:18518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff8d233a6f8c00) 00010000:00010000:0.0:1787831140.033171:0:18518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787831140.033174:0:18518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233bf11400, rc 0) 00000100:00100000:0.0:1787831140.033255:0:18518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb1cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+24:15812:x1874676433443328:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 433us (1580us total) trans 8589934671 rc 0/0 00000100:00100000:0.0:1787831140.033263:0:18518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 121 00000100:00100000:1.0:1787831140.041128:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831140.041168:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831140.041281:0:19892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433443712 00000100:00100000:2.0:1787831140.041291:0:19892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433443712 00000100:00100000:0.0:1787831140.041328:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433443456 00000100:00100000:0.0:1787831140.041333:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433443456 00000100:00100000:0.0:1787831140.041385:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 4 00000100:00100000:0.0:1787831140.041395:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fa48b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+25:2395:x1874676433443456:12345-192.168.203.31@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1787831140.041411:0:19892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 122 00010000:00010000:0.0:1787831140.041416:0:17091:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1787831140.041424:0:19892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22037921c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+25:15812:x1874676433443712:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787831140.041443:0:17091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11400/0x95459fb9d1d2a59d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994243b1 expref: 25 pid: 18518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831140.041462:0:17091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff8d233a6f8c00) 00010000:00010000:0.0:1787831140.041467:0:17091:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787831140.041494:0:19892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2600/0x95459fb9d1d2a5ab lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831140.041515:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fa48b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+24:2395:x1874676433443456:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 122us (395us total) trans 0 rc 0/0 00010000:00010000:2.0:1787831140.041518:0:19892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2600/0x95459fb9d1d2a5ab lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831140.041528:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 4 00010000:00010000:2.0:1787831140.041536:0:19892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2600/0x95459fb9d1d2a5ab lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831140.041726:0:19892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2600/0x95459fb9d1d2a5ab lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831140.041732:0:19892:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2600/0x95459fb9d1d2a5ab lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831140.041738:0:19892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2600/0x95459fb9d1d2a5ab lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831140.041744:0:19892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2303aa2600 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:2.0:1787831140.041748:0:19892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2600/0x95459fb9d1d2a5ab lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831140.041755:0:19892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2600/0x95459fb9d1d2a5ab lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831140.041783:0:19892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff8d233a6f8c00) 00010000:00010000:2.0:1787831140.041786:0:19892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787831140.041790:0:19892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2600/0x95459fb9d1d2a5ab lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831140.041797:0:19892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2600/0x95459fb9d1d2a5ab lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19892 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831140.041896:0:19892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22037921c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+24:15812:x1874676433443712:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 Request processed in 475us (725us total) trans 8589934672 rc 0/0 00000100:00100000:2.0:1787831140.041903:0:19892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 122 00000040:00080000:0.0:1787831140.042025:0:17139:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787831140.042030:0:17139:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787831140.042997:0:17139:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 4 00000040:00080000:0.0:1787831140.043009:0:17139:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1787831140.047733:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831140.047819:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433443968 00000100:00100000:0.0:1787831140.047829:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433443968 00000100:00100000:0.0:1787831140.047893:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 27 00000100:00100000:0.0:1787831140.047903:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203791a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+24:15812:x1874676433443968:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787831140.048132:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203791a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+25:15812:x1874676433443968:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 Request processed in 230us (408us total) trans 8589934673 rc 0/0 00000100:00100000:0.0:1787831140.048141:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 27 00000100:00100000:1.0:1787831140.072227:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787831140.072250:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220390c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443963136:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787831140.072432:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831140.073569:0:18612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443963136 00000100:00100000:3.0:1787831140.073580:0:18612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443963136 00000100:00100000:3.0:1787831140.073691:0:18612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787831140.073701:0:18612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203792d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3621:x1874676443963136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787831140.073726:0:18612:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25562816 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787831140.073821:0:18612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203792d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3621:x1874676443963136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 122us (1389us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831140.073829:0:18612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787831140.073953:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220390c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443963136:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787831140.074076:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787831140.263547:0:18633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787831140.586140:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787831140.586167:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203790780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1874676443963264:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787831140.586266:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831140.586725:0:19224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443963264 00000100:00100000:2.0:1787831140.586736:0:19224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443963264 00000100:00100000:2.0:1787831140.586940:0:19224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787831140.586955:0:19224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220390f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1874676443963264:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787831140.586992:0:19224:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787831140.587238:0:19224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220390f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1874676443963264:12345-0@lo:41:osp-pre-1-0.0 Request processed in 286us (971us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831140.587246:0:19224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787831140.587595:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203790780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1874676443963264:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787831140.956831:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831140.956930:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433444096 00000100:00100000:0.0:1787831140.956943:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433444096 00000100:00100000:0.0:1787831140.957025:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 163 00000100:00100000:0.0:1787831140.957036:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203527c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f931f0c-5730-4db2-abdb-70a9ab2deeff+13:2396:x1874676433444096:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1787831140.957153:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203527c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f931f0c-5730-4db2-abdb-70a9ab2deeff+13:2396:x1874676433444096:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 118us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831140.957161:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 163 00000100:00100000:1.0:1787831140.958594:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831140.958667:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831140.958715:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831140.958750:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831140.958773:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831140.958796:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831140.958817:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831140.958850:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831140.958878:0:18518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433444352 00000100:00100000:0.0:1787831140.958889:0:18518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433444352 00000100:00100000:2.0:1787831140.958897:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433444864 00000100:00100000:2.0:1787831140.958904:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433444864 00000100:00100000:1.0:1787831140.958910:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433444224 00000100:00100000:1.0:1787831140.958917:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433444224 00000100:00100000:3.0:1787831140.958943:0:19566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433444608 00000100:00100000:3.0:1787831140.958950:0:19566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433444608 00000100:00100000:0.0:1787831140.958969:0:18518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433444736 00000100:00100000:0.0:1787831140.958974:0:18518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433444736 00000100:00100000:2.0:1787831140.958985:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 58 00000100:00100000:1.0:1787831140.958996:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 59 00000100:00100000:3.0:1787831140.958997:0:19566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433445120 00000100:00100000:2.0:1787831140.959002:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22037912c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+25:2396:x1874676433444224:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1787831140.959004:0:19566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433445120 00000100:00100000:1.0:1787831140.959014:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203790000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8db48c6c-a61a-41ec-9c3b-96530aeb2537+5:2396:x1874676433444864:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1787831140.959021:0:18518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 60 00000100:00100000:3.0:1787831140.959034:0:19566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433444480 00000100:00100000:0.0:1787831140.959034:0:18518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203793c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+5:2396:x1874676433444352:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1787831140.959039:0:19566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433444480 00000100:00100000:3.0:1787831140.959064:0:19566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433444992 00000100:00100000:3.0:1787831140.959067:0:19566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433444992 00000100:00100000:3.0:1787831140.959096:0:19566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 21 00000100:00100000:3.0:1787831140.959106:0:19566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203793480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+6:2396:x1874676433444608:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1787831140.959111:0:18518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203793c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+5:2396:x1874676433444352:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 78us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831140.959117:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203790000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8db48c6c-a61a-41ec-9c3b-96530aeb2537+5:2396:x1874676433444864:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 103us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831140.959118:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22037912c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+25:2396:x1874676433444224:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 115us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831140.959130:0:18518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 60 00000100:00100000:1.0:1787831140.959139:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 59 00000100:00100000:3.0:1787831140.959156:0:19566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203793480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+6:2396:x1874676433444608:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 49us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831140.959161:0:18518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 61 00000100:00100000:3.0:1787831140.959170:0:19566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 21 00000100:00100000:3.0:1787831140.959186:0:19566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 22 00000100:00100000:3.0:1787831140.959200:0:19566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203793840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8db48c6c-a61a-41ec-9c3b-96530aeb2537+5:2396:x1874676433445120:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1787831140.959228:0:19566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203793840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8db48c6c-a61a-41ec-9c3b-96530aeb2537+5:2396:x1874676433445120:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 32us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831140.959236:0:19566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 22 00000100:00100000:0.0:1787831140.959248:0:18518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22037903c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8db48c6c-a61a-41ec-9c3b-96530aeb2537+6:2396:x1874676433444736:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1787831140.959255:0:19566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 23 00000100:00100000:3.0:1787831140.959266:0:19566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203791680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+7:2396:x1874676433444480:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1787831140.959282:0:18518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22037903c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8db48c6c-a61a-41ec-9c3b-96530aeb2537+6:2396:x1874676433444736:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 38us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831140.959301:0:19566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203791680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+7:2396:x1874676433444480:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 37us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831140.959307:0:19566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 23 00000100:00100000:3.0:1787831140.959396:0:19566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 24 00000100:00100000:3.0:1787831140.959403:0:19566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203790f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8db48c6c-a61a-41ec-9c3b-96530aeb2537+5:2396:x1874676433444992:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1787831140.959433:0:19566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203790f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8db48c6c-a61a-41ec-9c3b-96530aeb2537+5:2396:x1874676433444992:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 30us (582us total) trans 0 rc 0/0 00000100:00080000:1.0:1787831140.959435:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787831140.959442:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787831140.959481:0:19566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 24 00000100:00080000:1.0:1787831140.959491:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787831140.959494:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787831140.959895:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 58 00000100:00100000:0.0:1787831140.959909:0:18518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 61 00000001:00080000:2.0:1787831141.098561:0:18604:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934601 is committed 00000001:00080000:2.0:1787831141.098578:0:18604:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00010000:00010000:3.0:1787831141.289832:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787831141.444731:0:20433:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787831141.444746:0:20433:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787831141.444787:0:20433:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 4 count 4 00000040:00080000:1.0:1787831141.444796:0:20433:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1787831141.579048:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831141.579260:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433445376 00000100:00100000:3.0:1787831141.579273:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433445376 00000100:00100000:3.0:1787831141.579346:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 123 00000100:00100000:3.0:1787831141.579357:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb42d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+25:15833:x1874676433445376:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:3.0:1787831141.579387:0:17104:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787831141.579415:0:17104:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669a00/0x95459fb9d1d2a5b2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a994243b8 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831141.579567:0:17104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668800/0x95459fb9d1d2a5b9 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831141.579586:0:17104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668800/0x95459fb9d1d2a5b9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831141.579602:0:17104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668800/0x95459fb9d1d2a5b9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787831141.579616:0:17104:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00010000:00010000:3.0:1787831141.579881:0:17104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301669a00/0x95459fb9d1d2a5b2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994243b8 expref: 28 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831141.579901:0:17104:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668800/0x95459fb9d1d2a5b9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994243b8 expref: 27 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831141.579931:0:17104:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff8d233a6f8c00) 00010000:00010000:3.0:1787831141.579935:0:17104:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787831141.579938:0:17104:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2301668800, rc 0) 00000100:00100000:3.0:1787831141.580012:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb42d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+27:15833:x1874676433445376:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 657us (979us total) trans 8589934674 rc 0/0 00000100:00100000:3.0:1787831141.580021:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 123 00000100:00100000:3.0:1787831141.589205:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831141.589692:0:18518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433445504 00000100:00100000:2.0:1787831141.589707:0:18518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433445504 00000100:00100000:2.0:1787831141.589790:0:18518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 124 00000100:00100000:2.0:1787831141.589885:0:18518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb1e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+27:15833:x1874676433445504:12345-192.168.203.31@tcp:54:lfs.0 00010000:00010000:2.0:1787831141.589988:0:18518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3800/0x95459fb9d1d2a5c7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831141.590010:0:18518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3800/0x95459fb9d1d2a5c7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831141.590026:0:18518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3800/0x95459fb9d1d2a5c7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831141.590072:0:18518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3800/0x95459fb9d1d2a5c7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831141.590079:0:18518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3800/0x95459fb9d1d2a5c7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831141.590087:0:18518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3800/0x95459fb9d1d2a5c7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831141.590094:0:18518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2303aa3800 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:2.0:1787831141.590099:0:18518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3800/0x95459fb9d1d2a5c7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831141.590118:0:18518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3800/0x95459fb9d1d2a5c7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831141.590135:0:18518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff8d233a6f8c00) 00010000:00010000:2.0:1787831141.590138:0:18518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787831141.590144:0:18518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3800/0x95459fb9d1d2a5c7 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831141.590150:0:18518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa3800/0x95459fb9d1d2a5c7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831141.590246:0:18518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb1e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+27:15833:x1874676433445504:12345-192.168.203.31@tcp:54:lfs.0 Request processed in 366us (1062us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831141.590255:0:18518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 124 00000100:00100000:3.0:1787831141.662399:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831141.662541:0:19566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433445632 00000100:00100000:0.0:1787831141.662554:0:19566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433445632 00000100:00100000:0.0:1787831141.662693:0:19566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 37 00000100:00100000:0.0:1787831141.662706:0:19566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb1ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+6:2397:x1874676433445632:12345-192.168.203.31@tcp:101:cat.0 00010000:00010000:0.0:1787831141.662733:0:19566:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787831141.662763:0:19566:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d2c49235/0x95459fb9d1d2a5ce lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a994243bf expref: -99 pid: 19566 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787831141.662797:0:19566:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 13, mtime: 0x6a902362, atime: 0x6a902361, ctime: 0x6a902362, blocks: 0x8 00010000:00010000:0.0:1787831141.662828:0:19566:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=432s v=(0 0) 00010000:00010000:0.0:1787831141.662835:0:19566:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787831141.662848:0:19566:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d2c49235/0x95459fb9d1d2a5ce lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994243bf expref: 7 pid: 19566 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831141.662884:0:19566:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d2c49235/0x95459fb9d1d2a5ce lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994243bf expref: 7 pid: 19566 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831141.662900:0:19566:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233bf11e00, rc 0) 00000100:00100000:0.0:1787831141.663159:0:19566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb1ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+7:2397:x1874676433445632:12345-192.168.203.31@tcp:101:cat.0 Request processed in 455us (774us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831141.663168:0:19566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 37 00000100:00100000:3.0:1787831141.671475:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831141.673786:0:18615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433445760 00000100:00100000:1.0:1787831141.674152:0:18615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433445760 00002000:00100000:2.0:1787831141.674413:0:18615:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x22:0x0] (0->4095) req@ffff8d233fb1d680 x1874676433445760/t0(0) o3->2240faf2-2a81-4e92-bb4c-b58ed0f19f2a@192.168.203.31@tcp:212/0 lens 488/0 e 0 to 0 dl 1787831152 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:100 00002000:00100000:2.0:1787831141.674428:0:18615:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d233fb1d680 with x1874676433445760 ext(0->4095) 00002000:00010000:2.0:1787831141.674436:0:18615:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d233fb1d680 00000100:00100000:2.0:1787831141.674493:0:18615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 3 00000100:00100000:2.0:1787831141.674504:0:18615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb1d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+7:2396:x1874676433445760:12345-192.168.203.31@tcp:3:cat.0 00000100:00100000:2.0:1787831141.674957:0:18615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb1d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+7:2396:x1874676433445760:12345-192.168.203.31@tcp:3:cat.0 Request processed in 452us (3496us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787831141.674967:0:18615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 3 00002000:00100000:2.0:1787831141.674976:0:18615:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x22:0x0] (0->4095) req@ffff8d233fb1d680 x1874676433445760/t0(0) o3->2240faf2-2a81-4e92-bb4c-b58ed0f19f2a@192.168.203.31@tcp:212/0 lens 488/4536 e 0 to 0 dl 1787831152 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:100 00002000:00100000:2.0:1787831141.674986:0:18615:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d233fb1d680 with x1874676433445760 ext(0->4095) 00002000:00010000:2.0:1787831141.674997:0:18615:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d233fb1d680 00010000:00010000:2.0:1787831142.311460:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787831143.334890:0:18633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787831144.359612:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787831144.679003:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220390ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676443963648:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787831144.679451:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831144.679527:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233fb41680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1874676443963520:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787831144.679571:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233fb1d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443963392:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787831144.679602:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831144.679739:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443963392 00000100:00100000:1.0:1787831144.679747:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443963392 00000100:00100000:1.0:1787831144.679808:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787831144.679818:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22037930c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443963392:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787831144.679871:0:17109:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:1.0:1787831144.679927:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22037930c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443963392:12345-0@lo:41:osp-pre-0-1.0 Request processed in 109us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831144.679941:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787831144.683382:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233fb1f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443963776:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787831144.683594:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233fb1d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443963392:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787831144.684511:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203790780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443964032:0@lo:400:kworker.0 00000100:00100000:3.0:1787831144.684580:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831144.684740:0:19224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443964032 00000100:00100000:1.0:1787831144.684748:0:19224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443964032 00000100:00100000:1.0:1787831144.684824:0:19224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787831144.684837:0:19224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb1d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1874676443964032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787831144.685094:0:18612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443963648 00000100:00100000:2.0:1787831144.685101:0:18612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443963648 00000100:00100000:2.0:1787831144.685161:0:18612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787831144.685169:0:18612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220390c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3622:x1874676443963648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787831144.685198:0:18612:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25562816 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1787831144.685289:0:18612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220390c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3622:x1874676443963648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 118us (5837us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831144.685298:0:18612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:2.0:1787831144.685331:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787831144.685365:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831144.685403:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203792940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:be45932f-3bcb-4e49-b61c-a2395180b0ee:3620:1874676443963904:0@lo:400:kworker.0 00000100:00100000:2.0:1787831144.685442:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831144.685479:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22044012c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3620:1874676443964416:0@lo:400:kworker.0 00000100:00100000:2.0:1787831144.685509:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831144.685519:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220390ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676443963648:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787831144.685531:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204523840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3620:1874676443964928:0@lo:400:kworker.0 00000100:00100000:2.0:1787831144.685576:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831144.685600:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1787831144.685607:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204401e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1874676443964288:0@lo:400:kworker.0 00000100:00100000:0.0:1787831144.685657:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204403480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676443964160:0@lo:400:kworker.0 00000100:00100000:2.0:1787831144.685677:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831144.685710:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22044030c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3620:1874676443964800:0@lo:400:kworker.0 00000100:00100000:0.0:1787831144.685731:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831144.685748:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831144.685775:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204400000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676443964672:0@lo:400:kworker.0 00000100:00100000:2.0:1787831144.685786:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22045230c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3620:1874676443965312:0@lo:400:kworker.0 00000100:00100000:2.0:1787831144.685837:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831144.685864:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831144.685908:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204520b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3622:1874676443965184:0@lo:400:kworker.0 00000100:00100000:2.0:1787831144.685912:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443963904 00000100:00100000:2.0:1787831144.685932:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443963904 00000100:00100000:3.0:1787831144.685942:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204403c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443964544:0@lo:400:kworker.0 00000100:00100000:0.0:1787831144.685960:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831144.685992:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1787831144.686004:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203527450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be45932f-3bcb-4e49-b61c-a2395180b0ee+24:3620:x1874676443963904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787831144.686006:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831144.686048:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204520780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3621:1874676443965056:0@lo:400:kworker.0 00000100:00100000:0.0:1787831144.686063:0:18608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443964288 00000100:00100000:2.0:1787831144.686072:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203527450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be45932f-3bcb-4e49-b61c-a2395180b0ee+24:3620:x1874676443963904:12345-0@lo:400:kworker.0 Request processed in 69us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831144.686074:0:18608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443964288 00000100:00100000:3.0:1787831144.686085:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831144.686088:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1787831144.686153:0:19892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443964416 00000100:00100000:0.0:1787831144.686155:0:18608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443964160 00000100:00100000:2.0:1787831144.686160:0:19892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443964416 00000100:00100000:0.0:1787831144.686163:0:18608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443964160 00000100:00100000:3.0:1787831144.686193:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443964928 00000100:00100000:3.0:1787831144.686200:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443964928 00000100:00100000:2.0:1787831144.686200:0:19892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443964800 00000100:00100000:2.0:1787831144.686206:0:19892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443964800 00000100:00100000:0.0:1787831144.686218:0:18608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443964672 00000100:00100000:0.0:1787831144.686224:0:18608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443964672 00000100:00100000:2.0:1787831144.686239:0:19892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443965312 00000100:00100000:3.0:1787831144.686246:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443965184 00000100:00100000:2.0:1787831144.686246:0:19892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443965312 00000100:00100000:3.0:1787831144.686252:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443965184 00000100:00100000:0.0:1787831144.686269:0:18608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443964544 00000100:00100000:0.0:1787831144.686276:0:18608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443964544 00000100:00100000:2.0:1787831144.686286:0:19892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443965056 00000100:00100000:3.0:1787831144.686291:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787831144.686293:0:19892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443965056 00000100:00100000:3.0:1787831144.686311:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb40f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1874676443964416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787831144.686335:0:19892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787831144.686345:0:19892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb43c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1874676443964800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787831144.686356:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb40f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1874676443964416:12345-0@lo:400:kworker.0 Request processed in 48us (845us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831144.686364:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787831144.686384:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787831144.686390:0:19892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb43c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1874676443964800:12345-0@lo:400:kworker.0 Request processed in 46us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831144.686394:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb430c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1874676443964928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787831144.686403:0:19892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787831144.686424:0:19892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787831144.686433:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb430c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1874676443964928:12345-0@lo:400:kworker.0 Request processed in 42us (857us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831144.686436:0:19892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1874676443965312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787831144.686447:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787831144.686466:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787831144.686477:0:19892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1874676443965312:12345-0@lo:400:kworker.0 Request processed in 45us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831144.686489:0:19892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787831144.686494:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2314ed5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1874676443965184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787831144.686506:0:19892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787831144.686515:0:19892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1874676443965056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787831144.686560:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2314ed5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1874676443965184:12345-0@lo:400:kworker.0 Request processed in 64us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831144.686570:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787831144.686571:0:19892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1874676443965056:12345-0@lo:400:kworker.0 Request processed in 50us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831144.686588:0:19892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787831144.686620:0:18608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787831144.686622:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831144.686673:0:18608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb421c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3620:x1874676443964288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787831144.686689:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22044030c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3620:1874676443964800:0@lo:400:kworker.0 00000100:00100000:3.0:1787831144.686708:0:18611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443963520 00010000:00080000:2.0:1787831144.686712:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d22045230c0 x1874676443965312/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787831160 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787831144.686715:0:18611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443963520 00000100:00100000:2.0:1787831144.686728:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22045230c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3620:1874676443965312:0@lo:400:kworker.0 00000100:00100000:3.0:1787831144.686754:0:18611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443963776 00000100:00100000:2.0:1787831144.686754:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203792940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:be45932f-3bcb-4e49-b61c-a2395180b0ee:3620:1874676443963904:0@lo:400:kworker.0 00000100:00100000:0.0:1787831144.686767:0:18608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb421c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3620:x1874676443964288:12345-0@lo:400:kworker.0 Request processed in 97us (1084us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831144.686775:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22044012c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3620:1874676443964416:0@lo:400:kworker.0 00000100:00100000:0.0:1787831144.686792:0:18608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787831144.686796:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204523840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3620:1874676443964928:0@lo:400:kworker.0 00000100:00100000:0.0:1787831144.686824:0:18608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787831144.686837:0:18608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220390ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1874676443964160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787831144.686876:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204401e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1874676443964288:0@lo:400:kworker.0 00000100:00100000:0.0:1787831144.686914:0:18608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220390ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1874676443964160:12345-0@lo:400:kworker.0 Request processed in 76us (1181us total) trans 0 rc 0/0 00010000:00080000:2.0:1787831144.686930:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2204520780 x1874676443965056/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787831160 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787831144.686931:0:18608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787831144.686948:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204520780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3621:1874676443965056:0@lo:400:kworker.0 00000100:00100000:2.0:1787831144.686984:0:18612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787831144.686994:0:18612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb412c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3620:x1874676443963520:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787831144.687013:0:18612:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25562816 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1787831144.687061:0:18612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb412c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3620:x1874676443963520:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (1697us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831144.687068:0:18612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787831144.687106:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233fb41680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1874676443963520:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787831144.687292:0:18914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787831144.687308:0:18914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a203c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676443964672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787831144.687321:0:18608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787831144.687372:0:18914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a203c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676443964672:12345-0@lo:400:kworker.0 Request processed in 71us (1510us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831144.687543:0:18914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787831144.687556:0:18608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb1cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443964544:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787831144.687603:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787831144.687611:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787831144.687614:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787831144.687617:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787831144.687681:0:18608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb1cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443964544:12345-0@lo:400:kworker.0 Request processed in 135us (1677us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831144.687690:0:18608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787831144.687696:0:3622:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934601 gen 2 00000004:00080000:2.0:1787831144.687706:0:3622:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934599 committed transno 8589934601 00000004:00080000:2.0:1787831144.687730:0:3622:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d233fae8780, transno 8589934601 00000100:00100000:2.0:1787831144.687751:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204403480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676443964160:0@lo:400:kworker.0 00000100:00100000:0.0:1787831144.687756:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204403c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443964544:0@lo:400:kworker.0 00000100:00100000:2.0:1787831144.687777:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204400000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676443964672:0@lo:400:kworker.0 00000100:00100000:2.0:1787831144.687800:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204520b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3622:1874676443965184:0@lo:400:kworker.0 00000100:00100000:3.0:1787831144.688092:0:18611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443963776 00000100:00100000:3.0:1787831144.688134:0:18611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787831144.688207:0:18611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb1f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443963776:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787831144.688236:0:18611:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25562816 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787831144.688304:0:18611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb1f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443963776:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (1694us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831144.688311:0:18611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787831144.688354:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233fb1f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443963776:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787831144.688767:0:19224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb1d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1874676443964032:12345-0@lo:400:kworker.0 Request processed in 3924us (4177us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831144.688778:0:19224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787831144.688958:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203790780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443964032:0@lo:400:kworker.0 00000001:00080000:3.0:1787831144.691941:0:17084:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934674 is committed 00000020:00080000:3.0:1787831144.691969:0:17084:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d2335786300 refcount 2 committed 0 result 0 batchid 4294967530 00000020:00080000:3.0:1787831144.691975:0:17084:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d2318526d00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d22037ba780 00000020:00080000:3.0:1787831144.691977:0:17084:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d2318526e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d2306cadc00 00000020:00080000:3.0:1787831144.691997:0:17084:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967529 batchid updated 00000020:00080000:0.0:1787831144.692046:0:17143:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967530 committed batchid 4294967529 00000020:00080000:0.0:1787831144.692106:0:17143:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00010000:00010000:1.0:1787831144.692140:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11800/0x95459fb9d1d2a549 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831144.692151:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11800/0x95459fb9d1d2a549 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831144.692171:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11800/0x95459fb9d1d2a549 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831144.692177:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233bf11800 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:1.0:1787831144.692181:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11800/0x95459fb9d1d2a549 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831144.692187:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11800/0x95459fb9d1d2a549 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831144.692203:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff8d2320608800) 00010000:00010000:1.0:1787831144.692206:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787831144.692210:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11800/0x95459fb9d1d2a549 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831144.692215:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf11800/0x95459fb9d1d2a549 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831145.190795:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787831145.190828:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2314ed52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443965440:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1787831145.190885:0:17139:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787831145.190892:0:17139:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787831145.190918:0:17139:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 4 count 4 00000040:00080000:2.0:1787831145.190929:0:17139:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1787831145.190943:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831145.191004:0:18611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443965440 00000100:00100000:0.0:1787831145.191013:0:18611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443965440 00000100:00100000:0.0:1787831145.191074:0:18611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787831145.191083:0:18611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220442fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676443965440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787831145.191111:0:18611:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25562816 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787831145.191163:0:18611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220442fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676443965440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831145.191173:0:18611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787831145.191233:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2314ed52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443965440:0@lo:13:osp-pre-0-0.0 00000001:00080000:1.0:1787831145.196149:0:19422:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00000001:00080000:1.0:1787831145.196170:0:19422:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00010000:00010000:0.0:1787831145.382819:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787831145.452919:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831145.452997:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433445888 00000100:00100000:3.0:1787831145.453010:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433445888 00000100:00080000:2.0:1787831145.453080:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787831145.453108:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 125 00000100:00100000:3.0:1787831145.453121:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204520000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+13:15544:x1874676433445888:12345-192.168.203.31@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1787831145.453261:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204520000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+13:15544:x1874676433445888:12345-192.168.203.31@tcp:60:lhsmtool_posix.0 Request processed in 143us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831145.453271:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 125 00000100:00100000:3.0:1787831145.455711:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831145.455808:0:19892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433446016 00000100:00100000:2.0:1787831145.455821:0:19892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433446016 00000100:00080000:0.0:1787831145.455905:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787831145.455925:0:19892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 126 00000100:00100000:2.0:1787831145.455937:0:19892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb1f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+5:15544:x1874676433446016:12345-192.168.203.31@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1787831145.456288:0:19892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb1f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+5:15544:x1874676433446016:12345-192.168.203.31@tcp:60:lhsmtool_posix.0 Request processed in 352us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831145.456298:0:19892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 126 00000100:00100000:2.0:1787831145.459299:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831145.459560:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433446272 00000100:00100000:0.0:1787831145.459573:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433446272 00000100:00100000:3.0:1787831145.459667:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 28 00000100:00100000:3.0:1787831145.459682:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220385f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+13:15544:x1874676433446272:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787831145.460092:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220385f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+14:15544:x1874676433446272:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 Request processed in 412us (811us total) trans 8589934675 rc 0/0 00000100:00100000:3.0:1787831145.460101:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 28 00000040:00080000:0.0:1787831145.639560:0:17855:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787831145.703031:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204522940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443965568:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787831145.703135:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831145.703271:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443965568 00000100:00100000:1.0:1787831145.703280:0:17110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443965568 00000100:00100000:1.0:1787831145.703347:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787831145.703371:0:17110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22046452c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1874676443965568:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787831145.703418:0:17110:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787831145.703527:0:17110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22046452c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1874676443965568:12345-0@lo:41:osp-pre-1-0.0 Request processed in 159us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831145.703535:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787831145.704088:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204522940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443965568:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787831146.068994:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831146.069057:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831146.069093:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831146.069135:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831146.069164:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831146.069172:0:18914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433447296 00000100:00100000:2.0:1787831146.069186:0:18914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433447296 00000100:00100000:1.0:1787831146.069186:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831146.069213:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831146.069250:0:18518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433446656 00000100:00100000:1.0:1787831146.069259:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831146.069269:0:18914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433446912 00000100:00100000:2.0:1787831146.069276:0:18914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433446912 00000100:00100000:2.0:1787831146.069302:0:18914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433446784 00000100:00100000:2.0:1787831146.069305:0:18914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433446784 00000100:00100000:2.0:1787831146.069331:0:18914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 29 00000100:00100000:2.0:1787831146.069342:0:18914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22045212c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+6:2394:x1874676433446912:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1787831146.069353:0:18518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433446656 00000100:00100000:2.0:1787831146.069453:0:18914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22045212c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+6:2394:x1874676433446912:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 106us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831146.069494:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433446400 00000100:00100000:0.0:1787831146.069501:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433446400 00000100:00100000:0.0:1787831146.069540:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 165 00000100:00100000:0.0:1787831146.069548:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203526c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f931f0c-5730-4db2-abdb-70a9ab2deeff+13:2394:x1874676433446400:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1787831146.069577:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203526c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f931f0c-5730-4db2-abdb-70a9ab2deeff+13:2394:x1874676433446400:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 31us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831146.069585:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 165 00000100:00100000:3.0:1787831146.069938:0:18518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433447168 00000100:00100000:3.0:1787831146.069950:0:18518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433447168 00000100:00100000:3.0:1787831146.069978:0:18518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433446528 00000100:00100000:3.0:1787831146.069981:0:18518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433446528 00000100:00100000:3.0:1787831146.069994:0:18518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433447040 00000100:00100000:3.0:1787831146.069996:0:18518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433447040 00000100:00100000:3.0:1787831146.070018:0:18518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 68 00000100:00100000:3.0:1787831146.070028:0:18518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204522580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+5:2394:x1874676433446656:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1787831146.070099:0:18518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204522580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+5:2394:x1874676433446656:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 73us (1005us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831146.070107:0:18518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 68 00000100:00100000:3.0:1787831146.070124:0:18518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 69 00000100:00100000:3.0:1787831146.070131:0:18518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204521e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8db48c6c-a61a-41ec-9c3b-96530aeb2537+5:2394:x1874676433447168:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1787831146.071247:0:18518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204521e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8db48c6c-a61a-41ec-9c3b-96530aeb2537+5:2394:x1874676433447168:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 1110us (2077us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831146.071259:0:18518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 69 00000100:00100000:3.0:1787831146.071284:0:18518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 70 00000100:00100000:3.0:1787831146.071294:0:18518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204523480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+14:2394:x1874676433446528:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1787831146.071326:0:18518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204523480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+14:2394:x1874676433446528:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 36us (2142us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831146.071332:0:18518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 70 00000100:00100000:3.0:1787831146.071345:0:18518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 71 00000100:00100000:3.0:1787831146.071352:0:18518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204522d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8db48c6c-a61a-41ec-9c3b-96530aeb2537+6:2394:x1874676433447040:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1787831146.071378:0:18518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204522d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8db48c6c-a61a-41ec-9c3b-96530aeb2537+6:2394:x1874676433447040:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 26us (2118us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831146.071397:0:18518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 71 00000100:00100000:3.0:1787831146.071492:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831146.072065:0:18609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433447424 00000100:00100000:3.0:1787831146.072074:0:18609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433447424 00000100:00100000:1.0:1787831146.072703:0:18610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 30 00000100:00100000:1.0:1787831146.072731:0:18610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204521680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+5:2394:x1874676433446784:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1787831146.073051:0:18610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204521680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+5:2394:x1874676433446784:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 333us (3835us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831146.073061:0:18610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 30 00000100:00100000:1.0:1787831146.073263:0:18610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 38 00000100:00100000:1.0:1787831146.073273:0:18610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22045203c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8db48c6c-a61a-41ec-9c3b-96530aeb2537+5:2393:x1874676433447296:12345-192.168.203.31@tcp:9:kworker.0 00000020:00000080:1.0:1787831146.073310:0:18610:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x95459fb9d1d29f3e 00000100:00080000:1.0:1787831146.073331:0:18610:0:(import.c:65:import_set_state_nolock()) ffff8d2201d09000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787831146.073395:0:18610:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934601 00000100:00100000:1.0:1787831146.073557:0:18610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22045203c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8db48c6c-a61a-41ec-9c3b-96530aeb2537+2:2393:x1874676433447296:12345-192.168.203.31@tcp:9:kworker.0 Request processed in 287us (4580us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831146.073565:0:18610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 38 00010000:00010000:1.0:1787831146.073601:0:18633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787831146.073787:0:18914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 29 00000100:00080000:2.0:1787831146.073849:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787831146.073856:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787831146.073861:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787831146.073863:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787831146.074922:0:18608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 39 00000100:00100000:0.0:1787831146.074940:0:18608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204646940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8db48c6c-a61a-41ec-9c3b-96530aeb2537+5:2393:x1874676433447424:12345-192.168.203.31@tcp:9:kworker.0 00000020:00000080:0.0:1787831146.074969:0:18608:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x95459fb9d1d29f45 00000100:00080000:0.0:1787831146.075107:0:18608:0:(import.c:65:import_set_state_nolock()) ffff8d233556f000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1787831146.075162:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:0.0:1787831146.075163:0:18608:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:0.0:1787831146.075462:0:18608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204646940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8db48c6c-a61a-41ec-9c3b-96530aeb2537+2:2393:x1874676433447424:12345-192.168.203.31@tcp:9:kworker.0 Request processed in 528us (3968us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831146.075470:0:18608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 39 00010000:00010000:3.0:1787831146.407215:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787831147.430929:0:18633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787831147.884978:0:20630:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 07:45:47 (1787831147) 00010000:00010000:3.0:1787831148.454866:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787831149.479159:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787831149.798945:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220442c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676443965696:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787831149.799018:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831149.799482:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233fb41a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1874676443965952:0@lo:400:kworker.0 00000100:00100000:2.0:1787831149.799515:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831149.799541:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203791a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1874676443966464:0@lo:400:kworker.0 00000100:00100000:2.0:1787831149.799562:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831149.799578:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204403480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3620:1874676443966976:0@lo:400:kworker.0 00000100:00100000:2.0:1787831149.799608:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831149.799652:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233fb41e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:be45932f-3bcb-4e49-b61c-a2395180b0ee:3619:1874676443965824:0@lo:400:kworker.0 00000100:00100000:2.0:1787831149.799684:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233fae8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3622:1874676443966208:0@lo:400:kworker.0 00000100:00100000:0.0:1787831149.799697:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831149.799714:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831149.799815:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233faeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443966336:0@lo:400:kworker.0 00000100:00100000:0.0:1787831149.799843:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831149.799860:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204400000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3619:1874676443966848:0@lo:400:kworker.0 00000100:00100000:0.0:1787831149.799881:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831149.799899:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220442ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443967360:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787831149.799934:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831149.799967:0:18611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443965696 00000100:00100000:0.0:1787831149.799973:0:18611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443965696 00000100:00100000:0.0:1787831149.800017:0:18611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443967360 00000100:00100000:0.0:1787831149.800020:0:18611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443967360 00000100:00100000:0.0:1787831149.800038:0:18611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787831149.800157:0:18611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb41680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1874676443965696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787831149.800192:0:18611:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923501056 avail 3691978752 00000100:00100000:0.0:1787831149.800237:0:18611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb41680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1874676443965696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 191us (1218us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831149.800258:0:18611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787831149.800278:0:18611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787831149.800285:0:18611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2314ed52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443967360:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787831149.800296:0:18611:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923501056 avail 3691978752 00000100:00100000:0.0:1787831149.800327:0:18611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2314ed52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443967360:12345-0@lo:13:osp-pre-1-1.0 Request processed in 42us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831149.800334:0:18611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787831149.800440:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220442ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443967360:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787831149.800494:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443966976 00000100:00100000:0.0:1787831149.800499:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443966976 00000100:00100000:0.0:1787831149.800530:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443966208 00000100:00100000:0.0:1787831149.800533:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443966208 00000100:00100000:0.0:1787831149.800549:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443966848 00000100:00100000:0.0:1787831149.800552:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443966848 00000100:00100000:0.0:1787831149.800565:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787831149.800572:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22038f9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1874676443966976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787831149.800612:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22038f9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1874676443966976:12345-0@lo:400:kworker.0 Request processed in 40us (1003us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831149.800619:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787831149.800654:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787831149.800661:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22038f9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1874676443966208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787831149.800690:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22038f9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1874676443966208:12345-0@lo:400:kworker.0 Request processed in 31us (977us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831149.800697:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787831149.800709:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787831149.800715:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2314ed5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874676443966848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787831149.800850:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2314ed5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874676443966848:12345-0@lo:400:kworker.0 Request processed in 135us (967us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831149.800857:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787831149.800901:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204646580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443966080:0@lo:400:kworker.0 00000100:00100000:1.0:1787831149.800947:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831149.800973:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203790780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443966592:0@lo:400:kworker.0 00000100:00100000:1.0:1787831149.800993:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831149.801012:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204403c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3621:1874676443967104:0@lo:400:kworker.0 00000100:00100000:1.0:1787831149.801037:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831149.801063:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22045b7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443967616:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787831149.801085:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831149.801120:0:19224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443965952 00000100:00100000:1.0:1787831149.801124:0:19224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443965952 00000100:00100000:0.0:1787831149.801130:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204400000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3619:1874676443966848:0@lo:400:kworker.0 00000100:00100000:0.0:1787831149.801145:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787831149.801153:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220442ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443967488:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787831149.801179:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831149.801216:0:19224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443966336 00000100:00100000:1.0:1787831149.801221:0:19224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443966336 00000100:00100000:1.0:1787831149.801238:0:19224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443967488 00000100:00100000:1.0:1787831149.801241:0:19224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443967488 00000100:00100000:0.0:1787831149.801251:0:18914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443966464 00000100:00100000:0.0:1787831149.801256:0:18914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443966464 00000100:00100000:1.0:1787831149.801260:0:19224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787831149.801270:0:19224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22044012c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1874676443965952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787831149.801292:0:18914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443966080 00000100:00100000:0.0:1787831149.801296:0:18914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443966080 00000100:00100000:1.0:1787831149.801316:0:19224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22044012c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1874676443965952:12345-0@lo:400:kworker.0 Request processed in 47us (1799us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831149.801321:0:18914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443966592 00000100:00100000:1.0:1787831149.801327:0:19224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787831149.801328:0:18914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443966592 00000100:00100000:1.0:1787831149.801347:0:19224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787831149.801352:0:18914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787831149.801358:0:19224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220442e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3619:x1874676443966336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787831149.801364:0:18914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22044030c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3620:x1874676443966464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787831149.801394:0:19224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220442e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3619:x1874676443966336:12345-0@lo:400:kworker.0 Request processed in 39us (1549us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831149.801400:0:19224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787831149.801410:0:19224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787831149.801415:0:19224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22045b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443967488:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787831149.801436:0:19224:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:0.0:1787831149.801479:0:18914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22044030c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3620:x1874676443966464:12345-0@lo:400:kworker.0 Request processed in 119us (1914us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831149.801488:0:18914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787831149.801489:0:19224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22045b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443967488:12345-0@lo:41:osp-pre-0-1.0 Request processed in 71us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831149.801497:0:19224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787831149.801506:0:18914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787831149.801515:0:18914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22045221c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3621:x1874676443966080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787831149.801526:0:18610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787831149.801535:0:18610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204521a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443966592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787831149.801554:0:18914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22045221c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3621:x1874676443966080:12345-0@lo:400:kworker.0 Request processed in 40us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831149.801562:0:18914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787831149.801575:0:18610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204521a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443966592:12345-0@lo:400:kworker.0 Request processed in 41us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831149.801582:0:18610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787831149.801611:0:18611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443967616 00000100:00100000:0.0:1787831149.801615:0:18611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443967616 00000100:00100000:1.0:1787831149.801620:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204646580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443966080:0@lo:400:kworker.0 00000100:00100000:1.0:1787831149.801659:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203790780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443966592:0@lo:400:kworker.0 00000100:00100000:0.0:1787831149.801666:0:18611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787831149.801673:0:18611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204522940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443967616:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787831149.801695:0:18611:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787831149.801721:0:18611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204522940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443967616:12345-0@lo:13:osp-pre-0-1.0 Request processed in 49us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831149.801815:0:18611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787831149.801836:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443967104 00000100:00100000:0.0:1787831149.801839:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443967104 00000100:00100000:0.0:1787831149.801865:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787831149.801870:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204520f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1874676443967104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787831149.801902:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204520f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1874676443967104:12345-0@lo:400:kworker.0 Request processed in 32us (866us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831149.801909:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787831149.801971:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220442ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443967488:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787831149.801984:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233faeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443966336:0@lo:400:kworker.0 00000100:00100000:2.0:1787831149.802017:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233fae8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3622:1874676443966208:0@lo:400:kworker.0 00000100:00080000:0.0:1787831149.802030:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787831149.802036:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203792940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3622:1874676443966720:0@lo:400:kworker.0 00000100:00080000:0.0:1787831149.802036:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787831149.802040:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787831149.802043:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787831149.802065:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443965824 00000100:00100000:2.0:1787831149.802069:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831149.802070:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443965824 00000100:00100000:2.0:1787831149.802093:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204401e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3622:1874676443967232:0@lo:400:kworker.0 00000100:00100000:0.0:1787831149.802103:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1787831149.802111:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203524450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be45932f-3bcb-4e49-b61c-a2395180b0ee+24:3619:x1874676443965824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787831149.802118:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831149.802157:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203524450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be45932f-3bcb-4e49-b61c-a2395180b0ee+24:3619:x1874676443965824:12345-0@lo:400:kworker.0 Request processed in 47us (2460us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831149.802161:0:3622:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934599 gen 2 00000100:00100000:0.0:1787831149.802165:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000004:00080000:2.0:1787831149.802170:0:3622:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934599 committed transno 8589934599 00000100:00100000:2.0:1787831149.802200:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220442c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676443965696:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787831149.802207:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233fb41e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:be45932f-3bcb-4e49-b61c-a2395180b0ee:3619:1874676443965824:0@lo:400:kworker.0 00000100:00100000:3.0:1787831149.802275:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443966720 00000100:00100000:3.0:1787831149.802280:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443966720 00000100:00100000:3.0:1787831149.802308:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443967232 00000100:00100000:3.0:1787831149.802311:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443967232 00000100:00100000:3.0:1787831149.802335:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787831149.802353:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22038fb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1874676443966720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787831149.802363:0:19892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787831149.802407:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22038fb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1874676443966720:12345-0@lo:400:kworker.0 Request processed in 55us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831149.802442:0:19892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22038fad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1874676443967232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787831149.802472:0:19892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22038fad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1874676443967232:12345-0@lo:400:kworker.0 Request processed in 33us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831149.805155:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:3.0:1787831149.805254:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787831149.805315:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22045b7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443967616:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787831149.805322:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203792940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3622:1874676443966720:0@lo:400:kworker.0 00000100:00100000:1.0:1787831149.805339:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204403c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3621:1874676443967104:0@lo:400:kworker.0 00010000:00080000:3.0:1787831149.805347:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2204401e00 x1874676443967232/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787831165 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787831149.805359:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204401e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3622:1874676443967232:0@lo:400:kworker.0 00000100:00100000:2.0:1787831149.805447:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233fb41a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1874676443965952:0@lo:400:kworker.0 00000100:00100000:2.0:1787831149.805461:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203791a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1874676443966464:0@lo:400:kworker.0 00010000:00080000:2.0:1787831149.805474:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2204403480 x1874676443966976/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787831165 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787831149.805485:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204403480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3620:1874676443966976:0@lo:400:kworker.0 00000100:00100000:0.0:1787831149.806482:0:19892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000001:00080000:3.0:1787831149.807165:0:17084:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934675 is committed 00000020:00080000:3.0:1787831149.807175:0:17084:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967530 batchid updated 00000020:00080000:0.0:1787831149.807329:0:17143:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967530 00000020:00080000:0.0:1787831149.807339:0:17143:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967530 00000100:00100000:1.0:1787831150.310984:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787831150.311010:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22045b52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443967744:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787831150.311084:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831150.311416:0:18611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443967744 00000100:00100000:2.0:1787831150.311425:0:18611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443967744 00000100:00100000:2.0:1787831150.311476:0:18611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787831150.311485:0:18611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204523c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1874676443967744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787831150.311507:0:18611:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787831150.311565:0:18611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204523c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1874676443967744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831150.311572:0:18611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787831150.311752:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22045b52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443967744:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787831150.505936:0:18633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787831150.823601:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787831150.823644:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204520b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1874676443967872:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787831150.823729:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831150.823889:0:19224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443967872 00000100:00100000:1.0:1787831150.823897:0:19224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443967872 00000100:00100000:1.0:1787831150.823947:0:19224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787831150.823957:0:19224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22038f8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1874676443967872:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787831150.823993:0:19224:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787831150.824048:0:19224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22038f8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1874676443967872:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831150.824056:0:19224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787831150.824167:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204520b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1874676443967872:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787831151.193071:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831151.193285:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831151.193320:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831151.193355:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831151.193377:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831151.193399:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831151.193482:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831151.193513:0:19566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433448064 00000100:00100000:1.0:1787831151.193522:0:19566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433448064 00000100:00100000:1.0:1787831151.193580:0:19566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433447936 00000100:00100000:1.0:1787831151.193583:0:19566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433447936 00000100:00100000:1.0:1787831151.193609:0:19566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 34 00000100:00100000:1.0:1787831151.193619:0:19566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204523840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+6:2395:x1874676433448064:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1787831151.193712:0:19566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204523840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+6:2395:x1874676433448064:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 94us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831151.193721:0:19566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 34 00000100:00100000:1.0:1787831151.193738:0:19566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 35 00000100:00100000:1.0:1787831151.193745:0:19566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203791a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+5:2394:x1874676433447936:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1787831151.193771:0:19566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203791a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+5:2394:x1874676433447936:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 27us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831151.193777:0:19566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 35 00000100:00100000:1.0:1787831151.193925:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433447808 00000100:00100000:1.0:1787831151.193929:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433447808 00000100:00100000:1.0:1787831151.193959:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433448320 00000100:00100000:1.0:1787831151.193962:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433448320 00000100:00100000:1.0:1787831151.193977:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433447680 00000100:00100000:1.0:1787831151.193980:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433447680 00000100:00100000:1.0:1787831151.193992:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433448192 00000100:00100000:1.0:1787831151.193994:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433448192 00000100:00100000:1.0:1787831151.194023:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 78 00000100:00100000:1.0:1787831151.194029:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204520780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+5:2395:x1874676433447808:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1787831151.194064:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204520780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+5:2395:x1874676433447808:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 35us (780us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831151.194070:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 78 00000100:00100000:1.0:1787831151.194084:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 79 00000100:00100000:1.0:1787831151.194089:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22045230c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8db48c6c-a61a-41ec-9c3b-96530aeb2537+5:2395:x1874676433448320:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1787831151.194648:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 80 00000100:00100000:0.0:1787831151.194662:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204520b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+13:2394:x1874676433447680:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1787831151.194733:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22045230c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8db48c6c-a61a-41ec-9c3b-96530aeb2537+5:2395:x1874676433448320:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 642us (1377us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831151.194740:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 79 00000100:00100000:1.0:1787831151.194756:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 81 00000100:00100000:1.0:1787831151.194762:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203792940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8db48c6c-a61a-41ec-9c3b-96530aeb2537+6:2394:x1874676433448192:12345-192.168.203.31@tcp:400:kworker.0 00000100:00080000:2.0:1787831151.194851:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787831151.194856:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787831151.194859:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787831151.194876:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787831151.196788:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204520b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+13:2394:x1874676433447680:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 2123us (3401us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831151.196811:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 80 00000100:00100000:3.0:1787831151.200332:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433447552 00000100:00100000:3.0:1787831151.200347:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433447552 00000100:00100000:3.0:1787831151.200548:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 167 00000100:00100000:3.0:1787831151.200561:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203525450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f931f0c-5730-4db2-abdb-70a9ab2deeff+13:2395:x1874676433447552:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1787831151.200661:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203525450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f931f0c-5730-4db2-abdb-70a9ab2deeff+13:2395:x1874676433447552:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 103us (7599us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831151.200671:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 167 00000100:00100000:0.0:1787831151.201385:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203792940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8db48c6c-a61a-41ec-9c3b-96530aeb2537+6:2394:x1874676433448192:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 6618us (7897us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831151.201397:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 81 00000100:00100000:1.0:1787831151.281321:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831151.281429:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433448576 00000100:00100000:0.0:1787831151.281438:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433448576 00000100:00100000:0.0:1787831151.281499:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 29 00000100:00100000:0.0:1787831151.281508:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203790780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+13:16514:x1874676433448576:12345-192.168.203.31@tcp:35:umount.0 00000100:00100000:0.0:1787831151.281816:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203790780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+14:16514:x1874676433448576:12345-192.168.203.31@tcp:35:umount.0 Request processed in 308us (503us total) trans 8589934676 rc 0/0 00000100:00100000:0.0:1787831151.281825:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 29 00000100:00100000:1.0:1787831151.286459:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831151.286671:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433448832 00000100:00100000:3.0:1787831151.286683:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433448832 00000100:00100000:3.0:1787831151.286761:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 30 00000100:00100000:3.0:1787831151.286774:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203766d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+14:16514:x1874676433448832:12345-192.168.203.31@tcp:35:umount.0 00000100:00100000:3.0:1787831151.287224:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203766d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+15:16514:x1874676433448832:12345-192.168.203.31@tcp:35:umount.0 Request processed in 451us (777us total) trans 8589934677 rc 0/0 00000100:00100000:3.0:1787831151.287234:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 30 00000100:00100000:2.0:1787831151.294062:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831151.294189:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831151.294301:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831151.294423:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433449216 00000100:00100000:0.0:1787831151.294432:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433449216 00000100:00100000:0.0:1787831151.294493:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433449344 00000100:00100000:0.0:1787831151.294497:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433449344 00000100:00100000:0.0:1787831151.294518:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 5 00000100:00100000:0.0:1787831151.294536:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204644000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1f931f0c-5730-4db2-abdb-70a9ab2deeff+14:2397:x1874676433449216:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787831151.294553:0:17090:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787831151.294574:0:17090:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d233bf11000/0x95459fb9d1d29edc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424126 expref: 14 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831151.294596:0:17090:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787831151.294683:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204644000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1f931f0c-5730-4db2-abdb-70a9ab2deeff+13:2397:x1874676433449216:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 149us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831151.294691:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 5 00000100:00100000:0.0:1787831151.294708:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 6 00000100:00100000:0.0:1787831151.294714:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb47480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1f931f0c-5730-4db2-abdb-70a9ab2deeff+12:2397:x1874676433449344:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787831151.294722:0:17090:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787831151.294731:0:17090:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d22039c1400/0x95459fb9d1d29ee3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424157 expref: 12 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831151.294740:0:17090:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787831151.294758:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb47480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1f931f0c-5730-4db2-abdb-70a9ab2deeff+11:2397:x1874676433449344:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 44us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831151.294764:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 6 00000100:00100000:3.0:1787831151.296248:0:18609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433449088 00000100:00100000:3.0:1787831151.296259:0:18609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433449088 00000100:00100000:3.0:1787831151.296306:0:18609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 40 00000100:00100000:3.0:1787831151.296315:0:18609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204646580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+6:2393:x1874676433449088:12345-192.168.203.31@tcp:9:umount.0 00000020:00000080:3.0:1787831151.296354:0:18609:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x95459fb9d1d29f06 00000020:00010000:3.0:1787831151.296364:0:18609:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8d2201d9c800: total 0 00000100:00080000:3.0:1787831151.296369:0:18609:0:(import.c:65:import_set_state_nolock()) ffff8d2201d98800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787831151.296414:0:18609:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:3.0:1787831151.296551:0:18609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204646580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+4:2393:x1874676433449088:12345-192.168.203.31@tcp:9:umount.0 Request processed in 236us (2498us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831151.296559:0:18609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 40 00000020:00010000:3.0:1787831151.296583:0:17092:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8d2201d9c800: total 0 00010000:00010000:3.0:1787831151.296586:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787831151.296607:0:17092:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8d2201d9c800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1787831151.296701:0:17092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d2c49235/0x95459fb9d1d2a5ce lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994243bf expref: 3 pid: 19566 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831151.296728:0:17092:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8d2201d9c800, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1787831151.296740:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787831151.296742:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787831151.296743:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787831151.296973:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831151.297471:0:20128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433449472 00000100:00100000:2.0:1787831151.297477:0:20128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433449472 00000100:00100000:2.0:1787831151.297528:0:20128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 7 00000100:00100000:2.0:1787831151.297537:0:20128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2335548850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1f931f0c-5730-4db2-abdb-70a9ab2deeff+11:2397:x1874676433449472:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787831151.297549:0:20128:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787831151.297562:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2307c76a00/0x95459fb9d1d29fa0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a9942420d expref: 11 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831151.297575:0:20128:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787831151.297612:0:20128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2335548850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1f931f0c-5730-4db2-abdb-70a9ab2deeff+10:2397:x1874676433449472:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 77us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831151.297619:0:20128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 7 00000001:00100000:1.0:1787831151.300774:0:19422:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2240faf2-2a81-4e92-bb4c-b58ed0f19f2a 00000020:00000080:1.0:1787831151.300784:0:19422:0:(genops.c:885:class_export_put()) final put ffff8d2201d9c800/2240faf2-2a81-4e92-bb4c-b58ed0f19f2a 00000001:00100000:1.0:1787831151.300816:0:19422:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8db48c6c-a61a-41ec-9c3b-96530aeb2537 00000020:00000080:1.0:1787831151.300819:0:19422:0:(genops.c:885:class_export_put()) final put ffff8d233556c800/8db48c6c-a61a-41ec-9c3b-96530aeb2537 00000020:00000080:0.0:1787831151.300871:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2201d9c800/2240faf2-2a81-4e92-bb4c-b58ed0f19f2a for lustre-OST0001 00000020:00000080:0.0:1787831151.300923:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d233556c800/8db48c6c-a61a-41ec-9c3b-96530aeb2537 for lustre-OST0001 00000020:00000080:0.0:1787831151.300939:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d2201d98800 for lustre-OST0001 00000020:00000080:0.0:1787831151.300945:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d233556f000 for lustre-OST0001 00000100:00100000:0.0:1787831151.301188:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831151.301263:0:18610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433449600 00000100:00100000:1.0:1787831151.301272:0:18610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433449600 00000100:00100000:1.0:1787831151.301328:0:18610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 41 00000100:00100000:1.0:1787831151.301337:0:18610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22045b70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+5:2393:x1874676433449600:12345-192.168.203.31@tcp:9:umount.0 00000020:00000080:1.0:1787831151.301368:0:18610:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x95459fb9d1d29eff 00000100:00080000:1.0:1787831151.301379:0:18610:0:(import.c:65:import_set_state_nolock()) ffff8d220470d000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787831151.301436:0:18610:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934601 00010000:00010000:0.0:1787831151.301696:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787831151.307373:0:18610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22045b70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+2:2393:x1874676433449600:12345-192.168.203.31@tcp:9:umount.0 Request processed in 6026us (6253us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831151.307389:0:18610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 41 00000001:00100000:2.0:1787831151.309696:0:18604:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 8db48c6c-a61a-41ec-9c3b-96530aeb2537 00000020:00000080:2.0:1787831151.309705:0:18604:0:(genops.c:885:class_export_put()) final put ffff8d2201d08800/8db48c6c-a61a-41ec-9c3b-96530aeb2537 00000020:00000080:3.0:1787831151.314450:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2201d08800/8db48c6c-a61a-41ec-9c3b-96530aeb2537 for lustre-OST0000 00000020:00000080:3.0:1787831151.314519:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d2201d09000 for lustre-OST0000 00000100:00100000:1.0:1787831151.316601:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831151.316739:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433450368 00000100:00100000:2.0:1787831151.316749:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433450368 00000100:00100000:2.0:1787831151.316814:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 127 00000100:00100000:2.0:1787831151.316823:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203764780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+15:2393:x1874676433450368:12345-192.168.203.31@tcp:39:umount.0 00000020:00000080:2.0:1787831151.316855:0:17106:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x95459fb9d1d29ef1 00000020:00010000:2.0:1787831151.316885:0:17106:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8d2202a79000: total 0 00000100:00080000:2.0:1787831151.316890:0:17106:0:(import.c:65:import_set_state_nolock()) ffff8d2202a79800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787831151.316919:0:17106:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934677 00000100:00100000:2.0:1787831151.317079:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203764780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+14:2393:x1874676433450368:12345-192.168.203.31@tcp:39:umount.0 Request processed in 256us (485us total) trans 8589934678 rc 0/0 00000100:00100000:2.0:1787831151.317087:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 127 00000020:00010000:1.0:1787831151.317512:0:18633:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8d2202a79000: total 0 00010000:00010000:1.0:1787831151.317562:0:18633:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8d2202a79000, canceled 0 locks, left on hash table 8. 00010000:00010000:1.0:1787831151.317597:0:18633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff8d233a6f8c00) 00010000:00010000:1.0:1787831151.317601:0:18633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787831151.317610:0:18633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94c00/0x95459fb9d1d2a4b6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424372 expref: 13 pid: 19892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831151.317651:0:18633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8d2320608a00) 00010000:00010000:1.0:1787831151.317654:0:18633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787831151.317659:0:18633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10800/0x95459fb9d1d29fbc lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424214 expref: 12 pid: 18518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831151.317678:0:18633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d233a6f8800) 00010000:00010000:1.0:1787831151.317681:0:18633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787831151.317684:0:18633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10e00/0x95459fb9d1d2a09c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424253 expref: 11 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831151.317696:0:18633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d233a6f8800) 00010000:00010000:1.0:1787831151.317698:0:18633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787831151.317701:0:18633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0000/0x95459fb9d1d2a35f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a9942431e expref: 10 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831151.317717:0:18633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d220274c300) 00010000:00010000:1.0:1787831151.317720:0:18633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787831151.317734:0:18633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95600/0x95459fb9d1d29fd8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a9942421b expref: 9 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831151.317751:0:18633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff8d233a6f8c00) 00010000:00010000:1.0:1787831151.317753:0:18633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787831151.317757:0:18633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2303aa2a00/0x95459fb9d1d2a58f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994243aa expref: 8 pid: 19892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831151.317769:0:18633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff8d233a6f8c00) 00010000:00010000:1.0:1787831151.317772:0:18633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787831151.317775:0:18633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668800/0x95459fb9d1d2a5b9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994243b8 expref: 7 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831151.317790:0:18633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d220274cc00) 00010000:00010000:1.0:1787831151.317792:0:18633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787831151.317805:0:18633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95200/0x95459fb9d1d2a017 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424229 expref: 6 pid: 19892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831151.317816:0:18633:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8d2202a79000, canceled 8 locks, left on hash table 0. 00010000:00010000:1.0:1787831151.317830:0:18633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787831151.317832:0:18633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787831151.317834:0:18633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787831151.332359:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831151.332465:0:19892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433450496 00000100:00100000:0.0:1787831151.332474:0:19892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433450496 00000100:00100000:0.0:1787831151.332535:0:19892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 128 00000100:00100000:0.0:1787831151.332545:0:19892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+5:2393:x1874676433450496:12345-192.168.203.31@tcp:39:umount.0 00000020:00000080:0.0:1787831151.332579:0:19892:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x95459fb9d1d29ef8 00000100:00080000:0.0:1787831151.332597:0:19892:0:(import.c:65:import_set_state_nolock()) ffff8d22034d3800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787831151.332658:0:19892:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:0.0:1787831151.332903:0:19892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2240faf2-2a81-4e92-bb4c-b58ed0f19f2a+3:2393:x1874676433450496:12345-192.168.203.31@tcp:39:umount.0 Request processed in 358us (552us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1787831151.332911:0:19892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 128 00010000:00010000:1.0:1787831151.333054:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787831151.527075:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787831152.550813:0:18633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787831152.762857:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831152.762901:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831152.762936:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831152.762968:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433450624 00000100:00100000:3.0:1787831152.762977:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433450624 00000100:00100000:3.0:1787831152.763030:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433450880 00000100:00100000:3.0:1787831152.763033:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433450880 00000100:00100000:3.0:1787831152.763044:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433450752 00000100:00100000:3.0:1787831152.763046:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433450752 00000100:00100000:3.0:1787831152.763061:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 8 00000100:00100000:3.0:1787831152.763071:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204705a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1f931f0c-5730-4db2-abdb-70a9ab2deeff+12:2394:x1874676433450624:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787831152.763086:0:17090:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787831152.763107:0:17090:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d22039c0e00/0x95459fb9d1d29f1b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424196 expref: 12 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831152.763125:0:17090:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787831152.763169:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204705a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1f931f0c-5730-4db2-abdb-70a9ab2deeff+11:2394:x1874676433450624:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 100us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831152.763177:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 8 00000100:00100000:3.0:1787831152.763208:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 9 00000100:00100000:3.0:1787831152.763215:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22047070c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1f931f0c-5730-4db2-abdb-70a9ab2deeff+10:2394:x1874676433450880:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787831152.763236:0:17090:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787831152.763247:0:17090:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d233bf10400/0x95459fb9d1d29f99 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424206 expref: 10 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831152.763258:0:17090:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787831152.763276:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22047070c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1f931f0c-5730-4db2-abdb-70a9ab2deeff+9:2394:x1874676433450880:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 61us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831152.763282:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 9 00000100:00100000:3.0:1787831152.763295:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 10 00000100:00100000:3.0:1787831152.763302:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233cd15680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1f931f0c-5730-4db2-abdb-70a9ab2deeff+8:2394:x1874676433450752:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787831152.763309:0:17090:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787831152.763318:0:17090:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2307c76e00/0x95459fb9d1d29f22 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994241c7 expref: 8 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831152.763326:0:17090:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787831152.763341:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233cd15680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1f931f0c-5730-4db2-abdb-70a9ab2deeff+7:2394:x1874676433450752:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 39us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831152.763347:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 10 00000100:00100000:2.0:1787831152.766382:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831152.766467:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433451136 00000100:00100000:0.0:1787831152.766475:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433451136 00000100:00100000:0.0:1787831152.766538:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 129 00000100:00100000:0.0:1787831152.766549:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb443c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8db48c6c-a61a-41ec-9c3b-96530aeb2537+6:2393:x1874676433451136:12345-192.168.203.31@tcp:39:umount.0 00000020:00000080:0.0:1787831152.766585:0:17105:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x95459fb9d1d29f30 00000020:00010000:0.0:1787831152.766595:0:17105:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8d2201d0c800: total 0 00000100:00080000:0.0:1787831152.766599:0:17105:0:(import.c:65:import_set_state_nolock()) ffff8d2201d0f000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787831152.766662:0:17105:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934678 00000100:00100000:0.0:1787831152.766808:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb443c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8db48c6c-a61a-41ec-9c3b-96530aeb2537+5:2393:x1874676433451136:12345-192.168.203.31@tcp:39:umount.0 Request processed in 261us (435us total) trans 8589934679 rc 0/0 00000100:00100000:0.0:1787831152.766816:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 129 00000020:00010000:1.0:1787831152.767037:0:17092:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8d2201d0c800: total 0 00010000:00010000:1.0:1787831152.767089:0:17092:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8d2201d0c800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1787831152.767120:0:17092:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d220274cc00) 00010000:00010000:1.0:1787831152.767123:0:17092:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787831152.767132:0:17092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233bf10c00/0x95459fb9d1d2a025 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424230 expref: 4 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831152.767175:0:17092:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8d2201d0c800, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1787831152.767187:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787831152.767189:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787831152.767191:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787831152.777593:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831152.778044:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433451264 00000100:00100000:0.0:1787831152.778054:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433451264 00000100:00100000:0.0:1787831152.778152:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 130 00000100:00100000:0.0:1787831152.778164:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb47840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8db48c6c-a61a-41ec-9c3b-96530aeb2537+5:2393:x1874676433451264:12345-192.168.203.31@tcp:39:umount.0 00000020:00000080:0.0:1787831152.778204:0:17104:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x95459fb9d1d29f37 00000100:00080000:0.0:1787831152.778230:0:17104:0:(import.c:65:import_set_state_nolock()) ffff8d2335568000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787831152.778268:0:17104:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934593 00010000:00010000:3.0:1787831152.778477:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787831152.778714:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb47840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8db48c6c-a61a-41ec-9c3b-96530aeb2537+3:2393:x1874676433451264:12345-192.168.203.31@tcp:39:umount.0 Request processed in 552us (1131us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1787831152.778723:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 130 00000100:00100000:2.0:1787831152.813839:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831152.814224:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433451520 00000100:00100000:0.0:1787831152.814234:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433451520 00000100:00100000:0.0:1787831152.814341:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 168 00000100:00100000:0.0:1787831152.814352:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203526450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f931f0c-5730-4db2-abdb-70a9ab2deeff+7:2393:x1874676433451520:12345-192.168.203.31@tcp:251:umount.0 00000020:00000080:0.0:1787831152.814399:0:17096:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x95459fb9d1d29ece 00000020:00010000:0.0:1787831152.814408:0:17096:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8d2202a7f000: total 0 00000100:00080000:0.0:1787831152.814413:0:17096:0:(import.c:65:import_set_state_nolock()) ffff8d2202a7c800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1787831152.814507:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203526450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f931f0c-5730-4db2-abdb-70a9ab2deeff+3:2393:x1874676433451520:12345-192.168.203.31@tcp:251:umount.0 Request processed in 149us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831152.814516:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 168 00000020:00010000:1.0:1787831152.815140:0:18633:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8d2202a7f000: total 0 00010000:00010000:1.0:1787831152.815145:0:18633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787831152.815194:0:18633:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8d2202a7f000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1787831152.815228:0:18633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d23344b6600/0x95459fb9d1d29ed5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a9942411f expref: 2 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831152.815245:0:18633:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8d2202a7f000, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1787831152.815254:0:18633:0:(genops.c:885:class_export_put()) final put ffff8d2202a7f000/1f931f0c-5730-4db2-abdb-70a9ab2deeff 00010000:00010000:1.0:1787831152.815265:0:18633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787831152.815266:0:18633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787831152.815268:0:18633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787831152.815367:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2202a7f000/1f931f0c-5730-4db2-abdb-70a9ab2deeff for MGS 00000020:00000080:3.0:1787831152.816561:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d2202a7c800 for MGS 00010000:00010000:3.0:1787831153.576138:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787831154.324079:0:20825:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1787831154.340917:0:20825:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1787831154.340989:0:20825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d2303aa2800/0x95459fb9d1d29a91 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d29a98 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831154.341004:0:20825:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d2303aa2800/0x95459fb9d1d29a91 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d29a98 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831154.341012:0:20825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d2303aa2800/0x95459fb9d1d29a91 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x95459fb9d1d29a98 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831154.341019:0:20825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.131@tcp lock: ffff8d2303aa2800/0x95459fb9d1d29a91 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x95459fb9d1d29a98 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831154.341056:0:20825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787831154.341062:0:20825:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1787831154.341086:0:20825:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787831154.341090:0:20825:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787831154.341096:0:20825:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787831154.341122:0:20825:0:(import.c:65:import_set_state_nolock()) ffff8d2202a83800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1787831154.341194:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22045b5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874676443968000:0@lo:39:umount.0 00000100:00100000:2.0:1787831154.341281:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831154.341443:0:18518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443968000 00000100:00100000:0.0:1787831154.341451:0:18518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443968000 00010000:00010000:3.0:1787831154.341591:0:17093:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787831154.341598:0:17093:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8d2303aa2800/0x95459fb9d1d29a91 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x95459fb9d1d29a98 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831154.341617:0:17093:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2303aa2800 already unused, calling callback (ffffffffc14f9c20) 10000000:00010000:3.0:1787831154.341621:0:17093:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8d2303aa2800/0x95459fb9d1d29a91 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x95459fb9d1d29a98 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831154.341825:0:18518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1787831154.341836:0:18518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb452c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874676443968000:12345-0@lo:39:umount.0 00000020:00000080:0.0:1787831154.341861:0:18518:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x95459fb9d1d29ac2 00000100:00080000:0.0:1787831154.341869:0:18518:0:(import.c:65:import_set_state_nolock()) ffff8d233f438000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1787831154.341936:0:18518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb452c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3618:x1874676443968000:12345-0@lo:39:umount.0 Request processed in 102us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831154.341943:0:18518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000020:00000080:0.0:1787831154.341953:0:18518:0:(genops.c:885:class_export_put()) final put ffff8d233f525800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:2.0:1787831154.342011:0:18633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787831154.342041:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8d2202a83800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1787831154.342054:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22045b5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874676443968000:0@lo:39:umount.0 00010000:00010000:3.0:1787831154.342808:0:17093:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8d2303aa2800/0x95459fb9d1d29a91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x95459fb9d1d29a98 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787831154.342816:0:17093:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8d2303aa2800/0x95459fb9d1d29a91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x95459fb9d1d29a98 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787831154.342821:0:17093:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787831154.342824:0:17093:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1787831154.342827:0:17093:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1787831154.342862:0:17093:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8d2303aa2800/0x95459fb9d1d29a91 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x95459fb9d1d29a98 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831154.342869:0:17093:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787831154.342904:0:17093:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8d2303aa2800/0x95459fb9d1d29a91 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x95459fb9d1d29a98 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831154.342912:0:17093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8d2303aa2800/0x95459fb9d1d29a91 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x95459fb9d1d29a98 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831154.342926:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787831154.342928:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787831154.342930:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787831154.342943:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d233f525800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1787831154.343010:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d233f438000 for lustre-MDT0000 00000100:00100000:3.0:1787831154.343022:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787831154.343048:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233fb11680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:be45932f-3bcb-4e49-b61c-a2395180b0ee:3619:1874676443968128:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787831154.343095:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831154.343139:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443968128 00000100:00100000:3.0:1787831154.343145:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443968128 00000100:00100000:3.0:1787831154.343187:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787831154.343194:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb13840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:be45932f-3bcb-4e49-b61c-a2395180b0ee+24:3619:x1874676443968128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787831154.343206:0:17090:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787831154.343219:0:17090:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2307c77600/0x95459fb9d1d29a98 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x95459fb9d1d29a91 expref: 24 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831154.343232:0:17090:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787831154.343263:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb13840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:be45932f-3bcb-4e49-b61c-a2395180b0ee+23:3619:x1874676443968128:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831154.343270:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787831154.343300:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233fb11680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:be45932f-3bcb-4e49-b61c-a2395180b0ee:3619:1874676443968128:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1787831154.343686:0:20825:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787831154.343691:0:20825:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787831154.343696:0:20825:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1787831154.344619:0:20825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d23344b6800/0x95459fb9d1d299e2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d299e9 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831154.344660:0:20825:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d23344b6800/0x95459fb9d1d299e2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d299e9 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831154.344667:0:20825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d23344b6800/0x95459fb9d1d299e2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x95459fb9d1d299e9 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831154.344673:0:20825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.131@tcp lock: ffff8d23344b6800/0x95459fb9d1d299e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x95459fb9d1d299e9 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831154.344703:0:20825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787831154.344709:0:20825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d23344b6e00/0x95459fb9d1d29dee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d29df5 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831154.344715:0:20825:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d23344b6e00/0x95459fb9d1d29dee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d29df5 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831154.344722:0:20825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d23344b6e00/0x95459fb9d1d29dee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x95459fb9d1d29df5 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831154.344727:0:20825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.131@tcp lock: ffff8d23344b6e00/0x95459fb9d1d29dee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x95459fb9d1d29df5 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831154.344747:0:20825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787831154.344754:0:20825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d2307c76000/0x95459fb9d1d29f8b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d29f92 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831154.344760:0:20825:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d2307c76000/0x95459fb9d1d29f8b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d29f92 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831154.344765:0:20825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d2307c76000/0x95459fb9d1d29f8b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x95459fb9d1d29f92 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831154.344771:0:20825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.131@tcp lock: ffff8d2307c76000/0x95459fb9d1d29f8b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x95459fb9d1d29f92 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831154.344792:0:20825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1787831154.344797:0:20825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d23344b7c00/0x95459fb9d1d299d4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d299db expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831154.344810:0:20825:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d23344b7c00/0x95459fb9d1d299d4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d299db expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831154.344817:0:20825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d23344b7c00/0x95459fb9d1d299d4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x95459fb9d1d299db expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831154.344823:0:20825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.131@tcp lock: ffff8d23344b7c00/0x95459fb9d1d299d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x95459fb9d1d299db expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831154.344830:0:20825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:1.0:1787831154.344832:0:20825:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:1.0:1787831154.344862:0:20825:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1787831154.344866:0:20825:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:1.0:1787831154.344870:0:20825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787831154.344875:0:20825:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:1.0:1787831154.344880:0:20825:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8d2203b26800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787831154.344886:0:20825:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8d23073ec000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787831154.344891:0:20825:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8d220276c800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787831154.344895:0:20825:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8d232b966800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787831154.344903:0:20825:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff8d2201d0c800 8db48c6c-a61a-41ec-9c3b-96530aeb2537 192.168.203.31@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934599 stale:0 00000020:00080000:1.0:1787831154.344908:0:20825:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff8d2202a79000 2240faf2-2a81-4e92-bb4c-b58ed0f19f2a 192.168.203.31@tcp 4 (0 4 0) 1 0 0 0: 0000000000000000 8589934675 stale:0 00000020:00080000:1.0:1787831154.344915:0:20825:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff8d233f433370) has exports, disconnecting them 00000020:00080000:1.0:1787831154.344919:0:20825:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8d2203b26800), last request at 1787831149 00000020:00000080:1.0:1787831154.344926:0:20825:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x95459fb9d1d29dbd 00000100:00080000:1.0:1787831154.344942:0:20825:0:(import.c:65:import_set_state_nolock()) ffff8d2203b25800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1787831154.344998:0:20825:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d2203b26800): rc 0 00000020:00000080:1.0:1787831154.345002:0:20825:0:(genops.c:885:class_export_put()) final put ffff8d2203b26800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1787831154.345013:0:20825:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8d23073ec000), last request at 1787831149 00000020:00000080:1.0:1787831154.345017:0:20825:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x95459fb9d1d29c5f 00000100:00080000:1.0:1787831154.345022:0:20825:0:(import.c:65:import_set_state_nolock()) ffff8d23073ed800 : changing import state from FULL to CLOSED 00000020:00000080:1.0:1787831154.345032:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2203b26800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1787831154.345075:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d2203b25800 for lustre-MDT0000 00000020:00080000:1.0:1787831154.345088:0:20825:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d23073ec000): rc 0 00000020:00000080:1.0:1787831154.345090:0:20825:0:(genops.c:885:class_export_put()) final put ffff8d23073ec000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:1.0:1787831154.345097:0:20825:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8d220276c800), last request at 1787831093 00000020:00000080:1.0:1787831154.345100:0:20825:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x95459fb9d1d29bb0 00000100:00080000:1.0:1787831154.345104:0:20825:0:(import.c:65:import_set_state_nolock()) ffff8d220276f800 : changing import state from FULL to CLOSED 00000020:00000080:1.0:1787831154.345112:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d23073ec000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1787831154.345131:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d23073ed800 for lustre-MDT0000 00000020:00080000:1.0:1787831154.345141:0:20825:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d220276c800): rc 0 00000020:00000080:1.0:1787831154.345143:0:20825:0:(genops.c:885:class_export_put()) final put ffff8d220276c800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:1.0:1787831154.345150:0:20825:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8d232b966800), last request at 1787831093 00000020:00000080:1.0:1787831154.345154:0:20825:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x95459fb9d1d29b55 00000100:00080000:1.0:1787831154.345158:0:20825:0:(import.c:65:import_set_state_nolock()) ffff8d2202a82000 : changing import state from FULL to CLOSED 00000020:00000080:1.0:1787831154.345165:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d220276c800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1787831154.345187:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d220276f800 for lustre-MDT0000 00000001:00000004:1.0:1787831154.345198:0:20825:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934679 00000020:00080000:1.0:1787831154.345275:0:20825:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d232b966800): rc 0 00000004:00000080:1.0:1787831154.345281:0:20825:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffae38c0d53ae0 00000100:00080000:1.0:1787831154.345299:0:20825:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787831154.345303:0:20825:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1787831154.346137:0:20825:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1787831154.346162:0:20825:0:(import.c:65:import_set_state_nolock()) ffff8d2201e0b000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1787831154.346309:0:20825:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1787831154.346313:0:20825:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934601 gen 3 00000004:00080000:1.0:1787831154.346332:0:20825:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1787831154.346389:0:20825:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1787831154.346398:0:20825:0:(import.c:65:import_set_state_nolock()) ffff8d233be52000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1787831154.346405:0:20825:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1787831154.346406:0:20825:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934599 gen 3 00000004:00080000:1.0:1787831154.346414:0:20825:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1787831154.346475:0:20825:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1787831154.346483:0:20825:0:(import.c:65:import_set_state_nolock()) ffff8d2303f2a800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1787831154.346520:0:20825:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8d233f433370) has no exports 00010000:00010000:1.0:1787831154.346726:0:18633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1787831154.346734:0:18633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8d23344b6800/0x95459fb9d1d299e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x95459fb9d1d299e9 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831154.346744:0:18633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d23344b6800 already unused, calling callback (ffffffffc14f9c20) 10000000:00010000:1.0:1787831154.346749:0:18633:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8d23344b6800/0x95459fb9d1d299e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x95459fb9d1d299e9 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831154.346758:0:18633:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8d23344b6800/0x95459fb9d1d299e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x95459fb9d1d299e9 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787831154.346766:0:18633:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8d23344b6800/0x95459fb9d1d299e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x95459fb9d1d299e9 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787831154.346772:0:18633:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787831154.347039:0:17092:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787831154.347047:0:17092:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8d23344b6e00/0x95459fb9d1d29dee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x95459fb9d1d29df5 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831154.347054:0:17092:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d23344b6e00 already unused, calling callback (ffffffffc14f9c20) 10000000:00010000:3.0:1787831154.347056:0:17092:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8d23344b6e00/0x95459fb9d1d29dee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x95459fb9d1d29df5 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831154.347063:0:17092:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8d23344b6e00/0x95459fb9d1d29dee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x95459fb9d1d29df5 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787831154.347069:0:17092:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8d23344b6e00/0x95459fb9d1d29dee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x95459fb9d1d29df5 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787831154.347087:0:17092:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1787831154.347090:0:17092:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1787831154.347093:0:17092:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1787831154.347120:0:17092:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8d23344b6e00/0x95459fb9d1d29dee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x95459fb9d1d29df5 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831154.347126:0:17092:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787831154.347144:0:17092:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8d23344b6e00/0x95459fb9d1d29dee lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x95459fb9d1d29df5 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831154.347150:0:17092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8d23344b6e00/0x95459fb9d1d29dee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x95459fb9d1d29df5 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831154.347162:0:17092:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787831154.347166:0:17092:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8d2307c76000/0x95459fb9d1d29f8b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x95459fb9d1d29f92 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831154.347171:0:17092:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2307c76000 already unused, calling callback (ffffffffc14f9c20) 10000000:00010000:3.0:1787831154.347174:0:17092:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8d2307c76000/0x95459fb9d1d29f8b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x95459fb9d1d29f92 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831154.347180:0:17092:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8d2307c76000/0x95459fb9d1d29f8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x95459fb9d1d29f92 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787831154.347185:0:17092:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8d2307c76000/0x95459fb9d1d29f8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x95459fb9d1d29f92 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787831154.347189:0:17092:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1787831154.347192:0:17092:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1787831154.347199:0:17092:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1787831154.347214:0:17092:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8d2307c76000/0x95459fb9d1d29f8b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x95459fb9d1d29f92 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831154.347234:0:17092:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787831154.347241:0:17092:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8d2307c76000/0x95459fb9d1d29f8b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x95459fb9d1d29f92 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831154.347247:0:17092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8d2307c76000/0x95459fb9d1d29f8b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x95459fb9d1d29f92 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831154.347256:0:17092:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787831154.347259:0:17092:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8d23344b7c00/0x95459fb9d1d299d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x95459fb9d1d299db expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831154.347264:0:17092:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d23344b7c00 already unused, calling callback (ffffffffc14f9c20) 10000000:00010000:3.0:1787831154.347267:0:17092:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8d23344b7c00/0x95459fb9d1d299d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x95459fb9d1d299db expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831154.347273:0:17092:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8d23344b7c00/0x95459fb9d1d299d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x95459fb9d1d299db expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787831154.347279:0:17092:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8d23344b7c00/0x95459fb9d1d299d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x95459fb9d1d299db expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787831154.347284:0:17092:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1787831154.347286:0:17092:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1787831154.347288:0:17092:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1787831154.347317:0:17092:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8d23344b7c00/0x95459fb9d1d299d4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x95459fb9d1d299db expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831154.347323:0:17092:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787831154.347345:0:17092:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8d23344b7c00/0x95459fb9d1d299d4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x95459fb9d1d299db expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831154.347352:0:17092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8d23344b7c00/0x95459fb9d1d299d4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x95459fb9d1d299db expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831154.347362:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787831154.347364:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787831154.347366:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787831154.347445:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233fb11680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:be45932f-3bcb-4e49-b61c-a2395180b0ee:3621:1874676443968640:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787831154.347508:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831154.347555:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787831154.347561:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233fb12580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:be45932f-3bcb-4e49-b61c-a2395180b0ee:3621:1874676443968768:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787831154.347581:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831154.347610:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220483da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:be45932f-3bcb-4e49-b61c-a2395180b0ee:3619:1874676443968896:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787831154.347652:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831154.347683:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443968640 00000100:00100000:3.0:1787831154.347689:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443968640 00000100:00100000:3.0:1787831154.347729:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443968768 00000100:00100000:3.0:1787831154.347732:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443968768 00000100:00100000:3.0:1787831154.347744:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443968896 00000100:00100000:3.0:1787831154.347747:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443968896 00000100:00100000:3.0:1787831154.347761:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787831154.347768:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220483c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:be45932f-3bcb-4e49-b61c-a2395180b0ee+25:3621:x1874676443968640:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787831154.347789:0:17091:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787831154.347804:0:17091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2307c76800/0x95459fb9d1d29df5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x95459fb9d1d29dee expref: 25 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831154.347815:0:17091:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787831154.347855:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220483c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:be45932f-3bcb-4e49-b61c-a2395180b0ee+24:3621:x1874676443968640:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831154.347863:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787831154.347881:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787831154.347887:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220483e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:be45932f-3bcb-4e49-b61c-a2395180b0ee+23:3621:x1874676443968768:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787831154.347895:0:17091:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787831154.347904:0:17091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2307c76c00/0x95459fb9d1d29f92 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x95459fb9d1d29f8b expref: 23 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831154.347912:0:17091:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787831154.347933:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220483e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:be45932f-3bcb-4e49-b61c-a2395180b0ee+22:3621:x1874676443968768:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831154.347939:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787831154.347951:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787831154.347957:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2335548450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:be45932f-3bcb-4e49-b61c-a2395180b0ee+21:3619:x1874676443968896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787831154.347965:0:17091:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787831154.347973:0:17091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d22039c1e00/0x95459fb9d1d299db lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x95459fb9d1d299d4 expref: 21 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831154.347981:0:17091:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787831154.348004:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2335548450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:be45932f-3bcb-4e49-b61c-a2395180b0ee+20:3619:x1874676443968896:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831154.348009:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787831154.348068:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220483da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:be45932f-3bcb-4e49-b61c-a2395180b0ee:3619:1874676443968896:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787831154.348090:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233fb12580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:be45932f-3bcb-4e49-b61c-a2395180b0ee:3621:1874676443968768:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787831154.348097:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233fb11680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:be45932f-3bcb-4e49-b61c-a2395180b0ee:3621:1874676443968640:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787831154.348119:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787831154.349502:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203767480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1874676443968256:0@lo:39:umount.0 00000100:00100000:2.0:1787831154.349549:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831154.349587:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22037643c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1874676443968384:0@lo:9:umount.0 00000100:00100000:2.0:1787831154.349606:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831154.349656:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203765680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1874676443968512:0@lo:9:umount.0 00000100:00100000:2.0:1787831154.349674:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831154.349707:0:18609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443968384 00000100:00100000:2.0:1787831154.349713:0:18609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443968384 00000100:00100000:2.0:1787831154.349753:0:18609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443968512 00000100:00100000:2.0:1787831154.349755:0:18609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443968512 00000100:00100000:2.0:1787831154.349771:0:18609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787831154.349789:0:18609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb470c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1874676443968384:12345-0@lo:9:umount.0 00000020:00000080:2.0:1787831154.349821:0:18609:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x95459fb9d1d29c9e 00000100:00080000:2.0:1787831154.349829:0:18609:0:(import.c:65:import_set_state_nolock()) ffff8d2201d9f800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787831154.349871:0:18609:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934601 00000100:00100000:0.0:1787831154.350062:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443968256 00000100:00100000:0.0:1787831154.350066:0:17110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443968256 00000100:00100000:0.0:1787831154.350103:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787831154.350109:0:17110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb44f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1874676443968256:12345-0@lo:39:umount.0 00000020:00000080:0.0:1787831154.350123:0:17110:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x95459fb9d1d29bbe 00000100:00080000:0.0:1787831154.350128:0:17110:0:(import.c:65:import_set_state_nolock()) ffff8d2303f2d800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787831154.350143:0:17110:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:0.0:1787831154.350223:0:17110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb44f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+3:3618:x1874676443968256:12345-0@lo:39:umount.0 Request processed in 113us (672us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1787831154.350229:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00010000:0.0:1787831154.350256:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787831154.350685:0:18609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb470c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3618:x1874676443968384:12345-0@lo:9:umount.0 Request processed in 896us (1076us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831154.350693:0:18609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787831154.350710:0:18609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787831154.350717:0:18609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb461c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1874676443968512:12345-0@lo:9:umount.0 00000020:00000080:2.0:1787831154.350730:0:18609:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x95459fb9d1d29dfc 00000100:00080000:2.0:1787831154.350737:0:18609:0:(import.c:65:import_set_state_nolock()) ffff8d2203b23800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787831154.350763:0:18609:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934599 00010000:00010000:0.0:1787831154.350865:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787831154.351453:0:18609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb461c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3618:x1874676443968512:12345-0@lo:9:umount.0 Request processed in 735us (1776us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831154.351460:0:18609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:2.0:1787831154.351482:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787831154.351487:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787831154.351501:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787831154.351530:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8d2201e0b000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1787831154.351538:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203767480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1874676443968256:0@lo:39:umount.0 00000100:00080000:2.0:1787831154.351549:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8d233be52000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1787831154.352680:0:3618:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1787831154.354793:0:3618:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787831154.354808:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22037643c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1874676443968384:0@lo:9:umount.0 00000100:00080000:2.0:1787831154.354853:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8d2303f2a800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1787831154.354967:0:3618:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1787831154.354970:0:3618:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787831154.354974:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203765680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1874676443968512:0@lo:9:umount.0 10000000:01000000:1.0:1787831154.359001:0:18633:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:1.0:1787831154.359007:0:18633:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:1.0:1787831154.359063:0:18633:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8d23344b6800/0x95459fb9d1d299e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x95459fb9d1d299e9 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831154.359094:0:18633:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787831154.359164:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203764f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:be45932f-3bcb-4e49-b61c-a2395180b0ee:3620:1874676443969024:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787831154.359241:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831154.359333:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443969024 00000100:00100000:3.0:1787831154.359340:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443969024 00000100:00100000:3.0:1787831154.359405:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787831154.359416:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb47c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:be45932f-3bcb-4e49-b61c-a2395180b0ee+20:3620:x1874676443969024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787831154.359428:0:17091:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787831154.359445:0:17091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2303aa2000/0x95459fb9d1d299e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x95459fb9d1d299e2 expref: 20 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831154.359463:0:17091:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787831154.359518:0:18633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8d23344b6800/0x95459fb9d1d299e2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x95459fb9d1d299e9 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831154.359527:0:18633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8d23344b6800/0x95459fb9d1d299e2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x95459fb9d1d299e9 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831154.359540:0:18633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787831154.359542:0:18633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787831154.359544:0:18633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787831154.359897:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb47c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:be45932f-3bcb-4e49-b61c-a2395180b0ee+19:3620:x1874676443969024:12345-0@lo:103:ldlm_bl.0 Request processed in 481us (653us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831154.359905:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787831154.360041:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203764f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:be45932f-3bcb-4e49-b61c-a2395180b0ee:3620:1874676443969024:0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1787831154.364201:0:20825:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8d233f433370) has no exports 00000020:00000080:0.0:1787831154.405910:0:20825:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x95459fb9d1d29a2f 00000020:00000080:0.0:1787831154.405927:0:20825:0:(genops.c:885:class_export_put()) final put ffff8d233be56000/lustre-QMT0000_UUID 00000020:01000000:0.0:1787831154.405988:0:20825:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1787831154.406083:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d233be56000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1787831154.406134:0:20825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787831154.406146:0:20825:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787831154.406151:0:20825:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff8d232f77cd28) has no exports 00000020:00000080:2.0:1787831154.406573:0:20825:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x95459fb9d1d29a28 00000020:00000080:2.0:1787831154.406581:0:20825:0:(genops.c:885:class_export_put()) final put ffff8d233bd95800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787831154.406861:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d233bd95800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787831154.407013:0:20825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787831154.407022:0:20825:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1787831154.407025:0:20825:0:(genops.c:885:class_export_put()) final put ffff8d233bd91800/lustre-QMT0000_UUID 00000020:00000080:2.0:1787831154.407028:0:20825:0:(genops.c:844:class_export_destroy()) destroying export ffff8d233bd91800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1787831154.407036:0:20825:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:0.0:1787831154.598852:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787831154.919100:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233fb44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676443969280:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787831154.919167:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831154.919213:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787831154.919219:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22045b5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676443969152:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787831154.919245:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831154.919286:0:18611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443969280 00000100:00100000:3.0:1787831154.919293:0:18611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443969280 00000100:00100000:0.0:1787831154.919406:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220483da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443969408:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787831154.919440:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831154.919484:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443969408 00000100:00100000:0.0:1787831154.919488:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443969408 00000100:00100000:0.0:1787831154.919523:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787831154.919530:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22045b52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3619:x1874676443969408:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:0.0:1787831154.919538:0:17109:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1787831154.919576:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22045b52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3619:x1874676443969408:12345-0@lo:41:osp-pre-0-1.0 Request processed in 46us (134us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787831154.919583:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:02020000:0.0:1787831154.919641:0:3619:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00100000:2.0:1787831154.920747:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233fb45e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3620:1874676443969536:0@lo:400:kworker.0 00000100:00100000:2.0:1787831154.920804:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831154.920829:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233fb44b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3620:1874676443970048:0@lo:400:kworker.0 00000100:00100000:2.0:1787831154.920851:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831154.920874:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787831154.920880:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233fb46940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3620:1874676443969920:0@lo:400:kworker.0 00000100:00100000:2.0:1787831154.920903:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831154.920935:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443969536 00000100:00100000:2.0:1787831154.920940:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443969536 00000100:00100000:2.0:1787831154.920967:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443970048 00000100:00100000:2.0:1787831154.920970:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443970048 00000100:00100000:2.0:1787831154.920998:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443969920 00000100:00100000:2.0:1787831154.921001:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443969920 00000100:00100000:2.0:1787831154.921011:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787831154.921053:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fa48780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1874676443970048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787831154.921116:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fa48780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1874676443970048:12345-0@lo:400:kworker.0 Request processed in 99us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831154.921123:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787831154.921141:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1787831154.921145:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb46580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3620:x1874676443969536:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1787831154.921150:0:17106:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1787831154.921176:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb46580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3620:x1874676443969536:12345-0@lo:400:kworker.0 Request processed in 29us (371us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787831154.921182:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1787831154.921196:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1787831154.921200:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fa48b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3620:x1874676443969920:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1787831154.921204:0:17106:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1787831154.921225:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fa48b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3620:x1874676443969920:12345-0@lo:400:kworker.0 Request processed in 24us (321us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787831154.921232:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00080000:2.0:1787831154.921252:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787831154.921277:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233fb44780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3622:1874676443969792:0@lo:400:kworker.0 00000100:00100000:2.0:1787831154.921303:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831154.921437:0:18611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443969152 00000100:00100000:3.0:1787831154.921441:0:18611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443969152 00000100:00100000:3.0:1787831154.921458:0:18611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787831154.921466:0:18611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220483c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676443969280:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787831154.921488:0:18611:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:3.0:1787831154.921531:0:18611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220483c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676443969280:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (2364us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831154.921537:0:18611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787831154.921551:0:18611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787831154.921557:0:18611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220483e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676443969152:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787831154.921570:0:18611:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787831154.921597:0:18611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220483e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676443969152:12345-0@lo:13:osp-pre-0-1.0 Request processed in 41us (2352us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831154.921603:0:18611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:3.0:1787831154.922453:0:3620:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787831154.922459:0:3620:0:(import.c:65:import_set_state_nolock()) ffff8d2202a7e000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1787831154.922463:0:3620:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:1.0:1787831154.922543:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233fb45a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3621:1874676443969664:0@lo:400:kworker.0 00000100:00080000:1.0:1787831154.922617:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787831154.922622:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787831154.922785:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22045b5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676443969152:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787831154.922805:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233fb44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676443969280:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787831154.926553:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831154.926676:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443969792 00000100:00100000:1.0:1787831154.926686:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443969792 00000100:00100000:1.0:1787831154.926740:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443969664 00000100:00100000:1.0:1787831154.926744:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443969664 00000100:00100000:1.0:1787831154.926764:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787831154.926781:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204644b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1874676443969792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787831154.926856:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204644b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1874676443969792:12345-0@lo:400:kworker.0 Request processed in 86us (5553us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831154.926863:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787831154.926880:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1787831154.926884:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22037661c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3621:x1874676443969664:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1787831154.926889:0:17106:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1787831154.926920:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22037661c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3621:x1874676443969664:12345-0@lo:400:kworker.0 Request processed in 35us (375us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787831154.926940:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00080000:1.0:1787831154.926962:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787831154.926994:0:3621:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787831154.926999:0:3621:0:(import.c:65:import_set_state_nolock()) ffff8d23073ef800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1787831154.927003:0:3621:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1787831154.927007:0:3621:0:(import.c:65:import_set_state_nolock()) ffff8d23073ef800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787831154.927011:0:3621:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 396 00000100:00080000:1.0:1787831154.927018:0:3621:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8d23073ef800 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:1.0:1787831154.927045:0:3621:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2203767c00 x1874676443970176/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787831154.927065:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233fb45a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3621:1874676443969664:0@lo:400:kworker.0 00000100:00100000:2.0:1787831154.927200:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203767c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3618:1874676443970176:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1787831154.927247:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831154.927286:0:19892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443970176 00000100:00100000:2.0:1787831154.927291:0:19892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443970176 00000100:00100000:2.0:1787831154.927322:0:19892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1787831154.927334:0:19892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204644000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3618:x1874676443970176:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:2.0:1787831154.927350:0:19892:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1787831154.927397:0:19892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204644000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3618:x1874676443970176:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 62us (148us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787831154.927403:0:19892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00080000:2.0:1787831154.927429:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8d23073ef800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787831154.927433:0:3618:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787831154.927436:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203767c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3618:1874676443970176:0@lo:38:ptlrpcd_00_02.0 00010000:00080000:2.0:1787831154.927461:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d233fb44780 x1874676443969792/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787831170 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787831154.927473:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233fb44780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3622:1874676443969792:0@lo:400:kworker.0 00000100:00080000:0.0:1787831154.932692:0:3619:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1787831154.932700:0:3619:0:(import.c:65:import_set_state_nolock()) ffff8d2201e09800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1787831154.932705:0:3619:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1787831154.932711:0:3619:0:(import.c:65:import_set_state_nolock()) ffff8d2201e09800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787831154.932715:0:3619:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 384 00000100:00080000:0.0:1787831154.932724:0:3619:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8d2201e09800 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:0.0:1787831154.932760:0:3619:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d22045b7c00 x1874676443970304/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787831154.933041:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22045b7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1874676443970304:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1787831154.933108:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831154.934349:0:19224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443970304 00000100:00100000:0.0:1787831154.934375:0:19224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443970304 00000100:00100000:0.0:1787831154.934426:0:19224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787831154.934433:0:19224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb44780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3618:x1874676443970304:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:0.0:1787831154.934729:0:19224:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1787831154.934814:0:19224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb44780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3618:x1874676443970304:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 380us (1705us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787831154.934822:0:19224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:2.0:1787831154.934908:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8d2201e09800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787831154.934914:0:3618:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787831154.934918:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22045b7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1874676443970304:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:3.0:1787831154.955880:0:3620:0:(import.c:65:import_set_state_nolock()) ffff8d2202a7e000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787831154.955891:0:3620:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 407 00000100:00080000:3.0:1787831154.955900:0:3620:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8d2202a7e000 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:3.0:1787831154.955965:0:3620:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d220483cb40 x1874676443970432/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787831154.955999:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233fb46940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3620:1874676443969920:0@lo:400:kworker.0 00000100:00100000:0.0:1787831154.956098:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220483cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3618:1874676443970432:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1787831154.956167:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831154.956251:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443970432 00000100:00100000:1.0:1787831154.956258:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443970432 00000100:00080000:2.0:1787831154.956266:0:3620:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1787831154.956271:0:3620:0:(import.c:65:import_set_state_nolock()) ffff8d2203601800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1787831154.956274:0:3620:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1787831154.956278:0:3620:0:(import.c:65:import_set_state_nolock()) ffff8d2203601800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787831154.956281:0:3620:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 384 00000100:00080000:2.0:1787831154.956286:0:3620:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8d2203601800 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:2.0:1787831154.956300:0:3620:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d233fb45a40 x1874676443970560/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787831154.956303:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1787831154.956309:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22045b7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3618:x1874676443970432:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:1.0:1787831154.956325:0:17104:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1787831154.956378:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22045b7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3618:x1874676443970432:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 67us (209us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787831154.956385:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00080000:0.0:1787831154.956456:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8d2202a7e000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787831154.956460:0:3618:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787831154.956464:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220483cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3618:1874676443970432:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1787831154.956932:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233fb45a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3618:1874676443970560:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1787831154.956970:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831154.957021:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233fb45e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3620:1874676443969536:0@lo:400:kworker.0 00010000:00080000:2.0:1787831154.957040:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d233fb44b40 x1874676443970048/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787831170 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787831154.957040:0:19892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443970560 00000100:00100000:1.0:1787831154.957044:0:19892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443970560 00000100:00100000:2.0:1787831154.957050:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233fb44b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3620:1874676443970048:0@lo:400:kworker.0 00000100:00100000:1.0:1787831154.957077:0:19892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1787831154.957082:0:19892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22045b5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3618:x1874676443970560:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:1.0:1787831154.957092:0:19892:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1787831154.961257:0:19892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22045b5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3618:x1874676443970560:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 4164us (4277us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787831154.961287:0:19892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00080000:0.0:1787831154.961576:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8d2203601800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787831154.961583:0:3618:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787831154.961587:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233fb45a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3618:1874676443970560:0@lo:38:ptlrpcd_00_01.0 00010000:00010000:2.0:1787831155.622800:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787831155.879436:0:17855:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787831156.647172:0:18633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787831156.969015:0:17084:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787831156.969026:0:17084:0:(genops.c:885:class_export_put()) final put ffff8d232b966800/lustre-MDT0001-mdtlov_UUID 00000001:00100000:3.0:1787831156.969053:0:17084:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 8db48c6c-a61a-41ec-9c3b-96530aeb2537 00000001:00080000:3.0:1787831156.969062:0:17084:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934679 is committed 00000020:00000080:3.0:1787831156.969066:0:17084:0:(genops.c:885:class_export_put()) final put ffff8d2201d0c800/8db48c6c-a61a-41ec-9c3b-96530aeb2537 00000001:00100000:3.0:1787831156.969071:0:17084:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 2240faf2-2a81-4e92-bb4c-b58ed0f19f2a 00000001:00080000:3.0:1787831156.969076:0:17084:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934678 is committed 00000020:00000080:3.0:1787831156.969090:0:17084:0:(genops.c:885:class_export_put()) final put ffff8d2202a79000/2240faf2-2a81-4e92-bb4c-b58ed0f19f2a 00000020:00000080:0.0:1787831156.969145:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d232b966800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:0.0:1787831156.969198:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2201d0c800/8db48c6c-a61a-41ec-9c3b-96530aeb2537 for lustre-MDT0000 00000020:00000080:0.0:1787831156.969226:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2202a79000/2240faf2-2a81-4e92-bb4c-b58ed0f19f2a for lustre-MDT0000 00000020:00000080:0.0:1787831156.969254:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d2202a82000 for lustre-MDT0000 00000020:00000080:0.0:1787831156.969258:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d2201d0f000 for lustre-MDT0000 00000020:00000080:0.0:1787831156.969262:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d2202a79800 for lustre-MDT0000 00000001:00100000:3.0:1787831156.970561:0:17835:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1787831156.970573:0:17835:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934595 is committed 00000020:00000080:3.0:1787831156.970577:0:17835:0:(genops.c:885:class_export_put()) final put ffff8d2303f2a000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1787831156.970602:0:17835:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 8db48c6c-a61a-41ec-9c3b-96530aeb2537 00000001:00080000:3.0:1787831156.970606:0:17835:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934594 is committed 00000020:00000080:3.0:1787831156.970608:0:17835:0:(genops.c:885:class_export_put()) final put ffff8d2335569000/8db48c6c-a61a-41ec-9c3b-96530aeb2537 00000001:00100000:3.0:1787831156.970612:0:17835:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 2240faf2-2a81-4e92-bb4c-b58ed0f19f2a 00000001:00080000:3.0:1787831156.970616:0:17835:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934593 is committed 00000020:00000080:3.0:1787831156.970618:0:17835:0:(genops.c:885:class_export_put()) final put ffff8d22034d1000/2240faf2-2a81-4e92-bb4c-b58ed0f19f2a 00000020:00000080:1.0:1787831156.970798:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2303f2a000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:1.0:1787831156.975288:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2335569000/8db48c6c-a61a-41ec-9c3b-96530aeb2537 for lustre-MDT0001 00000020:00000080:1.0:1787831156.975364:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d22034d1000/2240faf2-2a81-4e92-bb4c-b58ed0f19f2a for lustre-MDT0001 00000020:00000080:1.0:1787831156.975390:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d2303f2d800 for lustre-MDT0001 00000020:00000080:1.0:1787831156.975395:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d2335568000 for lustre-MDT0001 00000020:00000080:1.0:1787831156.975399:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d22034d3800 for lustre-MDT0001 00000001:00100000:3.0:1787831156.975453:0:18604:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787831156.975458:0:18604:0:(genops.c:885:class_export_put()) final put ffff8d2201d9b800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1787831156.975477:0:18604:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2240faf2-2a81-4e92-bb4c-b58ed0f19f2a 00000020:00000080:3.0:1787831156.975480:0:18604:0:(genops.c:885:class_export_put()) final put ffff8d233f423000/2240faf2-2a81-4e92-bb4c-b58ed0f19f2a 00000020:00000080:1.0:1787831156.975534:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2201d9b800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1787831156.975560:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d233f423000/2240faf2-2a81-4e92-bb4c-b58ed0f19f2a for lustre-OST0000 00000020:00000080:1.0:1787831156.975578:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d2201d9f800 for lustre-OST0000 00000020:00000080:1.0:1787831156.975582:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d220470d000 for lustre-OST0000 00010000:00010000:0.0:1787831157.670971:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787831158.694790:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787831159.721111:0:18633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787831160.042240:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233fb44b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443970688:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787831160.042321:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831160.042911:0:18611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443970688 00000100:00100000:3.0:1787831160.042920:0:18611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443970688 00000100:00100000:3.0:1787831160.042993:0:18611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787831160.043003:0:18611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb45e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443970688:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787831160.043034:0:18611:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:3.0:1787831160.043093:0:18611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb45e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443970688:12345-0@lo:13:osp-pre-1-1.0 Request processed in 92us (772us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831160.043100:0:18611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787831160.043190:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233fb44b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443970688:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1787831160.043600:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787831160.043873:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233fb40b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676443970816:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787831160.043919:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787831160.044042:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787831160.044047:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787831160.044051:0:37:0:(import.c:65:import_set_state_nolock()) ffff8d2201e09800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787831160.044057:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 445 00000100:00100000:2.0:1787831160.044058:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00080000:1.0:1787831160.044062:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00100000:2.0:1787831160.044070:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203766580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:be45932f-3bcb-4e49-b61c-a2395180b0ee:3620:1874676443970944:0@lo:400:kworker.0 00000100:00080000:1.0:1787831160.044071:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8d2201e09800 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:1.0:1787831160.044099:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2203764000 x1874676443971072/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787831160.044115:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787831160.044120:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787831160.044125:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787831160.044127:0:37:0:(import.c:65:import_set_state_nolock()) ffff8d2203601800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787831160.044131:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 445 00000100:00080000:1.0:1787831160.044143:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787831160.044148:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8d2203601800 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:2.0:1787831160.044152:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443970944 00000100:00100000:2.0:1787831160.044158:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443970944 00000100:00100000:1.0:1787831160.044180:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d22037670c0 x1874676443971200/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787831160.044191:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:2.0:1787831160.044196:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00080000:1.0:1787831160.044197:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787831160.044201:0:37:0:(import.c:65:import_set_state_nolock()) ffff8d23073ef800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787831160.044207:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 445 00000100:00100000:2.0:1787831160.044209:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203525c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be45932f-3bcb-4e49-b61c-a2395180b0ee+19:3620:x1874676443970944:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1787831160.044212:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787831160.044221:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8d23073ef800 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:1.0:1787831160.044238:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d22037652c0 x1874676443971328/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787831160.044260:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787831160.044263:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787831160.044266:0:37:0:(import.c:65:import_set_state_nolock()) ffff8d2202a7e000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1787831160.044268:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203525c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be45932f-3bcb-4e49-b61c-a2395180b0ee+19:3620:x1874676443970944:12345-0@lo:400:kworker.0 Request processed in 54us (144us total) trans 0 rc 0/0 00000100:00080000:1.0:1787831160.044273:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 445 00000100:00080000:1.0:1787831160.044279:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00100000:2.0:1787831160.044281:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00080000:1.0:1787831160.044286:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8d2202a7e000 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:1.0:1787831160.044301:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2203765a40 x1874676443971584/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787831160.044320:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203767840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3620:1874676443971456:0@lo:400:kworker.0 00000100:00100000:1.0:1787831160.044344:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787831160.044352:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831160.044357:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203764b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3622:1874676443971712:0@lo:400:kworker.0 00000100:00100000:2.0:1787831160.044385:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203766580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:be45932f-3bcb-4e49-b61c-a2395180b0ee:3620:1874676443970944:0@lo:400:kworker.0 00000100:00100000:1.0:1787831160.044397:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831160.044440:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443971456 00000100:00100000:2.0:1787831160.044445:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443971456 00000100:00100000:2.0:1787831160.044478:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443971712 00000100:00100000:2.0:1787831160.044481:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443971712 00000100:00100000:2.0:1787831160.044500:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787831160.044506:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1874676443971456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787831160.044542:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1874676443971456:12345-0@lo:400:kworker.0 Request processed in 36us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831160.044548:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787831160.044560:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787831160.044566:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203765e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1874676443971712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787831160.044595:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203765e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1874676443971712:12345-0@lo:400:kworker.0 Request processed in 28us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831160.044600:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:2.0:1787831160.044659:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1787831160.044678:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2203767840 x1874676443971456/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787831176 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787831160.044689:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203767840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3620:1874676443971456:0@lo:400:kworker.0 00000100:00100000:2.0:1787831160.044721:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203764000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1874676443971072:0@lo:38:kworker.0 00000100:00100000:2.0:1787831160.044760:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831160.044779:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22037670c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3618:1874676443971200:0@lo:38:kworker.0 00000100:00100000:2.0:1787831160.044799:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831160.044814:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22037652c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3618:1874676443971328:0@lo:38:kworker.0 00000100:00100000:2.0:1787831160.044844:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831160.044863:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203765a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3618:1874676443971584:0@lo:38:kworker.0 00000100:00100000:2.0:1787831160.044893:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831160.044917:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443971200 00000100:00100000:2.0:1787831160.044921:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443971200 00000100:00100000:2.0:1787831160.044938:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443971328 00000100:00100000:2.0:1787831160.044940:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443971328 00000100:00100000:2.0:1787831160.044948:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443971584 00000100:00100000:2.0:1787831160.044950:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443971584 00000100:00100000:2.0:1787831160.044961:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1787831160.044965:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb45a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3618:x1874676443971200:12345-0@lo:38:kworker.0 00010000:02000000:2.0:1787831160.044982:0:17106:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1787831160.045385:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1787831160.045392:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d232f61e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3618:x1874676443971328:12345-0@lo:38:kworker.0 00010000:02000000:1.0:1787831160.045409:0:17104:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1787831160.046104:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1787831160.046113:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d232f61ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3618:x1874676443971584:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1787831160.046123:0:17105:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1787831160.047167:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d232f61ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3618:x1874676443971584:12345-0@lo:38:kworker.0 Request processed in 1047us (2267us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787831160.047196:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00080000:3.0:1787831160.047273:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8d2202a7e000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787831160.047278:0:3618:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787831160.047283:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203765a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3618:1874676443971584:0@lo:38:kworker.0 00000100:00100000:3.0:1787831160.047336:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443971072 00000100:00100000:3.0:1787831160.047344:0:17110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443971072 00000100:00100000:3.0:1787831160.047377:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787831160.047383:0:17110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb44b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3618:x1874676443971072:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1787831160.047395:0:17110:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1787831160.047453:0:17110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb44b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3618:x1874676443971072:12345-0@lo:38:kworker.0 Request processed in 69us (2692us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787831160.047460:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:3.0:1787831160.047487:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8d2201e09800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787831160.047491:0:3618:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787831160.047495:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203764000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1874676443971072:0@lo:38:kworker.0 00000100:00100000:1.0:1787831160.048136:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d232f61e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3618:x1874676443971328:12345-0@lo:38:kworker.0 Request processed in 2740us (3288us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787831160.048145:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00010000:00080000:1.0:1787831160.048202:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2203764b40 x1874676443971712/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787831176 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787831160.048215:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203764b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3622:1874676443971712:0@lo:400:kworker.0 00000100:00080000:3.0:1787831160.049275:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8d23073ef800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787831160.049284:0:3618:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787831160.049288:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22037652c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3618:1874676443971328:0@lo:38:kworker.0 00000100:00100000:0.0:1787831160.050171:0:18611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443970816 00000001:00100000:3.0:1787831160.050252:0:19422:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787831160.050259:0:19422:0:(genops.c:885:class_export_put()) final put ffff8d2203b20000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787831160.050340:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2203b20000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1787831160.050398:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d2203b23800 for lustre-OST0001 00000100:00100000:0.0:1787831160.050796:0:18611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443970816 00000100:00100000:0.0:1787831160.050929:0:18611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787831160.050939:0:18611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb46940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676443970816:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787831160.050971:0:18611:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787831160.051063:0:18611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb46940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676443970816:12345-0@lo:13:osp-pre-0-1.0 Request processed in 124us (7142us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831160.051071:0:18611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787831160.051109:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233fb40b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676443970816:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1787831160.059172:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787831160.066941:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb45a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3618:x1874676443971200:12345-0@lo:38:kworker.0 Request processed in 21966us (22133us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787831160.066958:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00080000:0.0:1787831160.067084:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8d2203601800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787831160.067090:0:3618:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787831160.067094:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22037670c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3618:1874676443971200:0@lo:38:kworker.0 00000020:01000000:3.0:1787831160.487111:0:20825:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d2201f6d1e0 - data ffff8d23308a9798/ffff8d233fa63c00 00000020:01000000:3.0:1787831160.487301:0:20825:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d2202917300 - data ffff8d23308865e8/ffff8d233cd45400 00000001:00000004:3.0:1787831160.497140:0:20825:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934679 00000100:00080000:2.0:1787831160.531005:0:20825:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787831160.531014:0:20825:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787831160.531029:0:20825:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8d2203767480 x1874676443968256/t8589934595(8589934595) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787831164 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787831160.531053:0:20825:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1787831160.533695:0:20825:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787831160.533703:0:20825:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934601 gen 4 00000004:00080000:2.0:1787831160.533945:0:20825:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787831160.533949:0:20825:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1787831160.535021:0:17128:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1787831160.535028:0:17128:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 3 count 1 00000040:00080000:1.0:1787831160.535041:0:17128:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:2.0:1787831160.536519:0:20825:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787831160.536526:0:20825:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934599 gen 4 00000004:00080000:2.0:1787831160.536574:0:20825:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787831160.536577:0:20825:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1787831160.537051:0:17130:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1787831160.537056:0:17130:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 2 count 1 00000040:00080000:0.0:1787831160.537065:0:17130:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:2.0:1787831160.538378:0:20825:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x95459fb9d1d299f7 00000020:00000080:2.0:1787831160.538387:0:20825:0:(genops.c:885:class_export_put()) final put ffff8d233f60e800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787831160.538482:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d233f60e800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787831160.540372:0:20825:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x95459fb9d1d29a0c 00000020:00000080:2.0:1787831160.540384:0:20825:0:(genops.c:885:class_export_put()) final put ffff8d2334551800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1787831160.540409:0:20825:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1787831160.540414:0:20825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787831160.540423:0:20825:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787831160.540426:0:20825:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff8d233f434d28) has no exports 00000020:00000080:0.0:1787831160.540445:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2334551800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:2.0:1787831160.540673:0:20825:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1787831160.540683:0:20825:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x95459fb9d1d29a6e 00000020:00000080:2.0:1787831160.540688:0:20825:0:(genops.c:885:class_export_put()) final put ffff8d2303f2f800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1787831160.540720:0:20825:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1787831160.540725:0:20825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787831160.540740:0:20825:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787831160.540744:0:20825:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff8d2201e199b8) has no exports 00000020:00000080:1.0:1787831160.540747:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2303f2f800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1787831160.540751:0:20825:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x95459fb9d1d29a67 00000020:00000080:2.0:1787831160.540757:0:20825:0:(genops.c:885:class_export_put()) final put ffff8d2312806000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787831160.540770:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2312806000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1787831160.541197:0:20825:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1787831160.541202:0:20825:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787831160.541207:0:20825:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934599 gen 5 00000004:00080000:2.0:1787831160.541213:0:20825:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787831160.541220:0:20825:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787831160.541280:0:20825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787831160.541287:0:20825:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787831160.541289:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d2303f2a800 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1787831160.541294:0:20825:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x95459fb9d1d29a59 00000020:00000080:1.0:1787831160.541298:0:8:0:(genops.c:885:class_export_put()) final put ffff8d2334556000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787831160.541302:0:20825:0:(genops.c:885:class_export_put()) final put ffff8d2334553000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787831160.541302:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2334556000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1787831160.541310:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1787831160.541321:0:20825:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1787831160.541326:0:20825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787831160.541330:0:20825:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787831160.541333:0:20825:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff8d2312950000) has no exports 00000020:00000080:2.0:1787831160.541338:0:20825:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x95459fb9d1d29a52 00000020:00000080:2.0:1787831160.541341:0:20825:0:(genops.c:885:class_export_put()) final put ffff8d233be50000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787831160.541403:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2334553000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1787831160.541412:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d233be50000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1787831160.541880:0:20825:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1787831160.541884:0:20825:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787831160.541887:0:20825:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934601 gen 5 00000004:00080000:2.0:1787831160.541891:0:20825:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787831160.541900:0:20825:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787831160.541938:0:20825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787831160.541945:0:20825:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787831160.541956:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d233be52000 for lustre-OST0000-osc-MDT0000 00000004:01000000:2.0:1787831160.541957:0:20825:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1787831160.541965:0:20825:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x95459fb9d1d29a44 00000020:00000080:0.0:1787831160.541966:0:37:0:(genops.c:885:class_export_put()) final put ffff8d2334550000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787831160.541971:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2334550000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1787831160.541973:0:20825:0:(genops.c:885:class_export_put()) final put ffff8d2334556800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1787831160.541975:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1787831160.541987:0:20825:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:2.0:1787831160.541992:0:20825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787831160.541996:0:20825:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787831160.541999:0:20825:0:(genops.c:1558:class_disconnect_exports()) OBD device 8 (ffff8d232f778000) has no exports 00000020:00000080:2.0:1787831160.542004:0:20825:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x95459fb9d1d29a3d 00000020:00000080:2.0:1787831160.542008:0:20825:0:(genops.c:885:class_export_put()) final put ffff8d2201e0e000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787831160.542038:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2334556800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1787831160.542047:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2201e0e000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1787831160.552963:0:20825:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:2.0:1787831160.552972:0:20825:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787831160.552977:0:20825:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787831160.552985:0:20825:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787831160.553035:0:20825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787831160.553045:0:20825:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787831160.553074:0:20825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787831160.553077:0:20825:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787831160.553086:0:20825:0:(genops.c:885:class_export_put()) final put ffff8d2302ba9800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787831160.553091:0:20825:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2302ba9800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1787831160.553101:0:20825:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787831160.553104:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d2201e0b000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1787831160.553111:0:8:0:(genops.c:885:class_export_put()) final put ffff8d2302baf800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787831160.553114:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2302baf800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1787831160.553118:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787831160.553204:0:20825:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x95459fb9d1d29a13 00000020:00000080:2.0:1787831160.553212:0:20825:0:(genops.c:885:class_export_put()) final put ffff8d2334555800/lustre-MDD0000_UUID 00000020:01000000:2.0:1787831160.553260:0:20825:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1787831160.553265:0:20825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787831160.553270:0:20825:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787831160.553278:0:20825:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff8d233f430000) has no exports 00000020:00000080:2.0:1787831160.553296:0:20825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787831160.553299:0:20825:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1787831160.553304:0:20825:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x95459fb9d1d29a1a 00000020:00000080:2.0:1787831160.553318:0:20825:0:(genops.c:885:class_export_put()) final put ffff8d2334554000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787831160.553341:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2334555800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1787831160.553740:0:8:0:(genops.c:885:class_export_put()) final put ffff8d2311f32000/lustre-MDD0000_UUID 00000020:00000080:1.0:1787831160.553744:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2311f32000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1787831160.553748:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:01000004:2.0:1787831160.553855:0:20825:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d23115b5000 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1787831160.553859:0:20825:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d23115b5000 3 00000020:01000004:2.0:1787831160.553862:0:20825:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8d23115b5000 from lustre-MDT0000 00000020:00000080:2.0:1787831160.553882:0:20825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787831160.553886:0:20825:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1787831160.553889:0:20825:0:(genops.c:885:class_export_put()) final put ffff8d233f60e000/lustre-MDT0000_UUID 00000020:00000080:2.0:1787831160.553891:0:20825:0:(genops.c:844:class_export_destroy()) destroying export ffff8d233f60e000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1787831160.553897:0:20825:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1787831160.553927:0:20825:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:2.0:1787831160.553930:0:20825:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1787831160.553933:0:20825:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1787831160.553935:0:20825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787831160.553937:0:20825:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787831160.553944:0:20825:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8d22045af800 be45932f-3bcb-4e49-b61c-a2395180b0ee 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787831160.553949:0:20825:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff8d233f4319b8) has exports, disconnecting them 00000020:00080000:2.0:1787831160.553953:0:20825:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8d22045af800), last request at 1787831082 00000020:00000080:2.0:1787831160.553967:0:20825:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x95459fb9d1d299bf 00000020:00010000:2.0:1787831160.553970:0:20825:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8d22045af800: total 1 00000100:00080000:2.0:1787831160.553974:0:20825:0:(import.c:65:import_set_state_nolock()) ffff8d22045ad800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1787831160.553991:0:20825:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d22045af800): rc 0 00000020:00080000:2.0:1787831160.553995:0:20825:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff8d233f4319b8) has no exports 00000100:00100000:2.0:1787831160.554043:0:17097:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff8d232f73ca00:17097] 1 exiting: rc = 0 00000100:00100000:3.0:1787831160.554046:0:17098:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff8d233befac00:17098] 2 exiting: rc = 0 00000020:00010000:0.0:1787831160.554106:0:17093:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8d22045af800: total 1 00010000:00010000:0.0:1787831160.554140:0:17093:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8d22045af800, canceled 0 locks, left on hash table 13. 00000020:00000080:1.0:1787831160.554143:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2334554000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:0.0:1787831160.554169:0:17093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d22039c0c00/0x95459fb9d1d29d7e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x95459fb9d1d29d77 expref: 14 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831160.554184:0:17096:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff8d233befba00:17096] 0 exiting: rc = 1 00010000:00010000:0.0:1787831160.554211:0:17093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2303aa2400/0x95459fb9d1d29c20 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x95459fb9d1d29c19 expref: 13 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831160.554225:0:17093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2307c77000/0x95459fb9d1d29da8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x95459fb9d1d29da1 expref: 12 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831160.554234:0:17093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2303aa3a00/0x95459fb9d1d299cd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x95459fb9d1d299c6 expref: 11 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831160.554244:0:17093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2307c76600/0x95459fb9d1d29f68 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x95459fb9d1d29f61 expref: 10 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831160.554253:0:17093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2303aa3400/0x95459fb9d1d29ade lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x95459fb9d1d29ad7 expref: 9 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831160.554260:0:20825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:0.0:1787831160.554264:0:17093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d22039c0200/0x95459fb9d1d29c4a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x95459fb9d1d29c43 expref: 8 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831160.554272:0:20825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:0.0:1787831160.554273:0:17093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d22039c1200/0x95459fb9d1d29f76 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x95459fb9d1d29f6f expref: 7 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831160.554278:0:20825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:0.0:1787831160.554283:0:17093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d22039c1c00/0x95459fb9d1d29b9b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x95459fb9d1d29b94 expref: 6 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831160.554284:0:20825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831160.554291:0:20825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:0.0:1787831160.554293:0:17093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d22039c0400/0x95459fb9d1d29aec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x95459fb9d1d29ae5 expref: 5 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831160.554297:0:20825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831160.554303:0:20825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:0.0:1787831160.554304:0:17093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d22039c0800/0x95459fb9d1d29f84 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x95459fb9d1d29f7d expref: 4 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831160.554309:0:20825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831160.554316:0:20825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:0.0:1787831160.554326:0:17093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2303aa3200/0x95459fb9d1d29afa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x95459fb9d1d29af3 expref: 3 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831160.554328:0:20825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831160.554334:0:20825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:0.0:1787831160.554337:0:17093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2307c77200/0x95459fb9d1d29de7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x95459fb9d1d29de0 expref: 2 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831160.554340:0:20825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831160.554346:0:20825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:0.0:1787831160.554348:0:17093:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8d22045af800, canceled 13 locks, left on hash table 0. 00000100:00100000:2.0:1787831160.554362:0:20825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1787831160.554362:0:17093:0:(genops.c:885:class_export_put()) final put ffff8d22045af800/be45932f-3bcb-4e49-b61c-a2395180b0ee 00000100:00100000:2.0:1787831160.554368:0:20825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:0.0:1787831160.554372:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787831160.554374:0:20825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:0.0:1787831160.554374:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787831160.554375:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787831160.554379:0:20825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831160.554385:0:20825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831160.554391:0:20825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831160.554396:0:20825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831160.554402:0:20825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831160.554408:0:20825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831160.554414:0:20825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831160.554419:0:20825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831160.554424:0:20825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831160.554430:0:20825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831160.554436:0:20825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831160.554441:0:20825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831160.554448:0:20825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831160.554453:0:20825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831160.554458:0:20825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831160.554463:0:20825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831160.554468:0:20825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831160.554473:0:20825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831160.554479:0:20825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831160.554485:0:20825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831160.554490:0:20825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831160.554495:0:20825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831160.554501:0:20825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831160.554506:0:20825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831160.554511:0:20825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831160.554517:0:20825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831160.554523:0:20825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831160.554533:0:20825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831160.554545:0:20825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831160.554551:0:20825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831160.554558:0:20825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831160.554568:0:20825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831160.554573:0:20825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831160.554579:0:20825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831160.554585:0:20825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831160.554591:0:20825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831160.554595:0:20825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831160.554601:0:20825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831160.554606:0:20825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831160.554611:0:20825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831160.554615:0:20825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831160.554620:0:20825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831160.554641:0:20825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831160.554648:0:20825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831160.554653:0:20825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831160.554659:0:20825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831160.554665:0:20825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831160.554670:0:20825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1787831160.555667:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d22045af800/be45932f-3bcb-4e49-b61c-a2395180b0ee for MGS 00000020:00000080:0.0:1787831160.555706:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d22045ad800 for MGS 00000020:01000000:2.0:1787831160.555796:0:20825:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d2201f6d840 - data ffff8d23123fce58/ffff8d233fa60c00 00000020:01000000:2.0:1787831160.555923:0:20825:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d2318d99180 - data ffff8d23309c5d80/ffff8d2203a6ec00 00000020:00000080:2.0:1787831160.556491:0:20825:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x95459fb9d1d299a3 00000020:00000080:2.0:1787831160.556498:0:20825:0:(genops.c:885:class_export_put()) final put ffff8d2302bad000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1787831160.556517:0:20825:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d23115b5000 from MGS, refs=2 00000020:01000004:2.0:1787831160.556520:0:20825:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d23115b5000 2 00000020:01000004:2.0:1787831160.556523:0:20825:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8d23115b5000 from MGS 00000020:00000080:2.0:1787831160.556542:0:20825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787831160.556548:0:20825:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1787831160.556550:0:20825:0:(genops.c:885:class_export_put()) final put ffff8d2302baf000/MGS 00000020:00000080:2.0:1787831160.556553:0:20825:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2302baf000/MGS for MGS 00000020:01000000:2.0:1787831160.556557:0:20825:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1787831160.556616:0:20825:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1787831160.556619:0:20825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787831160.556654:0:20825:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00000080:0.0:1787831160.556656:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2302bad000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00080000:2.0:1787831160.556660:0:20825:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8d2202a86800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787831160.556666:0:20825:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff8d2201e18000) has exports, disconnecting them 00000020:00080000:2.0:1787831160.556670:0:20825:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8d2202a86800), last request at 1787831083 00000020:00000080:2.0:1787831160.556674:0:20825:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x95459fb9d1d29aa6 00000020:00080000:2.0:1787831160.556683:0:20825:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d2202a86800): rc 0 00000020:00000080:2.0:1787831160.556687:0:20825:0:(genops.c:885:class_export_put()) final put ffff8d2202a86800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1787831160.556711:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2202a86800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1787831160.565779:0:20825:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1787831160.565790:0:20825:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787831160.565795:0:20825:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787831160.565803:0:20825:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787831160.566062:0:20825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787831160.566071:0:20825:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1787831160.566078:0:20825:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d23115b5000 1 00000020:00000080:0.0:1787831160.566086:0:20825:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x95459fb9d1d29995 00000020:00000080:0.0:1787831160.566096:0:20825:0:(genops.c:885:class_export_put()) final put ffff8d2302ba8800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787831160.567964:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d2202a83800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1787831160.567991:0:37:0:(genops.c:885:class_export_put()) final put ffff8d2321e10000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1787831160.567996:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2321e10000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1787831160.568010:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000000:0.0:1787831160.568443:0:20825:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1787831160.568473:0:20825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787831160.568481:0:20825:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787831160.568485:0:20825:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff8d23344a0000) has no exports 00000020:00000080:1.0:1787831160.569138:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2302ba8800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787831160.607303:0:20825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787831160.607315:0:20825:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1787831160.607321:0:20825:0:(genops.c:885:class_export_put()) final put ffff8d23115b4000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787831160.607326:0:20825:0:(genops.c:844:class_export_destroy()) destroying export ffff8d23115b4000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1787831160.607336:0:20825:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1787831160.607459:0:20825:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8d23115b0000 00000020:02000400:1.0:1787831160.607516:0:20825:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1787831160.748181:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787831161.766903:0:18633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787831162.790864:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787831163.814813:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787831164.841213:0:18633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787831165.096428:0:17855:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:1.0:1787831165.158897:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787831165.158904:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787831165.158907:0:37:0:(import.c:65:import_set_state_nolock()) ffff8d2201e09800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787831165.158915:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 451 00000100:00080000:1.0:1787831165.158922:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787831165.158928:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8d2201e09800 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:1.0:1787831165.158953:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2203767480 x1874676443971968/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787831165.158993:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787831165.158996:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787831165.159013:0:37:0:(import.c:65:import_set_state_nolock()) ffff8d2203601800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787831165.159017:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 451 00000100:00080000:1.0:1787831165.159020:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787831165.159023:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8d2203601800 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:1.0:1787831165.159036:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2203764000 x1874676443972352/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787831165.159046:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787831165.159049:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787831165.159050:0:37:0:(import.c:65:import_set_state_nolock()) ffff8d23073ef800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787831165.159053:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 451 00000100:00080000:1.0:1787831165.159056:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787831165.159060:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8d23073ef800 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:1.0:1787831165.159069:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2203765a40 x1874676443972480/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787831165.159085:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787831165.159088:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787831165.159090:0:37:0:(import.c:65:import_set_state_nolock()) ffff8d2202a7e000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787831165.159093:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 451 00000100:00080000:1.0:1787831165.159096:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787831165.159100:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8d2202a7e000 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:1.0:1787831165.159109:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2203766580 x1874676443972736/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787831165.159217:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203764b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:be45932f-3bcb-4e49-b61c-a2395180b0ee:3622:1874676443971840:0@lo:400:kworker.0 00000400:00000100:2.0:1787831165.159272:0:3622:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874676443971840 offset 0 length 224: 4 00000100:00100000:2.0:1787831165.159321:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203767c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3622:1874676443972864:0@lo:400:kworker.0 00000100:00100000:2.0:1787831165.159355:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831165.159393:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787831165.159400:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203767840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3622:1874676443972608:0@lo:400:kworker.0 00000100:00100000:2.0:1787831165.159423:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831165.159466:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22037652c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1874676443972224:0@lo:400:kworker.0 00000100:00100000:2.0:1787831165.159492:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831165.159522:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787831165.159527:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22037670c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1874676443972096:0@lo:400:kworker.0 00000100:00100000:2.0:1787831165.159547:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831165.159579:0:18609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443972224 00000100:00100000:2.0:1787831165.159585:0:18609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443972224 00000100:00100000:2.0:1787831165.159850:0:18609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443972096 00000100:00100000:2.0:1787831165.159855:0:18609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443972096 00000100:00100000:2.0:1787831165.159891:0:18609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787831165.159900:0:18609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d232f61cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1874676443972224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787831165.159957:0:18609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d232f61cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1874676443972224:12345-0@lo:400:kworker.0 Request processed in 57us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831165.159965:0:18609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787831165.159981:0:18609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787831165.159987:0:18609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d232f61f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1874676443972096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787831165.160012:0:18609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d232f61f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1874676443972096:12345-0@lo:400:kworker.0 Request processed in 26us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831165.160018:0:18609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787831165.160056:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22037670c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1874676443972096:0@lo:400:kworker.0 00000100:00100000:2.0:1787831165.160066:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22037652c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1874676443972224:0@lo:400:kworker.0 00000100:00100000:3.0:1787831165.160298:0:18518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443972864 00000100:00100000:3.0:1787831165.160304:0:18518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443972864 00000100:00100000:3.0:1787831165.160335:0:18518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443972608 00000100:00100000:3.0:1787831165.160338:0:18518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443972608 00000100:00100000:3.0:1787831165.160362:0:18518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787831165.160370:0:18518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d232f61d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1874676443972864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787831165.160412:0:18518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d232f61d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1874676443972864:12345-0@lo:400:kworker.0 Request processed in 44us (1057us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831165.160418:0:18518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787831165.160430:0:18518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787831165.160436:0:18518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d232f61d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1874676443972608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787831165.160478:0:18518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d232f61d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1874676443972608:12345-0@lo:400:kworker.0 Request processed in 42us (1053us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831165.160483:0:18518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:3.0:1787831165.160503:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787831165.160515:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787831165.160517:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787831165.160566:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220483c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443972992:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787831165.160593:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1787831165.160775:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff8d2203767840 x1874676443972608/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787831181 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787831165.160786:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203767840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3622:1874676443972608:0@lo:400:kworker.0 00010000:00080000:3.0:1787831165.160797:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff8d2203767c00 x1874676443972864/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787831181 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787831165.160805:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203767c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3622:1874676443972864:0@lo:400:kworker.0 00000100:00100000:0.0:1787831165.160995:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203767480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1874676443971968:0@lo:38:kworker.0 00000100:00100000:0.0:1787831165.161027:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831165.161044:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203764000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3618:1874676443972352:0@lo:38:kworker.0 00000100:00100000:0.0:1787831165.161066:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831165.161084:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203765a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3618:1874676443972480:0@lo:38:kworker.0 00000100:00100000:0.0:1787831165.161104:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831165.161120:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203766580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3618:1874676443972736:0@lo:38:kworker.0 00000100:00100000:0.0:1787831165.161138:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831165.161165:0:19892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443972352 00000100:00100000:0.0:1787831165.161169:0:19892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443972352 00000100:00100000:0.0:1787831165.161189:0:19892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443972480 00000100:00100000:0.0:1787831165.161192:0:19892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443972480 00000100:00100000:0.0:1787831165.161200:0:19892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443972736 00000100:00100000:0.0:1787831165.161202:0:19892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443972736 00000100:00100000:0.0:1787831165.161211:0:19892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1787831165.161216:0:19892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb40b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3618:x1874676443972352:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1787831165.161233:0:19892:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787831165.161486:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1787831165.161492:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb46d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3618:x1874676443972480:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787831165.161504:0:17106:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787831165.161546:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb46d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3618:x1874676443972480:12345-0@lo:38:kworker.0 Request processed in 52us (441us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787831165.161553:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1787831165.161568:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1787831165.161572:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb45680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3618:x1874676443972736:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787831165.161582:0:17106:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787831165.161605:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb45680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3618:x1874676443972736:12345-0@lo:38:kworker.0 Request processed in 32us (466us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787831165.161610:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1787831165.162436:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787831165.162453:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233fb41a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443973120:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787831165.162503:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787831165.162578:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8d23073ef800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787831165.162583:0:3618:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787831165.162587:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203765a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3618:1874676443972480:0@lo:38:kworker.0 00000100:00080000:2.0:1787831165.162598:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8d2202a7e000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787831165.162602:0:3618:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787831165.162604:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203766580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3618:1874676443972736:0@lo:38:kworker.0 00000100:00100000:2.0:1787831165.162650:0:18611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443972992 00000100:00100000:2.0:1787831165.162655:0:18611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443972992 00000100:00100000:2.0:1787831165.162684:0:18611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443973120 00000100:00100000:2.0:1787831165.162686:0:18611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443973120 00000100:00100000:2.0:1787831165.162697:0:18611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787831165.162717:0:18611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220483f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443972992:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787831165.162745:0:18611:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1787831165.162798:0:18611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220483f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443972992:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (2204us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831165.162804:0:18611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787831165.162818:0:18611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787831165.162823:0:18611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d232f61e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443973120:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787831165.162837:0:18611:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787831165.162862:0:18611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d232f61e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443973120:12345-0@lo:13:osp-pre-0-1.0 Request processed in 39us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831165.162867:0:18611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787831165.163135:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233fb41a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443973120:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787831165.163153:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220483c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443972992:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787831165.163251:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443971968 00000100:00100000:3.0:1787831165.163258:0:17110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443971968 00000100:00100000:3.0:1787831165.163290:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787831165.163296:0:17110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb41e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3618:x1874676443971968:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1787831165.163310:0:17110:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787831165.163356:0:17110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb41e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3618:x1874676443971968:12345-0@lo:38:kworker.0 Request processed in 59us (2327us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787831165.163361:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:2.0:1787831165.163484:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8d2201e09800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787831165.163489:0:3618:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787831165.163498:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203767480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1874676443971968:0@lo:38:kworker.0 00000100:00100000:0.0:1787831165.180417:0:19892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb40b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3618:x1874676443972352:12345-0@lo:38:kworker.0 Request processed in 19183us (19333us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787831165.180440:0:19892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00080000:3.0:1787831165.180794:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8d2203601800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787831165.180800:0:3618:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787831165.180804:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203764000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3618:1874676443972352:0@lo:38:kworker.0 00010000:00010000:0.0:1787831165.863279:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787831166.886734:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787831167.913356:0:18633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787831168.479495:0:21027:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1787831168.498774:0:21027:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:1.0:1787831168.498831:0:21027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d23344b6c00/0x95459fb9d1d29b94 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d29b9b expref: -99 pid: 17834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831168.498847:0:21027:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d23344b6c00/0x95459fb9d1d29b94 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d29b9b expref: -99 pid: 17834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831168.498854:0:21027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d23344b6c00/0x95459fb9d1d29b94 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x95459fb9d1d29b9b expref: -99 pid: 17834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831168.498862:0:21027:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.131@tcp lock: ffff8d23344b6c00/0x95459fb9d1d29b94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x95459fb9d1d29b9b expref: -99 pid: 17834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831168.498880:0:21027:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787831168.498886:0:21027:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1787831168.498909:0:21027:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787831168.498913:0:21027:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1787831168.498920:0:21027:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787831168.498925:0:21027:0:(import.c:65:import_set_state_nolock()) ffff8d2203601800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:1.0:1787831168.498930:0:21027:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787831168.498932:0:21027:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787831168.498935:0:21027:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1787831168.499824:0:21027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d23344b7400/0x95459fb9d1d29af3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d29afa expref: -99 pid: 17834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831168.499835:0:21027:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d23344b7400/0x95459fb9d1d29af3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d29afa expref: -99 pid: 17834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831168.499843:0:21027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d23344b7400/0x95459fb9d1d29af3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x95459fb9d1d29afa expref: -99 pid: 17834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831168.499863:0:21027:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.131@tcp lock: ffff8d23344b7400/0x95459fb9d1d29af3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x95459fb9d1d29afa expref: -99 pid: 17834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831168.499881:0:21027:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787831168.499887:0:21027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d23344b7e00/0x95459fb9d1d29de0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d29de7 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831168.499895:0:21027:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d23344b7e00/0x95459fb9d1d29de0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d29de7 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831168.499901:0:21027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d23344b7e00/0x95459fb9d1d29de0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x95459fb9d1d29de7 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831168.499908:0:21027:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.131@tcp lock: ffff8d23344b7e00/0x95459fb9d1d29de0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x95459fb9d1d29de7 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831168.499922:0:21027:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1787831168.499929:0:21027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d23344b7800/0x95459fb9d1d29f7d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d29f84 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831168.499936:0:21027:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d23344b7800/0x95459fb9d1d29f7d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d29f84 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831168.499942:0:21027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d23344b7800/0x95459fb9d1d29f7d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x95459fb9d1d29f84 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831168.499949:0:21027:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.131@tcp lock: ffff8d23344b7800/0x95459fb9d1d29f7d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x95459fb9d1d29f84 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831168.499966:0:21027:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:1.0:1787831168.499972:0:21027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d23344b6400/0x95459fb9d1d29ae5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d29aec expref: -99 pid: 17834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831168.499979:0:21027:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d23344b6400/0x95459fb9d1d29ae5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d29aec expref: -99 pid: 17834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831168.499985:0:21027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d23344b6400/0x95459fb9d1d29ae5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x95459fb9d1d29aec expref: -99 pid: 17834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831168.499992:0:21027:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.131@tcp lock: ffff8d23344b6400/0x95459fb9d1d29ae5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x95459fb9d1d29aec expref: -99 pid: 17834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831168.500000:0:21027:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 10000000:01000000:1.0:1787831168.500003:0:21027:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:1.0:1787831168.500024:0:21027:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0001 00000020:01000000:1.0:1787831168.500028:0:21027:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:1.0:1787831168.500032:0:21027:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787831168.500038:0:21027:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:1.0:1787831168.500045:0:21027:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff8d2203b27000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787831168.500051:0:21027:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff8d23073e9800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787831168.500056:0:21027:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff8d232f7799b8) has exports, disconnecting them 00000020:00080000:1.0:1787831168.500060:0:21027:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8d2203b27000), last request at 1787831165 00000020:00000080:1.0:1787831168.500067:0:21027:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x95459fb9d1d29dd2 00000100:00080000:1.0:1787831168.500085:0:21027:0:(import.c:65:import_set_state_nolock()) ffff8d2203b22800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1787831168.500127:0:21027:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d2203b27000): rc 0 00000020:00000080:1.0:1787831168.500130:0:21027:0:(genops.c:885:class_export_put()) final put ffff8d2203b27000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:1.0:1787831168.500142:0:21027:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8d23073e9800), last request at 1787831165 00000020:00000080:1.0:1787831168.500152:0:21027:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x95459fb9d1d29c74 00000100:00080000:1.0:1787831168.500159:0:21027:0:(import.c:65:import_set_state_nolock()) ffff8d220470d800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1787831168.500166:0:21027:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d23073e9800): rc 0 00000020:00000080:1.0:1787831168.500167:0:21027:0:(genops.c:885:class_export_put()) final put ffff8d23073e9800/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:1.0:1787831168.500175:0:21027:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffae38c1d0bae0 00000100:00080000:1.0:1787831168.500191:0:21027:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787831168.500200:0:21027:0:(client.c:3601:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff8d220483da40 x1874676443969408/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787831170 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787831168.500213:0:21027:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1787831168.501033:0:21027:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787831168.501041:0:21027:0:(import.c:65:import_set_state_nolock()) ffff8d2201e09800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00010000:00010000:3.0:1787831168.501145:0:18633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1787831168.501153:0:18633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8d23344b6c00/0x95459fb9d1d29b94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x95459fb9d1d29b9b expref: -99 pid: 17834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831168.501164:0:18633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d23344b6c00 already unused, calling callback (ffffffffc14f9c20) 10000000:00010000:3.0:1787831168.501168:0:18633:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8d23344b6c00/0x95459fb9d1d29b94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x95459fb9d1d29b9b expref: -99 pid: 17834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831168.501178:0:18633:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8d23344b6c00/0x95459fb9d1d29b94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x95459fb9d1d29b9b expref: -99 pid: 17834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787831168.501185:0:18633:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8d23344b6c00/0x95459fb9d1d29b94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x95459fb9d1d29b9b expref: -99 pid: 17834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787831168.501191:0:18633:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787831168.501194:0:18633:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1787831168.501206:0:18633:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1787831168.501242:0:18633:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8d23344b6c00/0x95459fb9d1d29b94 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x95459fb9d1d29b9b expref: -99 pid: 17834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831168.501249:0:18633:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787831168.501277:0:18633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8d23344b6c00/0x95459fb9d1d29b94 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x95459fb9d1d29b9b expref: -99 pid: 17834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831168.501285:0:18633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8d23344b6c00/0x95459fb9d1d29b94 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x95459fb9d1d29b9b expref: -99 pid: 17834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831168.501296:0:18633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1787831168.501299:0:18633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8d23344b7400/0x95459fb9d1d29af3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x95459fb9d1d29afa expref: -99 pid: 17834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831168.501304:0:18633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d23344b7400 already unused, calling callback (ffffffffc14f9c20) 10000000:00010000:3.0:1787831168.501307:0:18633:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8d23344b7400/0x95459fb9d1d29af3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x95459fb9d1d29afa expref: -99 pid: 17834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831168.501313:0:18633:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8d23344b7400/0x95459fb9d1d29af3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x95459fb9d1d29afa expref: -99 pid: 17834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787831168.501319:0:18633:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8d23344b7400/0x95459fb9d1d29af3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x95459fb9d1d29afa expref: -99 pid: 17834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787831168.501324:0:18633:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787831168.501327:0:18633:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 10000000:01000000:3.0:1787831168.501329:0:18633:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 00010000:00010000:3.0:1787831168.501341:0:18633:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8d23344b7400/0x95459fb9d1d29af3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x95459fb9d1d29afa expref: -99 pid: 17834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831168.501346:0:18633:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787831168.501359:0:18633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8d23344b7400/0x95459fb9d1d29af3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x95459fb9d1d29afa expref: -99 pid: 17834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831168.501366:0:18633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8d23344b7400/0x95459fb9d1d29af3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x95459fb9d1d29afa expref: -99 pid: 17834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831168.501374:0:18633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787831168.501378:0:18633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8d23344b7e00/0x95459fb9d1d29de0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x95459fb9d1d29de7 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831168.501383:0:18633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d23344b7e00 already unused, calling callback (ffffffffc14f9c20) 10000000:00010000:3.0:1787831168.501386:0:18633:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8d23344b7e00/0x95459fb9d1d29de0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x95459fb9d1d29de7 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831168.501392:0:18633:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8d23344b7e00/0x95459fb9d1d29de0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x95459fb9d1d29de7 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787831168.501398:0:18633:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8d23344b7e00/0x95459fb9d1d29de0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x95459fb9d1d29de7 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787831168.501402:0:18633:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1787831168.501404:0:18633:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1787831168.501406:0:18633:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1787831168.501418:0:18633:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8d23344b7e00/0x95459fb9d1d29de0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x95459fb9d1d29de7 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831168.501424:0:18633:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787831168.501436:0:18633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8d23344b7e00/0x95459fb9d1d29de0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x95459fb9d1d29de7 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831168.501441:0:18633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8d23344b7e00/0x95459fb9d1d29de0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x95459fb9d1d29de7 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831168.501463:0:18633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787831168.501467:0:18633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8d23344b7800/0x95459fb9d1d29f7d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x95459fb9d1d29f84 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831168.501472:0:18633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d23344b7800 already unused, calling callback (ffffffffc14f9c20) 10000000:00010000:3.0:1787831168.501475:0:18633:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8d23344b7800/0x95459fb9d1d29f7d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x95459fb9d1d29f84 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831168.501481:0:18633:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8d23344b7800/0x95459fb9d1d29f7d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x95459fb9d1d29f84 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787831168.501487:0:18633:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8d23344b7800/0x95459fb9d1d29f7d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x95459fb9d1d29f84 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787831168.501491:0:18633:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1787831168.501493:0:18633:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1787831168.501495:0:18633:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1787831168.501509:0:18633:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8d23344b7800/0x95459fb9d1d29f7d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x95459fb9d1d29f84 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831168.501514:0:18633:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787831168.501520:0:18633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8d23344b7800/0x95459fb9d1d29f7d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x95459fb9d1d29f84 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831168.501525:0:18633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8d23344b7800/0x95459fb9d1d29f7d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x95459fb9d1d29f84 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831168.501533:0:18633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787831168.501536:0:18633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8d23344b6400/0x95459fb9d1d29ae5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x95459fb9d1d29aec expref: -99 pid: 17834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831168.501548:0:18633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d23344b6400 already unused, calling callback (ffffffffc14f9c20) 10000000:00010000:3.0:1787831168.501551:0:18633:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8d23344b6400/0x95459fb9d1d29ae5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x95459fb9d1d29aec expref: -99 pid: 17834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831168.501558:0:18633:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8d23344b6400/0x95459fb9d1d29ae5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x95459fb9d1d29aec expref: -99 pid: 17834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787831168.501563:0:18633:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8d23344b6400/0x95459fb9d1d29ae5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x95459fb9d1d29aec expref: -99 pid: 17834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787831168.501568:0:18633:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1787831168.501570:0:18633:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1787831168.501572:0:18633:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1787831168.501584:0:18633:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8d23344b6400/0x95459fb9d1d29ae5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x95459fb9d1d29aec expref: -99 pid: 17834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831168.501590:0:18633:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787831168.501594:0:18633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8d23344b6400/0x95459fb9d1d29ae5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x95459fb9d1d29aec expref: -99 pid: 17834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831168.501599:0:18633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8d23344b6400/0x95459fb9d1d29ae5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x95459fb9d1d29aec expref: -99 pid: 17834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831168.501610:0:18633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787831168.501611:0:18633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787831168.501613:0:18633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787831168.501650:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2203b27000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:3.0:1787831168.501711:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d23073e9800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:3.0:1787831168.501734:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d2203b22800 for lustre-MDT0001 00000020:00000080:3.0:1787831168.501744:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d220470d800 for lustre-MDT0001 00000100:00100000:3.0:1787831168.501764:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220483d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:be45932f-3bcb-4e49-b61c-a2395180b0ee:3620:1874676443973632:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787831168.501829:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831168.501879:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787831168.501886:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220483d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:be45932f-3bcb-4e49-b61c-a2395180b0ee:3620:1874676443973504:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787831168.501906:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831168.501939:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443973632 00000100:00100000:3.0:1787831168.501945:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443973632 00000100:00100000:3.0:1787831168.501977:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443973504 00000100:00100000:3.0:1787831168.501980:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443973504 00000100:00100000:3.0:1787831168.501999:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787831168.502006:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220483f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3620:x1874676443973632:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1787831168.502012:0:17090:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787831168 with bad export cookie 10756178905482303935 00010000:00010000:0.0:1787831168.502648:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787831168.502691:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787831168.502698:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220483e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3620:x1874676443973504:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1787831168.502703:0:17091:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787831168 with bad export cookie 10756178905482303935 00000100:00100000:0.0:1787831168.502758:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220483e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3620:x1874676443973504:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (850us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787831168.502773:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:0.0:1787831168.502826:0:3620:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.131@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1787831168.502831:0:3620:0:(import.c:65:import_set_state_nolock()) ffff8d22045a8000 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1787831168.502835:0:3620:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.131@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00010000:2.0:1787831168.505073:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787831168.505101:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220483da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443969408:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787831168.510304:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220483f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3620:x1874676443973632:12345-0@lo:103:ldlm_bl.0 Request processed in 8292us (8470us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787831168.510317:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:0.0:1787831168.521059:0:3620:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.131@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1787831168.521065:0:3620:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1787831168.521075:0:3620:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d2203764b40 x1874676443971840/t0(0) o400->MGC192.168.203.131@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787831181 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787831168.521090:0:3620:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d220483d2c0 x1874676443973632/t0(0) o103->MGC192.168.203.131@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787831184 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787831168.521100:0:3620:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d220483d680 x1874676443973504/t0(0) o103->MGC192.168.203.131@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787831184 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1787831168.521108:0:3620:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1787831168.521111:0:3620:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1787831168.521112:0:3620:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1787831168.521414:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220483e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:be45932f-3bcb-4e49-b61c-a2395180b0ee:0:1874676443973248:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787831168.521423:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220483cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:be45932f-3bcb-4e49-b61c-a2395180b0ee:0:1874676443973760:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1787831168.521526:0:21027:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1787831168.521530:0:21027:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934594 gen 3 00000004:00080000:1.0:1787831168.521581:0:21027:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1787831168.521757:0:21027:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1787831168.521784:0:21027:0:(import.c:65:import_set_state_nolock()) ffff8d232b962800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1787831168.521808:0:21027:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1787831168.521810:0:21027:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:1.0:1787831168.521819:0:21027:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1787831168.521879:0:21027:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1787831168.521891:0:21027:0:(import.c:65:import_set_state_nolock()) ffff8d2303234000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1787831168.521927:0:21027:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff8d232f7799b8) has no exports 00000100:00100000:3.0:1787831168.521991:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22037643c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1874676443973888:0@lo:9:umount.0 00000100:00100000:3.0:1787831168.522055:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831168.522097:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203766940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1874676443974016:0@lo:9:umount.0 00000100:00100000:3.0:1787831168.522119:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831168.522275:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220483ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:be45932f-3bcb-4e49-b61c-a2395180b0ee:0:1874676443973376:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787831168.522289:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203764b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:be45932f-3bcb-4e49-b61c-a2395180b0ee:3622:1874676443971840:0@lo:400:kworker.0 00000100:00100000:2.0:1787831168.522403:0:18609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443973888 00000100:00100000:2.0:1787831168.522410:0:18609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443973888 00000100:00100000:2.0:1787831168.522460:0:18609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443974016 00000100:00100000:2.0:1787831168.522464:0:18609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443974016 00000100:00100000:2.0:1787831168.522487:0:18609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787831168.522495:0:18609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220483fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1874676443973888:12345-0@lo:9:umount.0 00000020:00000080:2.0:1787831168.522519:0:18609:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x95459fb9d1d29e03 00000100:00080000:2.0:1787831168.522526:0:18609:0:(import.c:65:import_set_state_nolock()) ffff8d22025c1000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787831168.522568:0:18609:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934601 00000100:00100000:2.0:1787831168.522810:0:18609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220483fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+2:3618:x1874676443973888:12345-0@lo:9:umount.0 Request processed in 315us (753us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831168.522817:0:18609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787831168.522836:0:18609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787831168.522843:0:18609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220483c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1874676443974016:12345-0@lo:9:umount.0 00000020:00000080:2.0:1787831168.522854:0:18609:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x95459fb9d1d29e0a 00000100:00080000:2.0:1787831168.522860:0:18609:0:(import.c:65:import_set_state_nolock()) ffff8d2203b24000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787831168.522882:0:18609:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:2.0:1787831168.522957:0:18609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220483c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+2:3618:x1874676443974016:12345-0@lo:9:umount.0 Request processed in 114us (836us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831168.522963:0:18609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:2.0:1787831168.522992:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787831168.522996:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787831168.523008:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787831168.523033:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8d232b962800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1787831168.523044:0:3618:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1787831168.523046:0:3618:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787831168.523049:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22037643c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1874676443973888:0@lo:9:umount.0 00000100:00080000:2.0:1787831168.523061:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8d2303234000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1787831168.523070:0:3618:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1787831168.523071:0:3618:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787831168.523073:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203766940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1874676443974016:0@lo:9:umount.0 00010000:00010000:2.0:1787831168.523099:0:18633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787831168.523566:0:3620:0:(import.c:65:import_set_state_nolock()) ffff8d22045a8000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787831168.523572:0:3620:0:(import.c:510:import_select_connection()) MGC192.168.203.131@tcp: connect to NID 0@lo last attempt 373 00000100:00080000:0.0:1787831168.523579:0:3620:0:(import.c:624:import_select_connection()) MGC192.168.203.131@tcp: import ffff8d22045a8000 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:0.0:1787831168.523613:0:3620:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d233faeb480 x1874676443974144/t0(0) o250->MGC192.168.203.131@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787831168.523786:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220483d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:be45932f-3bcb-4e49-b61c-a2395180b0ee:3620:1874676443973632:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787831168.523803:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220483d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:be45932f-3bcb-4e49-b61c-a2395180b0ee:3620:1874676443973504:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787831168.523857:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233faeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:be45932f-3bcb-4e49-b61c-a2395180b0ee:3618:1874676443974144:0@lo:250:ptlrpcd_00_01.0 00000400:00000100:1.0:1787831168.523889:0:3618:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874676443974144 offset 0 length 520: 4 00000020:00080000:3.0:1787831168.536172:0:21027:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff8d232f7799b8) has no exports 00000020:01000000:0.0:1787831168.588509:0:21027:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d233bcf1ba0 - data ffff8d23121fd798/ffff8d2306ca7000 00000020:01000000:0.0:1787831168.588720:0:21027:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d232f5ec1e0 - data ffff8d23123f1510/ffff8d2305a25c00 00000001:00000004:0.0:1787831168.598824:0:21027:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934595 00000100:00080000:2.0:1787831168.641146:0:21027:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787831168.641154:0:21027:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787831168.641161:0:21027:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1787831168.642827:0:21027:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787831168.642832:0:21027:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934594 gen 4 00000004:00080000:2.0:1787831168.642846:0:21027:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787831168.642848:0:21027:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1787831168.644266:0:17843:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1787831168.644272:0:17843:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 1 count 1 00000040:00080000:3.0:1787831168.644282:0:17843:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:2.0:1787831168.644975:0:21027:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787831168.644981:0:21027:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:2.0:1787831168.645001:0:21027:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787831168.645004:0:21027:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1787831168.645498:0:17845:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1787831168.645502:0:17845:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:3.0:1787831168.645512:0:17845:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:2.0:1787831168.646880:0:21027:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x95459fb9d1d29b08 00000020:00000080:2.0:1787831168.646891:0:21027:0:(genops.c:885:class_export_put()) final put ffff8d2201e0c000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1787831168.647929:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2201e0c000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1787831168.648851:0:21027:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x95459fb9d1d29b1d 00000020:00000080:2.0:1787831168.648866:0:21027:0:(genops.c:885:class_export_put()) final put ffff8d230884f000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1787831168.648873:0:21027:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:2.0:1787831168.648880:0:21027:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787831168.648885:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d230884f000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:00000080:2.0:1787831168.648889:0:21027:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787831168.648894:0:21027:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff8d232f77b370) has no exports 00000004:01000000:2.0:1787831168.649053:0:21027:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1787831168.649062:0:21027:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x95459fb9d1d29b71 00000020:00000080:2.0:1787831168.649067:0:21027:0:(genops.c:885:class_export_put()) final put ffff8d2203606800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1787831168.649171:0:21027:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:2.0:1787831168.649177:0:21027:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787831168.649183:0:21027:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787831168.649187:0:21027:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff8d23344a4d28) has no exports 00000020:00000080:2.0:1787831168.649193:0:21027:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x95459fb9d1d29b6a 00000020:00000080:2.0:1787831168.649198:0:21027:0:(genops.c:885:class_export_put()) final put ffff8d2303237800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1787831168.649306:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2203606800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1787831168.649813:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2303237800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:2.0:1787831168.650158:0:21027:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:2.0:1787831168.650164:0:21027:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787831168.650168:0:21027:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:2.0:1787831168.650174:0:21027:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787831168.650177:0:21027:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787831168.650227:0:21027:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787831168.650235:0:21027:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787831168.650242:0:21027:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x95459fb9d1d29b5c 00000020:00000080:2.0:1787831168.650250:0:21027:0:(genops.c:885:class_export_put()) final put ffff8d232f6b2000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1787831168.650255:0:21027:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:2.0:1787831168.650260:0:21027:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787831168.650264:0:21027:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787831168.650267:0:21027:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff8d2312954d28) has no exports 00000020:00000080:2.0:1787831168.650277:0:21027:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x95459fb9d1d29b4e 00000020:00000080:2.0:1787831168.650281:0:21027:0:(genops.c:885:class_export_put()) final put ffff8d233bc5c000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1787831168.650304:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d2303234000 for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1787831168.650311:0:37:0:(genops.c:885:class_export_put()) final put ffff8d232f6b2800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787831168.650314:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d232f6b2800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:3.0:1787831168.650318:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787831168.650387:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d232f6b2000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1787831168.650390:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d233bc5c000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:2.0:1787831168.651104:0:21027:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:2.0:1787831168.651108:0:21027:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787831168.651110:0:21027:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934594 gen 5 00000004:00080000:2.0:1787831168.651115:0:21027:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787831168.651117:0:21027:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787831168.651160:0:21027:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787831168.651166:0:21027:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:2.0:1787831168.651180:0:21027:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1787831168.651193:0:21027:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x95459fb9d1d29b40 00000020:00000080:2.0:1787831168.651199:0:21027:0:(genops.c:885:class_export_put()) final put ffff8d232f6b7000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1787831168.651209:0:21027:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:2.0:1787831168.651213:0:21027:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787831168.651217:0:21027:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787831168.651220:0:21027:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff8d23129519b8) has no exports 00000020:00000080:2.0:1787831168.651224:0:21027:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x95459fb9d1d29b39 00000020:00000080:2.0:1787831168.651228:0:21027:0:(genops.c:885:class_export_put()) final put ffff8d2201e08000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1787831168.651238:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d232b962800 for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1787831168.651246:0:37:0:(genops.c:885:class_export_put()) final put ffff8d232f6b6000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787831168.651249:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d232f6b6000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:3.0:1787831168.651255:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787831168.651300:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d232f6b7000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1787831168.651304:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2201e08000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:3.0:1787831168.655689:0:21027:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:3.0:1787831168.655697:0:21027:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787831168.655702:0:21027:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1787831168.655709:0:21027:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787831168.655764:0:21027:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787831168.655774:0:21027:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787831168.655803:0:21027:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787831168.655807:0:21027:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787831168.655811:0:21027:0:(genops.c:885:class_export_put()) final put ffff8d220276b000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787831168.655816:0:21027:0:(genops.c:844:class_export_destroy()) destroying export ffff8d220276b000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:3.0:1787831168.655822:0:21027:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787831168.655955:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d2201e09800 for lustre-MDT0000-osp-MDT0001 00000020:00000080:0.0:1787831168.655966:0:37:0:(genops.c:885:class_export_put()) final put ffff8d232b964800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787831168.655978:0:21027:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x95459fb9d1d29b24 00000020:00000080:3.0:1787831168.655995:0:21027:0:(genops.c:885:class_export_put()) final put ffff8d230884c800/lustre-MDD0001_UUID 00000020:01000000:3.0:1787831168.656008:0:21027:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:3.0:1787831168.656020:0:21027:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787831168.656025:0:21027:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787831168.656029:0:21027:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8d233454cd28) has no exports 00000020:00000080:3.0:1787831168.656049:0:21027:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787831168.656052:0:21027:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:3.0:1787831168.656056:0:21027:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x95459fb9d1d29b2b 00000020:00000080:3.0:1787831168.656060:0:21027:0:(genops.c:885:class_export_put()) final put ffff8d230884d000/lustre-MDT0001-osd_UUID 00000020:01000004:3.0:1787831168.656074:0:21027:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d233f43f000 from lustre-MDT0001, refs=2 00000020:01000004:3.0:1787831168.656077:0:21027:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d233f43f000 2 00000020:01000004:3.0:1787831168.656080:0:21027:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8d233f43f000 from lustre-MDT0001 00000020:00000080:3.0:1787831168.656097:0:21027:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787831168.656099:0:21027:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:3.0:1787831168.656102:0:21027:0:(genops.c:885:class_export_put()) final put ffff8d2201e0d000/lustre-MDT0001_UUID 00000020:00000080:3.0:1787831168.656104:0:21027:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2201e0d000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:3.0:1787831168.656111:0:21027:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:3.0:1787831168.656138:0:21027:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:3.0:1787831168.656141:0:21027:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:3.0:1787831168.656144:0:21027:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787831168.656146:0:21027:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787831168.656153:0:21027:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff8d2203604800 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787831168.656158:0:21027:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff8d2201e1b370) has exports, disconnecting them 00000020:00080000:3.0:1787831168.656162:0:21027:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff8d2203604800), last request at 1787831093 00000020:00000080:3.0:1787831168.656166:0:21027:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x95459fb9d1d29ba9 00000020:00080000:3.0:1787831168.656176:0:21027:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d2203604800): rc 0 00000020:00000080:3.0:1787831168.656180:0:21027:0:(genops.c:885:class_export_put()) final put ffff8d2203604800/lustre-MDT0000-lwp-MDT0001 00000020:00000080:0.0:1787831168.656491:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d232b964800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:0.0:1787831168.656511:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787831168.656621:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d230884c800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:0.0:1787831168.656648:0:37:0:(genops.c:885:class_export_put()) final put ffff8d230884c000/lustre-MDD0001_UUID 00000020:00000080:0.0:1787831168.656650:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d230884c000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:0.0:1787831168.656654:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:0.0:1787831168.656935:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d230884d000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1787831168.656941:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2203604800/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:3.0:1787831168.674657:0:21027:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:3.0:1787831168.674666:0:21027:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787831168.674726:0:21027:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1787831168.674734:0:21027:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787831168.674832:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d2203601800 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1787831168.674965:0:21027:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787831168.674974:0:21027:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:3.0:1787831168.674979:0:21027:0:(genops.c:885:class_export_put()) final put ffff8d23064ee000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:3.0:1787831168.675303:0:21027:0:(genops.c:844:class_export_destroy()) destroying export ffff8d23064ee000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:3.0:1787831168.675311:0:21027:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:3.0:1787831168.675383:0:21027:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d233f43f000 1 00000020:00000080:3.0:1787831168.675390:0:21027:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x95459fb9d1d29ad0 00000020:00000080:3.0:1787831168.675397:0:21027:0:(genops.c:885:class_export_put()) final put ffff8d232b9eb800/lustre-MDT0001-osd_UUID 00000020:01000000:3.0:1787831168.675413:0:21027:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:3.0:1787831168.675416:0:21027:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787831168.675421:0:21027:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787831168.675425:0:21027:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff8d2312953370) has no exports 00000020:00000080:0.0:1787831168.675496:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d232b9eb800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1787831168.725195:0:21027:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787831168.725209:0:21027:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:1.0:1787831168.725214:0:21027:0:(genops.c:885:class_export_put()) final put ffff8d233f43e000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1787831168.725219:0:21027:0:(genops.c:844:class_export_destroy()) destroying export ffff8d233f43e000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:1.0:1787831168.725229:0:21027:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:1.0:1787831168.725417:0:21027:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8d233f43a000 00000020:01000000:1.0:1787831168.725436:0:21027:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1787831168.725441:0:21027:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787831168.725446:0:21027:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787831168.725449:0:21027:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff8d23344a3370) has no exports 00000100:00100000:2.0:1787831168.726109:0:17106:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff8d22047ea600:17106] 2 exiting: rc = 0 00000100:00100000:2.0:1787831168.726216:0:18518:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff8d2338212c00:18518] 3 exiting: rc = 0 00000100:00100000:0.0:1787831168.726439:0:19892:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff8d2202679200:19892] 4 exiting: rc = 0 00000100:00100000:2.0:1787831168.726568:0:17104:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff8d2201e00000:17104] 0 exiting: rc = 1 00000100:00100000:0.0:1787831168.726875:0:17105:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff8d22047eac00:17105] 1 exiting: rc = 0 00000100:00100000:3.0:1787831168.727002:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.727010:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.727016:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.727021:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.727026:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.727031:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.727037:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.727042:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.727047:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.727053:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.727058:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.727063:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.727069:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.727074:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.727079:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.727084:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.727090:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.727095:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.727100:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.727106:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.727112:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.727129:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.727135:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.727145:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.727151:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.727156:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.727160:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.727165:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.727171:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.727175:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.727180:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.727186:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.727192:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.727197:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.727202:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.727207:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.727217:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.727222:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.727228:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.727233:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.727531:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.727537:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.727542:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.727548:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.727553:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.727559:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.727567:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.727572:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.727577:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.727582:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.727586:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.727591:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.727595:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.727600:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.727605:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.727609:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.727620:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.727686:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.727692:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.727697:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.727701:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.727706:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.727711:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.727716:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.731303:0:17107:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff8d22047eae00:17107] 0 exiting: rc = 1 00000100:00100000:1.0:1787831168.731900:0:17108:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8d22047ea800:17108] 1 exiting: rc = 0 00000100:00100000:2.0:1787831168.732001:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831168.732010:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831168.732015:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831168.732024:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831168.732030:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831168.732036:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831168.732040:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831168.732045:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831168.732050:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831168.732055:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831168.732065:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831168.732070:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831168.732075:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831168.732080:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831168.732086:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831168.732091:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831168.732096:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831168.732102:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831168.732112:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831168.732118:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831168.732123:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831168.732128:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831168.732134:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831168.732152:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831168.732157:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831168.732162:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831168.732167:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831168.732173:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831168.732178:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831168.732183:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831168.732189:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831168.732195:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831168.732200:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831168.732205:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831168.732210:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831168.732215:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831168.732220:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831168.732225:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831168.732229:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831168.732234:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831168.732239:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831168.732244:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831168.732250:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831168.732256:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831168.732260:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831168.732265:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831168.732270:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831168.732274:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831168.732279:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831168.732284:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831168.732289:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831168.732436:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831168.732446:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831168.732450:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831168.732453:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831168.732456:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831168.732460:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831168.732463:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831168.732472:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831168.732475:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831168.732479:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831168.732482:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831168.732486:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831168.732489:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.735987:0:17110:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff8d22047eb800:17110] 1 exiting: rc = 0 00000100:00100000:1.0:1787831168.736177:0:19224:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff8d2305a40200:19224] 2 exiting: rc = 0 00000100:00100000:1.0:1787831168.736251:0:17109:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff8d22047ebe00:17109] 0 exiting: rc = 1 00000100:00100000:3.0:1787831168.736400:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.736407:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.736414:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.736419:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.736428:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.736434:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.736454:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.736462:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.736468:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.736475:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.736481:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.736488:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.736497:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.736503:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.736509:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.736515:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.736521:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.736528:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.736551:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.736558:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.736564:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.736571:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.736577:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.736583:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.736589:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.736594:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.736615:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.736621:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.736663:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.736669:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.736699:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.736707:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.736712:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.736719:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.736725:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.736732:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.736737:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.736743:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.736748:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.736753:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.736758:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.736764:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.736783:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.736790:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.736795:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.736802:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.736807:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.736905:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.736912:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.736925:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.736931:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.736937:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.736943:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.736948:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.736966:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.736972:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.736978:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.736984:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.736990:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.736995:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.737000:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.737012:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.737017:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.737024:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831168.749504:0:17112:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8d22047ea200:17112] 1 exiting: rc = 0 00000100:00100000:3.0:1787831168.751034:0:17111:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8d22047ea400:17111] 0 exiting: rc = 1 00000100:00100000:0.0:1787831168.751192:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.751199:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.751205:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.751210:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.751216:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.751220:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.751225:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.751230:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.751235:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.751239:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.751245:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.751250:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.751255:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.751260:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.751265:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.751281:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.751286:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.751291:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.751306:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.751311:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.751316:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.751321:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.751325:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.751330:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.751336:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.751340:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.751345:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.751350:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.751355:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.751360:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.751365:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.751369:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.751374:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.751379:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.751384:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.751389:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.751395:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.751400:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.751404:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.751409:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.751414:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.751418:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.751423:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.751428:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.751432:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.751437:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.751441:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.751446:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.751451:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.751456:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.751467:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.751472:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.751477:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.751481:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.751486:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.751490:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.751495:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.751500:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.751505:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.751510:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.751515:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.751519:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.751524:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.751529:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831168.752028:0:17114:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8d2314dce800:17114] 1 exiting: rc = 0 00000100:00100000:3.0:1787831168.752537:0:17113:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8d2314dce000:17113] 0 exiting: rc = 1 00000100:00100000:0.0:1787831168.752693:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.752700:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.752705:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.752711:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.752716:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.752722:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.752727:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.752731:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.752737:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.752742:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.752747:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.752752:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.752757:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.752762:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.752767:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.752772:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.752777:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.752781:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.752786:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.752791:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.752796:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.752811:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.753000:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.753005:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.753010:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.753014:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.753019:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.753024:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.753028:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.753033:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.753039:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.753043:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.753047:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.753052:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.753057:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.753063:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.753069:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.753074:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.753079:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.753084:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.753089:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.753094:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.753099:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.753105:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.753110:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.753115:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.753120:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.753125:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.753130:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.753135:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.753141:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.753146:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.753151:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.753156:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.753160:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.753164:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.753177:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.753182:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.753187:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.753192:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.753197:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.753202:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.753207:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.753212:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831168.753771:0:17116:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff8d2204528c00:17116] 1 exiting: rc = 0 00000100:00100000:3.0:1787831168.754180:0:17115:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff8d2204528a00:17115] 0 exiting: rc = 1 00000100:00100000:0.0:1787831168.754400:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.754407:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.754412:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.754417:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.754422:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.754428:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.754433:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.754438:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.754444:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.754449:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.754454:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.754458:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.754463:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.754467:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.754474:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.754479:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.754484:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.754489:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.754494:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.754499:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.754505:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.754509:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.754515:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.754519:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.754525:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.754530:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.754534:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.754547:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.754552:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.754557:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.754562:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.754567:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.754572:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.754577:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.754581:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.754586:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.754592:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.754596:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.754602:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.754607:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.754611:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.754616:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.754621:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.754654:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.754660:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.754664:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.754669:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.754683:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.754689:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.754694:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.754701:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.754706:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.754711:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.754716:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.754720:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.754725:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.754730:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.754735:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.754739:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.754744:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.754749:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.754754:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.754766:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831168.754772:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831168.755419:0:17117:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff8d23038a8600:17117] 0 exiting: rc = 1 00000100:00100000:1.0:1787831168.755736:0:17118:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff8d23038a8c00:17118] 1 exiting: rc = 0 00000100:00100000:0.0:1787831168.756047:0:17119:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff8d23038a9200:17119] 2 exiting: rc = 0 00000100:00100000:1.0:1787831168.756133:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831168.756139:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831168.756144:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831168.756151:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831168.756156:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831168.756162:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831168.756168:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831168.756174:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831168.756180:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831168.756185:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831168.756191:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831168.756196:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831168.756202:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831168.756207:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831168.756213:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831168.756218:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831168.756224:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831168.756228:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831168.756234:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831168.756251:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831168.756256:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831168.756262:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831168.756268:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831168.756287:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831168.756359:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831168.756368:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831168.756374:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831168.756379:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831168.756385:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831168.756390:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831168.756396:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831168.756402:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831168.756408:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831168.756414:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831168.756420:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831168.756427:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831168.756433:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831168.756438:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831168.756446:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831168.756452:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831168.756457:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831168.756463:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831168.756469:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831168.756474:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831168.756480:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831168.756485:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831168.756491:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831168.756512:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831168.756519:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831168.756524:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831168.756529:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831168.756535:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831168.756540:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831168.756545:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831168.756558:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831168.756564:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831168.756569:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831168.756575:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831168.756581:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831168.756586:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831168.756592:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831168.756597:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831168.756602:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831168.756608:0:21027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1787831168.762899:0:21027:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787831168.762912:0:21027:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1787831168.763250:0:21027:0:(genops.c:885:class_export_put()) final put ffff8d2321e17800/MDS_uuid 00000020:00000080:1.0:1787831168.763255:0:21027:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2321e17800/MDS_uuid for MDS 00000020:01000000:1.0:1787831168.763261:0:21027:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1787831168.763469:0:21027:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:2.0:1787831168.934825:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787831169.958987:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787831170.284158:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) be45932f-3bcb-4e49-b61c-a2395180b0ee->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787831170.284168:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) be45932f-3bcb-4e49-b61c-a2395180b0ee->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787831170.284171:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787831170.284175:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787831170.284179:0:37:0:(import.c:65:import_set_state_nolock()) ffff8d23073ef800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787831170.284187:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 456 00000100:00080000:2.0:1787831170.284193:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1787831170.284200:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8d23073ef800 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:2.0:1787831170.284236:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d232f61de00 x1874676443974272/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787831170.284293:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787831170.284296:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787831170.284298:0:37:0:(import.c:65:import_set_state_nolock()) ffff8d2202a7e000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787831170.284302:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 456 00000100:00080000:2.0:1787831170.284304:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1787831170.284308:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8d2202a7e000 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:2.0:1787831170.284320:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d232f61c780 x1874676443974528/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787831170.284375:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d232f61e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3619:1874676443974656:0@lo:400:kworker.0 00000400:00000100:2.0:1787831170.284423:0:3619:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874676443974656 offset 0 length 224: 4 00000100:00100000:2.0:1787831170.284481:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787831170.284489:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d232f61da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3621:1874676443974400:0@lo:400:kworker.0 00000400:00000100:2.0:1787831170.284510:0:3621:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874676443974400 offset 0 length 224: 4 00000100:00100000:3.0:1787831170.284811:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d232f61de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3618:1874676443974272:0@lo:38:kworker.0 00000400:00000100:3.0:1787831170.284836:0:3618:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874676443974272 offset 0 length 520: 4 00000100:00100000:3.0:1787831170.284850:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d232f61c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3618:1874676443974528:0@lo:38:kworker.0 00000400:00000100:3.0:1787831170.285040:0:3618:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874676443974528 offset 0 length 520: 4 00010000:00010000:2.0:1787831170.985415:0:18633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787831171.904998:0:21227:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1787831171.918943:0:21227:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1787831171.919016:0:21227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d2303aa3600/0x95459fb9d1d29c43 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d29c4a expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831171.919033:0:21227:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d2303aa3600/0x95459fb9d1d29c43 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d29c4a expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831171.919042:0:21227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d2303aa3600/0x95459fb9d1d29c43 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x95459fb9d1d29c4a expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831171.919049:0:21227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.131@tcp lock: ffff8d2303aa3600/0x95459fb9d1d29c43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x95459fb9d1d29c4a expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831171.919073:0:21227:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787831171.919078:0:21227:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:2.0:1787831171.919111:0:17092:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787831171.919118:0:17092:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8d2303aa3600/0x95459fb9d1d29c43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x95459fb9d1d29c4a expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787831171.919399:0:21227:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787831171.919416:0:21227:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d232f61de00 x1874676443974272/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787831195 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787831171.919435:0:21227:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1787831171.919443:0:21227:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787831171.919451:0:21227:0:(import.c:65:import_set_state_nolock()) ffff8d23073ef800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1787831171.919457:0:21227:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787831171.919461:0:21227:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d232f61de00 x1874676443974272/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787831195 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787831171.919469:0:21227:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787831171.919472:0:21227:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 32s for inflight to error out 00010000:00010000:2.0:1787831171.920582:0:17092:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2303aa3600 already unused, calling callback (ffffffffc14f9c20) 10000000:00010000:2.0:1787831171.920594:0:17092:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8d2303aa3600/0x95459fb9d1d29c43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x95459fb9d1d29c4a expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831171.920619:0:17092:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8d2303aa3600/0x95459fb9d1d29c43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x95459fb9d1d29c4a expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787831171.920640:0:17092:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8d2303aa3600/0x95459fb9d1d29c43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x95459fb9d1d29c4a expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787831171.920647:0:17092:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787831171.920649:0:17092:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1787831171.920661:0:17092:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1787831171.920680:0:17092:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d22045a8000 00010000:00010000:2.0:1787831171.920684:0:17092:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8d2303aa3600/0x95459fb9d1d29c43 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x95459fb9d1d29c4a expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831171.920691:0:17092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8d2303aa3600/0x95459fb9d1d29c43 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x95459fb9d1d29c4a expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831171.920708:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787831171.920710:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787831171.920712:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787831171.920766:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d232f61de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3618:1874676443974272:0@lo:38:kworker.0 00000100:00080000:1.0:1787831171.921891:0:21227:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787831171.921912:0:21227:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d232f61da40 x1874676443974400/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787831186 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787831171.921936:0:21227:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1787831171.921956:0:21227:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1787831171.921993:0:21227:0:(import.c:65:import_set_state_nolock()) ffff8d22034d4800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1787831171.923534:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d232f61da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3621:1874676443974400:0@lo:400:kworker.0 00000100:00100000:2.0:1787831171.923587:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203766d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3618:1874676443974784:0@lo:39:umount.0 00000400:00000100:2.0:1787831171.924050:0:3618:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874676443974784 offset 0 length 224: 4 00010000:00010000:0.0:1787831172.006904:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787831173.030862:0:18633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787831173.287256:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) be45932f-3bcb-4e49-b61c-a2395180b0ee->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787831173.287272:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) be45932f-3bcb-4e49-b61c-a2395180b0ee->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787831173.287276:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787831173.287279:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787831173.287597:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787831173.287663:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220483d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3619:1874676443974912:0@lo:400:kworker.0 00000400:00000100:1.0:1787831173.287754:0:3619:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874676443974912 offset 0 length 224: 4 00000001:00100000:3.0:1787831173.865836:0:18604:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787831173.865846:0:18604:0:(genops.c:885:class_export_put()) final put ffff8d22025c3800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1787831173.866040:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d22025c3800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1787831173.866426:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d22025c1000 for lustre-OST0000 00000001:00100000:2.0:1787831173.869535:0:19422:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1787831173.869546:0:19422:0:(genops.c:885:class_export_put()) final put ffff8d2203b27800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1787831173.870067:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2203b27800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1787831173.870233:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d2203b24000 for lustre-OST0001 00010000:00010000:2.0:1787831174.054852:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787831175.079251:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787831175.337064:0:478:0:(pinger.c:229:ptlrpc_pinger_process_import()) be45932f-3bcb-4e49-b61c-a2395180b0ee->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787831175.337080:0:478:0:(pinger.c:247:ptlrpc_pinger_process_import()) be45932f-3bcb-4e49-b61c-a2395180b0ee->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787831175.337083:0:478:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787831175.337086:0:478:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787831175.337824:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220483d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3621:1874676443975040:0@lo:400:kworker.0 00000400:00000100:2.0:1787831175.337902:0:3621:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874676443975040 offset 0 length 224: 4 00010000:00010000:2.0:1787831176.102793:0:18633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787831177.126822:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787831178.022752:0:3618:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787831168/real 1787831168] req@ffff8d233faeb480 x1874676443974144/t0(0) o250->MGC192.168.203.131@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787831178 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787831178.022785:0:3618:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d233faeb480 x1874676443974144/t0(0) o250->MGC192.168.203.131@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787831178 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787831178.022804:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8d22045a8000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787831178.022834:0:3618:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1787831178.022839:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233faeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:be45932f-3bcb-4e49-b61c-a2395180b0ee:3618:1874676443974144:0@lo:250:ptlrpcd_00_01.0 00000100:00080000:3.0:1787831178.022931:0:478:0:(pinger.c:229:ptlrpc_pinger_process_import()) be45932f-3bcb-4e49-b61c-a2395180b0ee->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787831178.022937:0:478:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1787831178.022956:0:478:0:(import.c:65:import_set_state_nolock()) ffff8d22045a8000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787831178.022961:0:478:0:(import.c:510:import_select_connection()) MGC192.168.203.131@tcp: connect to NID 0@lo last attempt 459 00000100:00080000:3.0:1787831178.022967:0:478:0:(import.c:589:import_select_connection()) MGC192.168.203.131@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787831178.022973:0:478:0:(import.c:624:import_select_connection()) MGC192.168.203.131@tcp: import ffff8d22045a8000 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:3.0:1787831178.023001:0:478:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d220483ed00 x1874676443975168/t0(0) o250->MGC192.168.203.131@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787831178.023026:0:478:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787831178.023029:0:478:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787831178.023139:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220483cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3622:1874676443975296:0@lo:400:kworker.0 00000400:00000100:0.0:1787831178.023186:0:3622:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874676443975296 offset 0 length 224: 4 00000100:00100000:2.0:1787831178.023486:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220483ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:be45932f-3bcb-4e49-b61c-a2395180b0ee:3618:1874676443975168:0@lo:250:kworker.0 00000400:00000100:2.0:1787831178.023510:0:3618:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874676443975168 offset 0 length 520: 4 00010000:00010000:0.0:1787831178.151248:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787831179.174797:0:18633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787831180.200739:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787831181.095727:0:3618:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787831171/real 1787831171] req@ffff8d2203766d00 x1874676443974784/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787831181 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787831181.095773:0:3618:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d2203766d00 x1874676443974784/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787831181 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787831181.095793:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8d22034d4800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1787831181.095812:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203766d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3618:1874676443974784:0@lo:39:umount.0 00000100:00080000:1.0:1787831181.095896:0:21227:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787831181.095901:0:21227:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787831181.095906:0:21227:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1787831181.096790:0:21227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d22039c1600/0x95459fb9d1d29c19 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d29c20 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831181.096802:0:21227:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d22039c1600/0x95459fb9d1d29c19 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d29c20 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831181.096809:0:21227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d22039c1600/0x95459fb9d1d29c19 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x95459fb9d1d29c20 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831181.096815:0:21227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.131@tcp lock: ffff8d22039c1600/0x95459fb9d1d29c19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x95459fb9d1d29c20 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831181.096838:0:21227:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787831181.096846:0:21227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d23344b6200/0x95459fb9d1d29f6f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d29f76 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831181.096853:0:21227:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d23344b6200/0x95459fb9d1d29f6f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d29f76 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831181.096859:0:21227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d23344b6200/0x95459fb9d1d29f6f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x95459fb9d1d29f76 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831181.096887:0:21227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.131@tcp lock: ffff8d23344b6200/0x95459fb9d1d29f6f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x95459fb9d1d29f76 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831181.096909:0:21227:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1787831181.096915:0:21227:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00010000:00010000:0.0:1787831181.096915:0:17093:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787831181.096930:0:17093:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8d22039c1600/0x95459fb9d1d29c19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x95459fb9d1d29c20 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831181.096943:0:17093:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22039c1600 already unused, calling callback (ffffffffc14f9c20) 00000020:01000004:1.0:1787831181.096946:0:21227:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 10000000:00010000:0.0:1787831181.096949:0:17093:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8d22039c1600/0x95459fb9d1d29c19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x95459fb9d1d29c20 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000000:1.0:1787831181.096952:0:21227:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1787831181.096961:0:21227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00010000:00010000:0.0:1787831181.096967:0:17093:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8d22039c1600/0x95459fb9d1d29c19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x95459fb9d1d29c20 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1787831181.096968:0:21227:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787831181.096976:0:21227:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff8d2306c68000) has no exports 10000000:00010000:0.0:1787831181.096997:0:17093:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8d22039c1600/0x95459fb9d1d29c19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x95459fb9d1d29c20 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1787831181.097001:0:21227:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff8d2306c68000) has no exports 10000000:01000000:0.0:1787831181.097009:0:17093:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787831181.097013:0:17093:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:0.0:1787831181.097016:0:17093:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:0.0:1787831181.097060:0:17093:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d22045a8000 00010000:00010000:0.0:1787831181.097064:0:17093:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8d22039c1600/0x95459fb9d1d29c19 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x95459fb9d1d29c20 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831181.097072:0:17093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8d22039c1600/0x95459fb9d1d29c19 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x95459fb9d1d29c20 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831181.097091:0:17093:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787831181.097094:0:17093:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8d23344b6200/0x95459fb9d1d29f6f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x95459fb9d1d29f76 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831181.097100:0:17093:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d23344b6200 already unused, calling callback (ffffffffc14f9c20) 10000000:00010000:0.0:1787831181.097103:0:17093:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8d23344b6200/0x95459fb9d1d29f6f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x95459fb9d1d29f76 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831181.097110:0:17093:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8d23344b6200/0x95459fb9d1d29f6f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x95459fb9d1d29f76 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787831181.097117:0:17093:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8d23344b6200/0x95459fb9d1d29f6f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x95459fb9d1d29f76 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787831181.097122:0:17093:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1787831181.097124:0:17093:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1787831181.097127:0:17093:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1787831181.097132:0:17093:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d22045a8000 00010000:00010000:0.0:1787831181.097135:0:17093:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8d23344b6200/0x95459fb9d1d29f6f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x95459fb9d1d29f76 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831181.097141:0:17093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8d23344b6200/0x95459fb9d1d29f6f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x95459fb9d1d29f76 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831181.097162:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787831181.097164:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787831181.097166:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1787831181.098674:0:21227:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d233bcf1900 - data ffff8d2330a79af8/ffff8d2306ca4400 00000020:01000000:1.0:1787831181.098788:0:21227:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d233bc60000 - data ffff8d231229dca8/ffff8d220487f400 00010000:00010000:2.0:1787831181.099999:0:18633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:1.0:1787831181.114195:0:21227:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1787831181.121775:0:21227:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x95459fb9d1d29c2e 00000020:00000080:0.0:1787831181.121791:0:21227:0:(genops.c:885:class_export_put()) final put ffff8d2201d09800/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1787831181.121811:0:21227:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d2202768800 from lustre-OST0000, refs=2 00000020:01000004:0.0:1787831181.121816:0:21227:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d2202768800 2 00000020:01000004:0.0:1787831181.121820:0:21227:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8d2202768800 from lustre-OST0000 00000020:00000080:3.0:1787831181.121848:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2201d09800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1787831181.121854:0:21227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787831181.121868:0:21227:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1787831181.121872:0:21227:0:(genops.c:885:class_export_put()) final put ffff8d2201d0d000/lustre-OST0000_UUID 00000020:00000080:0.0:1787831181.121876:0:21227:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2201d0d000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1787831181.121886:0:21227:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1787831181.122194:0:21227:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1787831181.122205:0:21227:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1787831181.122209:0:21227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787831181.122216:0:21227:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787831181.122223:0:21227:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8d2201d9c000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787831181.122229:0:21227:0:(genops.c:1553:class_disconnect_exports()) OBD device 23 (ffff8d23088a19b8) has exports, disconnecting them 00000020:00080000:0.0:1787831181.122236:0:21227:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8d2201d9c000), last request at 1787831105 00000020:00000080:0.0:1787831181.122240:0:21227:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x95459fb9d1d29c58 00000020:00080000:0.0:1787831181.122251:0:21227:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d2201d9c000): rc 0 00000020:00000080:0.0:1787831181.122256:0:21227:0:(genops.c:885:class_export_put()) final put ffff8d2201d9c000/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1787831181.122331:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2201d9c000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1787831181.134481:0:21227:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1787831181.134489:0:21227:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787831181.134504:0:21227:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787831181.134511:0:21227:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787831181.134715:0:21227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787831181.134724:0:21227:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:2.0:1787831181.134731:0:21227:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1787831181.134736:0:21227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787831181.134740:0:21227:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787831181.134747:0:21227:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff8d22034d7000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787831181.134754:0:21227:0:(genops.c:1553:class_disconnect_exports()) OBD device 24 (ffff8d23344a19b8) has exports, disconnecting them 00000020:00080000:2.0:1787831181.134758:0:21227:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff8d22034d7000), last request at 1787831105 00000020:00000080:2.0:1787831181.134763:0:21227:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x95459fb9d1d29c6d 00000020:00080000:2.0:1787831181.134779:0:21227:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d22034d7000): rc 0 00000020:00000080:2.0:1787831181.134785:0:21227:0:(genops.c:885:class_export_put()) final put ffff8d22034d7000/lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1787831181.134963:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d23073ef800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1787831181.134978:0:37:0:(genops.c:885:class_export_put()) final put ffff8d2203601000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1787831181.134983:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2203601000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1787831181.134993:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1787831181.135083:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d22034d7000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:3.0:1787831181.135991:0:21227:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:3.0:1787831181.136005:0:21227:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1787831181.136010:0:21227:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1787831181.136017:0:21227:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787831181.136059:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d22034d4800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1787831181.136379:0:21227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787831181.136390:0:21227:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:3.0:1787831181.136394:0:21227:0:(genops.c:885:class_export_put()) final put ffff8d22034d7800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:3.0:1787831181.136401:0:21227:0:(genops.c:844:class_export_destroy()) destroying export ffff8d22034d7800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:3.0:1787831181.136406:0:21227:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:3.0:1787831181.136465:0:21227:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d2202768800 1 00000020:00000080:3.0:1787831181.136486:0:21227:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x95459fb9d1d29c0b 00000020:00000080:3.0:1787831181.136493:0:21227:0:(genops.c:885:class_export_put()) final put ffff8d233f427800/lustre-OST0000-osd_UUID 00000020:01000000:3.0:1787831181.136507:0:21227:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1787831181.136518:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d233f427800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1787831181.136526:0:21227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787831181.136535:0:21227:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787831181.136539:0:21227:0:(genops.c:1558:class_disconnect_exports()) OBD device 20 (ffff8d233454b370) has no exports 00000020:00000080:2.0:1787831181.187751:0:21227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787831181.187772:0:21227:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1787831181.187779:0:21227:0:(genops.c:885:class_export_put()) final put ffff8d220276b800/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1787831181.187785:0:21227:0:(genops.c:844:class_export_destroy()) destroying export ffff8d220276b800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1787831181.187802:0:21227:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1787831181.188123:0:21227:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8d220276f000 00000020:02000400:2.0:1787831181.188241:0:21227:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:2.0:1787831181.228420:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787831182.250967:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787831183.081572:0:478:0:(pinger.c:229:ptlrpc_pinger_process_import()) be45932f-3bcb-4e49-b61c-a2395180b0ee->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787831183.081588:0:478:0:(pinger.c:247:ptlrpc_pinger_process_import()) be45932f-3bcb-4e49-b61c-a2395180b0ee->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787831183.081592:0:478:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787831183.081595:0:478:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787831183.081679:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22037661c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3619:1874676443975424:0@lo:400:kworker.0 00000400:00000100:1.0:1787831183.081729:0:3619:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874676443975424 offset 0 length 224: 4 00010000:00010000:2.0:1787831183.271240:0:18633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787831184.297834:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787831185.324589:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787831185.328145:0:21430:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1787831185.342010:0:21430:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1787831185.342099:0:21430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233bf10a00/0x95459fb9d1d29da1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d29da8 expref: -99 pid: 19421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831185.342132:0:21430:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233bf10a00/0x95459fb9d1d29da1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d29da8 expref: -99 pid: 19421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831185.342139:0:21430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233bf10a00/0x95459fb9d1d29da1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x95459fb9d1d29da8 expref: -99 pid: 19421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831185.342145:0:21430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.131@tcp lock: ffff8d233bf10a00/0x95459fb9d1d29da1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x95459fb9d1d29da8 expref: -99 pid: 19421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831185.342225:0:21430:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787831185.342231:0:21430:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1787831185.342256:0:21430:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787831185.342266:0:21430:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d232f61c780 x1874676443974528/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787831195 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787831185.342292:0:21430:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787831185.342298:0:21430:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787831185.342304:0:21430:0:(import.c:65:import_set_state_nolock()) ffff8d2202a7e000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1787831185.342308:0:21430:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787831185.342311:0:21430:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d232f61c780 x1874676443974528/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787831195 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787831185.342318:0:21430:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787831185.342321:0:21430:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 13s for inflight to error out 00000100:00100000:1.0:1787831185.342389:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d232f61c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3618:1874676443974528:0@lo:38:kworker.0 00000100:00080000:0.0:1787831185.343434:0:21430:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1787831185.343444:0:21430:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d232f61e940 x1874676443974656/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787831186 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787831185.343457:0:21430:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d220483d680 x1874676443974912/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787831189 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787831185.343478:0:21430:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d220483d2c0 x1874676443975040/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787831191 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787831185.343655:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220483d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3619:1874676443974912:0@lo:400:kworker.0 00000100:00100000:0.0:1787831185.343694:0:21430:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d220483cf00 x1874676443975296/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787831194 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787831185.343708:0:21430:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d22037661c0 x1874676443975424/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787831199 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787831185.343715:0:21430:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00100000:0.0:1787831185.343739:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220483cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3622:1874676443975296:0@lo:400:kworker.0 00010000:00010000:2.0:1787831185.347639:0:18633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787831185.347653:0:18633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8d233bf10a00/0x95459fb9d1d29da1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x95459fb9d1d29da8 expref: -99 pid: 19421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831185.347664:0:18633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233bf10a00 already unused, calling callback (ffffffffc14f9c20) 10000000:00010000:2.0:1787831185.347669:0:18633:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8d233bf10a00/0x95459fb9d1d29da1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x95459fb9d1d29da8 expref: -99 pid: 19421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831185.347700:0:18633:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8d233bf10a00/0x95459fb9d1d29da1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x95459fb9d1d29da8 expref: -99 pid: 19421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787831185.347708:0:18633:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8d233bf10a00/0x95459fb9d1d29da1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x95459fb9d1d29da8 expref: -99 pid: 19421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787831185.347713:0:18633:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787831185.347716:0:18633:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1787831185.347719:0:18633:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1787831185.347735:0:18633:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d22045a8000 00010000:00010000:2.0:1787831185.347739:0:18633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8d233bf10a00/0x95459fb9d1d29da1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x95459fb9d1d29da8 expref: -99 pid: 19421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831185.347745:0:18633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8d233bf10a00/0x95459fb9d1d29da1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x95459fb9d1d29da8 expref: -99 pid: 19421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831185.347760:0:18633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787831185.347762:0:18633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787831185.347764:0:18633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787831185.347962:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220483d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3621:1874676443975040:0@lo:400:kworker.0 00000100:00100000:1.0:1787831185.348022:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d232f61e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3619:1874676443974656:0@lo:400:kworker.0 00000100:00100000:1.0:1787831185.348060:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22037661c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3619:1874676443975424:0@lo:400:kworker.0 00000100:00080000:0.0:1787831185.348783:0:21430:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1787831185.348812:0:21430:0:(import.c:65:import_set_state_nolock()) ffff8d2203b25000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1787831185.348890:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233faeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3618:1874676443975552:0@lo:39:umount.0 00000400:00000100:1.0:1787831185.348936:0:3618:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874676443975552 offset 0 length 224: 4 00010000:00010000:2.0:1787831186.342786:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787831187.371254:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787831188.199050:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) be45932f-3bcb-4e49-b61c-a2395180b0ee->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787831188.199057:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) be45932f-3bcb-4e49-b61c-a2395180b0ee->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1787831188.390784:0:18633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787831189.414801:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787831190.443810:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787831191.463055:0:18633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787831192.486830:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787831193.323297:0:478:0:(pinger.c:229:ptlrpc_pinger_process_import()) be45932f-3bcb-4e49-b61c-a2395180b0ee->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787831193.323310:0:478:0:(pinger.c:247:ptlrpc_pinger_process_import()) be45932f-3bcb-4e49-b61c-a2395180b0ee->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:3.0:1787831193.511197:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787831193.575314:0:3618:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787831178/real 1787831178] req@ffff8d220483ed00 x1874676443975168/t0(0) o250->MGC192.168.203.131@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787831193 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787831193.575358:0:3618:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d220483ed00 x1874676443975168/t0(0) o250->MGC192.168.203.131@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787831193 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787831193.575385:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8d22045a8000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787831193.575805:0:3618:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1787831193.575812:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220483ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:be45932f-3bcb-4e49-b61c-a2395180b0ee:3618:1874676443975168:0@lo:250:kworker.0 00000100:00080000:2.0:1787831193.575924:0:478:0:(pinger.c:229:ptlrpc_pinger_process_import()) be45932f-3bcb-4e49-b61c-a2395180b0ee->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787831193.575929:0:478:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1787831193.575955:0:478:0:(import.c:65:import_set_state_nolock()) ffff8d22045a8000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787831193.575960:0:478:0:(import.c:510:import_select_connection()) MGC192.168.203.131@tcp: connect to NID 0@lo last attempt 469 00000100:00080000:2.0:1787831193.575966:0:478:0:(import.c:589:import_select_connection()) MGC192.168.203.131@tcp: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787831193.575985:0:478:0:(import.c:624:import_select_connection()) MGC192.168.203.131@tcp: import ffff8d22045a8000 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:2.0:1787831193.576021:0:478:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d232f61da40 x1874676443975680/t0(0) o250->MGC192.168.203.131@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787831193.576191:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d232f61da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:be45932f-3bcb-4e49-b61c-a2395180b0ee:3618:1874676443975680:0@lo:250:kworker.0 00000400:00000100:1.0:1787831193.576249:0:3618:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874676443975680 offset 0 length 520: 4 00010000:00010000:2.0:1787831194.534782:0:18633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787831195.558768:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787831195.622755:0:3618:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787831185/real 1787831185] req@ffff8d233faeb480 x1874676443975552/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787831195 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787831195.622786:0:3618:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d233faeb480 x1874676443975552/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787831195 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787831195.622805:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8d2203b25000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1787831195.622824:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233faeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3618:1874676443975552:0@lo:39:umount.0 00000100:00080000:0.0:1787831195.623016:0:21430:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1787831195.623020:0:21430:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787831195.623026:0:21430:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1787831195.627217:0:21430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233bf10000/0x95459fb9d1d29d77 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d29d7e expref: -99 pid: 19421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831195.627235:0:21430:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233bf10000/0x95459fb9d1d29d77 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d29d7e expref: -99 pid: 19421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831195.627243:0:21430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233bf10000/0x95459fb9d1d29d77 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x95459fb9d1d29d7e expref: -99 pid: 19421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831195.627249:0:21430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.131@tcp lock: ffff8d233bf10000/0x95459fb9d1d29d77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x95459fb9d1d29d7e expref: -99 pid: 19421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831195.627351:0:21430:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787831195.627360:0:21430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d23344b7a00/0x95459fb9d1d29f61 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d29f68 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831195.627367:0:21430:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d23344b7a00/0x95459fb9d1d29f61 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d29f68 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831195.627373:0:21430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d23344b7a00/0x95459fb9d1d29f61 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x95459fb9d1d29f68 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831195.627379:0:21430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.131@tcp lock: ffff8d23344b7a00/0x95459fb9d1d29f61 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x95459fb9d1d29f68 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831195.628621:0:17093:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787831195.628643:0:17093:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8d233bf10000/0x95459fb9d1d29d77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x95459fb9d1d29d7e expref: -99 pid: 19421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831195.628654:0:17093:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233bf10000 already unused, calling callback (ffffffffc14f9c20) 10000000:00010000:3.0:1787831195.628659:0:17093:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8d233bf10000/0x95459fb9d1d29d77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x95459fb9d1d29d7e expref: -99 pid: 19421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831195.628678:0:21430:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787831195.628686:0:21430:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00010000:00010000:2.0:1787831195.628713:0:18633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787831195.628720:0:18633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8d23344b7a00/0x95459fb9d1d29f61 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x95459fb9d1d29f68 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831195.628726:0:18633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d23344b7a00 already unused, calling callback (ffffffffc14f9c20) 10000000:00010000:2.0:1787831195.628730:0:18633:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8d23344b7a00/0x95459fb9d1d29f61 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x95459fb9d1d29f68 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831195.628738:0:18633:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8d23344b7a00/0x95459fb9d1d29f61 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x95459fb9d1d29f68 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787831195.628746:0:18633:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8d23344b7a00/0x95459fb9d1d29f61 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x95459fb9d1d29f68 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787831195.628751:0:18633:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1787831195.628754:0:18633:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1787831195.628756:0:18633:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1787831195.628770:0:18633:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d22045a8000 00010000:00010000:2.0:1787831195.628774:0:18633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8d23344b7a00/0x95459fb9d1d29f61 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x95459fb9d1d29f68 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831195.628780:0:18633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8d23344b7a00/0x95459fb9d1d29f61 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x95459fb9d1d29f68 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831195.628810:0:18633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787831195.628812:0:18633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787831195.628814:0:18633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787831195.628842:0:21430:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1787831195.628847:0:21430:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:0.0:1787831195.628852:0:21430:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787831195.628858:0:21430:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787831195.628863:0:21430:0:(genops.c:1558:class_disconnect_exports()) OBD device 26 (ffff8d2334548000) has no exports 00000020:00080000:0.0:1787831195.628888:0:21430:0:(genops.c:1558:class_disconnect_exports()) OBD device 26 (ffff8d2334548000) has no exports 00010000:00010000:3.0:1787831195.631091:0:17093:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8d233bf10000/0x95459fb9d1d29d77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x95459fb9d1d29d7e expref: -99 pid: 19421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787831195.631109:0:17093:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8d233bf10000/0x95459fb9d1d29d77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x95459fb9d1d29d7e expref: -99 pid: 19421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787831195.631116:0:17093:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787831195.631119:0:17093:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:3.0:1787831195.631122:0:17093:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:3.0:1787831195.631137:0:17093:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d22045a8000 00010000:00010000:3.0:1787831195.631142:0:17093:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8d233bf10000/0x95459fb9d1d29d77 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x95459fb9d1d29d7e expref: -99 pid: 19421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831195.631163:0:17093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8d233bf10000/0x95459fb9d1d29d77 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x95459fb9d1d29d7e expref: -99 pid: 19421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831195.631180:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787831195.631182:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787831195.631185:0:17093:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1787831195.632787:0:21430:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d23063a9a20 - data ffff8d2312274870/ffff8d232b2c9c00 00000020:01000000:0.0:1787831195.632920:0:21430:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d233bcf1f60 - data ffff8d233096da20/ffff8d2305a8e000 00100000:10000000:0.0:1787831195.641086:0:21430:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1787831195.664144:0:21430:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x95459fb9d1d29d8c 00000020:00000080:1.0:1787831195.664156:0:21430:0:(genops.c:885:class_export_put()) final put ffff8d2201d9b000/lustre-OST0001-osd_UUID 00000020:01000004:1.0:1787831195.664181:0:21430:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d2204708800 from lustre-OST0001, refs=2 00000020:01000004:1.0:1787831195.664184:0:21430:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d2204708800 2 00000020:01000004:1.0:1787831195.664187:0:21430:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8d2204708800 from lustre-OST0001 00000020:00000080:1.0:1787831195.664227:0:21430:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787831195.664236:0:21430:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:1.0:1787831195.664239:0:21430:0:(genops.c:885:class_export_put()) final put ffff8d2201d99000/lustre-OST0001_UUID 00000020:00000080:1.0:1787831195.664242:0:21430:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2201d99000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:1.0:1787831195.664249:0:21430:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:1.0:1787831195.664385:0:21430:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import be45932f-3bcb-4e49-b61c-a2395180b0ee->MGS 00010000:00010000:1.0:1787831195.664400:0:21430:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8d23344b7000/0x95459fb9d1d29ad7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x95459fb9d1d29ade expref: -99 pid: 17834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787831195.664413:0:21430:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8d23344b7000/0x95459fb9d1d29ad7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x95459fb9d1d29ade expref: -99 pid: 17834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787831195.664431:0:21430:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:1.0:1787831195.664434:0:21430:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:1.0:1787831195.664437:0:21430:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:1.0:1787831195.664451:0:21430:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d22045a8000 00010000:00010000:1.0:1787831195.664455:0:21430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8d23344b7000/0x95459fb9d1d29ad7 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x95459fb9d1d29ade expref: -99 pid: 17834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831195.664471:0:21430:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8d23344b7200/0x95459fb9d1d299c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x95459fb9d1d299cd expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787831195.664479:0:21430:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8d23344b7200/0x95459fb9d1d299c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x95459fb9d1d299cd expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787831195.664485:0:21430:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787831195.664498:0:21430:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:1.0:1787831195.664500:0:21430:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:1.0:1787831195.664509:0:21430:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d22045a8000 00010000:00010000:1.0:1787831195.664512:0:21430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8d23344b7200/0x95459fb9d1d299c6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x95459fb9d1d299cd expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787831195.664557:0:21430:0:(import.c:65:import_set_state_nolock()) ffff8d22045a8000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:1.0:1787831195.664561:0:21430:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1787831195.664563:0:21430:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1787831195.664565:0:21430:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1787831195.664568:0:21430:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1787831195.664578:0:21430:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d232f61da40 x1874676443975680/t0(0) o250->MGC192.168.203.131@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1787831213 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1787831195.664592:0:21430:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1787831195.664595:0:21430:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 24s for inflight to error out 00000100:00100000:1.0:1787831195.664646:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d232f61da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:be45932f-3bcb-4e49-b61c-a2395180b0ee:3618:1874676443975680:0@lo:250:kworker.0 10000000:01000000:1.0:1787831195.664671:0:21430:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1787831195.664677:0:21430:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x95459fb9d1d299b1 00000020:00000080:1.0:1787831195.664682:0:21430:0:(genops.c:885:class_export_put()) final put ffff8d2321e14000/be45932f-3bcb-4e49-b61c-a2395180b0ee 00000020:01000000:1.0:1787831195.664687:0:21430:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.131@tcp (flags='') 00000020:00000080:1.0:1787831195.664691:0:21430:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787831195.664695:0:21430:0:(obd_config.c:956:class_cleanup()) MGC192.168.203.131@tcp: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787831195.664698:0:21430:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff8d2201e1cd28) has no exports 10000000:01000000:1.0:1787831195.664716:0:17102:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:1.0:1787831195.664758:0:21430:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.203.131@tcp: client import never connected 00000100:00080000:1.0:1787831195.664760:0:21430:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1787831195.664762:0:21430:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1787831195.664764:0:21430:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1787831195.664766:0:21430:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1787831195.664794:0:21430:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787831195.664798:0:21430:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.131@tcp (uuid be45932f-3bcb-4e49-b61c-a2395180b0ee) 00000020:01000000:1.0:1787831195.664802:0:21430:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1787831195.664805:0:21430:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787831195.664814:0:21430:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787831195.664819:0:21430:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8d2202a7d800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787831195.664824:0:21430:0:(genops.c:1553:class_disconnect_exports()) OBD device 27 (ffff8d2202a719b8) has exports, disconnecting them 00000020:00080000:1.0:1787831195.664834:0:21430:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8d2202a7d800), last request at 1787831116 00000020:00000080:1.0:1787831195.664838:0:21430:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x95459fb9d1d29db6 00000020:00080000:1.0:1787831195.664847:0:21430:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d2202a7d800): rc 0 00000020:00000080:1.0:1787831195.664851:0:21430:0:(genops.c:885:class_export_put()) final put ffff8d2202a7d800/lustre-MDT0000-lwp-OST0001 00010000:01000000:3.0:1787831195.667722:0:21430:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:3.0:1787831195.667729:0:21430:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787831195.667733:0:21430:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1787831195.667740:0:21430:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787831195.667891:0:21430:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787831195.667900:0:21430:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:3.0:1787831195.667905:0:21430:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1787831195.667910:0:21430:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787831195.667914:0:21430:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787831195.667922:0:21430:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff8d2203b20800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787831195.667928:0:21430:0:(genops.c:1553:class_disconnect_exports()) OBD device 28 (ffff8d2306c6b370) has exports, disconnecting them 00000020:00080000:3.0:1787831195.667932:0:21430:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff8d2203b20800), last request at 1787831116 00000020:00000080:3.0:1787831195.667935:0:21430:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x95459fb9d1d29dcb 00000020:00080000:3.0:1787831195.667949:0:21430:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d2203b20800): rc 0 00000020:00000080:3.0:1787831195.667955:0:21430:0:(genops.c:885:class_export_put()) final put ffff8d2203b20800/lustre-MDT0001-lwp-OST0001 00000020:00000080:2.0:1787831195.669540:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2201d9b000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1787831195.669561:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2321e14000/be45932f-3bcb-4e49-b61c-a2395180b0ee for MGC192.168.203.131@tcp 00000020:00000080:2.0:1787831195.669567:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d22045a8000 for MGC192.168.203.131@tcp 00000020:00000080:2.0:1787831195.669574:0:37:0:(genops.c:885:class_export_put()) final put ffff8d22045ac000/be45932f-3bcb-4e49-b61c-a2395180b0ee 00000020:00000080:2.0:1787831195.669577:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d22045ac000/be45932f-3bcb-4e49-b61c-a2395180b0ee for MGC192.168.203.131@tcp 00000020:01000000:2.0:1787831195.669581:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.131@tcp (be45932f-3bcb-4e49-b61c-a2395180b0ee) 00000020:00000080:2.0:1787831195.669881:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2202a7d800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1787831195.669888:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d2202a7e000 for lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1787831195.669893:0:37:0:(genops.c:885:class_export_put()) final put ffff8d22034d5800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:2.0:1787831195.669895:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d22034d5800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:2.0:1787831195.669898:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:2.0:1787831195.669930:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2203b20800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:2.0:1787831195.669957:0:21430:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:2.0:1787831195.669961:0:21430:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787831195.669964:0:21430:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787831195.669969:0:21430:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787831195.669989:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d2203b25000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:2.0:1787831195.670026:0:17092:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:2.0:1787831195.670116:0:18633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:2.0:1787831195.670186:0:17093:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:2.0:1787831195.670275:0:17088:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff8d2201e01400:17088] 1 exiting: rc = 0 00000100:00100000:2.0:1787831195.670344:0:17087:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff8d2201e01c00:17087] 0 exiting: rc = 1 00000100:00100000:2.0:1787831195.670402:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831195.671155:0:17089:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff8d2321934e00:17089] 0 exiting: rc = 1 00000100:00100000:2.0:1787831195.671237:0:17090:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff8d233bf2a200:17090] 1 exiting: rc = 0 00000100:00100000:2.0:1787831195.671309:0:20128:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff8d2202679600:20128] 3 exiting: rc = 0 00000100:00100000:2.0:1787831195.671375:0:17091:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8d22039c5c00:17091] 2 exiting: rc = 0 00000100:00100000:2.0:1787831195.672545:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831195.672554:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831195.672571:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831195.672579:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831195.672586:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831195.672596:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831195.672605:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831195.672612:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831195.672618:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831195.672645:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831195.672656:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831195.672666:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831195.672674:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831195.672687:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831195.672694:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831195.672772:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831195.672780:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831195.672787:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831195.672792:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831195.672797:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831195.672803:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831195.672808:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831195.672814:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831195.672820:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831195.672826:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831195.672832:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831195.672838:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831195.672844:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831195.672849:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831195.672855:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831195.672869:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831195.672873:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831195.672878:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831195.672882:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831195.672887:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831195.672892:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831195.672897:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831195.672902:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831195.672907:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831195.672912:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831195.672917:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831195.672922:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831195.672928:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831195.672934:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831195.672939:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831195.674040:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831195.674049:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831195.674054:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831195.675407:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831195.675483:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831195.675497:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831195.675502:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831195.675507:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831195.675512:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831195.675516:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831195.675521:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831195.675525:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831195.675530:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831195.675535:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831195.675540:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831195.675545:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831195.675622:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831195.675643:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831195.675648:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1787831195.677658:0:21430:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787831195.677683:0:21430:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:2.0:1787831195.677689:0:21430:0:(genops.c:885:class_export_put()) final put ffff8d2203b21800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:2.0:1787831195.677698:0:21430:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2203b21800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:2.0:1787831195.677707:0:21430:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:2.0:1787831195.677777:0:21430:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d2204708800 1 00000020:00000080:2.0:1787831195.677783:0:21430:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x95459fb9d1d29d70 00000020:00000080:2.0:1787831195.677790:0:21430:0:(genops.c:885:class_export_put()) final put ffff8d2201d0e000/lustre-OST0001-osd_UUID 00000020:01000000:2.0:1787831195.677800:0:21430:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:2.0:1787831195.677818:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2201d0e000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1787831195.677830:0:21430:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787831195.677835:0:21430:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787831195.677838:0:21430:0:(genops.c:1558:class_disconnect_exports()) OBD device 25 (ffff8d23088a4d28) has no exports 00000020:00000080:0.0:1787831195.702831:0:21430:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787831195.702843:0:21430:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1787831195.702849:0:21430:0:(genops.c:885:class_export_put()) final put ffff8d220470e000/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1787831195.702854:0:21430:0:(genops.c:844:class_export_destroy()) destroying export ffff8d220470e000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1787831195.702864:0:21430:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1787831195.703157:0:21430:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8d220470b000 00000020:01000000:0.0:1787831195.703175:0:21430:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1787831195.703178:0:21430:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787831195.703182:0:21430:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787831195.703186:0:21430:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff8d2306c699b8) has no exports 00000020:00000080:0.0:1787831195.703213:0:21430:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787831195.703217:0:21430:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1787831195.703219:0:21430:0:(genops.c:885:class_export_put()) final put ffff8d233f421000/OSS_uuid 00000020:00000080:0.0:1787831195.703222:0:21430:0:(genops.c:844:class_export_destroy()) destroying export ffff8d233f421000/OSS_uuid for OSS 00000020:01000000:0.0:1787831195.703225:0:21430:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:2.0:1787831195.703305:0:17099:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1787831195.703602:0:18609:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff8d2305a64400:18609] 1 exiting: rc = 0 00000100:00100000:3.0:1787831195.703673:0:18608:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff8d2203506800:18608] 0 exiting: rc = 1 00000100:00100000:0.0:1787831195.703760:0:18610:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff8d2321947800:18610] 2 exiting: rc = 0 00000100:00100000:2.0:1787831195.704356:0:19566:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff8d230581a000:19566] 4 exiting: rc = 0 00000100:00100000:1.0:1787831195.704706:0:18914:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff8d2202764600:18914] 3 exiting: rc = 0 00000100:00100000:3.0:1787831195.704909:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831195.704916:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831195.704921:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831195.704926:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831195.704932:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831195.704949:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831195.704955:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831195.704960:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831195.704964:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831195.704969:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831195.704973:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831195.704977:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831195.704982:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831195.704986:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831195.704990:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831195.704994:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831195.704998:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831195.705002:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831195.705006:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831195.705013:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831195.705017:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831195.705022:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831195.705026:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831195.705031:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831195.705035:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831195.705039:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831195.705043:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831195.705048:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831195.705052:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831195.705056:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831195.705060:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831195.705064:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831195.705068:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831195.705073:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831195.705077:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831195.705081:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831195.705086:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831195.705091:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831195.705095:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831195.705099:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831195.705109:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831195.705113:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831195.705118:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831195.705122:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831195.705126:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831195.705131:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831195.705135:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831195.705140:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831195.705144:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831195.705148:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831195.705153:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831195.705157:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831195.705162:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831195.705166:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831195.705170:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831195.705174:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831195.705178:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831195.705182:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831195.705187:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831195.705192:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831195.705196:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831195.705200:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831195.705205:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787831195.705209:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831195.706186:0:18611:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff8d2321947c00:18611] 0 exiting: rc = 1 00000100:00100000:1.0:1787831195.706261:0:18612:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff8d220271c800:18612] 1 exiting: rc = 0 00000100:00100000:0.0:1787831195.706354:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.706361:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.706366:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.706371:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.706376:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.706380:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.706384:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.706389:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.706393:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.706398:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.706402:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.706407:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.706412:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.706417:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.706422:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.706427:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.706432:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.706438:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.706443:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.706449:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.706455:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.706459:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.706465:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.706470:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.706494:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.706499:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.706504:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.706509:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.706514:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.706518:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.706523:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.706527:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.706531:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.706536:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.706541:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.706545:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.706550:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.706554:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.706559:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.706564:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.706568:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.706572:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.706576:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.706581:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.706586:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.706590:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.706594:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.706599:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.706604:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.706608:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.706613:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.706617:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.706846:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.706862:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.706868:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.706874:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.706878:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.706883:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.706889:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.706902:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.706908:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.706913:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.706918:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.706922:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831195.708112:0:18614:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff8d2305ae5600:18614] 1 exiting: rc = 0 00000100:00100000:3.0:1787831195.708283:0:18613:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8d23354c9400:18613] 0 exiting: rc = 1 00000100:00100000:2.0:1787831195.708456:0:18615:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8d2305ae5c00:18615] 2 exiting: rc = 0 00000100:00100000:0.0:1787831195.708566:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.708572:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.708577:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.708582:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.708594:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.708599:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.708604:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.708609:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.708614:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.708620:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.708753:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.708763:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.708768:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.708774:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.708781:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.708786:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.708791:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.708796:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.708801:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.708806:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.708813:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.708832:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.708840:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.708845:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.708851:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.708856:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.708862:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.708868:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.708873:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.708879:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.708895:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.708899:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.708904:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.708909:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.708914:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.708919:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.708924:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.708930:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.708934:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.708939:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.708944:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.708949:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.708954:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.708959:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.708964:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.708979:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.708984:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.708989:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.708993:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.708998:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.709003:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.709007:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.709012:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.709017:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.709031:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.709043:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.709050:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.709056:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.709061:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.709067:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.709072:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.709077:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.709082:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.709087:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787831195.712895:0:18616:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8d231123d000:18616] 0 exiting: rc = 1 00000100:00100000:2.0:1787831195.712932:0:18617:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8d230595b800:18617] 1 exiting: rc = 0 00000100:00100000:0.0:1787831195.713044:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.713089:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.713097:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.713103:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.713109:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.713114:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.713120:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.713126:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.713132:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.713138:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.713143:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.713149:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.713155:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.713159:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.713165:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.713170:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.713175:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.713182:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.713187:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.713192:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.713198:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.713204:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.713211:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.713216:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.713222:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.713227:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.713233:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.713238:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.713244:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.713249:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.713254:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.713260:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.713265:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.713271:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.713276:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.713281:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.713295:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.713299:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.713305:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.713311:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.713315:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.713321:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.713326:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.713330:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.713335:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.713340:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.713345:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.713350:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.713355:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.713360:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.713365:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.713370:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.713375:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.713380:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.713384:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.713389:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.713394:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.713399:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.713404:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.713410:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.713415:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.713419:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.713425:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.713431:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787831195.714134:0:18618:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8d23366a6e00:18618] 0 exiting: rc = 1 00000100:00100000:1.0:1787831195.714276:0:18619:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8d2311411600:18619] 1 exiting: rc = 0 00000100:00100000:0.0:1787831195.714331:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.714351:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.714358:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.714364:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.714370:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.714376:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.714391:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.714404:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.714409:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.714415:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.714421:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.714426:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.714432:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.714437:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.714445:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.714451:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.714456:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.714462:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.714484:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.714504:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.714510:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.714516:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.714522:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.714528:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.714534:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.714540:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.714546:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.714551:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.714557:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.714563:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.714583:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.714589:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.714596:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.714601:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.714609:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.714615:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.714621:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.714903:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.714909:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.714917:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.714923:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.714928:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.714954:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.714960:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.714966:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.714972:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.714978:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.714983:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.714988:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.714994:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.715000:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.715007:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.715015:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.715023:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.715056:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.715064:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.715092:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.715159:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.715165:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.715171:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.715178:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.715184:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.715251:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787831195.715268:0:21430:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1787831195.724756:0:21430:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1787831215.752168:0:22195:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg331-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1787831224.814359:0:22795:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787831224.814365:0:22795:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1787831224.814366:0:22795:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1787831224.814491:0:22795:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8d233fad3000 00000020:01000004:2.0:1787831224.814507:0:22795:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1787831224.814515:0:22795:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1787831224.814529:0:22795:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8d2306c6b370) 00000020:00000080:2.0:1787831224.814543:0:22795:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1787831224.895146:0:22795:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1787831224.895946:0:22795:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1787831224.907913:0:22795:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:2.0:1787831224.909219:0:22795:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:2.0:1787831224.909473:0:22795:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1787831224.909865:0:22795:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1787831224.910090:0:22795:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1787831224.910332:0:22795:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1787831224.911158:0:22795:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1787831224.911449:0:22795:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1787831224.912829:0:22795:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1787831224.913698:0:22795:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1787831224.914280:0:22795:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:2.0:1787831224.914880:0:22795:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1787831224.915149:0:22795:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:2.0:1787831224.915389:0:22795:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1787831224.915866:0:22795:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1787831224.916105:0:22795:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1787831224.916380:0:22795:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:3.0:1787831224.917083:0:22795:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:3.0:1787831224.918088:0:22795:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1787831224.920338:0:22795:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:3.0:1787831224.921851:0:22795:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1787831224.922115:0:22795:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1787831224.922313:0:22795:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1787831224.922493:0:22795:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1787831224.922704:0:22795:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:3.0:1787831224.923024:0:22795:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1787831224.923197:0:22795:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:3.0:1787831224.923392:0:22795:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1787831224.923572:0:22795:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1787831224.923972:0:22795:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1787831224.924197:0:22795:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1787831224.924419:0:22795:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:3.0:1787831224.924645:0:22795:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1787831224.925075:0:22795:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:3.0:1787831224.925260:0:22795:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1787831224.926119:0:22795:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:3.0:1787831224.926432:0:22795:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1787831224.926660:0:22795:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1787831224.926940:0:22795:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:3.0:1787831224.927153:0:22795:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:3.0:1787831224.927552:0:22795:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1787831224.927940:0:22795:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1787831224.928546:0:22795:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1787831224.928908:0:22795:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:3.0:1787831224.929113:0:22795:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1787831224.932013:0:22795:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:3.0:1787831224.933037:0:22795:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:3.0:1787831224.933612:0:22795:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:3.0:1787831224.934322:0:22795:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:3.0:1787831224.934534:0:22795:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:3.0:1787831224.935017:0:22795:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:01000000:3.0:1787831224.936062:0:22795:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1787831224.936281:0:22795:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1787831224.936300:0:22795:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787831224.936312:0:22795:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x95459fb9d1d2a5dc 00000020:01000004:3.0:1787831224.936320:0:22795:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1787831224.936326:0:22795:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1787831224.936332:0:22795:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d233fad3000 from MGS 00000020:01000004:3.0:1787831224.936335:0:22795:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1787831224.936347:0:22795:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8d2202a70000) 00000020:00000080:3.0:1787831224.936357:0:22795:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1787831224.936413:0:22795:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d233fad3000 from MGS, refs=2 00080000:01000000:3.0:1787831224.936417:0:22795:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787831224.936421:0:22795:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x95459fb9d1d2a5ea 00000100:00100000:3.0:1787831224.936512:0:22795:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1787831224.936678:0:22795:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1787831224.936683:0:22795:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1787831224.937429:0:22795:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1787831224.937437:0:22795:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1787831224.938316:0:22795:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787831224.938470:0:22795:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1787831224.938475:0:22795:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1787831224.939420:0:22795:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1787831224.939429:0:22795:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1787831224.940303:0:22795:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1787831224.940311:0:22795:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1787831224.941097:0:22804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787831224.941101:0:22804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787831224.941103:0:22804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787831224.941362:0:22805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787831224.941365:0:22805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787831224.941366:0:22805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787831224.941944:0:22795:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1787831224.945306:0:22804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1787831224.947618:0:22795:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1787831224.948651:0:22807:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1787831224.948704:0:22795:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1787831224.948758:0:22795:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787831224.949439:0:22795:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1787831224.949798:0:22795:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787831224.949944:0:22795:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1787831224.949949:0:22795:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1787831224.951349:0:22795:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1787831224.951359:0:22795:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1787831224.953137:0:22795:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1787831224.953151:0:22795:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:3.0:1787831224.953906:0:22811:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:2.0:1787831224.954118:0:22795:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1787831224.954139:0:22795:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.131@tcp' 00000020:01000004:2.0:1787831224.954141:0:22795:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1787831224.954173:0:22795:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.131@tcp (typ=mgc) 00000020:00000080:2.0:1787831224.954193:0:22795:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.131@tcp (ffff8d2306c6cd28) 00000020:00000080:2.0:1787831224.954210:0:22795:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1787831224.954308:0:22795:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d2310854800@MGC192.168.203.131@tcp: add connection 192.168.203.131@tcp at head 00010000:00010000:2.0:1787831224.954456:0:22795:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.131@tcp-0 is initialized 00000040:01000000:2.0:1787831224.954461:0:22795:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.131@tcp ctxt 1 is initialized 10000000:01000000:3.0:1787831224.956987:0:22812:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1787831224.957076:0:22795:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.131@tcp (uuid 8057bc0f-773b-4151-9d37-d94ddea63831) 00000020:00000080:2.0:1787831224.957099:0:22795:0:(genops.c:1385:class_connect()) connect: client 8057bc0f-773b-4151-9d37-d94ddea63831, cookie 0x95459fb9d1d2a5f8 00000100:00080000:2.0:1787831224.957112:0:22795:0:(import.c:510:import_select_connection()) MGC192.168.203.131@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787831224.957117:0:22795:0:(import.c:624:import_select_connection()) MGC192.168.203.131@tcp: import ffff8d2310854800 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:2.0:1787831224.957152:0:22795:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d232f61f480 x1874676443975808/t0(0) o250->MGC192.168.203.131@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787831224.957183:0:22795:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 8057bc0f-773b-4151-9d37-d94ddea63831->MGS 00000020:01000004:2.0:1787831224.957209:0:22795:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1787831224.957215:0:22795:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1787831224.957229:0:22795:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8d2306c699b8) 00000020:00000080:2.0:1787831224.957241:0:22795:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1787831224.958093:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d232f61f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8057bc0f-773b-4151-9d37-d94ddea63831:3618:1874676443975808:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1787831224.958164:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831224.958267:0:22808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443975808 00000100:00100000:0.0:1787831224.958275:0:22808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443975808 00000100:00100000:0.0:1787831224.958324:0:22808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787831224.958332:0:22808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d23061c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3618:x1874676443975808:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1787831224.958355:0:22808:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 8057bc0f-773b-4151-9d37-d94ddea63831@0@lo t0 exp 0000000000000000 cur 515 last 0 00000020:00000080:0.0:1787831224.958380:0:22808:0:(genops.c:1385:class_connect()) connect: client 8057bc0f-773b-4151-9d37-d94ddea63831, cookie 0x95459fb9d1d2a606 00000100:00080000:0.0:1787831224.958492:0:22808:0:(import.c:65:import_set_state_nolock()) ffff8d22024c8800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787831224.958567:0:22808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d23061c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8057bc0f-773b-4151-9d37-d94ddea63831+5:3618:x1874676443975808:12345-0@lo:250:mount.lustre.0 Request processed in 234us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831224.958579:0:22808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787831224.958643:0:3618:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.203.131@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1787831224.958652:0:3618:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.131@tcp: connect to target with instance 0 00000100:00080000:0.0:1787831224.958660:0:3618:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.131@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1787831224.958664:0:3618:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1787831224.958667:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8d2310854800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1787831224.958670:0:3618:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1787831224.958679:0:3618:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1787831224.958684:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d232f61f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8057bc0f-773b-4151-9d37-d94ddea63831:3618:1874676443975808:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1787831224.974244:0:22795:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787831224.974444:0:22795:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1787831224.974451:0:22795:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1787831224.975402:0:22795:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1787831224.975410:0:22795:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1787831224.979994:0:22795:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1787831224.980011:0:22795:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1787831224.985339:0:22795:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787831224.985528:0:22795:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1787831224.985540:0:22795:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1787831224.986242:0:22795:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1787831224.986250:0:22795:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1787831225.021236:0:22795:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787831225.021510:0:22795:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1787831225.021517:0:22795:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1787831225.024270:0:22795:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1787831225.024302:0:22795:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1787831225.027869:0:22795:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787831225.028268:0:22795:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787831225.028276:0:22795:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1787831225.029225:0:22795:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787831225.029237:0:22795:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1787831225.032648:0:22795:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787831225.032931:0:22795:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787831225.032938:0:22795:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1787831225.034015:0:22795:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787831225.034026:0:22795:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1787831225.034870:0:22795:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787831225.035079:0:22795:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787831225.035098:0:22795:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1787831225.035815:0:22795:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787831225.035825:0:22795:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1787831225.063912:0:22795:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787831225.067074:0:22795:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1787831225.067102:0:22795:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1787831225.073503:0:22795:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1787831225.073520:0:22795:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1787831225.076272:0:22795:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1787831225.076298:0:22795:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1787831225.080394:0:22795:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1787831225.080439:0:22795:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:3.0:1787831225.080447:0:22795:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.131@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1787831225.080768:0:22795:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.131@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787831225.080817:0:22795:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.131@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1787831225.080822:0:22795:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787831225.080824:0:22795:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787831225.080830:0:22795:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787831225.080831:0:22795:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787831225.080833:0:22795:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787831225.080834:0:22795:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787831225.080835:0:22795:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787831225.080837:0:22795:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787831225.080838:0:22795:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787831225.080839:0:22795:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787831225.080842:0:22795:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1787831225.080844:0:22795:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787831225.080845:0:22795:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787831225.080846:0:22795:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787831225.080847:0:22795:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787831225.080847:0:22795:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787831225.080848:0:22795:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787831225.080849:0:22795:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787831225.080850:0:22795:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787831225.080851:0:22795:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787831225.080851:0:22795:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787831225.080885:0:22795:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1787831225.080911:0:22795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220483da40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:22795:1874676443975936:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787831225.081023:0:22795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831225.081072:0:22795:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2335786a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787831225.081251:0:22810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443975936 00000100:00100000:2.0:1787831225.081260:0:22810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443975936 00000100:00100000:2.0:1787831225.081325:0:22810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787831225.081335:0:22810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d23061c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8057bc0f-773b-4151-9d37-d94ddea63831+5:22795:x1874676443975936:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787831225.081399:0:22810:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787831225.081412:0:22810:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1787831225.081416:0:22810:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1787831225.081982:0:22831:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1787831225.082507:0:22810:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 10 20000000:01000000:2.0:1787831225.087940:0:22832:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1787831225.087949:0:22832:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:2.0:1787831225.087952:0:22832:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1787831225.087955:0:22832:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1787831225.088243:0:22832:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:0.0:1787831225.088456:0:22810:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787831225.088465:0:22810:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1787831225.090953:0:22810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d23061c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8057bc0f-773b-4151-9d37-d94ddea63831+5:22795:x1874676443975936:12345-0@lo:253:mount.lustre.0 Request processed in 9611us (9921us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831225.090970:0:22810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787831225.091095:0:22795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220483da40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:22795:1874676443975936:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787831225.091110:0:22795:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1787831225.091113:0:22795:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787831225.091115:0:22795:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787831225.091116:0:22795:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787831225.091118:0:22795:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787831225.091119:0:22795:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787831225.091120:0:22795:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787831225.091122:0:22795:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787831225.091123:0:22795:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787831225.091125:0:22795:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787831225.091127:0:22795:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787831225.091148:0:22795:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d233fad3000 from lustre-MDT0000 10000000:01000000:3.0:1787831225.091180:0:22795:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1787831225.091195:0:22795:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787831225.091199:0:22795:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8d2306c6cd28 10000000:01000000:3.0:1787831225.091202:0:22795:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787831225.091210:0:22795:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8d2306c6cd28 from 1 10000000:01000000:3.0:1787831225.091213:0:22795:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787831225.091252:0:22795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d2301668600/0x95459fb9d1d2a60d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831225.091263:0:22795:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8d2301668600/0x95459fb9d1d2a60d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831225.091273:0:22795:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8d2301668600/0x95459fb9d1d2a60d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787831225.091301:0:22795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220483da40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:22795:1874676443976064:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787831225.091341:0:22795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831225.091374:0:22795:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2335786480 going to sleep for 11 seconds 00000100:00100000:0.0:1787831225.091425:0:22809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443976064 00000100:00100000:0.0:1787831225.091430:0:22809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443976064 00000100:00100000:0.0:1787831225.091462:0:22809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787831225.091468:0:22809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d23061c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8057bc0f-773b-4151-9d37-d94ddea63831+5:22795:x1874676443976064:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787831225.091479:0:22809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787831225.091489:0:22809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d233bf10000/0x95459fb9d1d2a614 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d2a60d expref: -99 pid: 22809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831225.091506:0:22809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d233bf10000/0x95459fb9d1d2a614 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d2a60d expref: 6 pid: 22809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831225.091513:0:22809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d233bf10000/0x95459fb9d1d2a614 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d2a60d expref: 6 pid: 22809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831225.091545:0:22809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233bf10000, rc 0) 00000100:00100000:0.0:1787831225.091591:0:22809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d23061c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8057bc0f-773b-4151-9d37-d94ddea63831+6:22795:x1874676443976064:12345-0@lo:101:mount.lustre.0 Request processed in 122us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831225.091598:0:22809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787831225.091673:0:22795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220483da40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:22795:1874676443976064:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787831225.091683:0:22795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8d2301668600/0x95459fb9d1d2a60d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2a614 expref: -99 pid: 22795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831225.091689:0:22795:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8d2301668600/0x95459fb9d1d2a60d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d2a614 expref: -99 pid: 22795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787831225.091727:0:22795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220483da40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:22795:1874676443976192:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787831225.091758:0:22795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831225.091782:0:22795:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2335786480 going to sleep for 11 seconds 00000100:00100000:1.0:1787831225.091866:0:22810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443976192 00000100:00100000:1.0:1787831225.091871:0:22810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443976192 00000100:00100000:1.0:1787831225.091902:0:22810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787831225.091909:0:22810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d23061c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8057bc0f-773b-4151-9d37-d94ddea63831+6:22795:x1874676443976192:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787831225.092180:0:22810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d23061c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8057bc0f-773b-4151-9d37-d94ddea63831+6:22795:x1874676443976192:12345-0@lo:501:mount.lustre.0 Request processed in 270us (420us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787831225.092187:0:22810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787831225.092313:0:22795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220483da40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:22795:1874676443976192:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1787831225.092408:0:22795:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787831225.092460:0:22795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d2301668600/0x95459fb9d1d2a60d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2a614 expref: -99 pid: 22795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831225.092467:0:22795:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8d2301668600/0x95459fb9d1d2a60d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2a614 expref: -99 pid: 22795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787831225.092479:0:22795:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d233fad3000 10000000:01000000:1.0:1787831225.092483:0:22795:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787831225.092486:0:22795:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8d233fad3000 10000000:01000000:1.0:1787831225.092488:0:22795:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1787831225.092489:0:22795:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8d233fad3000 from 1 10000000:01000000:1.0:1787831225.092491:0:22795:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1787831225.092509:0:22795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233be95800/0x95459fb9d1d2a61b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831225.092514:0:22795:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8d233be95800/0x95459fb9d1d2a61b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831225.092521:0:22795:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8d233be95800/0x95459fb9d1d2a61b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831225.092534:0:22795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203765a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:22795:1874676443976320:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787831225.092572:0:22795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831225.092592:0:22795:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d23082b6300 going to sleep for 11 seconds 00000100:00100000:2.0:1787831225.092722:0:22808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443976320 00000100:00100000:2.0:1787831225.092727:0:22808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443976320 00000100:00100000:2.0:1787831225.092827:0:22808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787831225.092835:0:22808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d23061c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8057bc0f-773b-4151-9d37-d94ddea63831+6:22795:x1874676443976320:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787831225.092845:0:22808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787831225.092859:0:22808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2303aa2000/0x95459fb9d1d2a622 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d2a61b expref: -99 pid: 22808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831225.092876:0:22808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2303aa2000/0x95459fb9d1d2a622 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d2a61b expref: 7 pid: 22808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831225.092886:0:22808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2303aa2000/0x95459fb9d1d2a622 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d2a61b expref: 7 pid: 22808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831225.092892:0:22808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2303aa2000, rc 0) 00000100:00100000:2.0:1787831225.092923:0:22808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d23061c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8057bc0f-773b-4151-9d37-d94ddea63831+7:22795:x1874676443976320:12345-0@lo:101:mount.lustre.0 Request processed in 89us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831225.092929:0:22808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787831225.092999:0:22795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203765a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:22795:1874676443976320:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787831225.093011:0:22795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8d233be95800/0x95459fb9d1d2a61b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2a622 expref: -99 pid: 22795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831225.093019:0:22795:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8d233be95800/0x95459fb9d1d2a61b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d2a622 expref: -99 pid: 22795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787831225.093031:0:22795:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1787831225.093313:0:22795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233be95800/0x95459fb9d1d2a61b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2a622 expref: -99 pid: 22795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831225.093329:0:22795:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8d233be95800/0x95459fb9d1d2a61b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2a622 expref: -99 pid: 22795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787831225.093336:0:22795:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787831225.093340:0:22795:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787831225.093344:0:22795:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8d233fad3000 10000000:01000000:1.0:1787831225.093346:0:22795:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1787831225.093349:0:22795:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1787831225.093351:0:22795:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787831225.093368:0:22795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233be94400/0x95459fb9d1d2a629 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831225.093375:0:22795:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8d233be94400/0x95459fb9d1d2a629 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831225.093381:0:22795:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8d233be94400/0x95459fb9d1d2a629 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831225.093394:0:22795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203765a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:22795:1874676443976448:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787831225.093423:0:22795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831225.093456:0:22795:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d23082b6300 going to sleep for 11 seconds 00000100:00100000:2.0:1787831225.093481:0:22810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443976448 00000100:00100000:2.0:1787831225.093486:0:22810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443976448 00000100:00100000:2.0:1787831225.093514:0:22810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787831225.093520:0:22810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d23061c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8057bc0f-773b-4151-9d37-d94ddea63831+7:22795:x1874676443976448:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787831225.093528:0:22810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787831225.093545:0:22810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2303aa2400/0x95459fb9d1d2a630 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d2a629 expref: -99 pid: 22810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831225.093560:0:22810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2303aa2400/0x95459fb9d1d2a630 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d2a629 expref: 8 pid: 22810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831225.093580:0:22810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2303aa2400/0x95459fb9d1d2a630 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d2a629 expref: 8 pid: 22810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831225.093587:0:22810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2303aa2400, rc 0) 00000100:00100000:2.0:1787831225.093646:0:22810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d23061c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8057bc0f-773b-4151-9d37-d94ddea63831+8:22795:x1874676443976448:12345-0@lo:101:mount.lustre.0 Request processed in 105us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831225.093652:0:22810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787831225.094498:0:22795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203765a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:22795:1874676443976448:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787831225.094516:0:22795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8d233be94400/0x95459fb9d1d2a629 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2a630 expref: -99 pid: 22795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831225.094534:0:22795:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8d233be94400/0x95459fb9d1d2a629 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d2a630 expref: -99 pid: 22795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831225.094673:0:22795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203765a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:22795:1874676443976576:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787831225.094715:0:22795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831225.094851:0:22795:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d23082b6300 going to sleep for 11 seconds 00000100:00100000:2.0:1787831225.094918:0:22808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443976576 00000100:00100000:2.0:1787831225.094922:0:22808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443976576 00000100:00100000:2.0:1787831225.094947:0:22808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787831225.094952:0:22808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d23061c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8057bc0f-773b-4151-9d37-d94ddea63831+8:22795:x1874676443976576:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787831225.095080:0:22808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d23061c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8057bc0f-773b-4151-9d37-d94ddea63831+9:22795:x1874676443976576:12345-0@lo:501:mount.lustre.0 Request processed in 126us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831225.095087:0:22808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787831225.095430:0:22795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203765a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:22795:1874676443976576:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787831225.095467:0:22795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203765a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:22795:1874676443976704:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787831225.095506:0:22795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831225.095731:0:22795:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d23082b6300 going to sleep for 11 seconds 00000100:00100000:0.0:1787831225.095779:0:22808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443976704 00000100:00100000:0.0:1787831225.095785:0:22808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443976704 00000100:00100000:0.0:1787831225.095823:0:22808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787831225.095831:0:22808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22025d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8057bc0f-773b-4151-9d37-d94ddea63831+9:22795:x1874676443976704:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787831225.098201:0:22795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203765a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:22795:1874676443976704:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787831225.098201:0:22808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22025d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8057bc0f-773b-4151-9d37-d94ddea63831+9:22795:x1874676443976704:12345-0@lo:503:mount.lustre.0 Request processed in 2367us (2690us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831225.098214:0:22808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787831225.099164:0:22833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203765a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8057bc0f-773b-4151-9d37-d94ddea63831:22833:1874676443976832:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787831225.099222:0:22833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831225.099306:0:22833:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d23082b6840 going to sleep for 11 seconds 00000100:00100000:2.0:1787831225.099355:0:22810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443976832 00000100:00100000:2.0:1787831225.099361:0:22810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443976832 00000100:00100000:2.0:1787831225.099411:0:22810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787831225.099420:0:22810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22025d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8057bc0f-773b-4151-9d37-d94ddea63831+9:22833:x1874676443976832:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787831225.100216:0:22810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22025d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8057bc0f-773b-4151-9d37-d94ddea63831+9:22833:x1874676443976832:12345-0@lo:502:llog_process_th.0 Request processed in 795us (992us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831225.100227:0:22810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787831225.101103:0:22833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203765a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8057bc0f-773b-4151-9d37-d94ddea63831:22833:1874676443976832:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787831225.101152:0:22833:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787831225.101163:0:22833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787831225.101165:0:22833:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787831225.101168:0:22833:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1787831225.101170:0:22833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787831225.101184:0:22833:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8d2334548000) 00000020:00000080:1.0:1787831225.101197:0:22833:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1787831225.101200:0:22833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1787831225.101261:0:22833:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:1.0:1787831225.101265:0:22833:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x95459fb9d1d2a63e 00000020:00000080:1.0:1787831225.101486:0:22833:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1787831225.101490:0:22833:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787831225.101492:0:22833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787831225.101499:0:22833:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787831225.101501:0:22833:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787831225.101504:0:22833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787831225.101505:0:22833:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1787831225.101507:0:22833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787831225.101513:0:22833:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8d23345499b8) 00000020:00000080:1.0:1787831225.101580:0:22833:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1787831225.101586:0:22833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1787831225.101587:0:22833:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1787831225.101590:0:22833:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1787831225.101595:0:22833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787831225.101656:0:22833:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d233fad3000 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1787831225.101671:0:22833:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8d233454b370) 00000020:00000080:1.0:1787831225.101679:0:22833:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1787831225.101743:0:22833:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1787831225.101759:0:22833:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x95459fb9d1d2a653 00000020:00000080:1.0:1787831225.101853:0:22833:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1787831225.101859:0:22833:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1787831225.101864:0:22833:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x95459fb9d1d2a65a 00080000:01000000:1.0:1787831225.101869:0:22833:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:1.0:1787831225.101873:0:22833:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x95459fb9d1d2a661 00010000:00010000:0.0:1787831225.175975:0:22833:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:0.0:1787831225.176574:0:22833:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934679 00000001:00080000:0.0:1787831225.177433:0:22833:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1787831225.178247:0:22833:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8d23088a4d28) 00000020:00000080:0.0:1787831225.178266:0:22833:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1787831225.178489:0:22833:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:0.0:1787831225.178497:0:22833:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x95459fb9d1d2a66f 00000020:00000080:1.0:1787831225.179337:0:22833:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1787831225.184920:0:22833:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x95459fb9d1d2a676 00000020:00000080:2.0:1787831225.187953:0:22833:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1787831225.187974:0:22833:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787831225.187991:0:22833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787831225.187993:0:22833:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1787831225.187996:0:22833:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787831225.187999:0:22833:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:2.0:1787831225.188000:0:22833:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787831225.188001:0:22833:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787831225.188003:0:22833:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787831225.188005:0:22833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787831225.188006:0:22833:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787831225.188009:0:22833:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787831225.188014:0:22833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787831225.188015:0:22833:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1787831225.188019:0:22833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1787831225.188073:0:22833:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1787831225.188093:0:22833:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787831225.188096:0:22833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787831225.188098:0:22833:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1787831225.188104:0:22833:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787831225.188107:0:22833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787831225.188109:0:22833:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:2.0:1787831225.188112:0:22833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787831225.188118:0:22833:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.131@tcp to nid 0x20000c0a8cb83 (192.168.203.131@tcp) 00000020:00000080:2.0:1787831225.188145:0:22833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787831225.188160:0:22833:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff8d2306c68000) 00000020:00000080:2.0:1787831225.188175:0:22833:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1787831225.188180:0:22833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787831225.188249:0:22833:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:2.0:1787831225.188256:0:22833:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:2.0:1787831225.188265:0:22833:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x95459fb9d1d2a684 00010000:00080000:2.0:1787831225.188315:0:22833:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d233f542000@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.131@tcp at head 00010000:00010000:2.0:1787831225.189973:0:22833:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:1.0:1787831225.191485:0:22833:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787831225.191498:0:22833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1787831225.191533:0:22833:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1787831225.191553:0:22833:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x95459fb9d1d2a68b 00000100:00080000:1.0:1787831225.191565:0:22833:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787831225.191571:0:22833:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8d233f542000 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:1.0:1787831225.191607:0:22833:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2203765a40 x1874676443976960/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787831225.191850:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203765a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1874676443976960:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787831225.191939:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787831225.192091:0:22833:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:1.0:1787831225.192173:0:22833:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787831225.192178:0:22833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787831225.192180:0:22833:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1787831225.192183:0:22833:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787831225.192187:0:22833:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:1.0:1787831225.192189:0:22833:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787831225.192190:0:22833:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787831225.192192:0:22833:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787831225.192194:0:22833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787831225.192195:0:22833:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787831225.192199:0:22833:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787831225.192203:0:22833:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1787831225.192206:0:22833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787831225.192208:0:22833:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1787831225.192211:0:22833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787831225.192215:0:22833:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.131@tcp to nid 0x20000c0a8cb83 (192.168.203.131@tcp) 00000020:01000000:1.0:1787831225.192237:0:22833:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1787831225.192239:0:22833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787831225.192255:0:22833:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8d233454cd28) 00000020:00000080:1.0:1787831225.192267:0:22833:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1787831225.192271:0:22833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787831225.192345:0:22833:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1787831225.192351:0:22833:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:1.0:1787831225.192357:0:22833:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x95459fb9d1d2a699 00010000:00080000:1.0:1787831225.192390:0:22833:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d233f541000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.131@tcp at head 00010000:00010000:1.0:1787831225.192597:0:22833:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:0.0:1787831225.192972:0:22820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443976960 00000100:00100000:0.0:1787831225.192989:0:22820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443976960 00000100:00100000:0.0:1787831225.193026:0:22820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787831225.193033:0:22820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d232f61de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3618:x1874676443976960:12345-0@lo:38:llog_process_th.0 00010000:00020000:0.0:1787831225.193048:0:22820:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000040:01000000:3.0:1787831225.200250:0:22833:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1787831225.200580:0:22833:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1787831225.203317:0:22833:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787831225.203514:0:22833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:3.0:1787831225.211384:0:22833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000100:00100000:2.0:1787831225.215716:0:22820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d232f61de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3618:x1874676443976960:12345-0@lo:38:llog_process_th.0 Request processed in 22674us (23768us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787831225.215735:0:22820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000040:00080000:2.0:1787831225.216455:0:22839:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1787831225.216460:0:22839:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000100:00080000:0.0:1787831225.216591:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8d233f542000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787831225.216597:0:3618:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787831225.216610:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203765a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1874676443976960:0@lo:38:llog_process_th.0 00000020:00000080:1.0:1787831225.219207:0:22833:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787831225.219222:0:22833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787831225.219261:0:22833:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1787831225.219289:0:22833:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x95459fb9d1d2a6a0 00000100:00080000:1.0:1787831225.219301:0:22833:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787831225.219306:0:22833:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d233f541000 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:1.0:1787831225.219354:0:22833:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2203767c00 x1874676443977088/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787831225.219410:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203767c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1874676443977088:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1787831225.219463:0:3618:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874676443977088 offset 0 length 520: 4 00000100:00080000:1.0:1787831225.219518:0:22833:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1787831225.219615:0:22833:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787831225.219619:0:22833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787831225.219621:0:22833:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1787831225.219642:0:22833:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787831225.219645:0:22833:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:1.0:1787831225.219647:0:22833:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787831225.219648:0:22833:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787831225.219650:0:22833:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787831225.219652:0:22833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787831225.219653:0:22833:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787831225.219655:0:22833:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787831225.219659:0:22833:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1787831225.219662:0:22833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787831225.219663:0:22833:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1787831225.219666:0:22833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787831225.219669:0:22833:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.131@tcp to nid 0x20000c0a8cb83 (192.168.203.131@tcp) 00000020:01000000:1.0:1787831225.219690:0:22833:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1787831225.219692:0:22833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787831225.219704:0:22833:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8d23344a19b8) 00000020:00000080:1.0:1787831225.219714:0:22833:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:1.0:1787831225.219718:0:22833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787831225.219798:0:22833:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1787831225.219804:0:22833:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:1.0:1787831225.219810:0:22833:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x95459fb9d1d2a6ae 00010000:00080000:1.0:1787831225.219836:0:22833:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d2202769000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.131@tcp at head 00010000:00010000:1.0:1787831225.220097:0:22833:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1787831225.220167:0:22833:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1787831225.220182:0:22833:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1787831225.222453:0:22833:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787831225.223086:0:22833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:1.0:1787831225.223259:0:22833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000040:00080000:3.0:1787831225.223725:0:22841:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1787831225.223791:0:22841:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1787831225.224464:0:22833:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787831225.224476:0:22833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787831225.224512:0:22833:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1787831225.224533:0:22833:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x95459fb9d1d2a6b5 00000100:00080000:1.0:1787831225.224544:0:22833:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787831225.224550:0:22833:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d2202769000 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:1.0:1787831225.224587:0:22833:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2203767840 x1874676443977216/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787831225.224671:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203767840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1874676443977216:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1787831225.224726:0:3618:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874676443977216 offset 0 length 520: 4 00000100:00080000:1.0:1787831225.224865:0:22833:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1787831225.224918:0:22833:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787831225.224922:0:22833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787831225.224924:0:22833:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1787831225.224926:0:22833:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787831225.224929:0:22833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787831225.224931:0:22833:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787831225.224933:0:22833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787831225.224935:0:22833:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787831225.224937:0:22833:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787831225.224938:0:22833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787831225.224939:0:22833:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787831225.224941:0:22833:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787831225.224943:0:22833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787831225.224944:0:22833:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787831225.224947:0:22833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1787831225.224988:0:22833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22037652c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8057bc0f-773b-4151-9d37-d94ddea63831:22833:1874676443977344:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787831225.225039:0:22833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831225.225059:0:22833:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2307d75b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787831225.225294:0:22808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443977344 00000100:00100000:0.0:1787831225.225301:0:22808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443977344 00000100:00100000:0.0:1787831225.225380:0:22808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787831225.225388:0:22808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22025d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8057bc0f-773b-4151-9d37-d94ddea63831+9:22833:x1874676443977344:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787831225.225519:0:22808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22025d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8057bc0f-773b-4151-9d37-d94ddea63831+9:22833:x1874676443977344:12345-0@lo:502:llog_process_th.0 Request processed in 130us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831225.225526:0:22808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787831225.225603:0:22833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22037652c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8057bc0f-773b-4151-9d37-d94ddea63831:22833:1874676443977344:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787831225.225652:0:22833:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787831225.225658:0:22833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787831225.225659:0:22833:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787831225.225663:0:22833:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:2.0:1787831225.225869:0:22795:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:2.0:1787831225.225891:0:22795:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787831225.225915:0:22795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233be94400/0x95459fb9d1d2a629 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2a630 expref: -99 pid: 22795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831225.225926:0:22795:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8d233be94400/0x95459fb9d1d2a629 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2a630 expref: -99 pid: 22795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787831225.225934:0:22795:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d233fad3000 from 1 10000000:01000000:2.0:1787831225.225936:0:22795:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787831225.225967:0:22795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d2303aa3a00/0x95459fb9d1d2a6bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831225.225985:0:22795:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8d2303aa3a00/0x95459fb9d1d2a6bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831225.225995:0:22795:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8d2303aa3a00/0x95459fb9d1d2a6bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831225.226011:0:22795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d232f61e1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:22795:1874676443977472:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787831225.226043:0:22795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831225.226385:0:22795:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d233be1b780 going to sleep for 11 seconds 00000100:00100000:3.0:1787831225.226453:0:22809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443977472 00000100:00100000:3.0:1787831225.226458:0:22809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443977472 00000100:00100000:3.0:1787831225.226485:0:22809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787831225.226492:0:22809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22025d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8057bc0f-773b-4151-9d37-d94ddea63831+9:22795:x1874676443977472:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787831225.226501:0:22809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787831225.226517:0:22809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2301669a00/0x95459fb9d1d2a6c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d2a6bc expref: -99 pid: 22809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831225.226539:0:22809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2301669a00/0x95459fb9d1d2a6c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d2a6bc expref: 10 pid: 22809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831225.226550:0:22809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2301669a00/0x95459fb9d1d2a6c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d2a6bc expref: 10 pid: 22809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831225.226559:0:22809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2301669a00, rc 0) 00000100:00100000:3.0:1787831225.226605:0:22809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22025d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8057bc0f-773b-4151-9d37-d94ddea63831+10:22795:x1874676443977472:12345-0@lo:101:mount.lustre.0 Request processed in 114us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831225.226611:0:22809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787831225.226740:0:22795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d232f61e1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:22795:1874676443977472:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787831225.226763:0:22795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8d2303aa3a00/0x95459fb9d1d2a6bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2a6c3 expref: -99 pid: 22795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831225.226771:0:22795:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8d2303aa3a00/0x95459fb9d1d2a6bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d2a6c3 expref: -99 pid: 22795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831225.227961:0:22795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d232f61e1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:22795:1874676443977600:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1787831225.228095:0:22795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831225.228137:0:22795:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d233be1b780 going to sleep for 11 seconds 00000100:00100000:3.0:1787831225.228214:0:22809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443977600 00000100:00100000:3.0:1787831225.228220:0:22809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443977600 00000100:00100000:3.0:1787831225.228253:0:22809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787831225.228260:0:22809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22025d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8057bc0f-773b-4151-9d37-d94ddea63831+10:22795:x1874676443977600:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1787831225.228277:0:22809:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1787831225.228297:0:22809:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1787831225.228378:0:22809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22025d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8057bc0f-773b-4151-9d37-d94ddea63831+10:22795:x1874676443977600:12345-0@lo:256:mount.lustre.0 Request processed in 118us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831225.228385:0:22809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787831225.228476:0:22795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d232f61e1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:22795:1874676443977600:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1787831225.229425:0:22795:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787831225.229510:0:22795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d2303aa3a00/0x95459fb9d1d2a6bc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2a6c3 expref: -99 pid: 22795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831225.229522:0:22795:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8d2303aa3a00/0x95459fb9d1d2a6bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2a6c3 expref: -99 pid: 22795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787831225.229531:0:22795:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d233fad3000 from 1 10000000:01000000:2.0:1787831225.229534:0:22795:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787831225.229566:0:22795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d2303aa3400/0x95459fb9d1d2a6ca lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831225.229574:0:22795:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8d2303aa3400/0x95459fb9d1d2a6ca lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831225.229584:0:22795:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8d2303aa3400/0x95459fb9d1d2a6ca lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831225.229601:0:22795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d232f61e1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:22795:1874676443977728:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787831225.229720:0:22795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831225.229822:0:22795:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d233be1b780 going to sleep for 11 seconds 00000100:00100000:2.0:1787831225.229846:0:22809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443977728 00000100:00100000:2.0:1787831225.229852:0:22809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443977728 00000100:00100000:2.0:1787831225.229887:0:22809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787831225.229895:0:22809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22025d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8057bc0f-773b-4151-9d37-d94ddea63831+10:22795:x1874676443977728:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787831225.229906:0:22809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787831225.229918:0:22809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2303aa3200/0x95459fb9d1d2a6d1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d2a6ca expref: -99 pid: 22809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831225.229941:0:22809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2303aa3200/0x95459fb9d1d2a6d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d2a6ca expref: 11 pid: 22809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831225.229951:0:22809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2303aa3200/0x95459fb9d1d2a6d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d2a6ca expref: 11 pid: 22809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831225.229959:0:22809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2303aa3200, rc 0) 00000100:00100000:2.0:1787831225.230076:0:22809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22025d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8057bc0f-773b-4151-9d37-d94ddea63831+11:22795:x1874676443977728:12345-0@lo:101:mount.lustre.0 Request processed in 181us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831225.230082:0:22809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787831225.230124:0:22795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d232f61e1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:22795:1874676443977728:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787831225.230137:0:22795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8d2303aa3400/0x95459fb9d1d2a6ca lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2a6d1 expref: -99 pid: 22795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831225.230144:0:22795:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8d2303aa3400/0x95459fb9d1d2a6ca lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d2a6d1 expref: -99 pid: 22795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831225.230200:0:22795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d232f61e1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:22795:1874676443977856:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787831225.230232:0:22795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831225.230245:0:22795:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d233be1b780 going to sleep for 11 seconds 00000100:00100000:2.0:1787831225.230259:0:22809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443977856 00000100:00100000:2.0:1787831225.230262:0:22809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443977856 00000100:00100000:2.0:1787831225.230279:0:22809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787831225.230295:0:22809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22025d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8057bc0f-773b-4151-9d37-d94ddea63831+11:22795:x1874676443977856:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787831225.230422:0:22809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22025d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8057bc0f-773b-4151-9d37-d94ddea63831+11:22795:x1874676443977856:12345-0@lo:501:mount.lustre.0 Request processed in 127us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831225.230429:0:22809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787831225.230460:0:22795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d232f61e1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:22795:1874676443977856:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787831225.230499:0:22795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d232f61e1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:22795:1874676443977984:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787831225.230535:0:22795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831225.230549:0:22795:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d233be1b780 going to sleep for 11 seconds 00000100:00100000:2.0:1787831225.230562:0:22809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443977984 00000100:00100000:2.0:1787831225.230565:0:22809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443977984 00000100:00100000:2.0:1787831225.230581:0:22809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787831225.230587:0:22809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22025d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8057bc0f-773b-4151-9d37-d94ddea63831+11:22795:x1874676443977984:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787831225.230690:0:22809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22025d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8057bc0f-773b-4151-9d37-d94ddea63831+11:22795:x1874676443977984:12345-0@lo:503:mount.lustre.0 Request processed in 103us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831225.230697:0:22809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787831225.231504:0:22795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d232f61e1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:22795:1874676443977984:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787831225.232094:0:22843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22037652c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8057bc0f-773b-4151-9d37-d94ddea63831:22843:1874676443978112:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787831225.232148:0:22843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831225.232212:0:22843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2307d75b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787831225.232273:0:22808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443978112 00000100:00100000:3.0:1787831225.232279:0:22808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443978112 00000100:00100000:2.0:1787831225.232340:0:22809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787831225.232349:0:22809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22025d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8057bc0f-773b-4151-9d37-d94ddea63831+11:22843:x1874676443978112:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787831225.233163:0:22809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22025d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8057bc0f-773b-4151-9d37-d94ddea63831+11:22843:x1874676443978112:12345-0@lo:502:llog_process_th.0 Request processed in 812us (1010us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831225.233180:0:22809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787831225.233269:0:22843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22037652c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8057bc0f-773b-4151-9d37-d94ddea63831:22843:1874676443978112:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787831225.233309:0:22843:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787831225.233321:0:22843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787831225.233323:0:22843:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787831225.233331:0:22843:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d233fad3000 00000020:00000080:0.0:1787831225.233334:0:22843:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787831225.233341:0:22843:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787831225.233343:0:22843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787831225.233345:0:22843:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1787831225.233348:0:22843:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787831225.233350:0:22843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787831225.233352:0:22843:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787831225.233355:0:22843:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d233fad3000 00000020:00000080:0.0:1787831225.233357:0:22843:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787831225.233457:0:22843:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787831225.234988:0:22843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787831225.234994:0:22843:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1787831225.235004:0:22843:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787831225.235009:0:22843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787831225.235011:0:22843:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787831225.235015:0:22843:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d233fad3000 00000020:00000080:1.0:1787831225.235018:0:22843:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787831225.235066:0:22843:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787831225.235070:0:22843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787831225.235071:0:22843:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787831225.235074:0:22843:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787831225.235076:0:22843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787831225.235078:0:22843:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1787831225.235082:0:22843:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d233fad3000 00000020:00000080:1.0:1787831225.235083:0:22843:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787831225.235141:0:22843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22037670c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8057bc0f-773b-4151-9d37-d94ddea63831:22843:1874676443978240:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787831225.235216:0:22843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831225.235264:0:22843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2314f920c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787831225.235273:0:22810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443978240 00000100:00100000:2.0:1787831225.235289:0:22810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443978240 00000100:00100000:2.0:1787831225.235338:0:22810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787831225.235347:0:22810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22025d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8057bc0f-773b-4151-9d37-d94ddea63831+11:22843:x1874676443978240:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787831225.235505:0:22810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22025d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8057bc0f-773b-4151-9d37-d94ddea63831+11:22843:x1874676443978240:12345-0@lo:502:llog_process_th.0 Request processed in 158us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831225.235513:0:22810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787831225.239210:0:22843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22037670c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8057bc0f-773b-4151-9d37-d94ddea63831:22843:1874676443978240:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787831225.239264:0:22843:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787831225.239274:0:22843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787831225.239276:0:22843:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1787831225.239299:0:22843:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1787831225.240365:0:22795:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1787831225.240399:0:22795:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787831225.240418:0:22795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d2303aa3400/0x95459fb9d1d2a6ca lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2a6d1 expref: -99 pid: 22795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831225.240430:0:22795:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8d2303aa3400/0x95459fb9d1d2a6ca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2a6d1 expref: -99 pid: 22795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787831225.240486:0:22795:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787831225.240490:0:22795:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d233fad3000 10000000:01000000:3.0:1787831225.240493:0:22795:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d233fad3000 10000000:01000000:3.0:1787831225.240497:0:22795:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787831225.240503:0:22795:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d233fad3000 from 1 10000000:01000000:3.0:1787831225.240506:0:22795:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787831225.240543:0:22795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d2301669600/0x95459fb9d1d2a6d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831225.240552:0:22795:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8d2301669600/0x95459fb9d1d2a6d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831225.240562:0:22795:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8d2301669600/0x95459fb9d1d2a6d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787831225.240585:0:22795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220483d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:22795:1874676443978368:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787831225.240675:0:22795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831225.240726:0:22795:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d23072d9780 going to sleep for 11 seconds 00000100:00100000:3.0:1787831225.242151:0:22809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443978368 00000100:00100000:3.0:1787831225.242164:0:22809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443978368 00000100:00100000:3.0:1787831225.242219:0:22809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787831225.242229:0:22809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22025d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8057bc0f-773b-4151-9d37-d94ddea63831+11:22795:x1874676443978368:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787831225.242243:0:22809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787831225.242259:0:22809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2301669c00/0x95459fb9d1d2a6df lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d2a6d8 expref: -99 pid: 22809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831225.242295:0:22809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2301669c00/0x95459fb9d1d2a6df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d2a6d8 expref: 12 pid: 22809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831225.242306:0:22809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2301669c00/0x95459fb9d1d2a6df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d2a6d8 expref: 12 pid: 22809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831225.242315:0:22809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2301669c00, rc 0) 00000100:00100000:3.0:1787831225.242391:0:22809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22025d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8057bc0f-773b-4151-9d37-d94ddea63831+12:22795:x1874676443978368:12345-0@lo:101:mount.lustre.0 Request processed in 164us (1716us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831225.242398:0:22809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787831225.242454:0:22795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220483d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:22795:1874676443978368:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787831225.242470:0:22795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8d2301669600/0x95459fb9d1d2a6d8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2a6df expref: -99 pid: 22795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831225.242479:0:22795:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8d2301669600/0x95459fb9d1d2a6d8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d2a6df expref: -99 pid: 22795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787831225.242546:0:22795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220483d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:22795:1874676443978496:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787831225.242576:0:22795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831225.242612:0:22795:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d23072d9780 going to sleep for 11 seconds 00000100:00100000:3.0:1787831225.242650:0:22808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443978496 00000100:00100000:3.0:1787831225.242654:0:22808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443978496 00000100:00100000:3.0:1787831225.242676:0:22808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787831225.242683:0:22808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22025d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8057bc0f-773b-4151-9d37-d94ddea63831+12:22795:x1874676443978496:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787831225.242803:0:22808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22025d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8057bc0f-773b-4151-9d37-d94ddea63831+12:22795:x1874676443978496:12345-0@lo:501:mount.lustre.0 Request processed in 120us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831225.242810:0:22808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787831225.242841:0:22795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220483d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:22795:1874676443978496:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787831225.242867:0:22795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220483d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:22795:1874676443978624:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787831225.242908:0:22795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831225.242920:0:22795:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d23072d9780 going to sleep for 11 seconds 00000100:00100000:3.0:1787831225.242932:0:22808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443978624 00000100:00100000:3.0:1787831225.242935:0:22808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443978624 00000100:00100000:3.0:1787831225.242956:0:22808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787831225.242961:0:22808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22025d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8057bc0f-773b-4151-9d37-d94ddea63831+12:22795:x1874676443978624:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787831225.245082:0:22808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22025d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8057bc0f-773b-4151-9d37-d94ddea63831+12:22795:x1874676443978624:12345-0@lo:503:mount.lustre.0 Request processed in 2112us (2165us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831225.245097:0:22808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787831225.245265:0:22795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220483d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:22795:1874676443978624:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787831225.247093:0:22847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233fae9a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8057bc0f-773b-4151-9d37-d94ddea63831:22847:1874676443978752:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787831225.247171:0:22847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831225.247215:0:22847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d220257c780 going to sleep for 11 seconds 00000100:00100000:3.0:1787831225.247343:0:22808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443978752 00000100:00100000:3.0:1787831225.247350:0:22808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443978752 00000100:00100000:3.0:1787831225.247392:0:22808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787831225.247402:0:22808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2305ffb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8057bc0f-773b-4151-9d37-d94ddea63831+12:22847:x1874676443978752:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787831225.247563:0:22808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2305ffb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8057bc0f-773b-4151-9d37-d94ddea63831+12:22847:x1874676443978752:12345-0@lo:502:llog_process_th.0 Request processed in 162us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831225.247572:0:22808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787831225.247703:0:22847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233fae9a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8057bc0f-773b-4151-9d37-d94ddea63831:22847:1874676443978752:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1787831225.247764:0:22847:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1787831225.247779:0:22847:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8d23088a3370) 00000020:00000080:0.0:1787831225.247799:0:22847:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:0.0:1787831225.247899:0:22847:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d233fad3000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787831225.248097:0:22847:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d233fad3000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787831225.248101:0:22847:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d233fad3000 4 00010000:00080000:0.0:1787831225.248136:0:22847:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d232b966000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.131@tcp at head 00010000:00010000:0.0:1787831225.253818:0:22847:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:0.0:1787831225.255246:0:22847:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1787831225.256727:0:22847:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787831225.256746:0:22847:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x95459fb9d1d2a6ed 00000100:00080000:0.0:1787831225.256758:0:22847:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787831225.256765:0:22847:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8d232b966000 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:0.0:1787831225.256814:0:22847:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d233fae9a40 x1874676443978880/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787831225.256851:0:22847:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787831225.258425:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233fae9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874676443978880:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787831225.258550:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831225.258697:0:22815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443978880 00000100:00100000:3.0:1787831225.258708:0:22815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443978880 00000100:00100000:3.0:1787831225.258770:0:22815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787831225.258781:0:22815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220483c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3618:x1874676443978880:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787831225.258806:0:22816:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1787831225.258860:0:22815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220483c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3618:x1874676443978880:12345-0@lo:38:llog_process_th.0 Request processed in 79us (309us total) trans 0 rc -11/-11 00000100:00100000:3.0:1787831225.258867:0:22815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787831225.258929:0:3618:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787831225.258939:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8d232b966000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787831225.258943:0:3618:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1787831225.258946:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233fae9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874676443978880:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787831225.259055:0:22816:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1787831225.260850:0:22847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233faea940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8057bc0f-773b-4151-9d37-d94ddea63831:22847:1874676443979008:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787831225.261418:0:22847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831225.261474:0:22847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d220257c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787831225.261879:0:22810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443979008 00000100:00100000:0.0:1787831225.261887:0:22810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443979008 00000100:00100000:0.0:1787831225.262111:0:22810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787831225.262123:0:22810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2305ffb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8057bc0f-773b-4151-9d37-d94ddea63831+12:22847:x1874676443979008:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787831225.264355:0:22810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2305ffb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8057bc0f-773b-4151-9d37-d94ddea63831+12:22847:x1874676443979008:12345-0@lo:502:llog_process_th.0 Request processed in 2226us (2935us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831225.264369:0:22810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787831225.264458:0:22847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233faea940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8057bc0f-773b-4151-9d37-d94ddea63831:22847:1874676443979008:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787831225.264526:0:22847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233faea940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8057bc0f-773b-4151-9d37-d94ddea63831:22847:1874676443979136:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787831225.264586:0:22847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831225.264620:0:22847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d220257c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787831225.264651:0:22809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443979136 00000100:00100000:0.0:1787831225.264656:0:22809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443979136 00000100:00100000:0.0:1787831225.264689:0:22809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787831225.264697:0:22809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2305ffa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8057bc0f-773b-4151-9d37-d94ddea63831+12:22847:x1874676443979136:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787831225.264788:0:22809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2305ffa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8057bc0f-773b-4151-9d37-d94ddea63831+12:22847:x1874676443979136:12345-0@lo:502:llog_process_th.0 Request processed in 91us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831225.264795:0:22809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787831225.264834:0:22847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233faea940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8057bc0f-773b-4151-9d37-d94ddea63831:22847:1874676443979136:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1787831225.264854:0:22847:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1787831225.265991:0:22795:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1787831225.266037:0:22795:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787831225.266059:0:22795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d2301669600/0x95459fb9d1d2a6d8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2a6df expref: -99 pid: 22795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831225.266073:0:22795:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8d2301669600/0x95459fb9d1d2a6d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2a6df expref: -99 pid: 22795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787831225.266146:0:22795:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787831225.266148:0:22795:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787831225.266150:0:22795:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787831225.266151:0:22795:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787831225.266153:0:22795:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787831225.266154:0:22795:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787831225.266156:0:22795:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787831225.266157:0:22795:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787831225.266159:0:22795:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787831225.266169:0:22795:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787831225.266174:0:22795:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1787831225.266177:0:22795:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787831225.266178:0:22795:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787831225.266179:0:22795:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787831225.266180:0:22795:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787831225.266181:0:22795:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787831225.266182:0:22795:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787831225.266183:0:22795:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787831225.266184:0:22795:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787831225.266185:0:22795:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787831225.266186:0:22795:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787831225.266217:0:22795:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1787831225.266241:0:22795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220483fc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:22795:1874676443979264:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787831225.266342:0:22795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831225.266411:0:22795:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d230879a9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787831225.266524:0:22808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443979264 00000100:00100000:0.0:1787831225.266539:0:22808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443979264 00000100:00100000:0.0:1787831225.266673:0:22808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787831225.266685:0:22808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2305ffa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8057bc0f-773b-4151-9d37-d94ddea63831+12:22795:x1874676443979264:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787831225.266718:0:22808:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787831225.266734:0:22808:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1787831225.270212:0:22808:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787831225.270238:0:22808:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1787831225.270265:0:22831:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787831225.270275:0:22831:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787831225.270307:0:22831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d233bf10800/0x95459fb9d1d2a6f4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831225.270335:0:22831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2301669a00/0x95459fb9d1d2a6c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d2a6bc expref: 12 pid: 22809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831225.270344:0:22831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d233bf10800/0x95459fb9d1d2a6f4 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831225.270389:0:22831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2301669a00/0x95459fb9d1d2a6c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x95459fb9d1d2a6bc expref: 12 pid: 22809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831225.270404:0:22831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d2301669a00/0x95459fb9d1d2a6c3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x95459fb9d1d2a6bc expref: 12 pid: 22809 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831225.270419:0:22831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233faea940 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22831:1874676443979392:0@lo:104: 00000100:00100000:0.0:1787831225.270487:0:22831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831225.270533:0:22831:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d220257c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787831225.270685:0:22799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443979392 00000100:00100000:0.0:1787831225.270692:0:22799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443979392 00000100:00100000:3.0:1787831225.270721:0:22808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2305ffa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8057bc0f-773b-4151-9d37-d94ddea63831+12:22795:x1874676443979264:12345-0@lo:253:mount.lustre.0 Request processed in 4033us (4373us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831225.270736:0:22799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787831225.270746:0:22799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233faea1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8057bc0f-773b-4151-9d37-d94ddea63831+3:22831:x1874676443979392:12345-0@lo:104: 00010000:00010000:0.0:1787831225.270758:0:22799:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff8d2303aa3a00/0x95459fb9d1d2a6bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d2a6c3 expref: -99 pid: 22795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831225.270811:0:22799:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787831225.270817:0:22799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233faea1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8057bc0f-773b-4151-9d37-d94ddea63831+3:22831:x1874676443979392:12345-0@lo:104: Request processed in 73us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831225.270825:0:22799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1787831225.270844:0:22805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787831225.270850:0:22805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8d2303aa3a00/0x95459fb9d1d2a6bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d2a6c3 expref: -99 pid: 22795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831225.270864:0:22805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2303aa3a00 already unused, calling callback (ffffffffc14f9c20) 10000000:00010000:0.0:1787831225.270868:0:22805:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8d2303aa3a00/0x95459fb9d1d2a6bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x95459fb9d1d2a6c3 expref: -99 pid: 22795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831225.270876:0:22805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8d2303aa3a00/0x95459fb9d1d2a6bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x95459fb9d1d2a6c3 expref: -99 pid: 22795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787831225.270884:0:22805:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8d2303aa3a00/0x95459fb9d1d2a6bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x95459fb9d1d2a6c3 expref: -99 pid: 22795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787831225.270890:0:22805:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787831225.271293:0:22805:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8d2303aa3a00/0x95459fb9d1d2a6bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d2a6c3 expref: -99 pid: 22795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831225.271300:0:22805:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787831225.271320:0:22805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8d2303aa3a00/0x95459fb9d1d2a6bc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d2a6c3 expref: -99 pid: 22795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831225.271328:0:22805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8d2303aa3a00/0x95459fb9d1d2a6bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d2a6c3 expref: -99 pid: 22795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831225.271343:0:22805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787831225.271345:0:22805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787831225.271347:0:22805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787831225.271389:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233fae9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8057bc0f-773b-4151-9d37-d94ddea63831:3620:1874676443979520:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787831225.271397:0:22808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787831225.271431:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831225.271476:0:22801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443979520 00000100:00100000:2.0:1787831225.271483:0:22801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443979520 00010000:00010000:2.0:1787831225.271511:0:22801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2301669a00/0x95459fb9d1d2a6c3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d2a6bc expref: 12 pid: 22809 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787831225.271515:0:22795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220483fc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:22795:1874676443979264:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787831225.271532:0:22831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233faea940 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22831:1874676443979392:0@lo:104: 10000000:01000000:3.0:1787831225.271546:0:22795:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1787831225.271552:0:22795:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787831225.271554:0:22795:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00010000:00010000:0.0:1787831225.271556:0:22831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d233bf10800/0x95459fb9d1d2a6f4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831225.271561:0:22801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000020:01000004:3.0:1787831225.271562:0:22795:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787831225.271572:0:22795:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787831225.271577:0:22795:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000100:00100000:2.0:1787831225.271578:0:22801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fae8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8057bc0f-773b-4151-9d37-d94ddea63831+12:3620:x1874676443979520:12345-0@lo:103:ldlm_bl.0 00000020:01000004:3.0:1787831225.271582:0:22795:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787831225.271590:0:22795:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787831225.271594:0:22795:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787831225.271596:0:22795:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00010000:00010000:2.0:1787831225.271597:0:22801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:01000004:3.0:1787831225.271599:0:22795:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00010000:00010000:2.0:1787831225.271607:0:22801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2301669a00/0x95459fb9d1d2a6c3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d2a6bc expref: 12 pid: 22809 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:02000000:3.0:1787831225.271620:0:22795:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:2.0:1787831225.271645:0:22801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2301669a00/0x95459fb9d1d2a6c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x95459fb9d1d2a6bc expref: 12 pid: 22809 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831225.271667:0:22801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2301669a00/0x95459fb9d1d2a6c3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x95459fb9d1d2a6bc expref: 12 pid: 22809 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831225.271695:0:22801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d233bf10800/0x95459fb9d1d2a6f4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831225.271703:0:22801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d233bf10800/0x95459fb9d1d2a6f4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787831225.271716:0:22801:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001441998s 00010000:00010000:2.0:1787831225.271720:0:22801:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d233bf10800/0x95459fb9d1d2a6f4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831225.271733:0:22831:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: MGS lock: ffff8d233bf10800/0x95459fb9d1d2a6f4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831225.271734:0:22801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d233bf10800/0x95459fb9d1d2a6f4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831225.271755:0:22831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d233bf10800/0x95459fb9d1d2a6f4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831225.271756:0:22801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d233bf10800/0x95459fb9d1d2a6f4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831225.271775:0:22801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d233bf10800/0x95459fb9d1d2a6f4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831225.271781:0:22801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233bf10800 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:2.0:1787831225.271785:0:22801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d233bf10800/0x95459fb9d1d2a6f4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831225.271792:0:22801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d233bf10800/0x95459fb9d1d2a6f4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831225.271800:0:22801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d233bf10800/0x95459fb9d1d2a6f4 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831225.271807:0:22801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d233bf10800/0x95459fb9d1d2a6f4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831225.271825:0:22801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787831225.271870:0:22801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fae8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8057bc0f-773b-4151-9d37-d94ddea63831+11:3620:x1874676443979520:12345-0@lo:103:ldlm_bl.0 Request processed in 295us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831225.271878:0:22801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787831225.272056:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233fae9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8057bc0f-773b-4151-9d37-d94ddea63831:3620:1874676443979520:0@lo:103:ldlm_bl.0 00000020:00080000:1.0:1787831225.302742:0:22795:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967530 00000040:01000000:1.0:1787831225.303412:0:22795:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1787831225.303553:0:22856:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967530 00000020:00080000:2.0:1787831225.303559:0:22856:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967530 00000040:01000000:0.0:1787831225.304054:0:22857:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1787831225.304211:0:22795:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00080000:1.0:1787831225.304587:0:22858:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff8d22037670c0 x1874676443979648/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787831225.304602:0:22858:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d230665e180 going to sleep for 0 seconds 00000040:01000000:0.0:1787831225.305093:0:22795:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1787831225.305145:0:22795:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787831225.305197:0:22857:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1787831225.305804:0:22795:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1787831225.305814:0:22795:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1787831225.305854:0:22795:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787831225.307223:0:22795:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1787831225.307982:0:22795:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1787831225.308023:0:22795:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1787831225.308602:0:22795:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00000040:00080000:3.0:1787831225.309174:0:22857:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1787831225.309245:0:22857:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00080000:10000000:0.0:1787831225.309344:0:22795:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/32) registered 00000001:00000004:0.0:1787831225.311578:0:22795:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:0.0:1787831225.317278:0:22795:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1787831225.317342:0:22795:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffae38c19f3988 00100000:10000000:0.0:1787831225.317353:0:22795:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1787831225.319023:0:22795:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787831225.319047:0:22795:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.131@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787831225.319072:0:22795:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=45 00000080:00000004:2.0:1787831225.319101:0:22795:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1787831225.320277:0:22795:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787831225.320789:0:22795:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787831225.958838:0:22804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787831226.086844:0:22812:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787831226.086857:0:22812:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d233fad3000 from 11 10000000:01000000:1.0:1787831226.086866:0:22812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787831226.086926:0:22812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233be94a00/0x95459fb9d1d2a6fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831226.086940:0:22812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8d233be94a00/0x95459fb9d1d2a6fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831226.086956:0:22812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8d233be94a00/0x95459fb9d1d2a6fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831226.086996:0:22812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22037652c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8057bc0f-773b-4151-9d37-d94ddea63831:22812:1874676443979776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787831226.087104:0:22812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831226.087164:0:22810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443979776 00000100:00100000:1.0:1787831226.087167:0:22812:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d230665ee40 going to sleep for 11 seconds 00000100:00100000:2.0:1787831226.087175:0:22810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443979776 00000100:00100000:2.0:1787831226.087246:0:22810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787831226.087257:0:22810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2305ffa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8057bc0f-773b-4151-9d37-d94ddea63831+11:22812:x1874676443979776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787831226.087284:0:22810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787831226.087302:0:22810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2303aa3600/0x95459fb9d1d2a702 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d2a6fb expref: -99 pid: 22810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831226.087330:0:22810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2303aa3600/0x95459fb9d1d2a702 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d2a6fb expref: 12 pid: 22810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831226.087342:0:22810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2303aa3600/0x95459fb9d1d2a702 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d2a6fb expref: 12 pid: 22810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831226.087352:0:22810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2303aa3600, rc 0) 00000100:00100000:2.0:1787831226.087402:0:22810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2305ffa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8057bc0f-773b-4151-9d37-d94ddea63831+12:22812:x1874676443979776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 146us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831226.087420:0:22810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787831226.087437:0:22812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22037652c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8057bc0f-773b-4151-9d37-d94ddea63831:22812:1874676443979776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787831226.087462:0:22812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8d233be94a00/0x95459fb9d1d2a6fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2a702 expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831226.087473:0:22812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8d233be94a00/0x95459fb9d1d2a6fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d2a702 expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831226.087551:0:22812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22037652c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8057bc0f-773b-4151-9d37-d94ddea63831:22812:1874676443979904:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787831226.087591:0:22812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831226.087616:0:22812:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d230665ee40 going to sleep for 11 seconds 00000100:00100000:2.0:1787831226.087748:0:22808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443979904 00000100:00100000:2.0:1787831226.087753:0:22808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443979904 00000100:00100000:2.0:1787831226.087776:0:22808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787831226.087783:0:22808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2305ff8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8057bc0f-773b-4151-9d37-d94ddea63831+12:22812:x1874676443979904:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787831226.087799:0:22808:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787831226.087820:0:22808:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787831226.087824:0:22808:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:2.0:1787831226.088770:0:22808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2305ff8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8057bc0f-773b-4151-9d37-d94ddea63831+12:22812:x1874676443979904:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 983us (1174us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831226.088779:0:22808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787831226.088824:0:22812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22037652c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8057bc0f-773b-4151-9d37-d94ddea63831:22812:1874676443979904:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787831226.088880:0:22812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787831226.088889:0:22812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233be94a00/0x95459fb9d1d2a6fb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2a702 expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831226.088899:0:22812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8d233be94a00/0x95459fb9d1d2a6fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2a702 expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787831226.283839:0:22852:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787831226.283850:0:22852:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787831226.288715:0:22852:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 4 count 4 00000040:00080000:3.0:1787831226.288783:0:22852:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1787831226.345310:0:22858:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d230665e180 going to sleep for 0 seconds 00010000:00010000:0.0:1787831226.982998:0:22805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787831227.302811:0:22852:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787831227.302820:0:22852:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787831227.302981:0:22852:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 1 00000040:00080000:3.0:1787831227.303020:0:22852:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787831227.303155:0:22852:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00000100:00100000:3.0:1787831227.368012:0:22858:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d230665e180 going to sleep for 0 seconds 00010000:00010000:1.0:1787831228.018731:0:22804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787831228.390700:0:22858:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d230665e180 going to sleep for 0 seconds 00010000:00010000:0.0:1787831229.030806:0:22805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787831229.246029:0:23100:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg331-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1787831229.417690:0:22858:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d230665e180 going to sleep for 0 seconds 00010000:00010000:0.0:1787831230.057475:0:22804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787831230.115338:0:23152:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787831230.115528:0:23152:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1787831230.439689:0:22858:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d230665e180 going to sleep for 0 seconds 00000100:00080000:1.0:1787831230.695204:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1787831230.695210:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1787831230.695215:0:8:0:(import.c:65:import_set_state_nolock()) ffff8d233f542000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787831230.695223:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 516 00000100:00080000:1.0:1787831230.695229:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787831230.695235:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8d233f542000 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:1.0:1787831230.695272:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2203764000 x1874676443980160/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787831230.695352:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203764000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1874676443980160:0@lo:38:kworker.0 00000100:00100000:2.0:1787831230.695448:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787831230.695528:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787831230.695533:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787831230.695536:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787831230.695539:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787831230.695542:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1787831230.695545:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787831230.695546:0:8:0:(import.c:65:import_set_state_nolock()) ffff8d232b966000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787831230.695552:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8d232b966000 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:1.0:1787831230.695567:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2203764b40 x1874676443980288/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787831230.695652:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203767480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8057bc0f-773b-4151-9d37-d94ddea63831:3621:1874676443980032:0@lo:400:kworker.0 00000100:00100000:3.0:1787831230.695702:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831230.696267:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203764b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874676443980288:0@lo:38:kworker.0 00000100:00100000:2.0:1787831230.696330:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831230.696674:0:22810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443980032 00000100:00100000:2.0:1787831230.696682:0:22810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443980032 00000100:00100000:2.0:1787831230.696735:0:22810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787831230.696762:0:22810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2305ff8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8057bc0f-773b-4151-9d37-d94ddea63831+12:3621:x1874676443980032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787831230.696816:0:22810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2305ff8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8057bc0f-773b-4151-9d37-d94ddea63831+12:3621:x1874676443980032:12345-0@lo:400:kworker.0 Request processed in 56us (1113us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831230.696824:0:22810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787831230.696871:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203767480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8057bc0f-773b-4151-9d37-d94ddea63831:3621:1874676443980032:0@lo:400:kworker.0 00000100:00100000:1.0:1787831230.697157:0:22821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443980160 00000100:00100000:1.0:1787831230.697168:0:22821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443980160 00000100:00100000:1.0:1787831230.697204:0:22821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787831230.697210:0:22821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d232f61cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3618:x1874676443980160:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787831230.697227:0:22821:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787831230.697272:0:22821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d232f61cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3618:x1874676443980160:12345-0@lo:38:kworker.0 Request processed in 62us (1825us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787831230.697278:0:22821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1787831230.697439:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8d233f542000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787831230.697445:0:3618:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787831230.697448:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203764000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1874676443980160:0@lo:38:kworker.0 00000100:00100000:0.0:1787831230.697848:0:22817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443980288 00000100:00100000:0.0:1787831230.697853:0:22817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443980288 00000100:00100000:0.0:1787831230.697928:0:22817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787831230.697934:0:22817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d232f61da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3618:x1874676443980288:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1787831230.697954:0:22817:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 521 last 0 00000020:00000080:0.0:1787831230.697987:0:22817:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x95459fb9d1d2a709 00000004:00100000:0.0:1787831230.698001:0:22817:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787831230.698136:0:22817:0:(import.c:65:import_set_state_nolock()) ffff8d232f732000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787831230.698196:0:22817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d232f61da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874676443980288:12345-0@lo:38:kworker.0 Request processed in 261us (1865us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831230.698203:0:22817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787831230.698278:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8d2203764b40 x1874676443980288/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787831240 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787831230.698291:0:3618:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1787831230.698299:0:3618:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1787831230.698304:0:3618:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787831230.698306:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8d232b966000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787831230.698312:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203764b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874676443980288:0@lo:38:kworker.0 00000020:00000004:0.0:1787831230.867689:0:23202:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787831230.868155:0:23202:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787831231.079524:0:22805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787831231.465677:0:22858:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d230665e180 going to sleep for 0 seconds 00010000:00010000:1.0:1787831232.106355:0:22804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787831232.488313:0:22858:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d230665e180 going to sleep for 0 seconds 00010000:00010000:0.0:1787831233.127852:0:22805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787831233.513449:0:22858:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d230665e180 going to sleep for 0 seconds 00010000:00010000:3.0:1787831234.155970:0:22804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787831234.535805:0:22858:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d230665e180 going to sleep for 0 seconds 00010000:00010000:0.0:1787831235.175766:0:22805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787831235.561282:0:22858:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d230665e180 going to sleep for 0 seconds 00000100:00080000:2.0:1787831235.818079:0:478:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1787831235.818084:0:478:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1787831235.818088:0:478:0:(import.c:65:import_set_state_nolock()) ffff8d233f542000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787831235.818095:0:478:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 521 00000100:00080000:2.0:1787831235.818100:0:478:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787831235.818106:0:478:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8d233f542000 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:2.0:1787831235.818127:0:478:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d232f61cb40 x1874676443980544/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787831235.821425:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d232f61c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8057bc0f-773b-4151-9d37-d94ddea63831:3622:1874676443980416:0@lo:400:kworker.0 00000100:00100000:0.0:1787831235.821499:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831235.821570:0:22808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443980416 00000100:00100000:0.0:1787831235.821576:0:22808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443980416 00000100:00100000:0.0:1787831235.824672:0:22808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787831235.824691:0:22808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2305ffb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8057bc0f-773b-4151-9d37-d94ddea63831+12:3622:x1874676443980416:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787831235.824716:0:478:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787831235.824721:0:478:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787831235.824723:0:478:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787831235.824726:0:478:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787831235.824774:0:22808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2305ffb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8057bc0f-773b-4151-9d37-d94ddea63831+12:3622:x1874676443980416:12345-0@lo:400:kworker.0 Request processed in 91us (3275us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831235.824782:0:22808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787831235.824827:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d232f61c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874676443980672:0@lo:400:kworker.0 00000100:00100000:2.0:1787831235.824873:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831235.824928:0:22816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443980672 00000100:00100000:2.0:1787831235.824935:0:22816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443980672 00000100:00100000:2.0:1787831235.824966:0:22816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787831235.824973:0:22816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d232f61fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874676443980672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787831235.825006:0:22816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d232f61fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874676443980672:12345-0@lo:400:kworker.0 Request processed in 34us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831235.825012:0:22816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787831235.825044:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8d232f61c000 x1874676443980672/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787831251 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787831235.825058:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d232f61c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874676443980672:0@lo:400:kworker.0 00000100:00100000:3.0:1787831235.825126:0:3618:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787831225/real 1787831225] req@ffff8d2203767840 x1874676443977216/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787831235 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787831235.825143:0:3618:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d2203767840 x1874676443977216/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787831235 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787831235.825155:0:3618:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787831225/real 1787831225] req@ffff8d2203767c00 x1874676443977088/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787831235 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787831235.825164:0:3618:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d2203767c00 x1874676443977088/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787831235 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787831235.825182:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d232f61cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1874676443980544:0@lo:38:kworker.0 00000100:00100000:3.0:1787831235.825225:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831235.825253:0:22821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443980544 00000100:00100000:3.0:1787831235.825256:0:22821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443980544 00000100:00100000:3.0:1787831235.825276:0:22821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787831235.825281:0:22821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220483d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3618:x1874676443980544:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1787831235.825295:0:22821:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787831235.833362:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d232f61c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8057bc0f-773b-4151-9d37-d94ddea63831:3622:1874676443980416:0@lo:400:kworker.0 00000100:00080000:2.0:1787831235.834441:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8d2202769000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787831235.834470:0:3618:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787831235.834476:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203767840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1874676443977216:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1787831235.834483:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8d233f541000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787831235.834488:0:3618:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787831235.834491:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203767c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1874676443977088:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1787831235.836528:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787831235.836537:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1787831235.836553:0:8:0:(import.c:65:import_set_state_nolock()) ffff8d233f541000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787831235.836560:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 516 00000100:00080000:0.0:1787831235.836565:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787831235.836573:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d233f541000 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:0.0:1787831235.836607:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d233fae9a40 x1874676443980800/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787831235.836655:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787831235.836658:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787831235.836660:0:8:0:(import.c:65:import_set_state_nolock()) ffff8d2202769000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787831235.836663:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 516 00000100:00080000:0.0:1787831235.836665:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787831235.836668:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d2202769000 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:2.0:1787831235.836672:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233fae9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1874676443980800:0@lo:8:kworker.0 00000100:00100000:0.0:1787831235.836679:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d233faea940 x1874676443980928/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000400:00000100:2.0:1787831235.836726:0:3618:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874676443980800 offset 0 length 520: 4 00000100:00100000:2.0:1787831235.836768:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233faea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1874676443980928:0@lo:8:kworker.0 00000400:00000100:2.0:1787831235.836788:0:3618:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874676443980928 offset 0 length 520: 4 00000100:00100000:3.0:1787831235.862827:0:22821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220483d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3618:x1874676443980544:12345-0@lo:38:kworker.0 Request processed in 37536us (37592us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787831235.862841:0:22821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1787831235.863020:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8d233f542000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787831235.863026:0:3618:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787831235.863030:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d232f61cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1874676443980544:0@lo:38:kworker.0 00010000:00010000:3.0:1787831236.199712:0:22804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787831236.583757:0:22858:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d230665e180 going to sleep for 0 seconds 00010000:00010000:0.0:1787831237.226555:0:22805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787831237.544561:0:22852:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787831237.607927:0:22858:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d230665e180 going to sleep for 0 seconds 00000020:01000004:2.0:1787831237.956230:0:23547:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787831237.956234:0:23547:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:2.0:1787831237.956236:0:23547:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1787831237.956356:0:23547:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8d2201e09000 00000020:01000004:2.0:1787831237.956372:0:23547:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:2.0:1787831237.956384:0:23547:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1787831237.956397:0:23547:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff8d233f4319b8) 00000020:00000080:2.0:1787831237.956419:0:23547:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1787831238.023592:0:23547:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1787831238.026378:0:23547:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:0.0:1787831238.027805:0:23547:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:0.0:1787831238.028180:0:23547:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:0.0:1787831238.028439:0:23547:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1787831238.029221:0:23547:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:0.0:1787831238.029513:0:23547:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1787831238.029856:0:23547:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:0.0:1787831238.030189:0:23547:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:0.0:1787831238.030500:0:23547:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:0.0:1787831238.030856:0:23547:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:0.0:1787831238.031228:0:23547:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1787831238.031545:0:23547:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:0.0:1787831238.031798:0:23547:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1787831238.033387:0:23547:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:1.0:1787831238.033609:0:23547:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:1.0:1787831238.034157:0:23547:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:1.0:1787831238.034395:0:23547:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:1.0:1787831238.034743:0:23547:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:1.0:1787831238.034914:0:23547:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:1.0:1787831238.035253:0:23547:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:1.0:1787831238.035558:0:23547:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:1.0:1787831238.035848:0:23547:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:1.0:1787831238.036156:0:23547:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:1.0:1787831238.036386:0:23547:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:1.0:1787831238.036598:0:23547:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:1.0:1787831238.037548:0:23547:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:1.0:1787831238.038215:0:23547:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:1.0:1787831238.038451:0:23547:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:1.0:1787831238.038746:0:23547:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:1.0:1787831238.039025:0:23547:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:1.0:1787831238.039433:0:23547:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:1.0:1787831238.039818:0:23547:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:1.0:1787831238.040201:0:23547:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:1.0:1787831238.040445:0:23547:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:1.0:1787831238.040887:0:23547:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:1.0:1787831238.041211:0:23547:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:1.0:1787831238.041430:0:23547:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:1.0:1787831238.041747:0:23547:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:1.0:1787831238.041937:0:23547:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:1.0:1787831238.042358:0:23547:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:1.0:1787831238.042604:0:23547:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:1.0:1787831238.042937:0:23547:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:1.0:1787831238.043359:0:23547:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:1.0:1787831238.043571:0:23547:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1787831238.043914:0:23547:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00080000:01000000:1.0:1787831238.046340:0:23547:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1787831238.046609:0:23547:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:1.0:1787831238.046874:0:23547:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787831238.046886:0:23547:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x95459fb9d1d2a717 00000020:01000004:1.0:1787831238.046894:0:23547:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:1.0:1787831238.046914:0:23547:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.131@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1787831238.046918:0:23547:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.131@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1787831238.046925:0:23547:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:1.0:1787831238.047143:0:23547:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:1.0:1787831238.047148:0:23547:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.131@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:1.0:1787831238.052349:0:23547:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.131@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787831238.052385:0:23547:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.131@tcp, index=0001, flags=0x20001 00000020:01000004:1.0:1787831238.052390:0:23547:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787831238.052392:0:23547:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787831238.052396:0:23547:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787831238.052398:0:23547:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787831238.052400:0:23547:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787831238.052401:0:23547:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787831238.052402:0:23547:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787831238.052404:0:23547:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787831238.052405:0:23547:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787831238.052409:0:23547:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:1.0:1787831238.052411:0:23547:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787831238.052412:0:23547:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787831238.052413:0:23547:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787831238.052414:0:23547:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787831238.052415:0:23547:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787831238.052416:0:23547:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787831238.052417:0:23547:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787831238.052418:0:23547:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787831238.052419:0:23547:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787831238.052451:0:23547:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1787831238.052469:0:23547:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203765e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:23547:1874676443981056:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787831238.052542:0:23547:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831238.052587:0:23547:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2303250cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787831238.052637:0:22809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443981056 00000100:00100000:3.0:1787831238.052646:0:22809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443981056 00000100:00100000:3.0:1787831238.052700:0:22809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787831238.052709:0:22809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2305ff8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8057bc0f-773b-4151-9d37-d94ddea63831+12:23547:x1874676443981056:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787831238.052736:0:22809:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1787831238.052740:0:22809:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:3.0:1787831238.052792:0:22809:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1787831238.053182:0:22809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2305ff8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8057bc0f-773b-4151-9d37-d94ddea63831+12:23547:x1874676443981056:12345-0@lo:253:mount.lustre.0 Request processed in 473us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831238.053199:0:22809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787831238.055246:0:23547:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203765e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:23547:1874676443981056:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787831238.055265:0:23547:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1787831238.055268:0:23547:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787831238.055270:0:23547:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787831238.055272:0:23547:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787831238.055282:0:23547:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787831238.055284:0:23547:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787831238.055286:0:23547:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787831238.055287:0:23547:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787831238.055290:0:23547:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787831238.055292:0:23547:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787831238.055393:0:23547:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d2201e09000 from lustre-MDT0001 10000000:01000000:0.0:1787831238.055434:0:23547:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:0.0:1787831238.055437:0:23547:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1787831238.055444:0:23547:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8d2306c6cd28 local copy 00010000:00010000:0.0:1787831238.055454:0:23547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d2301668600/0x95459fb9d1d2a60d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2a614 expref: -99 pid: 22795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831238.055564:0:23547:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233faead00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:23547:1874676443981184:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787831238.055614:0:23547:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831238.055675:0:23547:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d230879a6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787831238.055848:0:22810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443981184 00000100:00100000:2.0:1787831238.055854:0:22810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443981184 00000100:00100000:2.0:1787831238.055899:0:22810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787831238.055907:0:22810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2305ff9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8057bc0f-773b-4151-9d37-d94ddea63831+12:23547:x1874676443981184:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787831238.055991:0:22810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2305ff9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8057bc0f-773b-4151-9d37-d94ddea63831+12:23547:x1874676443981184:12345-0@lo:501:mount.lustre.0 Request processed in 84us (375us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787831238.055998:0:22810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787831238.056059:0:23547:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233faead00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:23547:1874676443981184:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1787831238.056073:0:23547:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.131@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1787831238.056173:0:23547:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.131@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1787831238.056180:0:23547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d2301668600/0x95459fb9d1d2a60d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2a614 expref: -99 pid: 22795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831238.056189:0:23547:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8d2301668600/0x95459fb9d1d2a60d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2a614 expref: -99 pid: 22795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787831238.056235:0:23547:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d2201e09000 10000000:01000000:0.0:1787831238.056240:0:23547:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787831238.056244:0:23547:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8d2306c6cd28 10000000:01000000:0.0:1787831238.056246:0:23547:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1787831238.056249:0:23547:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8d2306c6cd28 from 1 10000000:01000000:0.0:1787831238.056252:0:23547:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1787831238.056342:0:23547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233bf11400/0x95459fb9d1d2a71e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831238.056351:0:23547:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8d233bf11400/0x95459fb9d1d2a71e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831238.056361:0:23547:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8d233bf11400/0x95459fb9d1d2a71e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831238.056374:0:23547:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233faead00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:23547:1874676443981312:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787831238.056399:0:23547:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831238.057515:0:23547:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d230879a6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787831238.059564:0:22809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443981312 00000100:00100000:3.0:1787831238.059576:0:22809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443981312 00000100:00100000:3.0:1787831238.059793:0:22809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787831238.059804:0:22809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2305ff9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8057bc0f-773b-4151-9d37-d94ddea63831+12:23547:x1874676443981312:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787831238.059835:0:22809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787831238.059853:0:22809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2301669200/0x95459fb9d1d2a725 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d2a71e expref: -99 pid: 22809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831238.059879:0:22809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2301669200/0x95459fb9d1d2a725 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d2a71e expref: 13 pid: 22809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831238.059890:0:22809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2301669200/0x95459fb9d1d2a725 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d2a71e expref: 13 pid: 22809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831238.059899:0:22809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2301669200, rc 0) 00000100:00100000:3.0:1787831238.060236:0:22809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2305ff9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8057bc0f-773b-4151-9d37-d94ddea63831+13:23547:x1874676443981312:12345-0@lo:101:mount.lustre.0 Request processed in 433us (3835us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831238.060244:0:22809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787831238.061618:0:23547:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233faead00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:23547:1874676443981312:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787831238.061678:0:23547:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8d233bf11400/0x95459fb9d1d2a71e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2a725 expref: -99 pid: 23547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831238.061691:0:23547:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8d233bf11400/0x95459fb9d1d2a71e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d2a725 expref: -99 pid: 23547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787831238.061712:0:23547:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1787831238.061729:0:23547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233bf11400/0x95459fb9d1d2a71e lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2a725 expref: -99 pid: 23547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831238.061753:0:23547:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8d233bf11400/0x95459fb9d1d2a71e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2a725 expref: -99 pid: 23547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787831238.061765:0:23547:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8d2201e09000 10000000:01000000:0.0:1787831238.061769:0:23547:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1787831238.061774:0:23547:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8d2201e09000 from 1 10000000:01000000:0.0:1787831238.061776:0:23547:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1787831238.061808:0:23547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233bf11c00/0x95459fb9d1d2a72c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831238.061816:0:23547:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8d233bf11c00/0x95459fb9d1d2a72c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831238.061824:0:23547:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8d233bf11c00/0x95459fb9d1d2a72c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831238.061841:0:23547:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233faead00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:23547:1874676443981440:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787831238.061887:0:23547:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831238.061919:0:23547:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d230879a6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787831238.062075:0:22808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443981440 00000100:00100000:2.0:1787831238.062081:0:22808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443981440 00000100:00100000:2.0:1787831238.062125:0:22808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787831238.062132:0:22808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2305ffbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8057bc0f-773b-4151-9d37-d94ddea63831+13:23547:x1874676443981440:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787831238.062143:0:22808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787831238.062154:0:22808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2303aa2c00/0x95459fb9d1d2a733 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d2a72c expref: -99 pid: 22808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831238.062183:0:22808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2303aa2c00/0x95459fb9d1d2a733 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d2a72c expref: 14 pid: 22808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831238.062203:0:22808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2303aa2c00/0x95459fb9d1d2a733 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d2a72c expref: 14 pid: 22808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831238.062212:0:22808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2303aa2c00, rc 0) 00000100:00100000:2.0:1787831238.062257:0:22808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2305ffbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8057bc0f-773b-4151-9d37-d94ddea63831+14:23547:x1874676443981440:12345-0@lo:101:mount.lustre.0 Request processed in 126us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831238.062264:0:22808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787831238.062578:0:23547:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233faead00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:23547:1874676443981440:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787831238.062590:0:23547:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8d233bf11c00/0x95459fb9d1d2a72c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2a733 expref: -99 pid: 23547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831238.062598:0:23547:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8d233bf11c00/0x95459fb9d1d2a72c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d2a733 expref: -99 pid: 23547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787831238.062609:0:23547:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1787831238.062720:0:23547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233bf11c00/0x95459fb9d1d2a72c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2a733 expref: -99 pid: 23547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831238.062729:0:23547:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8d233bf11c00/0x95459fb9d1d2a72c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2a733 expref: -99 pid: 23547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787831238.062736:0:23547:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1787831238.062747:0:23547:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787831238.062752:0:23547:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8d2201e09000 10000000:01000000:3.0:1787831238.062755:0:23547:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1787831238.062758:0:23547:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:3.0:1787831238.062760:0:23547:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1787831238.062777:0:23547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d2301669800/0x95459fb9d1d2a73a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831238.062785:0:23547:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8d2301669800/0x95459fb9d1d2a73a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831238.062792:0:23547:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8d2301669800/0x95459fb9d1d2a73a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787831238.062805:0:23547:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220483e580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:23547:1874676443981568:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787831238.062831:0:23547:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831238.062885:0:23547:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d232f602b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787831238.066849:0:22809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443981568 00000100:00100000:1.0:1787831238.066863:0:22809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443981568 00000100:00100000:0.0:1787831238.070955:0:22809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787831238.070968:0:22809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2305ff9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8057bc0f-773b-4151-9d37-d94ddea63831+14:23547:x1874676443981568:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787831238.070986:0:22809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787831238.071013:0:22809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d233bf11200/0x95459fb9d1d2a741 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d2a73a expref: -99 pid: 22809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831238.071050:0:22809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d233bf11200/0x95459fb9d1d2a741 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d2a73a expref: 15 pid: 22809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831238.071080:0:22809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d233bf11200/0x95459fb9d1d2a741 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d2a73a expref: 15 pid: 22809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831238.071089:0:22809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233bf11200, rc 0) 00000100:00100000:0.0:1787831238.071182:0:22809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2305ff9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8057bc0f-773b-4151-9d37-d94ddea63831+15:23547:x1874676443981568:12345-0@lo:101:mount.lustre.0 Request processed in 216us (8349us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831238.071428:0:23547:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220483e580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:23547:1874676443981568:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787831238.071447:0:23547:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8d2301669800/0x95459fb9d1d2a73a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2a741 expref: -99 pid: 23547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831238.071477:0:23547:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8d2301669800/0x95459fb9d1d2a73a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d2a741 expref: -99 pid: 23547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831238.071878:0:22809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000040:00080000:3.0:1787831238.073563:0:23547:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000040:00080000:3.0:1787831238.074752:0:23547:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787831238.079442:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:3.0:1787831238.079496:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 136 off8552 00000040:00080000:3.0:1787831238.079511:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 176 off8728 00000040:00080000:3.0:1787831238.079525:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8952 00000040:00080000:3.0:1787831238.079553:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 224 off9176 00000040:00080000:3.0:1787831238.079571:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 120 off9296 00000040:00080000:3.0:1787831238.079584:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 112 off9408 00000040:00080000:3.0:1787831238.079598:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 160 off9568 00000040:00080000:3.0:1787831238.079611:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9792 00000040:00080000:3.0:1787831238.079625:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10016 00000040:00080000:3.0:1787831238.079970:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 88 off10104 00000040:00080000:3.0:1787831238.079995:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 144 off10248 00000040:00080000:3.0:1787831238.080009:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].13, 152 off10400 00000040:00080000:3.0:1787831238.081700:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].14, 168 off10568 00000040:00080000:3.0:1787831238.081718:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].15, 224 off10792 00000040:00080000:3.0:1787831238.081732:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].16, 224 off11016 00000040:00080000:3.0:1787831238.081747:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].17, 80 off11096 00000040:00080000:3.0:1787831238.081763:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].18, 224 off11320 00000040:00080000:3.0:1787831238.081778:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].19, 224 off11544 00000040:00080000:3.0:1787831238.081793:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].20, 160 off11704 00000040:00080000:3.0:1787831238.081820:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].21, 224 off11928 00000040:00080000:3.0:1787831238.081835:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].22, 224 off12152 00000040:00080000:3.0:1787831238.081849:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].23, 80 off12232 00000040:00080000:3.0:1787831238.081864:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].24, 224 off12456 00000040:00080000:3.0:1787831238.081877:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].25, 224 off12680 00000040:00080000:3.0:1787831238.082096:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].26, 88 off12768 00000040:00080000:3.0:1787831238.082118:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].27, 144 off12912 00000040:00080000:3.0:1787831238.082133:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].28, 152 off13064 00000040:00080000:3.0:1787831238.082145:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].29, 136 off13200 00000040:00080000:3.0:1787831238.082157:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].30, 224 off13424 00000040:00080000:3.0:1787831238.082169:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].31, 224 off13648 00000040:00080000:3.0:1787831238.082181:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].32, 80 off13728 00000040:00080000:3.0:1787831238.082375:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].33, 224 off13952 00000040:00080000:3.0:1787831238.082390:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].34, 224 off14176 00000040:00080000:3.0:1787831238.082401:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].35, 88 off14264 00000040:00080000:3.0:1787831238.082413:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].36, 144 off14408 00000040:00080000:3.0:1787831238.082425:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].37, 152 off14560 00000040:00080000:3.0:1787831238.082454:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].38, 136 off14696 00000040:00080000:3.0:1787831238.082466:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].39, 224 off14920 00000040:00080000:3.0:1787831238.082700:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].40, 224 off15144 00000040:00080000:3.0:1787831238.082718:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].41, 80 off15224 00000040:00080000:3.0:1787831238.082729:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].42, 224 off15448 00000040:00080000:3.0:1787831238.082741:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].43, 224 off15672 00000040:00080000:3.0:1787831238.082753:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].44, 120 off15792 00000040:00080000:3.0:1787831238.082779:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].45, 224 off16016 00000040:00080000:3.0:1787831238.082785:0:23547:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 45 count 46 00000100:00100000:3.0:1787831238.082907:0:23547:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220483e580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:23547:1874676443981696:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787831238.082969:0:23547:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831238.083017:0:23547:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d233bf5a600 going to sleep for 11 seconds 00000100:00100000:1.0:1787831238.083068:0:22808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443981696 00000100:00100000:1.0:1787831238.083075:0:22808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443981696 00000100:00100000:1.0:1787831238.083126:0:22808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787831238.083140:0:22808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233cd45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8057bc0f-773b-4151-9d37-d94ddea63831+15:23547:x1874676443981696:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787831238.083287:0:22808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233cd45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8057bc0f-773b-4151-9d37-d94ddea63831+15:23547:x1874676443981696:12345-0@lo:501:mount.lustre.0 Request processed in 147us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831238.083296:0:22808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787831238.083356:0:23547:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220483e580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:23547:1874676443981696:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787831238.083388:0:23547:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220483e580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:23547:1874676443981824:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787831238.083429:0:23547:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831238.083458:0:23547:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d233bf5a600 going to sleep for 11 seconds 00000100:00100000:0.0:1787831238.083513:0:22810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443981824 00000100:00100000:0.0:1787831238.083517:0:22810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443981824 00000100:00100000:0.0:1787831238.083550:0:22810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787831238.083557:0:22810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233cd44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8057bc0f-773b-4151-9d37-d94ddea63831+15:23547:x1874676443981824:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787831238.084567:0:22810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233cd44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8057bc0f-773b-4151-9d37-d94ddea63831+15:23547:x1874676443981824:12345-0@lo:503:mount.lustre.0 Request processed in 1008us (1134us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831238.084576:0:22810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787831238.085160:0:23547:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220483e580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:23547:1874676443981824:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787831238.085571:0:23547:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787831238.085754:0:23547:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220483e580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:23547:1874676443981952:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787831238.085963:0:23547:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831238.086044:0:23547:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d233bf5a600 going to sleep for 11 seconds 00000100:00100000:1.0:1787831238.090211:0:22809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443981952 00000100:00100000:1.0:1787831238.090226:0:22809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443981952 00000100:00100000:0.0:1787831238.090395:0:22809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787831238.090406:0:22809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233cd44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8057bc0f-773b-4151-9d37-d94ddea63831+15:23547:x1874676443981952:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787831238.091700:0:22809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233cd44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8057bc0f-773b-4151-9d37-d94ddea63831+15:23547:x1874676443981952:12345-0@lo:502:mount.lustre.0 Request processed in 1293us (5833us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831238.091711:0:22809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787831238.091821:0:23547:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220483e580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:23547:1874676443981952:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787831238.092095:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:1.0:1787831238.092138:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 136 off8552 00000040:00080000:1.0:1787831238.092155:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 176 off8728 00000040:00080000:1.0:1787831238.092169:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8952 00000040:00080000:1.0:1787831238.092182:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 224 off9176 00000040:00080000:1.0:1787831238.092206:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 120 off9296 00000040:00080000:1.0:1787831238.092221:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 112 off9408 00000040:00080000:1.0:1787831238.092233:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 160 off9568 00000040:00080000:1.0:1787831238.092246:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9792 00000040:00080000:1.0:1787831238.092260:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10016 00000040:00080000:1.0:1787831238.092273:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 88 off10104 00000040:00080000:1.0:1787831238.092285:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 144 off10248 00000040:00080000:1.0:1787831238.092297:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].13, 152 off10400 00000040:00080000:1.0:1787831238.092309:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].14, 168 off10568 00000040:00080000:1.0:1787831238.092320:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].15, 224 off10792 00000040:00080000:1.0:1787831238.092333:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].16, 224 off11016 00000040:00080000:1.0:1787831238.092345:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].17, 80 off11096 00000040:00080000:1.0:1787831238.092357:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].18, 224 off11320 00000040:00080000:1.0:1787831238.092369:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].19, 224 off11544 00000040:00080000:1.0:1787831238.092381:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].20, 160 off11704 00000040:00080000:1.0:1787831238.092395:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].21, 224 off11928 00000040:00080000:1.0:1787831238.092409:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].22, 224 off12152 00000040:00080000:1.0:1787831238.092423:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].23, 80 off12232 00000040:00080000:1.0:1787831238.092447:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].24, 224 off12456 00000040:00080000:1.0:1787831238.092462:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].25, 224 off12680 00000040:00080000:1.0:1787831238.092474:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].26, 88 off12768 00000040:00080000:1.0:1787831238.092487:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].27, 144 off12912 00000040:00080000:1.0:1787831238.092500:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].28, 152 off13064 00000040:00080000:1.0:1787831238.092513:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].29, 136 off13200 00000040:00080000:1.0:1787831238.092526:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].30, 224 off13424 00000040:00080000:1.0:1787831238.092539:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].31, 224 off13648 00000040:00080000:1.0:1787831238.092551:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].32, 80 off13728 00000040:00080000:1.0:1787831238.092564:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].33, 224 off13952 00000040:00080000:1.0:1787831238.092577:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].34, 224 off14176 00000040:00080000:1.0:1787831238.092590:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].35, 88 off14264 00000040:00080000:1.0:1787831238.092602:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].36, 144 off14408 00000040:00080000:1.0:1787831238.092615:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].37, 152 off14560 00000040:00080000:1.0:1787831238.092666:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].38, 136 off14696 00000040:00080000:1.0:1787831238.092683:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].39, 224 off14920 00000040:00080000:1.0:1787831238.092703:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].40, 224 off15144 00000040:00080000:1.0:1787831238.092716:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].41, 80 off15224 00000040:00080000:1.0:1787831238.092730:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].42, 224 off15448 00000040:00080000:1.0:1787831238.092743:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].43, 224 off15672 00000040:00080000:1.0:1787831238.092756:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].44, 120 off15792 00000100:00100000:1.0:1787831238.092789:0:23547:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203765e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:23547:1874676443982080:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787831238.092840:0:23547:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831238.096915:0:23547:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2303250300 going to sleep for 11 seconds 00000100:00100000:3.0:1787831238.097110:0:22808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443982080 00000100:00100000:3.0:1787831238.097119:0:22808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443982080 00000100:00100000:2.0:1787831238.097409:0:22808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787831238.097420:0:22808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233cd46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8057bc0f-773b-4151-9d37-d94ddea63831+15:23547:x1874676443982080:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787831238.097653:0:22808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233cd46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8057bc0f-773b-4151-9d37-d94ddea63831+15:23547:x1874676443982080:12345-0@lo:502:mount.lustre.0 Request processed in 204us (4781us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831238.097661:0:22808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787831238.098006:0:23547:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203765e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:23547:1874676443982080:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787831238.098087:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].45, 224 off16016 00000040:00080000:1.0:1787831238.098100:0:23547:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:0.0:1787831238.099311:0:23551:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787831238.099323:0:23551:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787831238.099325:0:23551:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1787831238.099331:0:23551:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:0.0:1787831238.099334:0:23551:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787831238.099349:0:23551:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff8d23088a0000) 00000020:00000080:0.0:1787831238.099369:0:23551:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:0.0:1787831238.099382:0:23551:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1787831238.099457:0:23551:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787831238.099464:0:23551:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x95459fb9d1d2a74f 00000020:00000080:0.0:1787831238.099999:0:23551:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1787831238.100005:0:23551:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787831238.100009:0:23551:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787831238.100011:0:23551:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1787831238.100014:0:23551:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787831238.100017:0:23551:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787831238.100018:0:23551:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:0.0:1787831238.100021:0:23551:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787831238.100029:0:23551:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff8d23088a19b8) 00000020:00000080:0.0:1787831238.100039:0:23551:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:0.0:1787831238.100043:0:23551:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1787831238.100045:0:23551:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:0.0:1787831238.100047:0:23551:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:0.0:1787831238.100053:0:23551:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787831238.100097:0:23551:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d2201e09000 from lustre-MDT0001, refs=2 00000020:00000080:0.0:1787831238.100109:0:23551:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff8d2312953370) 00000020:00000080:0.0:1787831238.100118:0:23551:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:0.0:1787831238.100363:0:23551:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1787831238.100369:0:23551:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x95459fb9d1d2a764 00000020:00000080:0.0:1787831238.100470:0:23551:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:0.0:1787831238.100477:0:23551:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1787831238.100480:0:23551:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x95459fb9d1d2a76b 00080000:01000000:0.0:1787831238.100485:0:23551:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:0.0:1787831238.100488:0:23551:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x95459fb9d1d2a772 00010000:00010000:1.0:1787831238.209090:0:23551:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:1.0:1787831238.211691:0:23551:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 8589934595 00000001:00080000:1.0:1787831238.212428:0:23551:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1787831238.214066:0:23551:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:1.0:1787831238.214079:0:23551:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787831238.214086:0:23551:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787831238.214088:0:23551:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:1.0:1787831238.214091:0:23551:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787831238.214097:0:23551:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787831238.214098:0:23551:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:1.0:1787831238.214102:0:23551:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787831238.214107:0:23551:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.131@tcp to nid 0x20000c0a8cb83 (192.168.203.131@tcp) 00000020:00000080:1.0:1787831238.214135:0:23551:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787831238.214150:0:23551:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff8d23344a3370) 00000020:00000080:1.0:1787831238.214173:0:23551:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:1.0:1787831238.214178:0:23551:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787831238.215122:0:23551:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:1.0:1787831238.215130:0:23551:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:1.0:1787831238.215140:0:23551:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x95459fb9d1d2a780 00010000:00080000:1.0:1787831238.215174:0:23551:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d23115b4000@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.131@tcp at head 00010000:00010000:1.0:1787831238.234378:0:23551:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:1.0:1787831238.236228:0:23551:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787831238.236243:0:23551:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1787831238.236278:0:23551:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:1.0:1787831238.236298:0:23551:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x95459fb9d1d2a787 00000100:00080000:1.0:1787831238.236307:0:23551:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787831238.236312:0:23551:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8d23115b4000 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:1.0:1787831238.236345:0:23551:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2203765e00 x1874676443982208/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787831238.236372:0:23551:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:1.0:1787831238.236466:0:23551:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787831238.236469:0:23551:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787831238.236471:0:23551:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:1.0:1787831238.236479:0:23551:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787831238.236482:0:23551:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1787831238.236483:0:23551:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787831238.236485:0:23551:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787831238.236486:0:23551:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787831238.236488:0:23551:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787831238.236490:0:23551:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787831238.236492:0:23551:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787831238.236496:0:23551:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787831238.236497:0:23551:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:1.0:1787831238.236500:0:23551:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1787831238.236529:0:23551:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1787831238.236540:0:23551:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787831238.236542:0:23551:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787831238.236544:0:23551:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:1.0:1787831238.236546:0:23551:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787831238.236548:0:23551:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:1.0:1787831238.236549:0:23551:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787831238.236550:0:23551:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787831238.236552:0:23551:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787831238.236554:0:23551:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787831238.236555:0:23551:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787831238.236558:0:23551:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787831238.236561:0:23551:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1787831238.236564:0:23551:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787831238.236565:0:23551:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1787831238.236568:0:23551:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787831238.236571:0:23551:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.131@tcp to nid 0x20000c0a8cb83 (192.168.203.131@tcp) 00000020:01000000:1.0:1787831238.236593:0:23551:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1787831238.236596:0:23551:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787831238.236607:0:23551:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff8d23344a4d28) 00000020:00000080:1.0:1787831238.236617:0:23551:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1787831238.236655:0:23551:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787831238.236723:0:23551:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:1.0:1787831238.236729:0:23551:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:1.0:1787831238.236734:0:23551:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x95459fb9d1d2a795 00010000:00080000:1.0:1787831238.236768:0:23551:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d232f6b4800@lustre-OST0000-osc-MDT0001: add connection 192.168.203.131@tcp at head 00000100:00100000:0.0:1787831238.237132:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203765e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1874676443982208:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787831238.237217:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831238.237277:0:22820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443982208 00000100:00100000:0.0:1787831238.237284:0:22820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443982208 00000100:00100000:0.0:1787831238.237314:0:22820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787831238.237321:0:22820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233faea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3618:x1874676443982208:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787831238.237351:0:22820:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 529 last 0 00000020:00000080:0.0:1787831238.237381:0:22820:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x95459fb9d1d2a79c 00000004:00100000:0.0:1787831238.237395:0:22820:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1787831238.237402:0:22820:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000100:00080000:3.0:1787831238.238112:0:478:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1787831238.238118:0:478:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1787831238.238122:0:478:0:(import.c:65:import_set_state_nolock()) ffff8d233f542000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787831238.238128:0:478:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 526 00000100:00080000:3.0:1787831238.238139:0:478:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1787831238.238145:0:478:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8d233f542000 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:3.0:1787831238.238168:0:478:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d220483de00 x1874676443982336/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787831238.238203:0:478:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787831238.238207:0:478:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787831238.238210:0:478:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787831238.238213:0:478:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787831238.238252:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220483e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3620:1874676443982464:0@lo:400:kworker.0 00000100:00100000:3.0:1787831238.238292:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831238.238329:0:22815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443982464 00000100:00100000:3.0:1787831238.238334:0:22815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443982464 00000100:00100000:3.0:1787831238.238372:0:22815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787831238.238379:0:22815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220483ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1874676443982464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787831238.238426:0:22815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220483ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1874676443982464:12345-0@lo:400:kworker.0 Request processed in 48us (134us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831238.238433:0:22815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787831238.238472:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8d220483e580 x1874676443982464/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787831254 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787831238.238484:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220483e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3620:1874676443982464:0@lo:400:kworker.0 00010000:00010000:1.0:1787831238.238597:0:23551:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00100000:0.0:1787831238.238729:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220483de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1874676443982336:0@lo:38:kworker.0 00000100:00100000:0.0:1787831238.238760:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831238.239091:0:22821:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:3.0:1787831238.239100:0:22821:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:3.0:1787831238.240232:0:22821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443982336 00000100:00100000:3.0:1787831238.240243:0:22821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443982336 00000100:00100000:0.0:1787831238.240675:0:23556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787831238.240683:0:23556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233faeb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3618:x1874676443982336:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1787831238.240764:0:23556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233faeb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3618:x1874676443982336:12345-0@lo:38:kworker.0 Request processed in 80us (2002us total) trans 0 rc -11/-11 00000100:00100000:0.0:1787831238.240771:0:23556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787831238.243433:0:3618:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787831238.243447:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8d233f542000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787831238.243453:0:3618:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1787831238.243458:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220483de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1874676443982336:0@lo:38:kworker.0 00000100:00080000:0.0:1787831238.245507:0:22820:0:(import.c:65:import_set_state_nolock()) ffff8d2334553800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787831238.245602:0:22820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233faea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3618:x1874676443982208:12345-0@lo:38:llog_process_th.0 Request processed in 8279us (8383us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831238.245612:0:22820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787831238.246232:0:3618:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787831238.246242:0:3618:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 3 00000100:00080000:1.0:1787831238.246250:0:3618:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1787831238.246255:0:3618:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787831238.246259:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8d23115b4000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787831238.246277:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203765e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1874676443982208:0@lo:38:llog_process_th.0 00000040:01000000:3.0:1787831238.246492:0:23551:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1787831238.247125:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233fae83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443982592:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787831238.247180:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831238.247436:0:22821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443982592 00000100:00100000:3.0:1787831238.247443:0:22821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443982592 00000100:00100000:3.0:1787831238.247485:0:22821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787831238.247495:0:22821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d232f61c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3621:x1874676443982592:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787831238.247523:0:22821:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1787831238.247569:0:22821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d232f61c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3621:x1874676443982592:12345-0@lo:41:osp-pre-0-1.0 Request processed in 76us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831238.247576:0:22821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787831238.247668:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233fae83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443982592:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787831238.247688:0:22804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1787831238.247742:0:23551:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1787831238.250335:0:23551:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787831238.250670:0:23551:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:1.0:1787831238.250791:0:23551:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:3.0:1787831238.252222:0:23557:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1787831238.252228:0:23557:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1787831238.253245:0:23551:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787831238.253257:0:23551:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787831238.253295:0:23551:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1787831238.253318:0:23551:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x95459fb9d1d2a7a3 00000100:00080000:1.0:1787831238.253329:0:23551:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787831238.253336:0:23551:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8d232f6b4800 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:1.0:1787831238.253367:0:23551:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2203765e00 x1874676443982720/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787831238.253398:0:23551:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1787831238.253450:0:23551:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787831238.253453:0:23551:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787831238.253455:0:23551:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1787831238.253458:0:23551:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787831238.253461:0:23551:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:1.0:1787831238.253463:0:23551:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787831238.253464:0:23551:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787831238.253466:0:23551:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787831238.253468:0:23551:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787831238.253469:0:23551:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787831238.253472:0:23551:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787831238.253475:0:23551:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1787831238.253478:0:23551:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787831238.253479:0:23551:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1787831238.253482:0:23551:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787831238.253485:0:23551:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.131@tcp to nid 0x20000c0a8cb83 (192.168.203.131@tcp) 00000020:01000000:1.0:1787831238.253504:0:23551:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1787831238.253507:0:23551:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787831238.253516:0:23551:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff8d23344a0000) 00000020:00000080:1.0:1787831238.253527:0:23551:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:1.0:1787831238.253531:0:23551:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787831238.253577:0:23551:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:1.0:1787831238.253583:0:23551:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:1.0:1787831238.253587:0:23551:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x95459fb9d1d2a7b1 00010000:00080000:1.0:1787831238.253611:0:23551:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d232b9ee000@lustre-OST0001-osc-MDT0001: add connection 192.168.203.131@tcp at head 00010000:00010000:1.0:1787831238.253837:0:23551:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000100:00100000:0.0:1787831238.254145:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203765e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1874676443982720:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1787831238.254203:0:3618:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874676443982720 offset 0 length 520: 4 00000100:00080000:3.0:1787831238.254398:0:478:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787831238.254404:0:478:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787831238.254406:0:478:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787831238.254409:0:478:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:01000000:1.0:1787831238.255180:0:23551:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1787831238.255206:0:23551:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1787831238.258507:0:23551:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787831238.259264:0:23551:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:1.0:1787831238.259403:0:23551:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 64 off8256 00000040:00080000:2.0:1787831238.260260:0:23559:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1787831238.260266:0:23559:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1787831238.261247:0:23551:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787831238.261263:0:23551:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787831238.261305:0:23551:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1787831238.261326:0:23551:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x95459fb9d1d2a7b8 00000100:00080000:3.0:1787831238.261337:0:23551:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787831238.261343:0:23551:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8d232b9ee000 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:3.0:1787831238.261379:0:23551:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d220483e580 x1874676443982848/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787831238.261408:0:23551:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1787831238.261464:0:23551:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787831238.261473:0:23551:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787831238.261475:0:23551:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1787831238.261479:0:23551:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787831238.261482:0:23551:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787831238.261483:0:23551:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787831238.261486:0:23551:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787831238.261488:0:23551:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787831238.261490:0:23551:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787831238.261492:0:23551:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787831238.261494:0:23551:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:3.0:1787831238.261496:0:23551:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787831238.261498:0:23551:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787831238.261500:0:23551:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787831238.261503:0:23551:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1787831238.261524:0:23551:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787831238.261526:0:23551:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787831238.261528:0:23551:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787831238.261530:0:23551:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 46 count 46 00000100:00100000:0.0:1787831238.261786:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220483e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1874676443982848:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1787831238.261861:0:3618:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874676443982848 offset 0 length 520: 4 00000100:00080000:2.0:1787831238.262070:0:478:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787831238.262076:0:478:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787831238.262079:0:478:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787831238.262081:0:478:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:1.0:1787831238.262392:0:23547:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:1.0:1787831238.262437:0:23547:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1787831238.262461:0:23547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d2301669800/0x95459fb9d1d2a73a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2a741 expref: -99 pid: 23547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831238.262473:0:23547:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8d2301669800/0x95459fb9d1d2a73a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2a741 expref: -99 pid: 23547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787831238.262481:0:23547:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d2201e09000 from 1 10000000:01000000:1.0:1787831238.262484:0:23547:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787831238.262512:0:23547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233be94000/0x95459fb9d1d2a7bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831238.262520:0:23547:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8d233be94000/0x95459fb9d1d2a7bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831238.262530:0:23547:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8d233be94000/0x95459fb9d1d2a7bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831238.262548:0:23547:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203764780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:23547:1874676443982976:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787831238.262592:0:23547:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831238.262863:0:23547:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d232f7e7840 going to sleep for 11 seconds 00000100:00100000:0.0:1787831238.263406:0:22810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443982976 00000100:00100000:0.0:1787831238.263414:0:22810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443982976 00000100:00100000:0.0:1787831238.263476:0:22810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787831238.263486:0:22810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233cd47850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8057bc0f-773b-4151-9d37-d94ddea63831+15:23547:x1874676443982976:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787831238.263499:0:22810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787831238.263521:0:22810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d233bf11a00/0x95459fb9d1d2a7c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d2a7bf expref: -99 pid: 22810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831238.263545:0:22810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d233bf11a00/0x95459fb9d1d2a7c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d2a7bf expref: 16 pid: 22810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831238.263556:0:22810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d233bf11a00/0x95459fb9d1d2a7c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d2a7bf expref: 16 pid: 22810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831238.263564:0:22810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233bf11a00, rc 0) 00000100:00100000:0.0:1787831238.263837:0:22810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233cd47850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8057bc0f-773b-4151-9d37-d94ddea63831+16:23547:x1874676443982976:12345-0@lo:101:mount.lustre.0 Request processed in 352us (1244us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831238.263845:0:22810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787831238.266308:0:23547:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203764780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:23547:1874676443982976:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787831238.266335:0:23547:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8d233be94000/0x95459fb9d1d2a7bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2a7c6 expref: -99 pid: 23547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831238.266348:0:23547:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8d233be94000/0x95459fb9d1d2a7bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d2a7c6 expref: -99 pid: 23547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831238.267556:0:23547:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233faebc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:23547:1874676443983104:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1787831238.267662:0:23547:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831238.267705:0:23547:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d23184ced80 going to sleep for 11 seconds 00000100:00100000:2.0:1787831238.267826:0:22808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443983104 00000100:00100000:2.0:1787831238.267840:0:22808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443983104 00000100:00100000:2.0:1787831238.267897:0:22808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787831238.267906:0:22808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233cd45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8057bc0f-773b-4151-9d37-d94ddea63831+16:23547:x1874676443983104:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1787831238.267926:0:22808:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1787831238.267942:0:22808:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787831238.267945:0:22808:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:2.0:1787831238.268053:0:22808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233cd45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8057bc0f-773b-4151-9d37-d94ddea63831+16:23547:x1874676443983104:12345-0@lo:256:mount.lustre.0 Request processed in 147us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831238.268061:0:22808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787831238.268287:0:23547:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233faebc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:23547:1874676443983104:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1787831238.268907:0:23547:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787831238.268920:0:23547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233be94000/0x95459fb9d1d2a7bf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2a7c6 expref: -99 pid: 23547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831238.268931:0:23547:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8d233be94000/0x95459fb9d1d2a7bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2a7c6 expref: -99 pid: 23547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787831238.268939:0:23547:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d2201e09000 from 1 10000000:01000000:1.0:1787831238.268943:0:23547:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787831238.268969:0:23547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233be94800/0x95459fb9d1d2a7cd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831238.268976:0:23547:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8d233be94800/0x95459fb9d1d2a7cd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831238.268984:0:23547:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8d233be94800/0x95459fb9d1d2a7cd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831238.269187:0:23547:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203764780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:23547:1874676443983232:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787831238.269238:0:23547:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831238.269272:0:23547:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d232f7e7840 going to sleep for 11 seconds 00000100:00100000:0.0:1787831238.269354:0:22810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443983232 00000100:00100000:0.0:1787831238.269360:0:22810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443983232 00000100:00100000:0.0:1787831238.269405:0:22810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787831238.269413:0:22810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233cd46c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8057bc0f-773b-4151-9d37-d94ddea63831+16:23547:x1874676443983232:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787831238.269423:0:22810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787831238.269436:0:22810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d233bf10a00/0x95459fb9d1d2a7d4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d2a7cd expref: -99 pid: 22810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831238.269458:0:22810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d233bf10a00/0x95459fb9d1d2a7d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d2a7cd expref: 17 pid: 22810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831238.269468:0:22810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d233bf10a00/0x95459fb9d1d2a7d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d2a7cd expref: 17 pid: 22810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831238.269489:0:22810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233bf10a00, rc 0) 00000100:00100000:0.0:1787831238.269523:0:22810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233cd46c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8057bc0f-773b-4151-9d37-d94ddea63831+17:23547:x1874676443983232:12345-0@lo:101:mount.lustre.0 Request processed in 111us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831238.269529:0:22810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787831238.270247:0:23547:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203764780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:23547:1874676443983232:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787831238.270264:0:23547:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8d233be94800/0x95459fb9d1d2a7cd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2a7d4 expref: -99 pid: 23547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831238.270274:0:23547:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8d233be94800/0x95459fb9d1d2a7cd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d2a7d4 expref: -99 pid: 23547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787831238.271445:0:23547:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000040:00080000:1.0:1787831238.271877:0:23547:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787831238.272203:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:1.0:1787831238.272231:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 112 off8528 00000040:00080000:1.0:1787831238.272245:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 224 off8752 00000040:00080000:1.0:1787831238.272258:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8976 00000040:00080000:1.0:1787831238.272272:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 112 off9088 00000040:00080000:1.0:1787831238.272285:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 224 off9312 00000040:00080000:1.0:1787831238.272299:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 224 off9536 00000040:00080000:1.0:1787831238.272312:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 128 off9664 00000040:00080000:1.0:1787831238.272325:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:1.0:1787831238.272336:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 224 off10112 00000040:00080000:1.0:1787831238.272350:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 128 off10240 00000040:00080000:1.0:1787831238.272368:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10464 00000040:00080000:1.0:1787831238.272373:0:23547:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 12 count 13 00000100:00100000:1.0:1787831238.272443:0:23547:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203764780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:23547:1874676443983360:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787831238.272503:0:23547:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831238.272533:0:23547:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d233bcea780 going to sleep for 11 seconds 00000100:00100000:0.0:1787831238.272618:0:22810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443983360 00000100:00100000:0.0:1787831238.272751:0:22810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443983360 00000100:00100000:0.0:1787831238.272799:0:22810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787831238.272995:0:22810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233cd46050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8057bc0f-773b-4151-9d37-d94ddea63831+17:23547:x1874676443983360:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787831238.273115:0:22810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233cd46050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8057bc0f-773b-4151-9d37-d94ddea63831+17:23547:x1874676443983360:12345-0@lo:501:mount.lustre.0 Request processed in 124us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831238.273171:0:23547:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203764780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:23547:1874676443983360:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787831238.273212:0:23547:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203764780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:23547:1874676443983488:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787831238.273251:0:23547:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831238.273280:0:23547:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d233bcea780 going to sleep for 11 seconds 00000100:00100000:2.0:1787831238.274667:0:22808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443983488 00000100:00100000:2.0:1787831238.274676:0:22808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443983488 00000100:00100000:0.0:1787831238.276385:0:22810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787831238.279964:0:22809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787831238.279988:0:22809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233cd44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8057bc0f-773b-4151-9d37-d94ddea63831+17:23547:x1874676443983488:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787831238.280178:0:22809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233cd44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8057bc0f-773b-4151-9d37-d94ddea63831+17:23547:x1874676443983488:12345-0@lo:503:mount.lustre.0 Request processed in 201us (6926us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831238.280186:0:22809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787831238.280384:0:23547:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203764780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:23547:1874676443983488:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787831238.281020:0:23547:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787831238.281097:0:23547:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203764780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:23547:1874676443983616:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787831238.281153:0:23547:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831238.282393:0:23547:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d233bcea780 going to sleep for 11 seconds 00000100:00100000:2.0:1787831238.282477:0:22808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443983616 00000100:00100000:2.0:1787831238.282484:0:22808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443983616 00000100:00100000:2.0:1787831238.282522:0:22808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787831238.282530:0:22808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233cd45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8057bc0f-773b-4151-9d37-d94ddea63831+17:23547:x1874676443983616:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787831238.282679:0:22808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233cd45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8057bc0f-773b-4151-9d37-d94ddea63831+17:23547:x1874676443983616:12345-0@lo:502:mount.lustre.0 Request processed in 149us (1526us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831238.282686:0:22808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787831238.282839:0:23547:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203764780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:23547:1874676443983616:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787831238.283057:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:1.0:1787831238.283092:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 112 off8528 00000040:00080000:1.0:1787831238.283121:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 224 off8752 00000040:00080000:1.0:1787831238.283133:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8976 00000040:00080000:1.0:1787831238.283142:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 112 off9088 00000040:00080000:1.0:1787831238.283151:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 224 off9312 00000040:00080000:1.0:1787831238.283161:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 224 off9536 00000040:00080000:1.0:1787831238.283171:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 128 off9664 00000040:00080000:1.0:1787831238.283181:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:1.0:1787831238.283201:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 224 off10112 00000040:00080000:1.0:1787831238.283214:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 128 off10240 00000100:00100000:1.0:1787831238.283237:0:23547:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203764780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:23547:1874676443983744:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787831238.283272:0:23547:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831238.283293:0:23547:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d233bcea780 going to sleep for 11 seconds 00000100:00100000:2.0:1787831238.283502:0:22808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443983744 00000100:00100000:2.0:1787831238.283507:0:22808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443983744 00000100:00100000:2.0:1787831238.283528:0:22808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787831238.283534:0:22808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233cd44450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8057bc0f-773b-4151-9d37-d94ddea63831+17:23547:x1874676443983744:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787831238.283619:0:22808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233cd44450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8057bc0f-773b-4151-9d37-d94ddea63831+17:23547:x1874676443983744:12345-0@lo:502:mount.lustre.0 Request processed in 85us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831238.283658:0:22808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787831238.283794:0:23547:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203764780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:23547:1874676443983744:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787831238.284171:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10464 00000040:00080000:1.0:1787831238.284181:0:23547:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1787831238.285365:0:23561:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787831238.285376:0:23561:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787831238.285378:0:23561:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787831238.285385:0:23561:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d2201e09000 00000020:00000080:1.0:1787831238.285389:0:23561:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787831238.285396:0:23561:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787831238.285399:0:23561:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787831238.285400:0:23561:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1787831238.285403:0:23561:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787831238.285405:0:23561:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787831238.285407:0:23561:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787831238.285410:0:23561:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d2201e09000 00000020:00000080:1.0:1787831238.285412:0:23561:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787831238.285513:0:23561:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787831238.285518:0:23561:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787831238.285529:0:23561:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1787831238.285533:0:23561:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787831238.285535:0:23561:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787831238.285537:0:23561:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787831238.285540:0:23561:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d2201e09000 00000020:00000080:1.0:1787831238.285542:0:23561:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787831238.289347:0:23561:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787831238.289360:0:23561:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787831238.289363:0:23561:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787831238.289368:0:23561:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787831238.289373:0:23561:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787831238.289374:0:23561:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1787831238.289380:0:23561:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d2201e09000 00000020:00000080:1.0:1787831238.289383:0:23561:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787831238.289445:0:23561:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787831238.289448:0:23561:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787831238.289450:0:23561:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1787831238.289455:0:23561:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 13 count 13 00000020:01000000:3.0:1787831238.290757:0:23547:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1787831238.290798:0:23547:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787831238.290825:0:23547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233be94800/0x95459fb9d1d2a7cd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2a7d4 expref: -99 pid: 23547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831238.290838:0:23547:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8d233be94800/0x95459fb9d1d2a7cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2a7d4 expref: -99 pid: 23547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787831238.291022:0:23547:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787831238.291032:0:23547:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d2201e09000 10000000:01000000:3.0:1787831238.291035:0:23547:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d2201e09000 10000000:01000000:3.0:1787831238.291039:0:23547:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787831238.291045:0:23547:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d2201e09000 from 1 10000000:01000000:3.0:1787831238.291048:0:23547:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787831238.291082:0:23547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d2301669e00/0x95459fb9d1d2a7db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831238.291091:0:23547:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8d2301669e00/0x95459fb9d1d2a7db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831238.291102:0:23547:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8d2301669e00/0x95459fb9d1d2a7db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787831238.291125:0:23547:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220483f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:23547:1874676443983872:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787831238.292456:0:23547:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831238.292513:0:23547:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d23385609c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787831238.292553:0:22808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443983872 00000100:00100000:3.0:1787831238.292561:0:22808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443983872 00000100:00100000:3.0:1787831238.292604:0:22808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787831238.292613:0:22808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233cd47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8057bc0f-773b-4151-9d37-d94ddea63831+17:23547:x1874676443983872:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787831238.292703:0:22808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787831238.292720:0:22808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2301669a00/0x95459fb9d1d2a7e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d2a7db expref: -99 pid: 22808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831238.292748:0:22808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2301669a00/0x95459fb9d1d2a7e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d2a7db expref: 18 pid: 22808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831238.292760:0:22808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2301669a00/0x95459fb9d1d2a7e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d2a7db expref: 18 pid: 22808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831238.292785:0:22808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2301669a00, rc 0) 00000100:00100000:3.0:1787831238.292965:0:22808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233cd47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8057bc0f-773b-4151-9d37-d94ddea63831+18:23547:x1874676443983872:12345-0@lo:101:mount.lustre.0 Request processed in 352us (1772us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831238.292972:0:22808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787831238.293737:0:23547:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220483f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:23547:1874676443983872:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787831238.293756:0:23547:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8d2301669e00/0x95459fb9d1d2a7db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2a7e2 expref: -99 pid: 23547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831238.293767:0:23547:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8d2301669e00/0x95459fb9d1d2a7db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d2a7e2 expref: -99 pid: 23547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787831238.298288:0:23547:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000040:00080000:3.0:1787831238.298586:0:23547:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787831238.302047:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:3.0:1787831238.302089:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 120 off8536 00000040:00080000:3.0:1787831238.302106:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 168 off8704 00000040:00080000:3.0:1787831238.302120:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8928 00000040:00080000:3.0:1787831238.302133:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 224 off9152 00000040:00080000:3.0:1787831238.302145:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 120 off9272 00000040:00080000:3.0:1787831238.302159:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 168 off9440 00000040:00080000:3.0:1787831238.302173:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 224 off9664 00000040:00080000:3.0:1787831238.302186:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 224 off9888 00000040:00080000:3.0:1787831238.303015:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].10, 120 off10008 00000040:00080000:3.0:1787831238.303033:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].11, 224 off10232 00000040:00080000:3.0:1787831238.303047:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].12, 224 off10456 00000040:00080000:3.0:1787831238.303061:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].13, 88 off10544 00000040:00080000:3.0:1787831238.303074:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].14, 128 off10672 00000040:00080000:3.0:1787831238.303088:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].15, 144 off10816 00000040:00080000:3.0:1787831238.303114:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].16, 160 off10976 00000040:00080000:3.0:1787831238.303142:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].17, 224 off11200 00000040:00080000:3.0:1787831238.303158:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].18, 224 off11424 00000040:00080000:3.0:1787831238.303170:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].19, 80 off11504 00000040:00080000:3.0:1787831238.303181:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].20, 224 off11728 00000040:00080000:3.0:1787831238.303203:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].21, 224 off11952 00000040:00080000:3.0:1787831238.303218:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].22, 88 off12040 00000040:00080000:3.0:1787831238.303230:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].23, 128 off12168 00000040:00080000:3.0:1787831238.303242:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].24, 144 off12312 00000040:00080000:3.0:1787831238.303255:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].25, 160 off12472 00000040:00080000:3.0:1787831238.303267:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].26, 224 off12696 00000040:00080000:3.0:1787831238.303278:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].27, 224 off12920 00000040:00080000:3.0:1787831238.303289:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].28, 80 off13000 00000040:00080000:3.0:1787831238.303302:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].29, 224 off13224 00000040:00080000:3.0:1787831238.303316:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].30, 224 off13448 00000040:00080000:3.0:1787831238.303328:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].31, 88 off13536 00000040:00080000:3.0:1787831238.303341:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].32, 128 off13664 00000040:00080000:3.0:1787831238.303368:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].33, 144 off13808 00000040:00080000:3.0:1787831238.303383:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].34, 128 off13936 00000040:00080000:3.0:1787831238.303396:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].35, 224 off14160 00000040:00080000:3.0:1787831238.303408:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].36, 224 off14384 00000040:00080000:3.0:1787831238.303421:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].37, 80 off14464 00000040:00080000:3.0:1787831238.303433:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].38, 224 off14688 00000040:00080000:3.0:1787831238.303446:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].39, 224 off14912 00000040:00080000:3.0:1787831238.303458:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].40, 88 off15000 00000040:00080000:3.0:1787831238.303470:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].41, 128 off15128 00000040:00080000:3.0:1787831238.303483:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].42, 144 off15272 00000040:00080000:3.0:1787831238.303497:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].43, 128 off15400 00000040:00080000:3.0:1787831238.303509:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].44, 224 off15624 00000040:00080000:3.0:1787831238.303520:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].45, 224 off15848 00000040:00080000:3.0:1787831238.303532:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].46, 80 off15928 00000040:00080000:3.0:1787831238.303545:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].47, 224 off16152 00000040:00080000:3.0:1787831238.303556:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].48, 232 off16384 00000040:00080000:3.0:1787831238.307584:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].49, 224 off16608 00000040:00080000:3.0:1787831238.308072:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].50, 120 off16728 00000040:00080000:3.0:1787831238.308105:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].51, 224 off16952 00000040:00080000:3.0:1787831238.308111:0:23547:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 51 count 51 00000100:00100000:3.0:1787831238.308225:0:23547:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220483f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:23547:1874676443984000:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787831238.308288:0:23547:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831238.308335:0:23547:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2338560840 going to sleep for 11 seconds 00000100:00100000:0.0:1787831238.309017:0:22810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443984000 00000100:00100000:0.0:1787831238.309025:0:22810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443984000 00000100:00100000:0.0:1787831238.309088:0:22810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787831238.309098:0:22810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233cd46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8057bc0f-773b-4151-9d37-d94ddea63831+18:23547:x1874676443984000:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787831238.309229:0:22810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233cd46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8057bc0f-773b-4151-9d37-d94ddea63831+18:23547:x1874676443984000:12345-0@lo:501:mount.lustre.0 Request processed in 132us (939us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831238.309236:0:22810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787831238.309968:0:23547:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220483f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:23547:1874676443984000:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787831238.311703:0:23547:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220483f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:23547:1874676443984128:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787831238.311780:0:23547:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831238.311835:0:23547:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2338560840 going to sleep for 11 seconds 00000100:00100000:3.0:1787831238.311860:0:22809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443984128 00000100:00100000:3.0:1787831238.311866:0:22809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443984128 00000100:00100000:3.0:1787831238.312253:0:22809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787831238.312264:0:22809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233cd47050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8057bc0f-773b-4151-9d37-d94ddea63831+18:23547:x1874676443984128:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787831238.312380:0:22809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233cd47050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8057bc0f-773b-4151-9d37-d94ddea63831+18:23547:x1874676443984128:12345-0@lo:503:mount.lustre.0 Request processed in 118us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831238.312388:0:22809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787831238.312443:0:23547:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220483f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:23547:1874676443984128:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787831238.316614:0:23547:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787831238.319427:0:23547:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220483f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:23547:1874676443984256:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787831238.319530:0:23547:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831238.319575:0:23547:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d23385609c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787831238.319617:0:22808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443984256 00000100:00100000:3.0:1787831238.319651:0:22808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443984256 00000100:00100000:3.0:1787831238.319696:0:22808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787831238.319711:0:22808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2320286050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8057bc0f-773b-4151-9d37-d94ddea63831+18:23547:x1874676443984256:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787831238.319840:0:22808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2320286050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8057bc0f-773b-4151-9d37-d94ddea63831+18:23547:x1874676443984256:12345-0@lo:502:mount.lustre.0 Request processed in 129us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831238.319847:0:22808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787831238.320273:0:23547:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220483f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:23547:1874676443984256:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787831238.320497:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:3.0:1787831238.320528:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 120 off8536 00000040:00080000:3.0:1787831238.320542:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 168 off8704 00000040:00080000:3.0:1787831238.320557:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8928 00000040:00080000:3.0:1787831238.320570:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 224 off9152 00000040:00080000:3.0:1787831238.320585:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 120 off9272 00000040:00080000:3.0:1787831238.320599:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 168 off9440 00000040:00080000:3.0:1787831238.320613:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 224 off9664 00000040:00080000:3.0:1787831238.334789:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 224 off9888 00000040:00080000:3.0:1787831238.334847:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 120 off10008 00000040:00080000:3.0:1787831238.334881:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].11, 224 off10232 00000040:00080000:3.0:1787831238.335032:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].12, 224 off10456 00000040:00080000:3.0:1787831238.335047:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].13, 88 off10544 00000040:00080000:3.0:1787831238.335062:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].14, 128 off10672 00000040:00080000:3.0:1787831238.335078:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].15, 144 off10816 00000040:00080000:3.0:1787831238.335093:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].16, 160 off10976 00000040:00080000:3.0:1787831238.335105:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].17, 224 off11200 00000040:00080000:3.0:1787831238.335116:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].18, 224 off11424 00000040:00080000:3.0:1787831238.335127:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].19, 80 off11504 00000040:00080000:3.0:1787831238.335138:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].20, 224 off11728 00000040:00080000:3.0:1787831238.335149:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].21, 224 off11952 00000040:00080000:3.0:1787831238.335162:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].22, 88 off12040 00000040:00080000:3.0:1787831238.335176:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].23, 128 off12168 00000040:00080000:3.0:1787831238.335200:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].24, 144 off12312 00000040:00080000:3.0:1787831238.335217:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].25, 160 off12472 00000040:00080000:3.0:1787831238.335244:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].26, 224 off12696 00000040:00080000:3.0:1787831238.335271:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].27, 224 off12920 00000040:00080000:3.0:1787831238.335286:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].28, 80 off13000 00000040:00080000:3.0:1787831238.335299:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].29, 224 off13224 00000040:00080000:3.0:1787831238.335314:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].30, 224 off13448 00000040:00080000:3.0:1787831238.335328:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].31, 88 off13536 00000040:00080000:3.0:1787831238.335342:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].32, 128 off13664 00000040:00080000:3.0:1787831238.335356:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].33, 144 off13808 00000040:00080000:3.0:1787831238.335370:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].34, 128 off13936 00000040:00080000:3.0:1787831238.335384:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].35, 224 off14160 00000040:00080000:3.0:1787831238.335397:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].36, 224 off14384 00000040:00080000:3.0:1787831238.335409:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].37, 80 off14464 00000040:00080000:3.0:1787831238.335421:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].38, 224 off14688 00000040:00080000:3.0:1787831238.335432:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].39, 224 off14912 00000040:00080000:3.0:1787831238.335444:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].40, 88 off15000 00000040:00080000:3.0:1787831238.335455:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].41, 128 off15128 00000040:00080000:3.0:1787831238.335467:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].42, 144 off15272 00000040:00080000:3.0:1787831238.335494:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].43, 128 off15400 00000040:00080000:3.0:1787831238.335509:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].44, 224 off15624 00000040:00080000:3.0:1787831238.335522:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].45, 224 off15848 00000040:00080000:3.0:1787831238.335534:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].46, 80 off15928 00000040:00080000:3.0:1787831238.335548:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].47, 224 off16152 00000040:00080000:3.0:1787831238.335563:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].48, 232 off16384 00000100:00100000:3.0:1787831238.335619:0:23547:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220483f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:23547:1874676443984384:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787831238.336791:0:23547:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831238.337988:0:23547:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d23385609c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787831238.338756:0:22808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443984384 00000100:00100000:3.0:1787831238.338765:0:22808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443984384 00000100:00100000:3.0:1787831238.339353:0:22808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787831238.339368:0:22808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2320285c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8057bc0f-773b-4151-9d37-d94ddea63831+18:23547:x1874676443984384:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787831238.339511:0:22808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2320285c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8057bc0f-773b-4151-9d37-d94ddea63831+18:23547:x1874676443984384:12345-0@lo:502:mount.lustre.0 Request processed in 147us (2721us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831238.340705:0:23547:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220483f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:23547:1874676443984384:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787831238.341315:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].49, 224 off16608 00000040:00080000:2.0:1787831238.341353:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].50, 120 off16728 00000100:00100000:2.0:1787831238.341387:0:23547:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d232f61ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:23547:1874676443984512:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787831238.341450:0:23547:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831238.341487:0:23547:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d23088ad900 going to sleep for 11 seconds 00000100:00100000:2.0:1787831238.341509:0:22809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443984512 00000100:00100000:2.0:1787831238.341515:0:22809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443984512 00000100:00100000:2.0:1787831238.341553:0:22809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787831238.341561:0:22809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2320286c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8057bc0f-773b-4151-9d37-d94ddea63831+19:23547:x1874676443984512:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787831238.341730:0:22809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2320286c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8057bc0f-773b-4151-9d37-d94ddea63831+19:23547:x1874676443984512:12345-0@lo:502:mount.lustre.0 Request processed in 169us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831238.341739:0:22809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787831238.341785:0:23547:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d232f61ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:23547:1874676443984512:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787831238.341960:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].51, 224 off16952 00000040:00080000:2.0:1787831238.341970:0:23547:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000100:00100000:3.0:1787831238.344744:0:22808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000020:01000004:0.0:1787831238.346199:0:23566:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:0.0:1787831238.346216:0:23566:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff8d23129519b8) 00000020:00000080:0.0:1787831238.346237:0:23566:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:0.0:1787831238.346329:0:23566:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d2201e09000 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1787831238.346333:0:23566:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d2201e09000 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1787831238.346336:0:23566:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d2201e09000 3 00010000:00080000:0.0:1787831238.346371:0:23566:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d230884c800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.131@tcp at head 00010000:00010000:0.0:1787831238.352456:0:23566:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:0.0:1787831238.356293:0:23566:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:0.0:1787831238.356346:0:23566:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787831238.356362:0:23566:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x95459fb9d1d2a7f0 00000100:00080000:0.0:1787831238.356374:0:23566:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787831238.356381:0:23566:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8d230884c800 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:0.0:1787831238.356415:0:23566:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d233fae9680 x1874676443984640/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787831238.356465:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233fae9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3618:1874676443984640:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787831238.356883:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787831238.357056:0:23566:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787831238.357082:0:478:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787831238.357088:0:478:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787831238.357091:0:478:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787831238.357093:0:478:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787831238.362610:0:22816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443984640 00000100:00100000:3.0:1787831238.362716:0:22816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443984640 00000100:00100000:3.0:1787831238.362765:0:22816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787831238.362774:0:22816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fae92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3618:x1874676443984640:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1787831238.362876:0:22816:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 529 last 0 00000020:00000080:3.0:1787831238.362980:0:22816:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x95459fb9d1d2a7f7 00000004:00100000:3.0:1787831238.362997:0:22816:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787831238.363753:0:22816:0:(import.c:65:import_set_state_nolock()) ffff8d2202a83000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787831238.364438:0:22816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fae92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1874676443984640:12345-0@lo:38:llog_process_th.0 Request processed in 1660us (7551us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831238.364449:0:22816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787831238.365481:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d233fae9680 x1874676443984640/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787831248 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787831238.365494:0:3618:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787831238.365503:0:3618:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 3 00000100:00080000:0.0:1787831238.365513:0:3618:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1787831238.365517:0:3618:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787831238.365520:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8d230884c800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787831238.365526:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233fae9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3618:1874676443984640:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1787831238.365667:0:23566:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 52 count 51 00000020:01000000:3.0:1787831238.366066:0:23547:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1787831238.366101:0:23547:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787831238.366122:0:23547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d2301669e00/0x95459fb9d1d2a7db lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2a7e2 expref: -99 pid: 23547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831238.366138:0:23547:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8d2301669e00/0x95459fb9d1d2a7db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2a7e2 expref: -99 pid: 23547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787831238.366200:0:23547:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787831238.366203:0:23547:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787831238.366204:0:23547:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787831238.366205:0:23547:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787831238.366207:0:23547:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787831238.366208:0:23547:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787831238.366209:0:23547:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787831238.366211:0:23547:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787831238.366213:0:23547:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787831238.366216:0:23547:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:3.0:1787831238.366224:0:23547:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787831238.366225:0:23547:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787831238.366226:0:23547:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787831238.366227:0:23547:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787831238.366228:0:23547:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787831238.366229:0:23547:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787831238.366230:0:23547:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787831238.366230:0:23547:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787831238.366231:0:23547:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787831238.366254:0:23547:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1787831238.366270:0:23547:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220483f840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:23547:1874676443984768:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787831238.366330:0:23547:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831238.366360:0:23547:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d23385600c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787831238.366578:0:22809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443984768 00000100:00100000:2.0:1787831238.366585:0:22809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443984768 00000100:00100000:2.0:1787831238.366653:0:22809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787831238.366663:0:22809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2320287850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8057bc0f-773b-4151-9d37-d94ddea63831+18:23547:x1874676443984768:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787831238.366686:0:22809:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1787831238.366700:0:22809:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:3.0:1787831238.392238:0:22796:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:2.0:1787831238.393583:0:22809:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787831238.393600:0:22809:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:0.0:1787831238.393792:0:22831:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787831238.393952:0:22831:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787831238.393975:0:22831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d233bf10e00/0x95459fb9d1d2a7fe lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831238.393994:0:22831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2303aa3600/0x95459fb9d1d2a702 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d2a6fb expref: 18 pid: 22810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831238.394445:0:22831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d233bf11a00/0x95459fb9d1d2a7c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d2a7bf expref: 18 pid: 22810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831238.394453:0:22831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d233bf10e00/0x95459fb9d1d2a7fe lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831238.394490:0:22831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d233bf11a00/0x95459fb9d1d2a7c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x95459fb9d1d2a7bf expref: 18 pid: 22810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831238.394505:0:22831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d233bf11a00/0x95459fb9d1d2a7c6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x95459fb9d1d2a7bf expref: 18 pid: 22810 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831238.394520:0:22831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233fae9680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22831:1874676443984896:0@lo:104: 00000100:00100000:0.0:1787831238.394581:0:22831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831238.394757:0:22809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2320287850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8057bc0f-773b-4151-9d37-d94ddea63831+18:23547:x1874676443984768:12345-0@lo:253:mount.lustre.0 Request processed in 28093us (28424us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831238.394769:0:22809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787831238.394961:0:23547:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220483f840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:23547:1874676443984768:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787831238.394974:0:23547:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1787831238.394977:0:23547:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787831238.394979:0:23547:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787831238.394980:0:23547:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787831238.394981:0:23547:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787831238.394982:0:23547:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787831238.394984:0:23547:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787831238.394985:0:23547:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787831238.394987:0:23547:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787831238.394988:0:23547:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787831238.395001:0:23547:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:0.0:1787831238.395967:0:22831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2303aa3600/0x95459fb9d1d2a702 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x95459fb9d1d2a6fb expref: 17 pid: 22810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831238.395980:0:22831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d2303aa3600/0x95459fb9d1d2a702 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x95459fb9d1d2a6fb expref: 17 pid: 22810 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831238.395991:0:22831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233fae8b40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22831:1874676443985024:0@lo:104: 00000100:00100000:0.0:1787831238.396032:0:22831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:01000000:2.0:1787831238.402410:0:23547:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:3.0:1787831238.402585:0:23573:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:3.0:1787831238.402589:0:23573:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:2.0:1787831238.402685:0:23574:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1787831238.402702:0:23547:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:00080000:2.0:1787831238.403346:0:23574:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787831238.406224:0:22831:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d230665e3c0 going to sleep for 11 seconds 00000040:00080000:2.0:1787831238.409533:0:23574:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1787831238.409610:0:23574:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000040:01000000:2.0:1787831238.410741:0:23547:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:2.0:1787831238.410786:0:23547:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1787831238.411931:0:23547:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1787831238.411944:0:23547:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:2.0:1787831238.412010:0:23547:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787831238.413029:0:23547:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1787831238.413555:0:23547:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1787831238.413584:0:23547:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:2.0:1787831238.413693:0:23547:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1787831238.414158:0:23547:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x30:0x0] (8/32) registered 00000100:00100000:2.0:1787831238.414494:0:23575:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d232f61ed00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23575:1874676443985152:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1787831238.414556:0:23575:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831238.414590:0:23575:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d23073c0e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787831238.414891:0:22820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443985152 00000100:00100000:0.0:1787831238.414904:0:22820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443985152 00000100:00100000:0.0:1787831238.414952:0:22820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787831238.414961:0:22820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d232f61e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23575:x1874676443985152:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1787831238.415044:0:22820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d232f61e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23575:x1874676443985152:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 83us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831238.415051:0:22820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787831238.415101:0:23575:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d232f61ed00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23575:1874676443985152:0@lo:1000:lod0001_rec0000.0 00000040:01000000:0.0:1787831238.415126:0:23575:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1787831238.415154:0:23575:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233fae8780 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23575:1874676443985280:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1787831238.415186:0:23575:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831238.415216:0:23556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443985280 00000100:00100000:0.0:1787831238.415220:0:23556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443985280 00000100:00100000:0.0:1787831238.415240:0:23556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787831238.415247:0:23556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233faebc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:23575:x1874676443985280:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1787831238.415326:0:23556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233faebc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:23575:x1874676443985280:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 79us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831238.415333:0:23556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787831238.415349:0:23575:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d230665e300 going to sleep for 11 seconds 00000100:00100000:0.0:1787831238.415361:0:23575:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233fae8780 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23575:1874676443985280:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1787831238.415409:0:23575:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233fae8780 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23575:1874676443985408:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1787831238.415433:0:23575:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831238.415465:0:22826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443985408 00000100:00100000:0.0:1787831238.415469:0:22826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443985408 00000100:00100000:0.0:1787831238.415490:0:22826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787831238.415495:0:22826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fae83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23575:x1874676443985408:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1787831238.415538:0:22826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fae83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23575:x1874676443985408:12345-0@lo:900:lod0001_rec0000.0 Request processed in 43us (104us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831238.415544:0:22826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787831238.415559:0:23575:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d230665e240 going to sleep for 11 seconds 00010000:00080000:0.0:1787831238.415572:0:23575:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d233fae8780 x1874676443985408/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787831254 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787831238.415582:0:23575:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233fae8780 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23575:1874676443985408:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1787831238.415615:0:23575:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233fae8780 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23575:1874676443985536:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1787831238.415669:0:23575:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831238.415686:0:23556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443985536 00000100:00100000:0.0:1787831238.415689:0:23556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443985536 00000100:00100000:0.0:1787831238.415706:0:23556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787831238.415712:0:23556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233faead00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:23575:x1874676443985536:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1787831238.415749:0:23556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233faead00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:23575:x1874676443985536:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 37us (79us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831238.415754:0:23556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787831238.415770:0:23575:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d230665e300 going to sleep for 11 seconds 00000100:00100000:0.0:1787831238.415781:0:23575:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233fae8780 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23575:1874676443985536:0@lo:1000:lod0001_rec0000.0 00000040:00080000:0.0:1787831238.415816:0:23575:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787831238.417880:0:23575:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1787831238.417957:0:23575:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1787831238.417963:0:23575:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000100:00100000:1.0:1787831238.418381:0:22800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443984896 00000100:00100000:1.0:1787831238.418390:0:22800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443984896 00000100:00100000:3.0:1787831238.419099:0:22799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443985024 00000100:00100000:3.0:1787831238.419106:0:22799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443985024 00000100:00100000:1.0:1787831238.419235:0:22800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787831238.419244:0:22800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233faeb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8057bc0f-773b-4151-9d37-d94ddea63831+4:22831:x1874676443984896:12345-0@lo:104: 00010000:00010000:1.0:1787831238.419263:0:22800:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff8d233be94000/0x95459fb9d1d2a7bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d2a7c6 expref: -99 pid: 23547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831238.419351:0:22800:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787831238.419358:0:22800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233faeb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8057bc0f-773b-4151-9d37-d94ddea63831+4:22831:x1874676443984896:12345-0@lo:104: Request processed in 115us (24777us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831238.419365:0:22800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787831238.419406:0:22831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233fae9680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22831:1874676443984896:0@lo:104: 00010000:00010000:1.0:1787831238.419420:0:22805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787831238.419437:0:22805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8d233be94000/0x95459fb9d1d2a7bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d2a7c6 expref: -99 pid: 23547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831238.419444:0:22805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233be94000 already unused, calling callback (ffffffffc14f9c20) 10000000:00010000:1.0:1787831238.419448:0:22805:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8d233be94000/0x95459fb9d1d2a7bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x95459fb9d1d2a7c6 expref: -99 pid: 23547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831238.419456:0:22805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8d233be94000/0x95459fb9d1d2a7bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x95459fb9d1d2a7c6 expref: -99 pid: 23547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787831238.419463:0:22805:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8d233be94000/0x95459fb9d1d2a7bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x95459fb9d1d2a7c6 expref: -99 pid: 23547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787831238.419468:0:22805:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787831238.419515:0:22805:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8d233be94000/0x95459fb9d1d2a7bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d2a7c6 expref: -99 pid: 23547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831238.419521:0:22805:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787831238.419539:0:22805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8d233be94000/0x95459fb9d1d2a7bf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d2a7c6 expref: -99 pid: 23547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831238.419547:0:22805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8d233be94000/0x95459fb9d1d2a7bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d2a7c6 expref: -99 pid: 23547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831238.419559:0:22805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787831238.419561:0:22805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787831238.419562:0:22805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787831238.419574:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203764780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8057bc0f-773b-4151-9d37-d94ddea63831:3622:1874676443985664:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787831238.419614:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831238.419705:0:22802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443985664 00000100:00100000:1.0:1787831238.419714:0:22802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443985664 00010000:00010000:1.0:1787831238.419729:0:22802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d233bf11a00/0x95459fb9d1d2a7c6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d2a7bf expref: 18 pid: 22810 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831238.419749:0:22802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787831238.419754:0:22802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203764f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8057bc0f-773b-4151-9d37-d94ddea63831+18:3622:x1874676443985664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787831238.419763:0:22802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787831238.419768:0:22802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d233bf11a00/0x95459fb9d1d2a7c6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d2a7bf expref: 18 pid: 22810 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831238.419777:0:22802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d233bf11a00/0x95459fb9d1d2a7c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x95459fb9d1d2a7bf expref: 18 pid: 22810 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831238.419791:0:22802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d233bf11a00/0x95459fb9d1d2a7c6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x95459fb9d1d2a7bf expref: 18 pid: 22810 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831238.419817:0:22802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787831238.419841:0:22802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203764f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8057bc0f-773b-4151-9d37-d94ddea63831+17:3622:x1874676443985664:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831238.419847:0:22802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787831238.419896:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203764780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8057bc0f-773b-4151-9d37-d94ddea63831:3622:1874676443985664:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787831238.423825:0:22799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787831238.423838:0:22799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233faeb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8057bc0f-773b-4151-9d37-d94ddea63831+3:22831:x1874676443985024:12345-0@lo:104: 00010000:00010000:0.0:1787831238.423857:0:22799:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff8d233be94a00/0x95459fb9d1d2a6fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d2a702 expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831238.423964:0:22799:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787831238.423971:0:22799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233faeb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8057bc0f-773b-4151-9d37-d94ddea63831+3:22831:x1874676443985024:12345-0@lo:104: Request processed in 136us (27938us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831238.423979:0:22799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787831238.424266:0:22831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233fae8b40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22831:1874676443985024:0@lo:104: 00010000:00010000:2.0:1787831238.424291:0:22831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d233bf10e00/0x95459fb9d1d2a7fe lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831238.424394:0:22804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787831238.424401:0:22804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8d233be94a00/0x95459fb9d1d2a6fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d2a702 expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831238.424420:0:22804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233be94a00 already unused, calling callback (ffffffffc14f9c20) 10000000:00010000:3.0:1787831238.424424:0:22804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8d233be94a00/0x95459fb9d1d2a6fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x95459fb9d1d2a702 expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831238.424433:0:22804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8d233be94a00/0x95459fb9d1d2a6fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x95459fb9d1d2a702 expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787831238.424441:0:22804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8d233be94a00/0x95459fb9d1d2a6fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x95459fb9d1d2a702 expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787831238.424446:0:22804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787831238.424489:0:22804:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8d233be94a00/0x95459fb9d1d2a6fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d2a702 expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831238.424496:0:22804:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787831238.424515:0:22804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8d233be94a00/0x95459fb9d1d2a6fb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d2a702 expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831238.424522:0:22804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8d233be94a00/0x95459fb9d1d2a6fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d2a702 expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831238.424538:0:22804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787831238.424540:0:22804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787831238.424542:0:22804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787831238.424554:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220483f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8057bc0f-773b-4151-9d37-d94ddea63831:3619:1874676443985792:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787831238.424594:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831238.424778:0:22803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443985792 00000100:00100000:1.0:1787831238.424784:0:22803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443985792 00010000:00010000:1.0:1787831238.424820:0:22803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2303aa3600/0x95459fb9d1d2a702 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d2a6fb expref: 17 pid: 22810 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831238.424843:0:22803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787831238.424849:0:22803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220483e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8057bc0f-773b-4151-9d37-d94ddea63831+17:3619:x1874676443985792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787831238.424859:0:22803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787831238.424872:0:22803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2303aa3600/0x95459fb9d1d2a702 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d2a6fb expref: 17 pid: 22810 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831238.424893:0:22803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2303aa3600/0x95459fb9d1d2a702 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x95459fb9d1d2a6fb expref: 17 pid: 22810 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831238.424906:0:22803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2303aa3600/0x95459fb9d1d2a702 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x95459fb9d1d2a6fb expref: 17 pid: 22810 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831238.424920:0:22803:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d233bf10e00/0x95459fb9d1d2a7fe lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831238.424928:0:22803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d233bf10e00/0x95459fb9d1d2a7fe lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787831238.424942:0:22803:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.030990682s 00010000:00010000:1.0:1787831238.424946:0:22803:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d233bf10e00/0x95459fb9d1d2a7fe lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831238.424952:0:22803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d233bf10e00/0x95459fb9d1d2a7fe lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831238.424958:0:22803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d233bf10e00/0x95459fb9d1d2a7fe lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831238.424964:0:22803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d233bf10e00/0x95459fb9d1d2a7fe lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831238.424968:0:22803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233bf10e00 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:1.0:1787831238.424972:0:22803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d233bf10e00/0x95459fb9d1d2a7fe lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831238.424989:0:22803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d233bf10e00/0x95459fb9d1d2a7fe lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831238.425014:0:22803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d233bf10e00/0x95459fb9d1d2a7fe lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831238.425024:0:22803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787831238.425057:0:22803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220483e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8057bc0f-773b-4151-9d37-d94ddea63831+16:3619:x1874676443985792:12345-0@lo:103:ldlm_bl.0 Request processed in 209us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831238.425064:0:22803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1787831238.425085:0:22831:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d233bf10e00/0x95459fb9d1d2a7fe lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831238.425092:0:22831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d233bf10e00/0x95459fb9d1d2a7fe lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831238.425098:0:22831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d233bf10e00/0x95459fb9d1d2a7fe lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831238.425124:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220483f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8057bc0f-773b-4151-9d37-d94ddea63831:3619:1874676443985792:0@lo:103:ldlm_bl.0 00000001:00000004:2.0:1787831238.425867:0:23547:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:2.0:1787831238.443678:0:23547:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1787831238.443717:0:23547:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffae38c554f988 00100000:10000000:2.0:1787831238.443726:0:23547:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:2.0:1787831238.447981:0:23547:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787831238.448018:0:23547:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.131@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787831238.448041:0:23547:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1787831238.448335:0:23547:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:2.0:1787831238.449303:0:23547:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787831238.449515:0:23547:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1787831238.632912:0:22858:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d230665e180 going to sleep for 0 seconds 00010000:00010000:1.0:1787831239.270726:0:22805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787831239.400814:0:23569:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787831239.655705:0:22858:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d230665e180 going to sleep for 0 seconds 10000000:01000000:3.0:1787831239.723362:0:22812:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787831239.723369:0:22812:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d2201e09000 from 12 10000000:01000000:3.0:1787831239.723373:0:22812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787831239.723431:0:22812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d2301668800/0x95459fb9d1d2a805 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831239.723442:0:22812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8d2301668800/0x95459fb9d1d2a805 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831239.723454:0:22812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8d2301668800/0x95459fb9d1d2a805 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787831239.723481:0:22812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220483c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8057bc0f-773b-4151-9d37-d94ddea63831:22812:1874676443985920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787831239.723546:0:22812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831239.723594:0:22812:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d232f73f240 going to sleep for 11 seconds 00000100:00100000:2.0:1787831239.726796:0:22808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443985920 00000100:00100000:2.0:1787831239.726812:0:22808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443985920 00000100:00100000:2.0:1787831239.726881:0:22808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787831239.726892:0:22808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2320286450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8057bc0f-773b-4151-9d37-d94ddea63831+16:22812:x1874676443985920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787831239.726908:0:22808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787831239.726941:0:22808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2303aa2200/0x95459fb9d1d2a80c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d2a805 expref: -99 pid: 22808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831239.726973:0:22808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2303aa2200/0x95459fb9d1d2a80c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d2a805 expref: 17 pid: 22808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831239.726985:0:22808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2303aa2200/0x95459fb9d1d2a80c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d2a805 expref: 17 pid: 22808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831239.726995:0:22808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2303aa2200, rc 0) 00000100:00100000:2.0:1787831239.727069:0:22808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2320286450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8057bc0f-773b-4151-9d37-d94ddea63831+17:22812:x1874676443985920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 179us (3523us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831239.727076:0:22808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787831239.727269:0:22812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220483c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8057bc0f-773b-4151-9d37-d94ddea63831:22812:1874676443985920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787831239.727290:0:22812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8d2301668800/0x95459fb9d1d2a805 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2a80c expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831239.727300:0:22812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8d2301668800/0x95459fb9d1d2a805 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d2a80c expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787831239.727372:0:22812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220483c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8057bc0f-773b-4151-9d37-d94ddea63831:22812:1874676443986048:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787831239.727412:0:22812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831239.727484:0:22812:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d232f73f240 going to sleep for 11 seconds 00000100:00100000:2.0:1787831239.732019:0:22809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443986048 00000100:00100000:2.0:1787831239.732034:0:22809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443986048 00000100:00100000:2.0:1787831239.732140:0:22809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787831239.732152:0:22809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2320285450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8057bc0f-773b-4151-9d37-d94ddea63831+17:22812:x1874676443986048:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787831239.732190:0:22809:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787831239.732217:0:22809:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787831239.732220:0:22809:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:2.0:1787831239.732355:0:22809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2320285450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8057bc0f-773b-4151-9d37-d94ddea63831+17:22812:x1874676443986048:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 206us (4942us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831239.732363:0:22809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787831239.737681:0:22812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220483c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8057bc0f-773b-4151-9d37-d94ddea63831:22812:1874676443986048:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787831239.737766:0:22812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787831239.737778:0:22812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d2301668800/0x95459fb9d1d2a805 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2a80c expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831239.737790:0:22812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8d2301668800/0x95459fb9d1d2a805 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2a80c expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787831239.737801:0:22812:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787831239.737804:0:22812:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d233fad3000 from 12 10000000:01000000:2.0:1787831239.737808:0:22812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787831239.737844:0:22812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d2303aa3e00/0x95459fb9d1d2a813 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831239.737852:0:22812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8d2303aa3e00/0x95459fb9d1d2a813 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831239.737861:0:22812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8d2303aa3e00/0x95459fb9d1d2a813 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831239.737880:0:22812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d232f61d680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8057bc0f-773b-4151-9d37-d94ddea63831:22812:1874676443986176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787831239.737958:0:22812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831239.737999:0:22812:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d23046d2240 going to sleep for 11 seconds 00000100:00100000:2.0:1787831239.738021:0:22809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443986176 00000100:00100000:2.0:1787831239.738026:0:22809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443986176 00000100:00100000:2.0:1787831239.738065:0:22809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787831239.738073:0:22809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2320284850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8057bc0f-773b-4151-9d37-d94ddea63831+17:22812:x1874676443986176:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787831239.738086:0:22809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787831239.738099:0:22809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2303aa2a00/0x95459fb9d1d2a81a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d2a813 expref: -99 pid: 22809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831239.738132:0:22809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2303aa2a00/0x95459fb9d1d2a81a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d2a813 expref: 18 pid: 22809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831239.738142:0:22809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2303aa2a00/0x95459fb9d1d2a81a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d2a813 expref: 18 pid: 22809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831239.738149:0:22809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2303aa2a00, rc 0) 00000100:00100000:2.0:1787831239.738198:0:22809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2320284850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8057bc0f-773b-4151-9d37-d94ddea63831+18:22812:x1874676443986176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831239.738205:0:22809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787831239.738244:0:22812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d232f61d680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8057bc0f-773b-4151-9d37-d94ddea63831:22812:1874676443986176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787831239.738256:0:22812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8d2303aa3e00/0x95459fb9d1d2a813 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2a81a expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831239.738264:0:22812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8d2303aa3e00/0x95459fb9d1d2a813 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d2a81a expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831239.738307:0:22812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d232f61d680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8057bc0f-773b-4151-9d37-d94ddea63831:22812:1874676443986304:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787831239.738340:0:22812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831239.738354:0:22812:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d23046d2240 going to sleep for 11 seconds 00000100:00100000:2.0:1787831239.738366:0:22809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443986304 00000100:00100000:2.0:1787831239.738369:0:22809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443986304 00000100:00100000:2.0:1787831239.738385:0:22809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787831239.738391:0:22809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2320284450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8057bc0f-773b-4151-9d37-d94ddea63831+18:22812:x1874676443986304:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787831239.738403:0:22809:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787831239.738417:0:22809:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787831239.738423:0:22809:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:2.0:1787831239.738496:0:22809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2320284450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8057bc0f-773b-4151-9d37-d94ddea63831+18:22812:x1874676443986304:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 104us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831239.738502:0:22809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787831239.738530:0:22812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d232f61d680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8057bc0f-773b-4151-9d37-d94ddea63831:22812:1874676443986304:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787831239.738562:0:22812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787831239.738569:0:22812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d2303aa3e00/0x95459fb9d1d2a813 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2a81a expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831239.738576:0:22812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8d2303aa3e00/0x95459fb9d1d2a813 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2a81a expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831240.298654:0:22804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787831240.434167:0:23569:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787831240.678716:0:22858:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d230665e180 going to sleep for 0 seconds 00010000:00010000:1.0:1787831241.320567:0:22805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787831241.710655:0:22858:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d230665e180 going to sleep for 0 seconds 00000001:02000400:1.0:1787831242.100345:0:23816:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg331-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787831242.346882:0:22804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787831242.727654:0:22858:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d230665e180 going to sleep for 0 seconds 00000020:00000004:0.0:1787831243.254957:0:23869:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787831243.255250:0:23869:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787831243.368275:0:22805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787831243.494945:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1787831243.494950:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1787831243.494954:0:8:0:(import.c:65:import_set_state_nolock()) ffff8d233f542000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787831243.494965:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8d233f542000 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:3.0:1787831243.494998:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d220483da40 x1874676443986560/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787831243.495028:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787831243.495032:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787831243.495035:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787831243.495038:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787831243.495069:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787831243.495072:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787831243.495075:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787831243.495078:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787831243.495106:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220483f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3621:1874676443986688:0@lo:400:kworker.0 00000100:00100000:3.0:1787831243.495297:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831243.495351:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787831243.495357:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220483cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443986816:0@lo:400:kworker.0 00000100:00100000:3.0:1787831243.495382:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831243.495556:0:22815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443986688 00000100:00100000:3.0:1787831243.495563:0:22815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443986688 00000100:00100000:3.0:1787831243.495607:0:22815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787831243.495615:0:22815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220483fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1874676443986688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787831243.495695:0:22815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220483fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1874676443986688:12345-0@lo:400:kworker.0 Request processed in 80us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831243.495702:0:22815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787831243.495741:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d220483f480 x1874676443986688/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787831259 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787831243.495754:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220483f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3621:1874676443986688:0@lo:400:kworker.0 00000100:00100000:2.0:1787831243.495841:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220483c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874676443986944:0@lo:400:kworker.0 00000100:00100000:2.0:1787831243.495874:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831243.495905:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787831243.495911:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220483d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8057bc0f-773b-4151-9d37-d94ddea63831:3619:1874676443986432:0@lo:400:kworker.0 00000100:00100000:2.0:1787831243.495936:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831243.495966:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220483da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1874676443986560:0@lo:38:kworker.0 00000100:00100000:2.0:1787831243.496002:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831243.496032:0:22809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443986432 00000100:00100000:2.0:1787831243.496036:0:22809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443986432 00000100:00100000:2.0:1787831243.496061:0:22809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787831243.496067:0:22809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2320287050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8057bc0f-773b-4151-9d37-d94ddea63831+18:3619:x1874676443986432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787831243.496109:0:22809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2320287050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8057bc0f-773b-4151-9d37-d94ddea63831+18:3619:x1874676443986432:12345-0@lo:400:kworker.0 Request processed in 42us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831243.496121:0:22809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787831243.496290:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220483d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8057bc0f-773b-4151-9d37-d94ddea63831:3619:1874676443986432:0@lo:400:kworker.0 00000100:00100000:0.0:1787831243.496378:0:23556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443986816 00000100:00100000:0.0:1787831243.496382:0:23556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443986816 00000100:00100000:0.0:1787831243.496563:0:23556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443986560 00000100:00100000:0.0:1787831243.496567:0:23556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443986560 00000100:00100000:0.0:1787831243.496580:0:23556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787831243.496587:0:23556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220483c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443986816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787831243.496653:0:23556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220483c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443986816:12345-0@lo:400:kworker.0 Request processed in 66us (1269us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831243.496661:0:23556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787831243.496679:0:23556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787831243.496682:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220483cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443986816:0@lo:400:kworker.0 00000100:00100000:0.0:1787831243.496688:0:23556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d232f61d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3618:x1874676443986560:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1787831243.496714:0:23556:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 534 last 0 00000020:00000080:0.0:1787831243.496749:0:23556:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x95459fb9d1d2a821 00000004:00100000:0.0:1787831243.496763:0:23556:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1787831243.496768:0:23556:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:3.0:1787831243.497085:0:22851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443986944 00000100:00100000:3.0:1787831243.497090:0:22851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443986944 00000100:00100000:3.0:1787831243.497117:0:22851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787831243.497124:0:22851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d232f61d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874676443986944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787831243.497199:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233fae8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1874676443987072:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787831243.497243:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831243.497277:0:22820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443987072 00000100:00100000:1.0:1787831243.497282:0:22820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443987072 00000100:00100000:1.0:1787831243.497300:0:22820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787831243.497305:0:22820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203764780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1874676443987072:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787831243.497326:0:22820:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1787831243.497363:0:22820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203764780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1874676443987072:12345-0@lo:41:osp-pre-0-1.0 Request processed in 58us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831243.497370:0:22820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787831243.497400:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233fae8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1874676443987072:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787831243.498379:0:22851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d232f61d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874676443986944:12345-0@lo:400:kworker.0 Request processed in 1251us (2499us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831243.498389:0:22851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787831243.498608:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d220483c3c0 x1874676443986944/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787831259 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787831243.498640:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220483c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874676443986944:0@lo:400:kworker.0 00000100:00080000:1.0:1787831243.516528:0:23556:0:(import.c:65:import_set_state_nolock()) ffff8d232aef7800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787831243.516729:0:23556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d232f61d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3618:x1874676443986560:12345-0@lo:38:kworker.0 Request processed in 20040us (20724us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831243.516740:0:23556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1787831243.517804:0:3618:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1787831243.517816:0:3618:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1787831243.517822:0:3618:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1787831243.517825:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8d233f542000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1787831243.517880:0:3618:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000038e0530c): req@ffff8d22037670c0 x1874676443979648/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787831243.517905:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220483da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1874676443986560:0@lo:38:kworker.0 00000100:00100000:0.0:1787831243.518018:0:22858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831243.518052:0:22858:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d230665e180 going to sleep for 11 seconds 00000100:00100000:2.0:1787831243.521483:0:22820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443979648 00000100:00100000:2.0:1787831243.521497:0:22820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443979648 00000100:00100000:2.0:1787831243.521547:0:22820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787831243.521556:0:22820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fae9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22858:x1874676443979648:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1787831243.521712:0:22820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fae9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22858:x1874676443979648:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 157us (3694us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831243.521719:0:22820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787831243.521968:0:22858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22037670c0 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22858:1874676443979648:0@lo:1000:lod0000_rec0001.0 00000040:01000000:0.0:1787831243.522024:0:22858:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1787831243.522071:0:22858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233fae8b40 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22858:1874676443987200:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1787831243.522114:0:22858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831243.522147:0:22858:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d232f5efd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787831243.522171:0:23556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443987200 00000100:00100000:0.0:1787831243.522175:0:23556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443987200 00000100:00100000:0.0:1787831243.522201:0:23556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787831243.522209:0:23556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fae9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22858:x1874676443987200:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1787831243.522306:0:23556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fae9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22858:x1874676443987200:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 98us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831243.522313:0:23556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787831243.522341:0:22858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233fae8b40 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22858:1874676443987200:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1787831243.522405:0:22858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233fae8b40 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22858:1874676443987328:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1787831243.522427:0:22858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831243.522441:0:22858:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d232f5efd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787831243.522453:0:22821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443987328 00000100:00100000:0.0:1787831243.522456:0:22821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443987328 00000100:00100000:0.0:1787831243.522476:0:22821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787831243.522481:0:22821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fae8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22858:x1874676443987328:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1787831243.522525:0:22821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fae8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22858:x1874676443987328:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 44us (96us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831243.522532:0:22821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787831243.522554:0:22858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233fae8b40 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22858:1874676443987328:0@lo:1000:lod0000_rec0001.0 00000040:00080000:0.0:1787831243.522589:0:22858:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787831243.524568:0:22858:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1787831243.524687:0:22858:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 18, retries 0 00000004:00080000:0.0:1787831243.524693:0:22858:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000100:00100000:2.0:1787831243.525258:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787831243.525277:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220483f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676443987456:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787831243.525343:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831243.525427:0:22820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443987456 00000100:00100000:3.0:1787831243.525434:0:22820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443987456 00000100:00100000:3.0:1787831243.525514:0:22820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787831243.525523:0:22820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d232f61ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3622:x1874676443987456:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787831243.525555:0:22820:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787831243.525613:0:22820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d232f61ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3622:x1874676443987456:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831243.525620:0:22820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787831243.529244:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220483f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676443987456:0@lo:41:osp-pre-1-0.0 00000020:00000004:1.0:1787831244.101869:0:23919:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787831244.102062:0:23919:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787831244.393512:0:22804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787831245.064477:0:23967:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff930c2590 20000000:00000080:2.0:1787831245.064492:0:23967:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d231fac4000 uarg=0000000000000000 20000000:01000000:2.0:1787831245.064533:0:23967:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1787831245.064540:0:23967:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1787831245.064544:0:23967:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1787831245.066852:0:23968:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:1.0:1787831245.067935:0:23967:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1787831245.076242:0:23967:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787831245.076276:0:23967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d233be94000/0x95459fb9d1d2a828 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831245.076295:0:23967:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2303aa3200/0x95459fb9d1d2a6d1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d2a6ca expref: 17 pid: 22809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831245.076302:0:23967:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d233bf10a00/0x95459fb9d1d2a7d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d2a7cd expref: 17 pid: 22810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831245.076310:0:23967:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d233be94000/0x95459fb9d1d2a828 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831245.076368:0:23967:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d233bf10a00/0x95459fb9d1d2a7d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x95459fb9d1d2a7cd expref: 17 pid: 22810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831245.077247:0:23967:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d233bf10a00/0x95459fb9d1d2a7d4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x95459fb9d1d2a7cd expref: 17 pid: 22810 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831245.077272:0:23967:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203765680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23967:1874676443987584:0@lo:104: 00000100:00100000:1.0:1787831245.077339:0:23967:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787831245.077408:0:23967:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2303aa3200/0x95459fb9d1d2a6d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x95459fb9d1d2a6ca expref: 17 pid: 22809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831245.077418:0:23967:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d2303aa3200/0x95459fb9d1d2a6d1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x95459fb9d1d2a6ca expref: 17 pid: 22809 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831245.077428:0:23967:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22037670c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23967:1874676443987712:0@lo:104: 00000100:00100000:1.0:1787831245.077451:0:23967:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831245.077478:0:23967:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2310a40780 going to sleep for 11 seconds 00000100:00100000:3.0:1787831245.077678:0:22799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443987584 00000100:00100000:3.0:1787831245.077687:0:22799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443987584 00000100:00100000:3.0:1787831245.077879:0:22799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443987712 00000100:00100000:3.0:1787831245.077883:0:22799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443987712 00000100:00100000:3.0:1787831245.077899:0:22799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787831245.077908:0:22799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203766d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8057bc0f-773b-4151-9d37-d94ddea63831+4:23967:x1874676443987584:12345-0@lo:104: 00010000:00010000:3.0:1787831245.077920:0:22799:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff8d233be94800/0x95459fb9d1d2a7cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d2a7d4 expref: -99 pid: 23547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831245.078031:0:22799:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787831245.078048:0:22799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203766d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8057bc0f-773b-4151-9d37-d94ddea63831+4:23967:x1874676443987584:12345-0@lo:104: Request processed in 142us (710us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831245.078057:0:22799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787831245.078074:0:22799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787831245.078081:0:22799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22037643c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8057bc0f-773b-4151-9d37-d94ddea63831+3:23967:x1874676443987712:12345-0@lo:104: 00010000:00010000:3.0:1787831245.078089:0:22799:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff8d2303aa3400/0x95459fb9d1d2a6ca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d2a6d1 expref: -99 pid: 22795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831245.078277:0:23967:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203765680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23967:1874676443987584:0@lo:104: 00000100:00100000:1.0:1787831245.078287:0:23967:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22037670c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23967:1874676443987712:0@lo:104: 00010000:00010000:1.0:1787831245.078307:0:23967:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d233be94000/0x95459fb9d1d2a828 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831245.079991:0:22805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787831245.080004:0:22805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8d233be94800/0x95459fb9d1d2a7cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d2a7d4 expref: -99 pid: 23547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831245.080016:0:22805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233be94800 already unused, calling callback (ffffffffc14f9c20) 10000000:00010000:0.0:1787831245.080020:0:22805:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8d233be94800/0x95459fb9d1d2a7cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x95459fb9d1d2a7d4 expref: -99 pid: 23547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831245.080030:0:22805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8d233be94800/0x95459fb9d1d2a7cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x95459fb9d1d2a7d4 expref: -99 pid: 23547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787831245.080038:0:22805:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8d233be94800/0x95459fb9d1d2a7cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x95459fb9d1d2a7d4 expref: -99 pid: 23547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787831245.080044:0:22805:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787831245.080097:0:22805:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8d233be94800/0x95459fb9d1d2a7cd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d2a7d4 expref: -99 pid: 23547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831245.080104:0:22805:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787831245.080130:0:22805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8d233be94800/0x95459fb9d1d2a7cd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d2a7d4 expref: -99 pid: 23547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831245.080138:0:22805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8d233be94800/0x95459fb9d1d2a7cd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d2a7d4 expref: -99 pid: 23547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831245.080164:0:22805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787831245.080167:0:22805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8d2303aa3400/0x95459fb9d1d2a6ca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d2a6d1 expref: -99 pid: 22795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831245.080191:0:22805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2303aa3400 already unused, calling callback (ffffffffc14f9c20) 10000000:00010000:0.0:1787831245.080194:0:22805:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8d2303aa3400/0x95459fb9d1d2a6ca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x95459fb9d1d2a6d1 expref: -99 pid: 22795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831245.080201:0:22805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8d2303aa3400/0x95459fb9d1d2a6ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x95459fb9d1d2a6d1 expref: -99 pid: 22795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787831245.080208:0:22805:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8d2303aa3400/0x95459fb9d1d2a6ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x95459fb9d1d2a6d1 expref: -99 pid: 22795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787831245.080213:0:22805:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787831245.080229:0:22805:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8d2303aa3400/0x95459fb9d1d2a6ca lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d2a6d1 expref: -99 pid: 22795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831245.080235:0:22805:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787831245.080244:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233fae8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8057bc0f-773b-4151-9d37-d94ddea63831:3622:1874676443987840:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787831245.080250:0:22805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8d2303aa3400/0x95459fb9d1d2a6ca lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d2a6d1 expref: -99 pid: 22795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831245.080256:0:22805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8d2303aa3400/0x95459fb9d1d2a6ca lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d2a6d1 expref: -99 pid: 22795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831245.080269:0:22805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787831245.080270:0:22805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787831245.080272:0:22805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787831245.080285:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220442f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8057bc0f-773b-4151-9d37-d94ddea63831:3619:1874676443987968:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787831245.080301:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831245.080329:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831245.080363:0:22803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443987840 00000100:00100000:0.0:1787831245.080365:0:22802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443987968 00000100:00100000:1.0:1787831245.080369:0:22803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443987840 00000100:00100000:0.0:1787831245.080369:0:22802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443987968 00010000:00010000:0.0:1787831245.080397:0:22802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2303aa3200/0x95459fb9d1d2a6d1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d2a6ca expref: 19 pid: 22809 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831245.080400:0:22803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d233bf10a00/0x95459fb9d1d2a7d4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d2a7cd expref: 19 pid: 22810 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831245.080431:0:22803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787831245.080438:0:22803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22037670c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8057bc0f-773b-4151-9d37-d94ddea63831+19:3622:x1874676443987840:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787831245.080450:0:22803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787831245.080456:0:22803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d233bf10a00/0x95459fb9d1d2a7d4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d2a7cd expref: 19 pid: 22810 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831245.080466:0:22803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d233bf10a00/0x95459fb9d1d2a7d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x95459fb9d1d2a7cd expref: 19 pid: 22810 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831245.080480:0:22803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d233bf10a00/0x95459fb9d1d2a7d4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x95459fb9d1d2a7cd expref: 19 pid: 22810 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831245.080493:0:22803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787831245.080531:0:22803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22037670c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8057bc0f-773b-4151-9d37-d94ddea63831+18:3622:x1874676443987840:12345-0@lo:103:ldlm_bl.0 Request processed in 93us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831245.080538:0:22803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787831245.080553:0:22803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787831245.080559:0:22803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220442fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8057bc0f-773b-4151-9d37-d94ddea63831+17:3619:x1874676443987968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787831245.080566:0:22803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787831245.080571:0:22803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2303aa3200/0x95459fb9d1d2a6d1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d2a6ca expref: 17 pid: 22809 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831245.080578:0:22803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2303aa3200/0x95459fb9d1d2a6d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x95459fb9d1d2a6ca expref: 17 pid: 22809 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831245.080587:0:22803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2303aa3200/0x95459fb9d1d2a6d1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x95459fb9d1d2a6ca expref: 17 pid: 22809 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831245.080593:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233fae8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8057bc0f-773b-4151-9d37-d94ddea63831:3622:1874676443987840:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787831245.080697:0:22803:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d233be94000/0x95459fb9d1d2a828 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831245.080706:0:22803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d233be94000/0x95459fb9d1d2a828 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831245.080720:0:22803:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d233be94000/0x95459fb9d1d2a828 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831245.080727:0:22803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d233be94000/0x95459fb9d1d2a828 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831245.080733:0:22803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d233be94000/0x95459fb9d1d2a828 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831245.080739:0:22803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d233be94000/0x95459fb9d1d2a828 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831245.080743:0:22803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233be94000 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:1.0:1787831245.080747:0:22803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d233be94000/0x95459fb9d1d2a828 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831245.080755:0:22803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d233be94000/0x95459fb9d1d2a828 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831245.080777:0:22803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d233be94000/0x95459fb9d1d2a828 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831245.080787:0:22803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787831245.080817:0:22803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220442fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8057bc0f-773b-4151-9d37-d94ddea63831+16:3619:x1874676443987968:12345-0@lo:103:ldlm_bl.0 Request processed in 258us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831245.080829:0:22803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1787831245.080882:0:23967:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d233be94000/0x95459fb9d1d2a828 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831245.080890:0:23967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d233be94000/0x95459fb9d1d2a828 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831245.080896:0:23967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d233be94000/0x95459fb9d1d2a828 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831245.080946:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220442f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8057bc0f-773b-4151-9d37-d94ddea63831:3619:1874676443987968:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787831245.082555:0:22799:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:3.0:1787831245.082570:0:22799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22037643c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8057bc0f-773b-4151-9d37-d94ddea63831+3:23967:x1874676443987712:12345-0@lo:104: Request processed in 4487us (5115us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831245.082581:0:22799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1787831245.083693:0:22804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787831245.414841:0:22805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787831246.440546:0:22804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787831246.760226:0:22812:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787831246.760234:0:22812:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d2201e09000 from 13 10000000:01000000:2.0:1787831246.760239:0:22812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787831246.760286:0:22812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d2303aa2800/0x95459fb9d1d2a82f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831246.760297:0:22812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8d2303aa2800/0x95459fb9d1d2a82f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831246.760309:0:22812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8d2303aa2800/0x95459fb9d1d2a82f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831246.760336:0:22812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d232f61cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8057bc0f-773b-4151-9d37-d94ddea63831:22812:1874676443988096:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787831246.760404:0:22812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831246.760448:0:22812:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d23110bab40 going to sleep for 11 seconds 00000100:00100000:2.0:1787831246.760519:0:22808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443988096 00000100:00100000:2.0:1787831246.760534:0:22808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443988096 00000100:00100000:2.0:1787831246.760580:0:22808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787831246.760589:0:22808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2320284050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8057bc0f-773b-4151-9d37-d94ddea63831+16:22812:x1874676443988096:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787831246.760602:0:22808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787831246.760616:0:22808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2303aa3800/0x95459fb9d1d2a836 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d2a82f expref: -99 pid: 22808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831246.760658:0:22808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2303aa3800/0x95459fb9d1d2a836 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d2a82f expref: 17 pid: 22808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831246.760669:0:22808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2303aa3800/0x95459fb9d1d2a836 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d2a82f expref: 17 pid: 22808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831246.760678:0:22808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2303aa3800, rc 0) 00000100:00100000:2.0:1787831246.760715:0:22808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2320284050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8057bc0f-773b-4151-9d37-d94ddea63831+17:22812:x1874676443988096:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831246.760722:0:22808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787831246.760768:0:22812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d232f61cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8057bc0f-773b-4151-9d37-d94ddea63831:22812:1874676443988096:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787831246.760782:0:22812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8d2303aa2800/0x95459fb9d1d2a82f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2a836 expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831246.760790:0:22812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8d2303aa2800/0x95459fb9d1d2a82f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d2a836 expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831246.760845:0:22812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d232f61cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8057bc0f-773b-4151-9d37-d94ddea63831:22812:1874676443988224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787831246.760869:0:22812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831246.760891:0:22812:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d23110bab40 going to sleep for 11 seconds 00000100:00100000:2.0:1787831246.760912:0:22810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443988224 00000100:00100000:2.0:1787831246.760921:0:22810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443988224 00000100:00100000:2.0:1787831246.760944:0:22810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787831246.760949:0:22810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2320284c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8057bc0f-773b-4151-9d37-d94ddea63831+17:22812:x1874676443988224:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787831246.761045:0:22810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2320284c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8057bc0f-773b-4151-9d37-d94ddea63831+17:22812:x1874676443988224:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 94us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831246.761052:0:22810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787831246.761080:0:22812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d232f61cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8057bc0f-773b-4151-9d37-d94ddea63831:22812:1874676443988224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787831246.761107:0:22812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d232f61cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8057bc0f-773b-4151-9d37-d94ddea63831:22812:1874676443988352:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787831246.761159:0:22812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831246.761171:0:22812:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d23110bab40 going to sleep for 11 seconds 00000100:00100000:2.0:1787831246.761183:0:22809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443988352 00000100:00100000:2.0:1787831246.761186:0:22809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443988352 00000100:00100000:2.0:1787831246.761207:0:22809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787831246.761213:0:22809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2320287c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8057bc0f-773b-4151-9d37-d94ddea63831+17:22812:x1874676443988352:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787831246.761285:0:22809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2320287c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8057bc0f-773b-4151-9d37-d94ddea63831+17:22812:x1874676443988352:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 72us (126us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831246.761292:0:22809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787831246.761331:0:22812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d232f61cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8057bc0f-773b-4151-9d37-d94ddea63831:22812:1874676443988352:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787831246.764435:0:24036:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1787831246.765082:0:22812:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1787831246.765108:0:22812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787831246.765119:0:22812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d2303aa2800/0x95459fb9d1d2a82f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2a836 expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831246.765145:0:22812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8d2303aa2800/0x95459fb9d1d2a82f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2a836 expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787831246.765167:0:22812:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787831246.765170:0:22812:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d233fad3000 from 13 10000000:01000000:2.0:1787831246.765173:0:22812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787831246.765209:0:22812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d2303aa2e00/0x95459fb9d1d2a83d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831246.765217:0:22812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8d2303aa2e00/0x95459fb9d1d2a83d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831246.765227:0:22812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8d2303aa2e00/0x95459fb9d1d2a83d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831246.765252:0:22812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d232f61cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8057bc0f-773b-4151-9d37-d94ddea63831:22812:1874676443988480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787831246.765312:0:22812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831246.765366:0:22812:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d23110bab40 going to sleep for 11 seconds 00000100:00100000:3.0:1787831246.765904:0:22808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443988480 00000100:00100000:3.0:1787831246.765914:0:22808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443988480 00000100:00100000:3.0:1787831246.765976:0:22808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787831246.765986:0:22808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203901050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8057bc0f-773b-4151-9d37-d94ddea63831+17:22812:x1874676443988480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787831246.766001:0:22808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787831246.766016:0:22808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2307c77c00/0x95459fb9d1d2a844 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d2a83d expref: -99 pid: 22808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831246.766040:0:22808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2307c77c00/0x95459fb9d1d2a844 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d2a83d expref: 18 pid: 22808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831246.766051:0:22808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2307c77c00/0x95459fb9d1d2a844 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d2a83d expref: 18 pid: 22808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831246.766060:0:22808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2307c77c00, rc 0) 00000100:00100000:3.0:1787831246.766105:0:22808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203901050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8057bc0f-773b-4151-9d37-d94ddea63831+18:22812:x1874676443988480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (793us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831246.766119:0:22808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787831246.766236:0:22812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d232f61cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8057bc0f-773b-4151-9d37-d94ddea63831:22812:1874676443988480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787831246.766253:0:22812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8d2303aa2e00/0x95459fb9d1d2a83d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2a844 expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831246.766262:0:22812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8d2303aa2e00/0x95459fb9d1d2a83d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d2a844 expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831246.766327:0:22812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203765680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8057bc0f-773b-4151-9d37-d94ddea63831:22812:1874676443988608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787831246.766355:0:22812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831246.766383:0:22812:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2310a40180 going to sleep for 11 seconds 00000100:00100000:2.0:1787831246.766495:0:22810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443988608 00000100:00100000:2.0:1787831246.766501:0:22810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443988608 00000100:00100000:2.0:1787831246.766541:0:22810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787831246.766548:0:22810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203902050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8057bc0f-773b-4151-9d37-d94ddea63831+18:22812:x1874676443988608:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787831246.767060:0:22810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203902050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8057bc0f-773b-4151-9d37-d94ddea63831+18:22812:x1874676443988608:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 511us (703us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831246.767067:0:22810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787831246.767446:0:22812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203765680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8057bc0f-773b-4151-9d37-d94ddea63831:22812:1874676443988608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787831246.767488:0:22812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220483cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8057bc0f-773b-4151-9d37-d94ddea63831:22812:1874676443988736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787831246.767535:0:22812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831246.767568:0:22812:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d231008c900 going to sleep for 11 seconds 00000100:00100000:1.0:1787831246.767865:0:22808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443988736 00000100:00100000:1.0:1787831246.767872:0:22808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443988736 00000100:00100000:1.0:1787831246.767915:0:22808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787831246.767922:0:22808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203901850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8057bc0f-773b-4151-9d37-d94ddea63831+18:22812:x1874676443988736:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787831246.768025:0:22808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203901850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8057bc0f-773b-4151-9d37-d94ddea63831+18:22812:x1874676443988736:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 103us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831246.768033:0:22808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787831246.769884:0:22812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220483cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8057bc0f-773b-4151-9d37-d94ddea63831:22812:1874676443988736:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787831246.771580:0:24037:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1787831246.776325:0:22812:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1787831246.776359:0:22812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787831246.776370:0:22812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d2303aa2e00/0x95459fb9d1d2a83d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2a844 expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831246.776383:0:22812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8d2303aa2e00/0x95459fb9d1d2a83d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2a844 expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831247.465045:0:22805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787831247.783347:0:22852:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787831248.495703:0:22804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787831248.615307:0:3618:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787831238/real 1787831238] req@ffff8d220483e580 x1874676443982848/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787831248 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787831248.615336:0:3618:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d220483e580 x1874676443982848/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787831248 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787831248.615346:0:3618:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787831238/real 1787831238] req@ffff8d2203765e00 x1874676443982720/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787831248 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787831248.615374:0:3618:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d2203765e00 x1874676443982720/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787831248 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787831248.615391:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8d232b9ee000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787831248.615403:0:3618:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787831248.615407:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220483e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1874676443982848:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1787831248.615413:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8d232f6b4800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787831248.615417:0:3618:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787831248.615420:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203765e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1874676443982720:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1787831248.615494:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787831248.615499:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787831248.615502:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787831248.615505:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787831248.615520:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787831248.615523:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1787831248.615526:0:37:0:(import.c:65:import_set_state_nolock()) ffff8d232f6b4800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787831248.615531:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 529 00000100:00080000:1.0:1787831248.615535:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787831248.615541:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8d232f6b4800 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:1.0:1787831248.615561:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2203767480 x1874676443989376/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787831248.616806:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787831248.616818:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787831248.616821:0:37:0:(import.c:65:import_set_state_nolock()) ffff8d232b9ee000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787831248.616827:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 529 00000100:00080000:1.0:1787831248.616831:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787831248.616846:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8d232b9ee000 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:1.0:1787831248.616871:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2203766580 x1874676443989504/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787831248.616915:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203764b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3622:1874676443989120:0@lo:400:kworker.0 00000100:00100000:1.0:1787831248.616981:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831248.617021:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787831248.617027:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22037661c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676443988992:0@lo:400:kworker.0 00000100:00100000:1.0:1787831248.617052:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831248.617087:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203767480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1874676443989376:0@lo:8:kworker.0 00000400:00000100:1.0:1787831248.617107:0:3618:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874676443989376 offset 0 length 520: 4 00000100:00100000:1.0:1787831248.617132:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203766580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1874676443989504:0@lo:8:kworker.0 00000400:00000100:1.0:1787831248.617149:0:3618:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874676443989504 offset 0 length 520: 4 00000100:00100000:0.0:1787831248.619758:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203765e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8057bc0f-773b-4151-9d37-d94ddea63831:3620:1874676443988864:0@lo:400:kworker.0 00000100:00100000:0.0:1787831248.619817:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831248.619873:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203765a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3620:1874676443989632:0@lo:400:kworker.0 00000100:00100000:0.0:1787831248.619898:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831248.619930:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787831248.619936:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203764000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1874676443989248:0@lo:400:kworker.0 00000100:00100000:0.0:1787831248.619958:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831248.619990:0:23556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443988992 00000100:00100000:0.0:1787831248.619997:0:23556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443988992 00000100:00100000:0.0:1787831248.620030:0:23556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443989248 00000100:00100000:0.0:1787831248.620032:0:23556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443989248 00000100:00100000:0.0:1787831248.620045:0:23556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787831248.620052:0:23556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203766940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3622:x1874676443988992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787831248.620099:0:23556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203766940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3622:x1874676443988992:12345-0@lo:400:kworker.0 Request processed in 48us (3046us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831248.620106:0:23556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787831248.620133:0:23556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787831248.620139:0:23556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220442d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1874676443989248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787831248.620166:0:23556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220442d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1874676443989248:12345-0@lo:400:kworker.0 Request processed in 28us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831248.620183:0:23556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787831248.620199:0:22809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443988864 00000100:00100000:0.0:1787831248.620202:0:22809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443988864 00000100:00100000:0.0:1787831248.620222:0:22809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787831248.620227:0:22809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203901450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8057bc0f-773b-4151-9d37-d94ddea63831+18:3620:x1874676443988864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787831248.620253:0:22809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203901450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8057bc0f-773b-4151-9d37-d94ddea63831+18:3620:x1874676443988864:12345-0@lo:400:kworker.0 Request processed in 26us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831248.620258:0:22809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787831248.620301:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22037661c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676443988992:0@lo:400:kworker.0 00000100:00100000:0.0:1787831248.620322:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203764000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1874676443989248:0@lo:400:kworker.0 00000100:00100000:0.0:1787831248.620329:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203765e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8057bc0f-773b-4151-9d37-d94ddea63831:3620:1874676443988864:0@lo:400:kworker.0 00000100:00100000:3.0:1787831248.623350:0:22817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443989120 00000100:00100000:3.0:1787831248.623364:0:22817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443989120 00000100:00100000:3.0:1787831248.623483:0:22817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443989632 00000100:00100000:3.0:1787831248.623487:0:22817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443989632 00000100:00100000:3.0:1787831248.623508:0:22817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787831248.623517:0:22817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22037652c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1874676443989120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787831248.625300:0:22817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22037652c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1874676443989120:12345-0@lo:400:kworker.0 Request processed in 1776us (8310us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831248.625315:0:22817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787831248.625350:0:22817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787831248.625373:0:22817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220442da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1874676443989632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787831248.625425:0:22817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220442da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1874676443989632:12345-0@lo:400:kworker.0 Request processed in 57us (5526us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831248.625431:0:22817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1787831248.625518:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d2203764b40 x1874676443989120/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787831264 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787831248.625533:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203764b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3622:1874676443989120:0@lo:400:kworker.0 00000100:00100000:3.0:1787831248.625551:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787831248.625560:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220483cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676443989760:0@lo:41:osp-pre-1-0.0 00010000:00080000:0.0:1787831248.625747:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d2203765a40 x1874676443989632/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787831264 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787831248.625758:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203765a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3620:1874676443989632:0@lo:400:kworker.0 00000100:00100000:3.0:1787831248.627003:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831248.627054:0:23556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443989760 00000100:00100000:3.0:1787831248.627060:0:23556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443989760 00000100:00100000:3.0:1787831248.627104:0:23556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787831248.627126:0:23556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220483f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3622:x1874676443989760:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787831248.627160:0:23556:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787831248.627205:0:23556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220483f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3622:x1874676443989760:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831248.627211:0:23556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787831248.627251:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220483cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676443989760:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787831248.627323:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220483cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676443989888:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787831248.627345:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831248.627375:0:22820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443989888 00000100:00100000:3.0:1787831248.627378:0:22820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443989888 00000100:00100000:3.0:1787831248.627401:0:22820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787831248.627407:0:22820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220483f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676443989888:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787831248.627435:0:22820:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1787831248.627469:0:22820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220483f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676443989888:12345-0@lo:41:osp-pre-0-1.0 Request processed in 62us (123us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831248.627476:0:22820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787831248.627504:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220483cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676443989888:0@lo:41:osp-pre-0-1.0 00000001:00100000:0.0:1787831249.128745:0:23548:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1787831249.511791:0:22805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787831250.534852:0:22804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787831250.667531:0:3618:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787831235/real 1787831235] req@ffff8d233faea940 x1874676443980928/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787831250 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787831250.667574:0:3618:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d233faea940 x1874676443980928/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787831250 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787831250.667586:0:3618:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787831235/real 1787831235] req@ffff8d233fae9a40 x1874676443980800/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787831250 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787831250.667598:0:3618:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d233fae9a40 x1874676443980800/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787831250 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787831250.667640:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8d2202769000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787831250.667659:0:3618:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787831250.667664:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233faea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1874676443980928:0@lo:8:kworker.0 00000100:00080000:3.0:1787831250.667670:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8d233f541000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787831250.667676:0:3618:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787831250.667678:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233fae9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1874676443980800:0@lo:8:kworker.0 00000040:00080000:0.0:1787831250.668595:0:23569:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:0.0:1787831250.668750:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787831250.668755:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1787831250.668760:0:37:0:(import.c:65:import_set_state_nolock()) ffff8d233f541000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787831250.668766:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 526 00000100:00080000:0.0:1787831250.668773:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787831250.668782:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d233f541000 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:0.0:1787831250.668807:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d220442c3c0 x1874676443990272/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787831250.668838:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787831250.668842:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787831250.668844:0:37:0:(import.c:65:import_set_state_nolock()) ffff8d2202769000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787831250.668847:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 526 00000100:00080000:0.0:1787831250.668850:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787831250.668854:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d2202769000 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:0.0:1787831250.668867:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d220442c780 x1874676443990400/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787831250.668901:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787831250.668904:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787831250.668907:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787831250.668911:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787831250.668941:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220442cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8057bc0f-773b-4151-9d37-d94ddea63831:3619:1874676443990016:0@lo:400:kworker.0 00000100:00100000:0.0:1787831250.669029:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831250.669080:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220442f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874676443990784:0@lo:400:kworker.0 00000100:00100000:0.0:1787831250.669122:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831250.669148:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787831250.669154:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220442e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443990144:0@lo:400:kworker.0 00000100:00100000:0.0:1787831250.669182:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831250.669216:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220442e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3621:1874676443990528:0@lo:400:kworker.0 00000100:00100000:0.0:1787831250.669246:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831250.669264:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787831250.669268:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220442de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443990656:0@lo:400:kworker.0 00000100:00100000:0.0:1787831250.669298:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831250.669332:0:22810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443990016 00000100:00100000:0.0:1787831250.669340:0:22810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443990016 00000100:00100000:0.0:1787831250.669392:0:22810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787831250.669404:0:22810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203902850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8057bc0f-773b-4151-9d37-d94ddea63831+18:3619:x1874676443990016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787831250.669461:0:22810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203902850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8057bc0f-773b-4151-9d37-d94ddea63831+18:3619:x1874676443990016:12345-0@lo:400:kworker.0 Request processed in 58us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831250.669469:0:22810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787831250.669506:0:22817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443990784 00000100:00100000:0.0:1787831250.669509:0:22817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443990784 00000100:00100000:0.0:1787831250.669539:0:22817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443990528 00000100:00100000:0.0:1787831250.669542:0:22817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443990528 00000100:00100000:0.0:1787831250.669564:0:22817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787831250.669570:0:22817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220442d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874676443990784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787831250.669602:0:22817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220442d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874676443990784:12345-0@lo:400:kworker.0 Request processed in 32us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831250.669610:0:22817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787831250.669643:0:22817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787831250.669651:0:22817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220442c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1874676443990528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787831250.669683:0:22817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220442c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1874676443990528:12345-0@lo:400:kworker.0 Request processed in 34us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831250.669688:0:22817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787831250.669706:0:22821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443990144 00000100:00100000:0.0:1787831250.669709:0:22821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443990144 00000100:00100000:0.0:1787831250.669732:0:22821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443990656 00000100:00100000:0.0:1787831250.669735:0:22821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443990656 00000100:00100000:0.0:1787831250.669748:0:22821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787831250.669755:0:22821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220442cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676443990144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787831250.669799:0:22821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220442cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676443990144:12345-0@lo:400:kworker.0 Request processed in 44us (615us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831250.669806:0:22821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787831250.669817:0:22821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787831250.669823:0:22821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220442ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443990656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787831250.669851:0:22821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220442ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443990656:12345-0@lo:400:kworker.0 Request processed in 28us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831250.669857:0:22821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787831250.669913:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220442de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443990656:0@lo:400:kworker.0 00010000:00080000:0.0:1787831250.669928:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d220442e940 x1874676443990528/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787831266 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787831250.669937:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220442e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3621:1874676443990528:0@lo:400:kworker.0 00000100:00100000:0.0:1787831250.669966:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220442c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1874676443990272:0@lo:8:kworker.0 00000400:00000100:0.0:1787831250.669990:0:3618:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874676443990272 offset 0 length 520: 4 00000100:00100000:0.0:1787831250.670006:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220442c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1874676443990400:0@lo:8:kworker.0 00000400:00000100:0.0:1787831250.670021:0:3618:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874676443990400 offset 0 length 520: 4 00000100:00100000:0.0:1787831250.670051:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220442e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443990144:0@lo:400:kworker.0 00000100:00100000:0.0:1787831250.670060:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220442cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8057bc0f-773b-4151-9d37-d94ddea63831:3619:1874676443990016:0@lo:400:kworker.0 00010000:00080000:0.0:1787831250.670070:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d220442f840 x1874676443990784/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787831266 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787831250.670078:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220442f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874676443990784:0@lo:400:kworker.0 00010000:00010000:1.0:1787831251.560956:0:22805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787831251.762280:0:24315:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787831251.762284:0:24315:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:1.0:1787831251.762286:0:24315:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1787831251.762395:0:24315:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8d232aef4800 00000020:01000004:1.0:1787831251.762411:0:24315:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1787831251.762427:0:24315:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1787831251.762443:0:24315:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8d2201e1cd28) 00000020:00000080:1.0:1787831251.762459:0:24315:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1787831251.819339:0:24315:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1787831251.821655:0:24315:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1787831251.822598:0:24315:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:0.0:1787831251.823153:0:24315:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:0.0:1787831251.823429:0:24315:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:0.0:1787831251.823652:0:24315:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1787831251.824343:0:24315:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:01000000:1.0:1787831251.827260:0:24315:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1787831251.827474:0:24315:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1787831251.827487:0:24315:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787831251.827499:0:24315:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x95459fb9d1d2a852 00000020:01000004:1.0:1787831251.827508:0:24315:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:1.0:1787831251.827530:0:24315:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.131@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1787831251.827534:0:24315:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.131@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1787831251.827540:0:24315:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1787831251.827558:0:24315:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1787831251.827572:0:24315:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8d2201e1b370) 00000020:00000080:1.0:1787831251.827584:0:24315:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:1.0:1787831251.832058:0:24315:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787831251.832343:0:24315:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1787831251.832349:0:24315:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1787831251.839970:0:24315:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1787831251.839989:0:24315:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1787831251.840451:0:24315:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1787831251.840458:0:24315:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1787831251.842695:0:24315:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787831251.843275:0:24315:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1787831251.843282:0:24315:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1787831251.847290:0:24315:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1787831251.847301:0:24315:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1787831251.869606:0:24315:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787831251.870252:0:24315:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1787831251.870260:0:24315:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1787831251.872509:0:24315:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1787831251.872524:0:24315:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1787831251.874293:0:24315:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1787831251.874306:0:24315:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1787831251.878247:0:24315:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787831251.878456:0:24315:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1787831251.878466:0:24315:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1787831251.879406:0:24315:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1787831251.879415:0:24315:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1787831251.917967:0:24315:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787831251.918196:0:24315:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1787831251.918203:0:24315:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1787831251.922410:0:24315:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1787831251.922424:0:24315:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1787831251.924185:0:24315:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1787831251.924218:0:24315:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:3.0:1787831251.924226:0:24315:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.131@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1787831251.940422:0:24315:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.131@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787831251.940467:0:24315:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.131@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1787831251.940472:0:24315:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787831251.940473:0:24315:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787831251.940475:0:24315:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787831251.940476:0:24315:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787831251.940478:0:24315:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787831251.940479:0:24315:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787831251.940480:0:24315:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787831251.940482:0:24315:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787831251.940483:0:24315:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787831251.940487:0:24315:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1787831251.940489:0:24315:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787831251.940491:0:24315:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787831251.940492:0:24315:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787831251.940493:0:24315:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787831251.940494:0:24315:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787831251.940495:0:24315:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787831251.940496:0:24315:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787831251.940497:0:24315:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787831251.940498:0:24315:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787831251.940527:0:24315:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787831251.940558:0:24315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d232f61f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:24315:1874676443990912:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787831251.940679:0:24315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831251.940727:0:24315:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d232f727b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787831251.940947:0:22808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443990912 00000100:00100000:0.0:1787831251.940956:0:22808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443990912 00000100:00100000:0.0:1787831251.941017:0:22808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787831251.941028:0:22808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d23061c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8057bc0f-773b-4151-9d37-d94ddea63831+18:24315:x1874676443990912:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787831251.941061:0:22808:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1787831251.941075:0:22808:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1787831251.941079:0:22808:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1787831251.941985:0:22808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d23061c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8057bc0f-773b-4151-9d37-d94ddea63831+18:24315:x1874676443990912:12345-0@lo:253:mount.lustre.0 Request processed in 957us (1303us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831251.941996:0:22808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787831251.942334:0:24315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d232f61f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:24315:1874676443990912:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787831251.942348:0:24315:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1787831251.942351:0:24315:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787831251.942352:0:24315:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787831251.942354:0:24315:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787831251.942355:0:24315:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787831251.942356:0:24315:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787831251.942357:0:24315:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787831251.942358:0:24315:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787831251.942360:0:24315:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787831251.942361:0:24315:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787831251.942381:0:24315:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d232aef4800 from lustre-OST0000 10000000:01000000:1.0:1787831251.942430:0:24315:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1787831251.942433:0:24315:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1787831251.942440:0:24315:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8d2306c6cd28 local copy 00010000:00010000:1.0:1787831251.942451:0:24315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d2301668600/0x95459fb9d1d2a60d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2a614 expref: -99 pid: 22795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831251.942534:0:24315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203765680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:24315:1874676443991040:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787831251.942610:0:24315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831251.942668:0:24315:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d232f5eff00 going to sleep for 11 seconds 00000100:00100000:0.0:1787831251.942751:0:22809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443991040 00000100:00100000:0.0:1787831251.942756:0:22809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443991040 00000100:00100000:0.0:1787831251.942802:0:22809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787831251.942810:0:22809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d23061c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8057bc0f-773b-4151-9d37-d94ddea63831+18:24315:x1874676443991040:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787831251.943359:0:22809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d23061c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8057bc0f-773b-4151-9d37-d94ddea63831+18:24315:x1874676443991040:12345-0@lo:501:mount.lustre.0 Request processed in 548us (746us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787831251.943376:0:22809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787831251.943497:0:24315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203765680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:24315:1874676443991040:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1787831251.943516:0:24315:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.131@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787831251.943605:0:24315:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.131@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787831251.943620:0:24315:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d2301668600/0x95459fb9d1d2a60d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2a614 expref: -99 pid: 22795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831251.943980:0:24315:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8d2301668600/0x95459fb9d1d2a60d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2a614 expref: -99 pid: 22795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787831251.944014:0:24315:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d232aef4800 10000000:01000000:2.0:1787831251.944020:0:24315:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787831251.944026:0:24315:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787831251.944028:0:24315:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787831251.944033:0:24315:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1787831251.944036:0:24315:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1787831251.944147:0:24315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d2303aa3600/0x95459fb9d1d2a860 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831251.944158:0:24315:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8d2303aa3600/0x95459fb9d1d2a860 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831251.944170:0:24315:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8d2303aa3600/0x95459fb9d1d2a860 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831251.944190:0:24315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d232f61e940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:24315:1874676443991168:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787831251.944231:0:24315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831251.944318:0:24315:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d232f727480 going to sleep for 11 seconds 00000100:00100000:0.0:1787831251.944357:0:22810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443991168 00000100:00100000:0.0:1787831251.944363:0:22810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443991168 00000100:00100000:0.0:1787831251.944438:0:22810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787831251.944447:0:22810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d23061c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8057bc0f-773b-4151-9d37-d94ddea63831+18:24315:x1874676443991168:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787831251.944457:0:22810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787831251.944469:0:22810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d233bf10c00/0x95459fb9d1d2a867 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d2a860 expref: -99 pid: 22810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831251.944488:0:22810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d233bf10c00/0x95459fb9d1d2a867 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d2a860 expref: 19 pid: 22810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831251.944499:0:22810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d233bf10c00/0x95459fb9d1d2a867 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d2a860 expref: 19 pid: 22810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831251.944508:0:22810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233bf10c00, rc 0) 00000100:00100000:0.0:1787831251.944558:0:22810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d23061c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8057bc0f-773b-4151-9d37-d94ddea63831+19:24315:x1874676443991168:12345-0@lo:101:mount.lustre.0 Request processed in 113us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831251.944564:0:22810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787831251.944660:0:24315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d232f61e940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:24315:1874676443991168:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787831251.944675:0:24315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8d2303aa3600/0x95459fb9d1d2a860 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2a867 expref: -99 pid: 24315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831251.944685:0:24315:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8d2303aa3600/0x95459fb9d1d2a860 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d2a867 expref: -99 pid: 24315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787831251.946516:0:24315:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:1.0:1787831251.947929:0:24315:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787831251.954233:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:1.0:1787831251.954295:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:1.0:1787831251.954313:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:1.0:1787831251.954329:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:1.0:1787831251.954344:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:1.0:1787831251.954359:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:1.0:1787831251.954374:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:1.0:1787831251.954390:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:1.0:1787831251.954405:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:1.0:1787831251.954421:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:1.0:1787831251.954436:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:1.0:1787831251.954451:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:1.0:1787831251.954479:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:1.0:1787831251.954485:0:24315:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:1.0:1787831251.954597:0:24315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203765680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:24315:1874676443991296:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787831251.954697:0:24315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831251.954750:0:24315:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d232f73fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787831251.955305:0:22808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443991296 00000100:00100000:0.0:1787831251.955315:0:22808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443991296 00000100:00100000:0.0:1787831251.955368:0:22808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787831251.955377:0:22808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d23061c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8057bc0f-773b-4151-9d37-d94ddea63831+19:24315:x1874676443991296:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787831251.955562:0:22808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d23061c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8057bc0f-773b-4151-9d37-d94ddea63831+19:24315:x1874676443991296:12345-0@lo:501:mount.lustre.0 Request processed in 185us (864us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831251.955570:0:22808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787831251.956014:0:24315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203765680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:24315:1874676443991296:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787831251.956074:0:24315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203765680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:24315:1874676443991424:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787831251.956126:0:24315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831251.956146:0:24315:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d232f73fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787831251.956252:0:22810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443991424 00000100:00100000:0.0:1787831251.956262:0:22810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443991424 00000100:00100000:0.0:1787831251.956299:0:22810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787831251.956306:0:22810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d23061c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8057bc0f-773b-4151-9d37-d94ddea63831+19:24315:x1874676443991424:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787831251.957411:0:22810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d23061c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8057bc0f-773b-4151-9d37-d94ddea63831+19:24315:x1874676443991424:12345-0@lo:503:mount.lustre.0 Request processed in 1101us (1280us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831251.957422:0:22810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787831251.958167:0:24315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203765680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:24315:1874676443991424:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787831251.959174:0:24315:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787831251.959279:0:24315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d232f61e1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:24315:1874676443991552:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787831251.959344:0:24315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831251.959440:0:24315:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d232f727cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787831251.959492:0:22809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443991552 00000100:00100000:0.0:1787831251.959500:0:22809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443991552 00000100:00100000:0.0:1787831251.960418:0:22809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787831251.960432:0:22809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d23061c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8057bc0f-773b-4151-9d37-d94ddea63831+19:24315:x1874676443991552:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787831251.961366:0:22809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d23061c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8057bc0f-773b-4151-9d37-d94ddea63831+19:24315:x1874676443991552:12345-0@lo:502:mount.lustre.0 Request processed in 935us (2019us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831251.961378:0:22809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787831251.961473:0:24315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d232f61e1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:24315:1874676443991552:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787831251.961768:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:1.0:1787831251.961815:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:1.0:1787831251.961846:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:1.0:1787831251.961863:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:1.0:1787831251.961876:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:1.0:1787831251.961889:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:1.0:1787831251.961901:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:1.0:1787831251.961914:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:1.0:1787831251.961952:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:1.0:1787831251.961968:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:1.0:1787831251.961981:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:1.0:1787831251.961994:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:1.0:1787831251.962026:0:24315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203767840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:24315:1874676443991680:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787831251.962089:0:24315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831251.963115:0:24315:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d232f73fb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787831251.963192:0:22810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443991680 00000100:00100000:2.0:1787831251.963199:0:22810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443991680 00000100:00100000:2.0:1787831251.963245:0:22810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787831251.963255:0:22810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d23061c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8057bc0f-773b-4151-9d37-d94ddea63831+19:24315:x1874676443991680:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787831251.963400:0:22810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d23061c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8057bc0f-773b-4151-9d37-d94ddea63831+19:24315:x1874676443991680:12345-0@lo:502:mount.lustre.0 Request processed in 145us (1310us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831251.963407:0:22810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787831251.963585:0:24315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203767840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:24315:1874676443991680:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787831251.963677:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:1.0:1787831251.963690:0:24315:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:1.0:1787831251.964996:0:24332:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787831251.965007:0:24332:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:1.0:1787831251.965014:0:24332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787831251.965017:0:24332:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1787831251.965023:0:24332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787831251.965040:0:24332:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8d2201e18000) 00000020:00000080:1.0:1787831251.965162:0:24332:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:1.0:1787831251.965171:0:24332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787831251.965265:0:24332:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d232aef4800 from lustre-OST0000, refs=2 00080000:01000000:1.0:1787831251.965274:0:24332:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787831251.965281:0:24332:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x95459fb9d1d2a875 00010000:00010000:1.0:1787831251.969092:0:24332:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:1.0:1787831251.974434:0:24332:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934601 00080000:10000000:0.0:1787831251.978276:0:24332:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:0.0:1787831251.980765:0:24332:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1787831251.980777:0:24332:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787831251.981058:0:24332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787831251.981136:0:24332:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1787831251.981145:0:24332:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787831251.981148:0:24332:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:0.0:1787831251.981149:0:24332:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787831251.981151:0:24332:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787831251.981152:0:24332:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787831251.981156:0:24332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787831251.981158:0:24332:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787831251.981160:0:24332:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787831251.981163:0:24332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787831251.981164:0:24332:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787831251.981167:0:24332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787831251.981169:0:24332:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787831251.981177:0:24332:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787831251.981179:0:24332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787831251.981181:0:24332:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:0.0:1787831251.981183:0:24332:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787831251.981185:0:24332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787831251.981186:0:24332:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787831251.981189:0:24332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1787831251.981218:0:24332:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787831251.981220:0:24332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787831251.981222:0:24332:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787831251.981225:0:24332:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:2.0:1787831251.983696:0:24315:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1787831251.986980:0:24315:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1787831251.988037:0:24315:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d2303aa3600/0x95459fb9d1d2a860 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2a867 expref: -99 pid: 24315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831251.988054:0:24315:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8d2303aa3600/0x95459fb9d1d2a860 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2a867 expref: -99 pid: 24315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787831251.988071:0:24315:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d232aef4800 from 1 10000000:01000000:2.0:1787831251.988075:0:24315:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787831251.988121:0:24315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d2303aa3a00/0x95459fb9d1d2a87c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831251.988130:0:24315:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8d2303aa3a00/0x95459fb9d1d2a87c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831251.988141:0:24315:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8d2303aa3a00/0x95459fb9d1d2a87c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831251.988166:0:24315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d232f61c3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:24315:1874676443991808:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787831251.988232:0:24315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831251.988269:0:24315:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d232f727a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787831251.989196:0:22810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443991808 00000100:00100000:3.0:1787831251.989208:0:22810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443991808 00000100:00100000:3.0:1787831251.989264:0:22810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787831251.989274:0:22810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22025d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8057bc0f-773b-4151-9d37-d94ddea63831+19:24315:x1874676443991808:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787831251.989292:0:22810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787831251.989310:0:22810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2307c77200/0x95459fb9d1d2a883 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d2a87c expref: -99 pid: 22810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831251.989337:0:22810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2307c77200/0x95459fb9d1d2a883 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d2a87c expref: 20 pid: 22810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831251.989348:0:22810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2307c77200/0x95459fb9d1d2a883 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d2a87c expref: 20 pid: 22810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831251.989357:0:22810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2307c77200, rc 0) 00000100:00100000:3.0:1787831251.989416:0:22810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22025d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8057bc0f-773b-4151-9d37-d94ddea63831+20:24315:x1874676443991808:12345-0@lo:101:mount.lustre.0 Request processed in 144us (1185us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831251.989423:0:22810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787831251.991136:0:24315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d232f61c3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:24315:1874676443991808:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787831251.991162:0:24315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8d2303aa3a00/0x95459fb9d1d2a87c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2a883 expref: -99 pid: 24315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831251.991175:0:24315:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8d2303aa3a00/0x95459fb9d1d2a87c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d2a883 expref: -99 pid: 24315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787831251.994371:0:24315:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:3.0:1787831252.003236:0:24315:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787831252.003504:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:3.0:1787831252.003533:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:3.0:1787831252.004641:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:3.0:1787831252.004673:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:3.0:1787831252.004715:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:3.0:1787831252.005059:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:3.0:1787831252.005165:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:3.0:1787831252.005178:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:3.0:1787831252.005204:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:3.0:1787831252.005216:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:3.0:1787831252.005228:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:3.0:1787831252.005249:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:3.0:1787831252.005254:0:24315:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:3.0:1787831252.005378:0:24315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220483e580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:24315:1874676443991936:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787831252.005444:0:24315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831252.005490:0:24315:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d232f6e2cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787831252.006492:0:22808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443991936 00000100:00100000:1.0:1787831252.006500:0:22808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443991936 00000100:00100000:1.0:1787831252.006539:0:22808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787831252.006561:0:22808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22025d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8057bc0f-773b-4151-9d37-d94ddea63831+20:24315:x1874676443991936:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787831252.006921:0:22808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22025d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8057bc0f-773b-4151-9d37-d94ddea63831+20:24315:x1874676443991936:12345-0@lo:501:mount.lustre.0 Request processed in 361us (1475us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831252.006930:0:22808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787831252.007198:0:24315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220483e580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:24315:1874676443991936:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787831252.007242:0:24315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d232f61c3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:24315:1874676443992064:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787831252.007293:0:24315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831252.007327:0:24315:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d232f727840 going to sleep for 11 seconds 00000100:00100000:1.0:1787831252.007397:0:22809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443992064 00000100:00100000:1.0:1787831252.007402:0:22809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443992064 00000100:00100000:1.0:1787831252.007534:0:22809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787831252.007551:0:22809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22025d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8057bc0f-773b-4151-9d37-d94ddea63831+20:24315:x1874676443992064:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787831252.007663:0:22809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22025d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8057bc0f-773b-4151-9d37-d94ddea63831+20:24315:x1874676443992064:12345-0@lo:503:mount.lustre.0 Request processed in 121us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831252.007671:0:22809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787831252.007753:0:24315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d232f61c3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:24315:1874676443992064:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787831252.008551:0:24315:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787831252.008616:0:24315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d232f61c3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:24315:1874676443992192:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787831252.008691:0:24315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831252.009335:0:24315:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d232f727a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787831252.009392:0:22808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443992192 00000100:00100000:3.0:1787831252.009398:0:22808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443992192 00000100:00100000:3.0:1787831252.009430:0:22808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787831252.009438:0:22808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22025d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8057bc0f-773b-4151-9d37-d94ddea63831+20:24315:x1874676443992192:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787831252.009560:0:22808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22025d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8057bc0f-773b-4151-9d37-d94ddea63831+20:24315:x1874676443992192:12345-0@lo:502:mount.lustre.0 Request processed in 121us (868us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831252.009567:0:22808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787831252.009756:0:24315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d232f61c3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:24315:1874676443992192:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787831252.010216:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:2.0:1787831252.010245:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:2.0:1787831252.010277:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:2.0:1787831252.010295:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:2.0:1787831252.010309:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:2.0:1787831252.010323:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:2.0:1787831252.010336:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:2.0:1787831252.010349:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:2.0:1787831252.010362:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:2.0:1787831252.010385:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:2.0:1787831252.010396:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:2.0:1787831252.010423:0:24315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d232f61c3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:24315:1874676443992320:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787831252.010470:0:24315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831252.010487:0:24315:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d232f727a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787831252.010683:0:22808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443992320 00000100:00100000:3.0:1787831252.010688:0:22808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443992320 00000100:00100000:3.0:1787831252.010945:0:22808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787831252.010956:0:22808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22025d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8057bc0f-773b-4151-9d37-d94ddea63831+20:24315:x1874676443992320:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787831252.011049:0:22808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22025d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8057bc0f-773b-4151-9d37-d94ddea63831+20:24315:x1874676443992320:12345-0@lo:502:mount.lustre.0 Request processed in 96us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831252.011056:0:22808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787831252.011242:0:24315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d232f61c3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:24315:1874676443992320:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787831252.011291:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:2.0:1787831252.011302:0:24315:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1787831252.012426:0:24336:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787831252.012436:0:24336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787831252.012439:0:24336:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787831252.012446:0:24336:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d232aef4800 00000020:00000080:2.0:1787831252.012449:0:24336:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787831252.012456:0:24336:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787831252.012459:0:24336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787831252.012460:0:24336:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1787831252.012463:0:24336:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787831252.012465:0:24336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787831252.012466:0:24336:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787831252.012470:0:24336:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d232aef4800 00000020:00000080:2.0:1787831252.012472:0:24336:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787831252.012527:0:24336:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787831252.012531:0:24336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787831252.012532:0:24336:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1787831252.012535:0:24336:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787831252.012537:0:24336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787831252.012539:0:24336:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787831252.012611:0:24336:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d232aef4800 00000020:00000080:2.0:1787831252.012614:0:24336:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787831252.012656:0:24336:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787831252.012659:0:24336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787831252.012661:0:24336:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787831252.012671:0:24336:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787831252.012674:0:24336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787831252.012675:0:24336:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1787831252.012679:0:24336:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d232aef4800 00000020:00000080:2.0:1787831252.012681:0:24336:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787831252.013622:0:24336:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787831252.013652:0:24336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787831252.013654:0:24336:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1787831252.013659:0:24336:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:3.0:1787831252.013844:0:24315:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1787831252.013990:0:24315:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787831252.014015:0:24315:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d2303aa3a00/0x95459fb9d1d2a87c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2a883 expref: -99 pid: 24315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831252.014028:0:24315:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8d2303aa3a00/0x95459fb9d1d2a87c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2a883 expref: -99 pid: 24315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787831252.014258:0:24315:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787831252.014261:0:24315:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d232aef4800 10000000:01000000:3.0:1787831252.014264:0:24315:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d232aef4800 10000000:01000000:3.0:1787831252.014268:0:24315:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787831252.014273:0:24315:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d232aef4800 from 1 10000000:01000000:3.0:1787831252.014276:0:24315:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787831252.014315:0:24315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d2307c77e00/0x95459fb9d1d2a88a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831252.014324:0:24315:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8d2307c77e00/0x95459fb9d1d2a88a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831252.014335:0:24315:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8d2307c77e00/0x95459fb9d1d2a88a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787831252.014358:0:24315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220483da40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:24315:1874676443992448:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787831252.014422:0:24315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831252.014467:0:24315:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d232f6e2e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787831252.014529:0:22808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443992448 00000100:00100000:2.0:1787831252.014536:0:22808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443992448 00000100:00100000:2.0:1787831252.015973:0:22808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787831252.015989:0:22808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22025d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8057bc0f-773b-4151-9d37-d94ddea63831+20:24315:x1874676443992448:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787831252.016005:0:22808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787831252.016023:0:22808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2303aa2600/0x95459fb9d1d2a891 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d2a88a expref: -99 pid: 22808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831252.016051:0:22808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2303aa2600/0x95459fb9d1d2a891 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d2a88a expref: 21 pid: 22808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831252.016078:0:22808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2303aa2600/0x95459fb9d1d2a891 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d2a88a expref: 21 pid: 22808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831252.016087:0:22808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2303aa2600, rc 0) 00000100:00100000:2.0:1787831252.016159:0:22808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22025d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8057bc0f-773b-4151-9d37-d94ddea63831+21:24315:x1874676443992448:12345-0@lo:101:mount.lustre.0 Request processed in 176us (1737us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831252.016166:0:22808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787831252.017853:0:24315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220483da40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:24315:1874676443992448:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787831252.017879:0:24315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8d2307c77e00/0x95459fb9d1d2a88a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2a891 expref: -99 pid: 24315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831252.017893:0:24315:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8d2307c77e00/0x95459fb9d1d2a88a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d2a891 expref: -99 pid: 24315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787831252.030336:0:24315:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:2.0:1787831252.031194:0:24315:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787831252.031423:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:2.0:1787831252.031458:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:2.0:1787831252.031477:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:2.0:1787831252.031494:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:2.0:1787831252.031508:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:2.0:1787831252.031521:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:2.0:1787831252.031535:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:2.0:1787831252.034312:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:2.0:1787831252.034338:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:2.0:1787831252.034354:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:2.0:1787831252.034369:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:2.0:1787831252.034386:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:2.0:1787831252.034399:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:2.0:1787831252.034414:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:2.0:1787831252.034428:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:2.0:1787831252.034444:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:2.0:1787831252.034460:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:2.0:1787831252.034474:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:2.0:1787831252.034487:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:2.0:1787831252.034502:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:2.0:1787831252.034516:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:2.0:1787831252.034532:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:2.0:1787831252.034559:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:2.0:1787831252.034591:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:2.0:1787831252.034606:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:2.0:1787831252.034619:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:2.0:1787831252.034652:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:2.0:1787831252.034668:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:2.0:1787831252.034683:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:2.0:1787831252.034695:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:2.0:1787831252.034716:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:2.0:1787831252.037198:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:2.0:1787831252.037224:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:2.0:1787831252.037240:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:2.0:1787831252.037268:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:2.0:1787831252.037282:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:2.0:1787831252.037296:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:2.0:1787831252.037309:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:2.0:1787831252.037322:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:2.0:1787831252.037355:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:2.0:1787831252.037371:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:2.0:1787831252.037385:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:2.0:1787831252.037399:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:2.0:1787831252.037413:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:2.0:1787831252.037427:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:2.0:1787831252.037441:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:2.0:1787831252.037455:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:2.0:1787831252.037467:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:2.0:1787831252.037682:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:2.0:1787831252.037711:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:2.0:1787831252.041524:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:2.0:1787831252.041555:0:24315:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:2.0:1787831252.041667:0:24315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d232f61c3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:24315:1874676443992576:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787831252.043011:0:24315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831252.043052:0:24315:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d232f727540 going to sleep for 11 seconds 00000100:00100000:0.0:1787831252.045261:0:22810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443992576 00000100:00100000:0.0:1787831252.045275:0:22810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443992576 00000100:00100000:0.0:1787831252.045330:0:22810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787831252.045340:0:22810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22025d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8057bc0f-773b-4151-9d37-d94ddea63831+21:24315:x1874676443992576:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787831252.045523:0:22810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22025d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8057bc0f-773b-4151-9d37-d94ddea63831+21:24315:x1874676443992576:12345-0@lo:501:mount.lustre.0 Request processed in 184us (2515us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831252.045532:0:22810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787831252.046029:0:24315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d232f61c3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:24315:1874676443992576:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787831252.046176:0:24315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d232f61c3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:24315:1874676443992704:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787831252.046231:0:24315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831252.046271:0:24315:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d232f727540 going to sleep for 11 seconds 00000100:00100000:0.0:1787831252.046663:0:22808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443992704 00000100:00100000:0.0:1787831252.046669:0:22808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443992704 00000100:00100000:0.0:1787831252.046920:0:22808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787831252.046929:0:22808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22025d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8057bc0f-773b-4151-9d37-d94ddea63831+21:24315:x1874676443992704:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787831252.047034:0:22808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22025d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8057bc0f-773b-4151-9d37-d94ddea63831+21:24315:x1874676443992704:12345-0@lo:503:mount.lustre.0 Request processed in 106us (802us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831252.050884:0:24315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d232f61c3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:24315:1874676443992704:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787831252.051438:0:24315:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787831252.051541:0:24315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d232f61c3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:24315:1874676443992832:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787831252.051616:0:24315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831252.051674:0:24315:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d232f727540 going to sleep for 11 seconds 00000100:00100000:0.0:1787831252.052498:0:22808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787831252.052564:0:22809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443992832 00000100:00100000:0.0:1787831252.052571:0:22809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443992832 00000100:00100000:0.0:1787831252.052660:0:22809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787831252.052669:0:22809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22025d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8057bc0f-773b-4151-9d37-d94ddea63831+21:24315:x1874676443992832:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787831252.053348:0:22809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22025d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8057bc0f-773b-4151-9d37-d94ddea63831+21:24315:x1874676443992832:12345-0@lo:502:mount.lustre.0 Request processed in 678us (1729us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831252.053356:0:22809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787831252.053597:0:24315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d232f61c3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:24315:1874676443992832:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787831252.054423:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:2.0:1787831252.054462:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:2.0:1787831252.054496:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:2.0:1787831252.054512:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:2.0:1787831252.054524:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:2.0:1787831252.054536:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:2.0:1787831252.054548:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:2.0:1787831252.054562:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:2.0:1787831252.054575:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:2.0:1787831252.054587:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:2.0:1787831252.054600:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:2.0:1787831252.054614:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:2.0:1787831252.054687:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:2.0:1787831252.055002:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:2.0:1787831252.055020:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:2.0:1787831252.055032:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:2.0:1787831252.055043:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:2.0:1787831252.055054:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:2.0:1787831252.055081:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:2.0:1787831252.055108:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:2.0:1787831252.055125:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:2.0:1787831252.055140:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:2.0:1787831252.055156:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:2.0:1787831252.055168:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:2.0:1787831252.055180:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:2.0:1787831252.055191:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:2.0:1787831252.055202:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:2.0:1787831252.055214:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:2.0:1787831252.055235:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:2.0:1787831252.055246:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:2.0:1787831252.055258:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:2.0:1787831252.055268:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:2.0:1787831252.055279:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:2.0:1787831252.055290:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:2.0:1787831252.055314:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:2.0:1787831252.056430:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:2.0:1787831252.056450:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:2.0:1787831252.056462:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:2.0:1787831252.056475:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:2.0:1787831252.056488:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:2.0:1787831252.056501:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:2.0:1787831252.056515:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:2.0:1787831252.056528:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:2.0:1787831252.056540:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:2.0:1787831252.056554:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:2.0:1787831252.056567:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:2.0:1787831252.056579:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:2.0:1787831252.056592:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:2.0:1787831252.056662:0:24315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d232f61c3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:24315:1874676443992960:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787831252.056926:0:24315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831252.056969:0:24315:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d232f727540 going to sleep for 11 seconds 00000100:00100000:1.0:1787831252.057018:0:22809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443992960 00000100:00100000:1.0:1787831252.057026:0:22809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443992960 00000100:00100000:1.0:1787831252.057083:0:22809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787831252.057101:0:22809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22025d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8057bc0f-773b-4151-9d37-d94ddea63831+21:24315:x1874676443992960:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787831252.057225:0:22809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22025d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8057bc0f-773b-4151-9d37-d94ddea63831+21:24315:x1874676443992960:12345-0@lo:502:mount.lustre.0 Request processed in 133us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831252.057233:0:22809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787831252.058494:0:24315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d232f61c3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:24315:1874676443992960:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787831252.058744:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:2.0:1787831252.058796:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:2.0:1787831252.058838:0:24315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d232f61c3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:24315:1874676443993088:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787831252.058889:0:24315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831252.058922:0:22810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443993088 00000100:00100000:2.0:1787831252.058927:0:22810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443993088 00000100:00100000:2.0:1787831252.058968:0:22810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787831252.058974:0:22810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22025d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8057bc0f-773b-4151-9d37-d94ddea63831+21:24315:x1874676443993088:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787831252.059061:0:22810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22025d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8057bc0f-773b-4151-9d37-d94ddea63831+21:24315:x1874676443993088:12345-0@lo:502:mount.lustre.0 Request processed in 86us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831252.059069:0:22810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787831252.059124:0:24315:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d232f727540 going to sleep for 11 seconds 00000100:00100000:2.0:1787831252.059139:0:24315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d232f61c3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:24315:1874676443993088:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787831252.059173:0:24315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:2.0:1787831252.059181:0:24315:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1787831252.061998:0:24341:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1787831252.062017:0:24341:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8d2202a73370) 00000020:00000080:3.0:1787831252.062041:0:24341:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:3.0:1787831252.062291:0:24341:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d232aef4800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1787831252.062296:0:24341:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d232aef4800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1787831252.062299:0:24341:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d232aef4800 3 00010000:00080000:3.0:1787831252.062329:0:24341:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d220341f800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.131@tcp at head 00010000:00010000:3.0:1787831252.067526:0:24341:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:3.0:1787831252.069713:0:24341:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1787831252.069768:0:24341:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787831252.069781:0:24341:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x95459fb9d1d2a89f 00000100:00080000:3.0:1787831252.069799:0:24341:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787831252.069805:0:24341:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8d220341f800 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:3.0:1787831252.069841:0:24341:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d220483da40 x1874676443993216/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787831252.071248:0:24341:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787831252.071687:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220483da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3618:1874676443993216:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787831252.071989:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831252.072228:0:22817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443993216 00000100:00100000:3.0:1787831252.072236:0:22817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443993216 00000100:00100000:3.0:1787831252.072269:0:22817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787831252.072276:0:22817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220442f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3618:x1874676443993216:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1787831252.072302:0:22817:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 543 last 0 00000020:00000080:3.0:1787831252.072351:0:22817:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x95459fb9d1d2a8a6 00000004:00100000:3.0:1787831252.072366:0:22817:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787831252.072399:0:22817:0:(import.c:65:import_set_state_nolock()) ffff8d2203419000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787831252.072453:0:22817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220442f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1874676443993216:12345-0@lo:38:llog_process_th.0 Request processed in 176us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831252.072461:0:22817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1787831252.072767:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787831252.072771:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787831252.072774:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787831252.072776:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787831252.072819:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787831252.072823:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787831252.072825:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787831252.072829:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00080000:0.0:1787831252.073181:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d220483da40 x1874676443993216/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787831262 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787831252.073194:0:3618:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787831252.073202:0:3618:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:0.0:1787831252.073210:0:3618:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787831252.073215:0:3618:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787831252.073218:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8d220341f800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787831252.073224:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220483da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3618:1874676443993216:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787831252.073257:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220442cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1874676443993344:0@lo:400:kworker.0 00000100:00100000:0.0:1787831252.073302:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831252.073326:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787831252.073331:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220442de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3620:1874676443993728:0@lo:400:kworker.0 00000100:00100000:0.0:1787831252.073350:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831252.073376:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220442e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3621:1874676443993472:0@lo:400:kworker.0 00000100:00100000:0.0:1787831252.073395:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831252.073410:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787831252.073415:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220442e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443993600:0@lo:400:kworker.0 00000100:00100000:0.0:1787831252.073432:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831252.073454:0:22821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443993344 00000100:00100000:0.0:1787831252.073458:0:22821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443993344 00000100:00100000:0.0:1787831252.073484:0:22821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443993600 00000100:00100000:0.0:1787831252.073486:0:22821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443993600 00000100:00100000:0.0:1787831252.073497:0:22821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787831252.073503:0:22821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220442e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1874676443993344:12345-0@lo:400:kworker.0 00000020:01000004:2.0:1787831252.078598:0:24341:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1787831252.078616:0:24341:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff8d233f433370) 00000020:00000080:2.0:1787831252.078657:0:24341:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000100:00100000:3.0:1787831252.078692:0:22816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443993728 00000100:00100000:3.0:1787831252.078701:0:22816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443993728 00000100:00100000:3.0:1787831252.078753:0:22816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443993472 00000100:00100000:3.0:1787831252.078756:0:22816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443993472 00000020:01000004:2.0:1787831252.078763:0:24341:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d232aef4800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787831252.078768:0:24341:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d232aef4800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787831252.078770:0:24341:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d232aef4800 3 00000100:00100000:3.0:1787831252.078797:0:22816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1787831252.078802:0:24341:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d233f421800@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.131@tcp at head 00000100:00100000:3.0:1787831252.078805:0:22816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220442f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1874676443993728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787831252.078903:0:22816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220442f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1874676443993728:12345-0@lo:400:kworker.0 Request processed in 98us (5551us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831252.078910:0:22816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787831252.078929:0:22816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787831252.078935:0:22816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220442f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1874676443993472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787831252.078968:0:22816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220442f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1874676443993472:12345-0@lo:400:kworker.0 Request processed in 34us (5572us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831252.078975:0:22816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:2.0:1787831252.081920:0:24341:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:2.0:1787831252.082116:0:24341:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000100:00100000:0.0:1787831252.085690:0:22821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220442e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1874676443993344:12345-0@lo:400:kworker.0 Request processed in 12177us (12377us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831252.085997:0:22821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787831252.086037:0:22821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787831252.086052:0:22821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204400780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443993600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787831252.086201:0:22821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204400780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443993600:12345-0@lo:400:kworker.0 Request processed in 156us (12767us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831252.086208:0:22821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:0.0:1787831252.086280:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d220442de00 x1874676443993728/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787831268 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787831252.086296:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220442de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3620:1874676443993728:0@lo:400:kworker.0 00000100:00100000:0.0:1787831252.086322:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220442cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1874676443993344:0@lo:400:kworker.0 00000100:00100000:0.0:1787831252.086361:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220442e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443993600:0@lo:400:kworker.0 00010000:00080000:0.0:1787831252.086375:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d220442e580 x1874676443993472/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787831268 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787831252.086385:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220442e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3621:1874676443993472:0@lo:400:kworker.0 00000010:01000000:2.0:1787831252.087596:0:24341:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787831252.087613:0:24341:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x95459fb9d1d2a8b4 00000100:00080000:2.0:1787831252.087641:0:24341:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787831252.087648:0:24341:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8d233f421800 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:2.0:1787831252.087680:0:24341:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d232f61c3c0 x1874676443993856/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787831252.088998:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d232f61c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3618:1874676443993856:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787831252.089068:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831252.089144:0:22816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443993856 00000100:00100000:2.0:1787831252.089157:0:22816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443993856 00000100:00100000:2.0:1787831252.089192:0:22816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787831252.089200:0:22816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d232f61f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3618:x1874676443993856:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787831252.089227:0:22816:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 543 last 0 00000020:00000080:2.0:1787831252.089273:0:22816:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x95459fb9d1d2a8bb 00000004:00100000:2.0:1787831252.089288:0:22816:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787831252.089317:0:22816:0:(import.c:65:import_set_state_nolock()) ffff8d232b9ef000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787831252.089362:0:22816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d232f61f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1874676443993856:12345-0@lo:38:llog_process_th.0 Request processed in 162us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831252.089370:0:22816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1787831252.089408:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d232f61c3c0 x1874676443993856/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787831262 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787831252.089417:0:3618:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787831252.089424:0:3618:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 3 00000100:00080000:2.0:1787831252.089431:0:3618:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787831252.089435:0:3618:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1787831252.089438:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8d233f421800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787831252.089443:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d232f61c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3618:1874676443993856:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1787831252.089459:0:24341:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1787831252.089479:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787831252.089484:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787831252.089487:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787831252.089489:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787831252.089492:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787831252.089500:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787831252.089502:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787831252.089504:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:2.0:1787831252.090963:0:24341:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:2.0:1787831252.091021:0:24315:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1787831252.091048:0:24315:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787831252.091071:0:24315:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d2307c77e00/0x95459fb9d1d2a88a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2a891 expref: -99 pid: 24315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831252.091082:0:24315:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8d2307c77e00/0x95459fb9d1d2a88a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2a891 expref: -99 pid: 24315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787831252.091138:0:24315:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787831252.091141:0:24315:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787831252.091142:0:24315:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787831252.091143:0:24315:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787831252.091145:0:24315:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787831252.091147:0:24315:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787831252.091149:0:24315:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787831252.091151:0:24315:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787831252.091153:0:24315:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787831252.091156:0:24315:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1787831252.091159:0:24315:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787831252.091160:0:24315:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787831252.091161:0:24315:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787831252.091162:0:24315:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787831252.091163:0:24315:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787831252.091164:0:24315:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787831252.091165:0:24315:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787831252.091166:0:24315:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787831252.091168:0:24315:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787831252.091189:0:24315:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787831252.091204:0:24315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d232f61c3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:24315:1874676443993984:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787831252.091268:0:24315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831252.091305:0:24315:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d232f727cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787831252.092162:0:22809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443993984 00000100:00100000:1.0:1787831252.092171:0:22809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443993984 00000100:00100000:1.0:1787831252.092218:0:22809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787831252.092232:0:22809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22025d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8057bc0f-773b-4151-9d37-d94ddea63831+21:24315:x1874676443993984:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787831252.092263:0:22809:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1787831252.092278:0:22809:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787831252.095937:0:22809:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787831252.095955:0:22809:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1787831252.096475:0:22831:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787831252.096480:0:22831:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787831252.096501:0:22831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d233be94c00/0x95459fb9d1d2a8c2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831252.096520:0:22831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2303aa2200/0x95459fb9d1d2a80c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d2a805 expref: 21 pid: 22808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831252.096529:0:22831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2303aa2a00/0x95459fb9d1d2a81a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d2a813 expref: 21 pid: 22809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831252.096584:0:22831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d233be94c00/0x95459fb9d1d2a8c2 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831252.096650:0:22831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2303aa2a00/0x95459fb9d1d2a81a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x95459fb9d1d2a813 expref: 21 pid: 22809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831252.096665:0:22831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d2303aa2a00/0x95459fb9d1d2a81a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x95459fb9d1d2a813 expref: 21 pid: 22809 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831252.096681:0:22831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203767840 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22831:1874676443994112:0@lo:104: 00000100:00100000:2.0:1787831252.097224:0:22809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22025d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8057bc0f-773b-4151-9d37-d94ddea63831+21:24315:x1874676443993984:12345-0@lo:253:mount.lustre.0 Request processed in 4995us (5953us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831252.097235:0:22809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787831252.097308:0:24315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d232f61c3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:24315:1874676443993984:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787831252.097321:0:24315:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787831252.097324:0:24315:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787831252.097326:0:24315:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787831252.097327:0:24315:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787831252.097329:0:24315:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787831252.097330:0:24315:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787831252.097331:0:24315:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787831252.097333:0:24315:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787831252.097335:0:24315:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787831252.097336:0:24315:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787831252.097351:0:24315:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1787831252.097658:0:22831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787831252.097770:0:22831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2303aa2200/0x95459fb9d1d2a80c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x95459fb9d1d2a805 expref: 20 pid: 22808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831252.097794:0:22831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d2303aa2200/0x95459fb9d1d2a80c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x95459fb9d1d2a805 expref: 20 pid: 22808 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831252.097806:0:22831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203765a40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22831:1874676443994240:0@lo:104: 00000100:00100000:1.0:1787831252.097950:0:22831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831252.097964:0:22831:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d23184ce9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787831252.098061:0:22800:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787831252.098077:0:22800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443994112 00000100:00100000:0.0:1787831252.098082:0:22800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443994112 00000100:00100000:0.0:1787831252.098121:0:22800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443994240 00000100:00100000:0.0:1787831252.098124:0:22800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443994240 00000100:00100000:0.0:1787831252.098139:0:22800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787831252.098146:0:22800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203767c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8057bc0f-773b-4151-9d37-d94ddea63831+4:22831:x1874676443994112:12345-0@lo:104: 00010000:00010000:0.0:1787831252.098159:0:22800:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff8d2303aa3e00/0x95459fb9d1d2a813 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d2a81a expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831252.098215:0:22800:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787831252.098221:0:22800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203767c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8057bc0f-773b-4151-9d37-d94ddea63831+4:22831:x1874676443994112:12345-0@lo:104: Request processed in 76us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831252.098227:0:22800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787831252.098242:0:22800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787831252.098248:0:22800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2306d1c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8057bc0f-773b-4151-9d37-d94ddea63831+3:22831:x1874676443994240:12345-0@lo:104: 00010000:00010000:0.0:1787831252.098255:0:22800:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff8d2301668800/0x95459fb9d1d2a805 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d2a80c expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831252.098296:0:22800:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787831252.098301:0:22800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2306d1c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8057bc0f-773b-4151-9d37-d94ddea63831+3:22831:x1874676443994240:12345-0@lo:104: Request processed in 54us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831252.098307:0:22800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1787831252.098341:0:22804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787831252.098347:0:22804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8d2303aa3e00/0x95459fb9d1d2a813 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d2a81a expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831252.098354:0:22804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2303aa3e00 already unused, calling callback (ffffffffc14f9c20) 10000000:00010000:0.0:1787831252.098359:0:22804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8d2303aa3e00/0x95459fb9d1d2a813 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x95459fb9d1d2a81a expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831252.098368:0:22804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8d2303aa3e00/0x95459fb9d1d2a813 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x95459fb9d1d2a81a expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787831252.098375:0:22804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8d2303aa3e00/0x95459fb9d1d2a813 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x95459fb9d1d2a81a expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787831252.098381:0:22804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787831252.098403:0:22804:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8d2303aa3e00/0x95459fb9d1d2a813 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d2a81a expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831252.098410:0:22804:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787831252.098427:0:22804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8d2303aa3e00/0x95459fb9d1d2a813 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d2a81a expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831252.098435:0:22804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8d2303aa3e00/0x95459fb9d1d2a813 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d2a81a expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831252.098456:0:22804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787831252.098459:0:22804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8d2301668800/0x95459fb9d1d2a805 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d2a80c expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831252.098465:0:22804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2301668800 already unused, calling callback (ffffffffc14f9c20) 10000000:00010000:0.0:1787831252.098468:0:22804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8d2301668800/0x95459fb9d1d2a805 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x95459fb9d1d2a80c expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831252.098475:0:22804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8d2301668800/0x95459fb9d1d2a805 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x95459fb9d1d2a80c expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787831252.098481:0:22804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8d2301668800/0x95459fb9d1d2a805 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x95459fb9d1d2a80c expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787831252.098486:0:22804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787831252.098496:0:22804:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8d2301668800/0x95459fb9d1d2a805 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d2a80c expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831252.098502:0:22804:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787831252.098514:0:22804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8d2301668800/0x95459fb9d1d2a805 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d2a80c expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831252.098520:0:22804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8d2301668800/0x95459fb9d1d2a805 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d2a80c expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831252.098533:0:22804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787831252.098534:0:22804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787831252.098536:0:22804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787831252.098677:0:22831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203767840 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22831:1874676443994112:0@lo:104: 00000100:00100000:1.0:1787831252.098685:0:22831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203765a40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22831:1874676443994240:0@lo:104: 00010000:00010000:0.0:1787831252.099427:0:22805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787831252.099455:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204401680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8057bc0f-773b-4151-9d37-d94ddea63831:3620:1874676443994368:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787831252.099494:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831252.099536:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22044030c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8057bc0f-773b-4151-9d37-d94ddea63831:3621:1874676443994496:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787831252.099640:0:22831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d233be94c00/0x95459fb9d1d2a8c2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831252.099799:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831252.100190:0:22801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443994368 00000100:00100000:1.0:1787831252.100198:0:22801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443994368 00010000:00010000:1.0:1787831252.100225:0:22801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2303aa2a00/0x95459fb9d1d2a81a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d2a813 expref: 21 pid: 22809 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831252.100255:0:22801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443994496 00000100:00100000:1.0:1787831252.100258:0:22801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443994496 00010000:00010000:1.0:1787831252.100268:0:22801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2303aa2200/0x95459fb9d1d2a80c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d2a805 expref: 22 pid: 22808 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831252.100280:0:22801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787831252.100287:0:22801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204401a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8057bc0f-773b-4151-9d37-d94ddea63831+22:3620:x1874676443994368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787831252.100299:0:22801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787831252.100304:0:22801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2303aa2a00/0x95459fb9d1d2a81a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d2a813 expref: 22 pid: 22809 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831252.100314:0:22801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2303aa2a00/0x95459fb9d1d2a81a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x95459fb9d1d2a813 expref: 22 pid: 22809 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831252.100339:0:22801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2303aa2a00/0x95459fb9d1d2a81a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x95459fb9d1d2a813 expref: 22 pid: 22809 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831252.100350:0:22801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787831252.100383:0:22801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204401a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8057bc0f-773b-4151-9d37-d94ddea63831+21:3620:x1874676443994368:12345-0@lo:103:ldlm_bl.0 Request processed in 96us (888us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831252.100389:0:22801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787831252.100405:0:22801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787831252.100411:0:22801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203902450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8057bc0f-773b-4151-9d37-d94ddea63831+20:3621:x1874676443994496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787831252.100417:0:22801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787831252.100421:0:22801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2303aa2200/0x95459fb9d1d2a80c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d2a805 expref: 20 pid: 22808 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831252.100430:0:22801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2303aa2200/0x95459fb9d1d2a80c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x95459fb9d1d2a805 expref: 20 pid: 22808 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831252.100439:0:22801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2303aa2200/0x95459fb9d1d2a80c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x95459fb9d1d2a805 expref: 20 pid: 22808 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831252.100449:0:22801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d233be94c00/0x95459fb9d1d2a8c2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831252.100458:0:22801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d233be94c00/0x95459fb9d1d2a8c2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787831252.100470:0:22801:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.030990682s 00010000:00010000:1.0:1787831252.100474:0:22801:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d233be94c00/0x95459fb9d1d2a8c2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831252.100490:0:22801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d233be94c00/0x95459fb9d1d2a8c2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831252.100498:0:22801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d233be94c00/0x95459fb9d1d2a8c2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831252.100505:0:22801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d233be94c00/0x95459fb9d1d2a8c2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831252.100511:0:22801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233be94c00 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:1.0:1787831252.100515:0:22801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d233be94c00/0x95459fb9d1d2a8c2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831252.100523:0:22801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d233be94c00/0x95459fb9d1d2a8c2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831252.100537:0:22801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d233be94c00/0x95459fb9d1d2a8c2 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831252.100557:0:22801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787831252.100581:0:22801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203902450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8057bc0f-773b-4151-9d37-d94ddea63831+19:3621:x1874676443994496:12345-0@lo:103:ldlm_bl.0 Request processed in 170us (781us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831252.100587:0:22801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1787831252.100649:0:22831:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d233be94c00/0x95459fb9d1d2a8c2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831252.100657:0:22831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d233be94c00/0x95459fb9d1d2a8c2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831252.100663:0:22831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d233be94c00/0x95459fb9d1d2a8c2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831252.101014:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204401680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8057bc0f-773b-4151-9d37-d94ddea63831:3620:1874676443994368:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787831252.101039:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22044030c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8057bc0f-773b-4151-9d37-d94ddea63831:3621:1874676443994496:0@lo:103:ldlm_bl.0 00000001:00000004:2.0:1787831252.102357:0:24315:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:2.0:1787831252.108272:0:24315:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1787831252.108281:0:24315:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1787831252.108319:0:24315:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787831252.108359:0:24315:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.131@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787831252.108376:0:24315:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1787831252.108393:0:24315:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:2.0:1787831252.109185:0:24315:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787831252.109371:0:24315:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787831252.582994:0:22804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787831253.158527:0:24397:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787831253.159019:0:24397:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787831253.607817:0:22805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787831253.734849:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787831253.734872:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220483f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443994624:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787831253.734936:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831253.734982:0:22821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443994624 00000100:00100000:3.0:1787831253.734989:0:22821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443994624 00000100:00100000:3.0:1787831253.735036:0:22821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787831253.735045:0:22821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220483c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443994624:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787831253.735095:0:22821:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1787831253.735143:0:22821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220483c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443994624:12345-0@lo:41:osp-pre-0-1.0 Request processed in 99us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831253.735151:0:22821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787831253.735198:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220483f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443994624:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787831253.735442:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203764f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443994752:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787831253.735477:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831253.735559:0:23556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443994752 00000100:00100000:1.0:1787831253.735564:0:23556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443994752 00000100:00100000:1.0:1787831253.735597:0:23556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787831253.735605:0:23556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d232f61c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676443994752:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787831253.735654:0:23556:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787831253.735697:0:23556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d232f61c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676443994752:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831253.735703:0:23556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787831253.735847:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203764f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443994752:0@lo:41:osp-pre-1-0.0 10000000:01000000:0.0:1787831253.862741:0:22812:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787831253.862749:0:22812:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d2201e09000 from 13 10000000:01000000:0.0:1787831253.862753:0:22812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787831253.862797:0:22812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233bf10400/0x95459fb9d1d2a8c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831253.862809:0:22812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8d233bf10400/0x95459fb9d1d2a8c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831253.862819:0:22812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8d233bf10400/0x95459fb9d1d2a8c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831253.862843:0:22812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22044012c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8057bc0f-773b-4151-9d37-d94ddea63831:22812:1874676443994880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787831253.862907:0:22812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831253.862952:0:22812:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2321ef7a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787831253.863068:0:22808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443994880 00000100:00100000:2.0:1787831253.863076:0:22808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443994880 00000100:00100000:2.0:1787831253.863144:0:22808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787831253.863153:0:22808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22025d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8057bc0f-773b-4151-9d37-d94ddea63831+19:22812:x1874676443994880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787831253.863167:0:22808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787831253.863182:0:22808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2303aa3200/0x95459fb9d1d2a8d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d2a8c9 expref: -99 pid: 22808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831253.863207:0:22808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2303aa3200/0x95459fb9d1d2a8d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d2a8c9 expref: 20 pid: 22808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831253.863219:0:22808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2303aa3200/0x95459fb9d1d2a8d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d2a8c9 expref: 20 pid: 22808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831253.863229:0:22808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2303aa3200, rc 0) 00000100:00100000:2.0:1787831253.863284:0:22808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22025d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8057bc0f-773b-4151-9d37-d94ddea63831+20:22812:x1874676443994880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831253.863292:0:22808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787831253.863388:0:22812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22044012c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8057bc0f-773b-4151-9d37-d94ddea63831:22812:1874676443994880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787831253.863403:0:22812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8d233bf10400/0x95459fb9d1d2a8c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2a8d0 expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831253.863412:0:22812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8d233bf10400/0x95459fb9d1d2a8c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d2a8d0 expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831253.863467:0:22812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22037670c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8057bc0f-773b-4151-9d37-d94ddea63831:22812:1874676443995008:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787831253.863500:0:22812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831253.863520:0:22812:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d23184ce6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787831253.863570:0:22809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443995008 00000100:00100000:2.0:1787831253.863575:0:22809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443995008 00000100:00100000:2.0:1787831253.863603:0:22809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787831253.863609:0:22809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2305ffb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8057bc0f-773b-4151-9d37-d94ddea63831+20:22812:x1874676443995008:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787831253.863620:0:22809:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787831253.863660:0:22809:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787831253.863663:0:22809:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:2.0:1787831253.863739:0:22809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2305ffb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8057bc0f-773b-4151-9d37-d94ddea63831+20:22812:x1874676443995008:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 130us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831253.863746:0:22809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787831253.863860:0:22812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22037670c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8057bc0f-773b-4151-9d37-d94ddea63831:22812:1874676443995008:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787831253.863916:0:22812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787831253.863922:0:22812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233bf10400/0x95459fb9d1d2a8c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2a8d0 expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831253.863930:0:22812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8d233bf10400/0x95459fb9d1d2a8c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2a8d0 expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787831253.863947:0:22812:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787831253.863949:0:22812:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d233fad3000 from 13 10000000:01000000:1.0:1787831253.863952:0:22812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787831253.863967:0:22812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233be95a00/0x95459fb9d1d2a8d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831253.863974:0:22812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8d233be95a00/0x95459fb9d1d2a8d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831253.863982:0:22812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8d233be95a00/0x95459fb9d1d2a8d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831253.863993:0:22812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22037670c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8057bc0f-773b-4151-9d37-d94ddea63831:22812:1874676443995136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787831253.864016:0:22812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831253.864040:0:22812:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d23184ce6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787831253.864093:0:22809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443995136 00000100:00100000:2.0:1787831253.864097:0:22809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443995136 00000100:00100000:2.0:1787831253.864122:0:22809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787831253.864128:0:22809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2305ffb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8057bc0f-773b-4151-9d37-d94ddea63831+20:22812:x1874676443995136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787831253.864134:0:22809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787831253.864143:0:22809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2303aa2a00/0x95459fb9d1d2a8de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d2a8d7 expref: -99 pid: 22809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831253.864158:0:22809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2303aa2a00/0x95459fb9d1d2a8de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d2a8d7 expref: 21 pid: 22809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831253.864166:0:22809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2303aa2a00/0x95459fb9d1d2a8de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d2a8d7 expref: 21 pid: 22809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831253.864174:0:22809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2303aa2a00, rc 0) 00000100:00100000:2.0:1787831253.864197:0:22809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2305ffb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8057bc0f-773b-4151-9d37-d94ddea63831+21:22812:x1874676443995136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 69us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831253.864203:0:22809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787831253.864279:0:22812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22037670c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8057bc0f-773b-4151-9d37-d94ddea63831:22812:1874676443995136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787831253.864288:0:22812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8d233be95a00/0x95459fb9d1d2a8d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2a8de expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831253.864295:0:22812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8d233be95a00/0x95459fb9d1d2a8d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d2a8de expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831253.864328:0:22812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22037670c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8057bc0f-773b-4151-9d37-d94ddea63831:22812:1874676443995264:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787831253.864351:0:22812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831253.864363:0:22812:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d23184ce6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787831253.864373:0:22809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443995264 00000100:00100000:1.0:1787831253.864375:0:22809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443995264 00000100:00100000:1.0:1787831253.864398:0:22809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787831253.864403:0:22809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2305ffa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8057bc0f-773b-4151-9d37-d94ddea63831+21:22812:x1874676443995264:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787831253.864412:0:22809:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787831253.864420:0:22809:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787831253.864423:0:22809:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:1.0:1787831253.864474:0:22809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2305ffa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8057bc0f-773b-4151-9d37-d94ddea63831+21:22812:x1874676443995264:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 71us (122us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831253.864480:0:22809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787831253.864503:0:22812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22037670c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8057bc0f-773b-4151-9d37-d94ddea63831:22812:1874676443995264:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787831253.864537:0:22812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787831253.864543:0:22812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233be95a00/0x95459fb9d1d2a8d7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2a8de expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831253.864550:0:22812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8d233be95a00/0x95459fb9d1d2a8d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2a8de expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831254.631284:0:22804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787831255.654975:0:22805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787831256.678804:0:22804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787831257.006679:0:22852:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:3.0:1787831257.324926:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787831257.324933:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787831257.324936:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787831257.324946:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787831257.324965:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787831257.324967:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787831257.324970:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787831257.324972:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787831257.325012:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220483d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8057bc0f-773b-4151-9d37-d94ddea63831:3620:1874676443995392:0@lo:400:kworker.0 00000100:00100000:3.0:1787831257.325090:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831257.325134:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220483cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3620:1874676443995904:0@lo:400:kworker.0 00000100:00100000:3.0:1787831257.325165:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831257.325195:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787831257.325201:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220483de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1874676443995776:0@lo:400:kworker.0 00000100:00100000:3.0:1787831257.325228:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831257.325255:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220483e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443995520:0@lo:400:kworker.0 00000100:00100000:3.0:1787831257.325280:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831257.325298:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220483e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3621:1874676443996032:0@lo:400:kworker.0 00000100:00100000:3.0:1787831257.325321:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831257.325337:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787831257.325342:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220483f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3621:1874676443995648:0@lo:400:kworker.0 00000100:00100000:3.0:1787831257.325359:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831257.325373:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220483da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3621:1874676443996160:0@lo:400:kworker.0 00000100:00100000:3.0:1787831257.325392:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831257.325418:0:22809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443995392 00000100:00100000:3.0:1787831257.325424:0:22809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443995392 00000100:00100000:3.0:1787831257.325475:0:22809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787831257.325484:0:22809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2305ffa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8057bc0f-773b-4151-9d37-d94ddea63831+21:3620:x1874676443995392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787831257.325532:0:22809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2305ffa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8057bc0f-773b-4151-9d37-d94ddea63831+21:3620:x1874676443995392:12345-0@lo:400:kworker.0 Request processed in 49us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831257.325539:0:22809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787831257.325571:0:22820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443995776 00000100:00100000:3.0:1787831257.325575:0:22820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443995776 00000100:00100000:3.0:1787831257.325594:0:22820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443995520 00000100:00100000:3.0:1787831257.325596:0:22820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443995520 00000100:00100000:3.0:1787831257.325608:0:22820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787831257.325614:0:22820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204624f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1874676443995776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787831257.325671:0:22820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204624f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1874676443995776:12345-0@lo:400:kworker.0 Request processed in 56us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831257.325677:0:22820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787831257.325689:0:22820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787831257.325695:0:22820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204625a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1874676443995520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787831257.325727:0:22820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204625a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1874676443995520:12345-0@lo:400:kworker.0 Request processed in 32us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831257.325732:0:22820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787831257.325753:0:22851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443995904 00000100:00100000:3.0:1787831257.325756:0:22851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443995904 00000100:00100000:3.0:1787831257.325772:0:22851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443996032 00000100:00100000:3.0:1787831257.325775:0:22851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443996032 00000100:00100000:3.0:1787831257.325873:0:22851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443995648 00000100:00100000:3.0:1787831257.325877:0:22851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443995648 00000100:00100000:3.0:1787831257.325885:0:22851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443996160 00000100:00100000:3.0:1787831257.325888:0:22851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443996160 00000100:00100000:3.0:1787831257.325900:0:22851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787831257.325904:0:22851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220483e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1874676443995904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787831257.325941:0:22851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220483e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1874676443995904:12345-0@lo:400:kworker.0 Request processed in 36us (776us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831257.325947:0:22851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787831257.325958:0:22851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787831257.325963:0:22851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204626940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1874676443996032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787831257.325986:0:22851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204626940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1874676443996032:12345-0@lo:400:kworker.0 Request processed in 24us (665us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831257.325991:0:22851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787831257.326002:0:22851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787831257.326007:0:22851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204625680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1874676443995648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787831257.326031:0:22851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204625680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1874676443995648:12345-0@lo:400:kworker.0 Request processed in 25us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831257.326036:0:22851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787831257.326046:0:22851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787831257.326051:0:22851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22046261c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1874676443996160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787831257.326086:0:22851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22046261c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1874676443996160:12345-0@lo:400:kworker.0 Request processed in 35us (692us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831257.326092:0:22851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:3.0:1787831257.326120:0:22811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787831257.326124:0:22811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787831257.326149:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d220483f480 x1874676443995648/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787831273 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787831257.326163:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220483f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3621:1874676443995648:0@lo:400:kworker.0 00010000:00080000:3.0:1787831257.326174:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d220483da40 x1874676443996160/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787831273 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787831257.326195:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220483da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3621:1874676443996160:0@lo:400:kworker.0 00000100:00100000:3.0:1787831257.326206:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220483e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443995520:0@lo:400:kworker.0 00010000:00080000:3.0:1787831257.326214:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d220483e1c0 x1874676443996032/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787831273 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787831257.326222:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220483e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3621:1874676443996032:0@lo:400:kworker.0 00000100:00100000:3.0:1787831257.326254:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220483de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1874676443995776:0@lo:400:kworker.0 00000100:00100000:3.0:1787831257.326261:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220483d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8057bc0f-773b-4151-9d37-d94ddea63831:3620:1874676443995392:0@lo:400:kworker.0 00010000:00080000:3.0:1787831257.326269:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d220483cf00 x1874676443995904/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787831273 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787831257.326276:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220483cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3620:1874676443995904:0@lo:400:kworker.0 00000001:02000400:2.0:1787831257.587452:0:24686:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg331-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787831257.710164:0:22805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787831258.327166:0:24738:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787831258.328296:0:24738:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787831258.733336:0:22804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787831258.854837:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203765a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1874676443996416:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787831258.854840:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22046243c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443996288:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787831258.858471:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831258.858585:0:22820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443996416 00000100:00100000:1.0:1787831258.858594:0:22820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443996416 00000100:00100000:1.0:1787831258.858657:0:22820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787831258.858667:0:22820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203767840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1874676443996416:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787831258.858702:0:22820:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787831258.858769:0:22820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203767840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1874676443996416:12345-0@lo:41:osp-pre-1-0.0 Request processed in 104us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831258.858787:0:22820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787831258.858838:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203765a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1874676443996416:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787831258.861239:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831258.861434:0:22821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443996288 00000100:00100000:2.0:1787831258.861443:0:22821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443996288 00000100:00100000:2.0:1787831258.861503:0:22821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787831258.861513:0:22821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204624000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443996288:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787831258.861549:0:22821:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1787831258.861618:0:22821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204624000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443996288:12345-0@lo:41:osp-pre-0-1.0 Request processed in 107us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831258.861646:0:22821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787831258.861711:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22046243c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443996288:0@lo:41:osp-pre-0-1.0 00000020:00000004:3.0:1787831259.292354:0:24789:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787831259.292597:0:24789:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787831259.750929:0:22805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787831260.774736:0:22804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787831260.905963:0:23569:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787831261.799651:0:22805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787831262.438757:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787831262.438764:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787831262.438767:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787831262.438770:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787831262.438806:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22046270c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676443996672:0@lo:400:kworker.0 00000100:00080000:3.0:1787831262.438807:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787831262.438810:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787831262.438813:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787831262.438816:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787831262.438840:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204624b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8057bc0f-773b-4151-9d37-d94ddea63831:3621:1874676443996544:0@lo:400:kworker.0 00000100:00100000:2.0:1787831262.438874:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831262.438892:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831262.439222:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204627840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874676443996800:0@lo:400:kworker.0 00000100:00100000:3.0:1787831262.439258:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831262.440898:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204626d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3622:1874676443997184:0@lo:400:kworker.0 00000100:00100000:2.0:1787831262.440955:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831262.441012:0:23556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443996672 00000100:00100000:2.0:1787831262.441019:0:23556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443996672 00000100:00100000:2.0:1787831262.441076:0:23556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787831262.441085:0:23556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d232f61f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1874676443996672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787831262.441584:0:23556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d232f61f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1874676443996672:12345-0@lo:400:kworker.0 Request processed in 498us (2709us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831262.441593:0:23556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787831262.441620:0:22816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443996800 00000100:00100000:2.0:1787831262.441642:0:22816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443996800 00000100:00100000:2.0:1787831262.441669:0:22816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443997184 00000100:00100000:2.0:1787831262.441672:0:22816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443997184 00000100:00100000:2.0:1787831262.441699:0:22816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787831262.441705:0:22816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204626580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874676443996800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787831262.441850:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204627c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3621:1874676443997056:0@lo:400:kworker.0 00000100:00100000:0.0:1787831262.441889:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831262.442068:0:22810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443996544 00000100:00100000:0.0:1787831262.442074:0:22810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443996544 00000100:00100000:0.0:1787831262.442107:0:22810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787831262.442115:0:22810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2305ffa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8057bc0f-773b-4151-9d37-d94ddea63831+21:3621:x1874676443996544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787831262.442160:0:22810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2305ffa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8057bc0f-773b-4151-9d37-d94ddea63831+21:3621:x1874676443996544:12345-0@lo:400:kworker.0 Request processed in 46us (3269us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831262.442168:0:22810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787831262.442220:0:22816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204626580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874676443996800:12345-0@lo:400:kworker.0 Request processed in 514us (2960us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831262.442227:0:22816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787831262.442242:0:22816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443997056 00000100:00100000:2.0:1787831262.442247:0:22816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443997056 00000100:00100000:2.0:1787831262.442266:0:22816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787831262.442274:0:22816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d232f61c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1874676443997184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787831262.442300:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204624b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8057bc0f-773b-4151-9d37-d94ddea63831:3621:1874676443996544:0@lo:400:kworker.0 00000100:00100000:2.0:1787831262.442311:0:22816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d232f61c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1874676443997184:12345-0@lo:400:kworker.0 Request processed in 37us (1355us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831262.442320:0:22816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787831262.442341:0:22816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787831262.442347:0:22816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204400b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1874676443997056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787831262.442383:0:22816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204400b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1874676443997056:12345-0@lo:400:kworker.0 Request processed in 36us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831262.442391:0:22816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:2.0:1787831262.442414:0:22811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787831262.443235:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2204627c00 x1874676443997056/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787831278 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787831262.443250:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204627c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3621:1874676443997056:0@lo:400:kworker.0 00010000:00080000:2.0:1787831262.443293:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2204626d00 x1874676443997184/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787831278 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787831262.443304:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22046252c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1874676443996928:0@lo:400:kworker.0 00000100:00100000:2.0:1787831262.443305:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204626d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3622:1874676443997184:0@lo:400:kworker.0 00010000:00080000:3.0:1787831262.444044:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2204627840 x1874676443996800/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787831278 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787831262.444057:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204627840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874676443996800:0@lo:400:kworker.0 00000100:00100000:3.0:1787831262.444066:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204627480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3619:1874676443997312:0@lo:400:kworker.0 00000100:00100000:3.0:1787831262.444112:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831262.445213:0:22816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443997312 00000100:00100000:1.0:1787831262.445222:0:22816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443997312 00000100:00100000:1.0:1787831262.445326:0:22816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787831262.445336:0:22816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204625e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874676443997312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787831262.445408:0:22816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204625e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874676443997312:12345-0@lo:400:kworker.0 Request processed in 75us (1296us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831262.445416:0:22816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:1.0:1787831262.445458:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2204627480 x1874676443997312/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787831278 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787831262.445470:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204627480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3619:1874676443997312:0@lo:400:kworker.0 00000100:00080000:3.0:1787831262.445517:0:22811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787831262.446070:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22046270c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676443996672:0@lo:400:kworker.0 00000100:00100000:0.0:1787831262.447061:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831262.447164:0:22821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443996928 00000100:00100000:1.0:1787831262.447172:0:22821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443996928 00000100:00100000:1.0:1787831262.447219:0:22821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787831262.447228:0:22821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204402d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1874676443996928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787831262.447286:0:22821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204402d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1874676443996928:12345-0@lo:400:kworker.0 Request processed in 60us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831262.447293:0:22821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787831262.447392:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22046252c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1874676443996928:0@lo:400:kworker.0 00010000:00010000:3.0:1787831262.823721:0:22804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787831263.336854:0:3618:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787831248/real 1787831248] req@ffff8d2203767480 x1874676443989376/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787831263 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787831263.336900:0:3618:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d2203767480 x1874676443989376/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787831263 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787831263.336912:0:3618:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787831248/real 1787831248] req@ffff8d2203766580 x1874676443989504/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787831263 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787831263.336925:0:3618:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d2203766580 x1874676443989504/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787831263 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787831263.336955:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8d232f6b4800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787831263.336992:0:3618:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787831263.336997:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203767480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1874676443989376:0@lo:8:kworker.0 00000100:00080000:0.0:1787831263.337004:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8d232b9ee000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787831263.337249:0:3618:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787831263.337254:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203766580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1874676443989504:0@lo:8:kworker.0 00000100:00100000:0.0:1787831263.337676:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22046252c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8057bc0f-773b-4151-9d37-d94ddea63831:3620:1874676443997440:0@lo:400:kworker.0 00000100:00100000:0.0:1787831263.337779:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831263.339373:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22046270c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443997568:0@lo:400:kworker.0 00000100:00100000:0.0:1787831263.339448:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787831263.340446:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787831263.340456:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787831263.340459:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787831263.340463:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787831263.340659:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204626d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3622:1874676443997696:0@lo:400:kworker.0 00000100:00100000:2.0:1787831263.340725:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831263.341457:0:22820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443997568 00000100:00100000:2.0:1787831263.341467:0:22820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443997568 00000100:00100000:2.0:1787831263.341531:0:22820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787831263.341541:0:22820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204402940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1874676443997568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787831263.342212:0:22820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204402940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1874676443997568:12345-0@lo:400:kworker.0 Request processed in 669us (2760us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831263.342224:0:22820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787831263.342263:0:22817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443997696 00000100:00100000:2.0:1787831263.342269:0:22817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443997696 00000100:00100000:2.0:1787831263.342324:0:22817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787831263.342344:0:22817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d232f61cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1874676443997696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787831263.342400:0:22817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d232f61cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1874676443997696:12345-0@lo:400:kworker.0 Request processed in 58us (1675us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831263.342408:0:22817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:2.0:1787831263.342954:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2204626d00 x1874676443997696/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787831279 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787831263.342973:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204626d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3622:1874676443997696:0@lo:400:kworker.0 00000100:00100000:0.0:1787831263.343309:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22046270c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676443997568:0@lo:400:kworker.0 00000100:00080000:3.0:1787831263.343827:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787831263.343834:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787831263.343837:0:8:0:(import.c:65:import_set_state_nolock()) ffff8d232f6b4800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787831263.343845:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 539 00000100:00080000:3.0:1787831263.343852:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787831263.343867:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8d232f6b4800 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:3.0:1787831263.343893:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2204627c00 x1874676443997952/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787831263.343911:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787831263.343914:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787831263.343917:0:8:0:(import.c:65:import_set_state_nolock()) ffff8d232b9ee000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787831263.343920:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 539 00000100:00080000:3.0:1787831263.343922:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787831263.343925:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8d232b9ee000 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:3.0:1787831263.343934:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2204624b40 x1874676443998080/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787831263.344005:0:22808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443997440 00000100:00100000:3.0:1787831263.344011:0:22808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443997440 00000100:00100000:3.0:1787831263.344064:0:22808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787831263.344072:0:22808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2305ff8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8057bc0f-773b-4151-9d37-d94ddea63831+21:3620:x1874676443997440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787831263.344150:0:22808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2305ff8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8057bc0f-773b-4151-9d37-d94ddea63831+21:3620:x1874676443997440:12345-0@lo:400:kworker.0 Request processed in 78us (6371us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831263.344157:0:22808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787831263.344319:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22046270c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3622:1874676443998464:0@lo:400:kworker.0 00000100:00100000:3.0:1787831263.344351:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831263.344379:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787831263.344384:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204624780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3622:1874676443998336:0@lo:400:kworker.0 00000100:00100000:3.0:1787831263.344400:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831263.345119:0:22816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443998464 00000100:00100000:3.0:1787831263.345126:0:22816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443998464 00000100:00100000:3.0:1787831263.345162:0:22816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443998336 00000100:00100000:3.0:1787831263.345172:0:22816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443998336 00000100:00100000:3.0:1787831263.345200:0:22816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787831263.345209:0:22816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204626d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1874676443998464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787831263.345266:0:22816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204626d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1874676443998464:12345-0@lo:400:kworker.0 Request processed in 60us (914us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831263.345277:0:22816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787831263.345294:0:22817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787831263.345315:0:22817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220483cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1874676443998336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787831263.345331:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204627480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443997824:0@lo:400:kworker.0 00000100:00100000:3.0:1787831263.345387:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831263.345413:0:22817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220483cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1874676443998336:12345-0@lo:400:kworker.0 Request processed in 104us (1008us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831263.345422:0:22817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787831263.345546:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787831263.345557:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22046243c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874676443998208:0@lo:400:kworker.0 00000100:00100000:3.0:1787831263.345594:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831263.345641:0:23556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443997824 00000100:00100000:3.0:1787831263.345645:0:23556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443997824 00000100:00100000:3.0:1787831263.345680:0:23556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787831263.345691:0:23556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220483cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443997824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787831263.345745:0:23556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220483cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676443997824:12345-0@lo:400:kworker.0 Request processed in 59us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831263.345752:0:23556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:3.0:1787831263.345791:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2204624780 x1874676443998336/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787831279 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787831263.345804:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204624780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3622:1874676443998336:0@lo:400:kworker.0 00010000:00080000:3.0:1787831263.345814:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22046270c0 x1874676443998464/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787831279 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787831263.345822:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22046270c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3622:1874676443998464:0@lo:400:kworker.0 00000100:00100000:3.0:1787831263.345855:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22046252c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8057bc0f-773b-4151-9d37-d94ddea63831:3620:1874676443997440:0@lo:400:kworker.0 00000100:00100000:3.0:1787831263.345881:0:22816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443998208 00000100:00100000:3.0:1787831263.345885:0:22816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443998208 00000100:00100000:3.0:1787831263.345909:0:22816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787831263.345915:0:22816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220483d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874676443998208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787831263.346080:0:22816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220483d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874676443998208:12345-0@lo:400:kworker.0 Request processed in 164us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831263.346087:0:22816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:3.0:1787831263.346116:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22046243c0 x1874676443998208/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787831279 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787831263.346125:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22046243c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874676443998208:0@lo:400:kworker.0 00000100:00100000:3.0:1787831263.346134:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204627480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443997824:0@lo:400:kworker.0 00000100:00100000:3.0:1787831263.346154:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204627c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1874676443997952:0@lo:8:kworker.0 00000100:00100000:3.0:1787831263.346186:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831263.346213:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204624b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1874676443998080:0@lo:8:kworker.0 00000100:00100000:3.0:1787831263.346238:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831263.347395:0:24321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443997952 00000100:00100000:2.0:1787831263.347404:0:24321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443997952 00000100:00100000:2.0:1787831263.347428:0:24321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443998080 00000100:00100000:2.0:1787831263.347432:0:24321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443998080 00000100:00100000:2.0:1787831263.347449:0:24321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787831263.347456:0:24321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220483de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3618:x1874676443997952:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1787831263.347487:0:24321:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 554 last 0 00000020:00000080:2.0:1787831263.347519:0:24321:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x95459fb9d1d2a8e5 00002000:00100000:2.0:1787831263.347535:0:24321:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff8d2203605800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211393d ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:2.0:1787831263.347540:0:24321:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:2.0:1787831263.347542:0:24321:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787831263.349231:0:24321:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:2.0:1787831263.349266:0:24321:0:(import.c:65:import_set_state_nolock()) ffff8d2203600000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787831263.349364:0:24321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220483de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3618:x1874676443997952:12345-0@lo:8:kworker.0 Request processed in 1906us (3175us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831263.349373:0:24321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787831263.349406:0:24321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787831263.349412:0:24321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220483e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3618:x1874676443998080:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1787831263.349431:0:24321:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:3.0:1787831263.363819:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2204627c00 x1874676443997952/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787831283 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787831263.363834:0:3618:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787831263.363845:0:3618:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 3 00000100:00080000:3.0:1787831263.363854:0:3618:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787831263.363860:0:3618:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1787831263.363863:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8d232f6b4800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787831263.363879:0:3618:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787831263.363885:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204627c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1874676443997952:0@lo:8:kworker.0 00000004:00080000:3.0:1787831263.364005:0:23557:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787831263.364150:0:23557:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 554364524920ns, next at 0ns, rc = 0 00080000:00080000:3.0:1787831263.364169:0:23557:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:0.0:1787831263.364339:0:23558:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:0.0:1787831263.364381:0:23558:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204400f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23558:1874676443998720:0@lo:7:osp-pre-0-1.0 00000100:00100000:0.0:1787831263.364478:0:23558:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831263.364535:0:23558:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2321ef7240 going to sleep for 11 seconds 00000100:00100000:0.0:1787831263.364852:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204402580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443998592:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787831263.364893:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831263.366655:0:24319:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1787831263.366677:0:24319:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1787831263.369095:0:24319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443998720 00000100:00100000:1.0:1787831263.369113:0:24319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443998720 00000100:00080000:1.0:1787831263.369196:0:22811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787831263.370590:0:25005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787831263.370610:0:25005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204403840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23558:x1874676443998720:12345-0@lo:7:osp-pre-0-1.0 00000100:00100000:2.0:1787831263.373960:0:24323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443998592 00000100:00100000:2.0:1787831263.373978:0:24323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443998592 00000004:00080000:0.0:1787831263.374055:0:23548:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:2.0:1787831263.374223:0:24323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787831263.374327:0:24323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22044021c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3619:x1874676443998592:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787831263.374362:0:24323:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787831263.374474:0:24323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22044021c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3619:x1874676443998592:12345-0@lo:13:osp-pre-0-1.0 Request processed in 242us (9580us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831263.374482:0:24323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787831263.374554:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2204402580 x1874676443998592/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787831279 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787831263.374581:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204402580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676443998592:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787831263.374938:0:24321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220483e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3618:x1874676443998080:12345-0@lo:8:kworker.0 Request processed in 25524us (28698us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787831263.374950:0:24321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1787831263.375043:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8d232b9ee000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787831263.375050:0:3618:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787831263.375053:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204624b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1874676443998080:0@lo:8:kworker.0 00002000:00080000:3.0:1787831263.381576:0:25005:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:3.0:1787831263.381588:0:25005:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x41:0x0] 00000100:00100000:3.0:1787831263.381732:0:25005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204403840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23558:x1874676443998720:12345-0@lo:7:osp-pre-0-1.0 Request processed in 11125us (17248us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831263.381751:0:25005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787831263.382411:0:23558:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2204400f00 x1874676443998720/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787831279 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787831263.382434:0:23558:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204400f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23558:1874676443998720:0@lo:7:osp-pre-0-1.0 00000004:00080000:0.0:1787831263.382452:0:23558:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x41:0x0] 00000100:00100000:0.0:1787831263.382523:0:23558:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204400f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23558:1874676443998848:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1787831263.382583:0:23558:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831263.382679:0:23558:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2321ef7240 going to sleep for 11 seconds 00000100:00100000:1.0:1787831263.383245:0:24319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443998848 00000100:00100000:1.0:1787831263.383254:0:24319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443998848 00000100:00100000:1.0:1787831263.383813:0:24319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787831263.383829:0:24319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22044003c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23558:x1874676443998848:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1787831263.384211:0:24319:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:1.0:1787831263.385673:0:24319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22044003c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23558:x1874676443998848:12345-0@lo:5:osp-pre-0-1.0 Request processed in 1840us (3080us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831263.385701:0:24319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787831263.386091:0:23558:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2204400f00 x1874676443998848/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787831279 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787831263.386111:0:23558:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204400f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23558:1874676443998848:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1787831263.386132:0:23558:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x41:0x0] 00000100:00100000:0.0:1787831263.386204:0:23558:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204400f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23558:1874676443998976:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1787831263.386276:0:23558:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831263.386317:0:23558:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2321ef7240 going to sleep for 11 seconds 00000100:00100000:3.0:1787831263.386551:0:24321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443998976 00000100:00100000:3.0:1787831263.386558:0:24321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443998976 00000100:00100000:3.0:1787831263.387133:0:24321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787831263.387144:0:24321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204403480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23558:x1874676443998976:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:3.0:1787831263.387185:0:24321:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 66 00000001:00080000:1.0:1787831263.417871:0:24316:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00000001:00100000:1.0:1787831263.417893:0:24316:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:3.0:1787831263.418193:0:24321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204403480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:23558:x1874676443998976:12345-0@lo:5:osp-pre-0-1.0 Request processed in 31040us (31906us total) trans 12884901889 rc 0/0 00000100:00100000:3.0:1787831263.418209:0:24321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1787831263.418232:0:23558:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2204400f00 x1874676443998976/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787831279 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787831263.418247:0:23558:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:0.0:1787831263.418254:0:23558:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204400f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23558:1874676443998976:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1787831263.418442:0:23558:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00000100:00100000:0.0:1787831263.418579:0:23558:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204400f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23558:1874676443999104:0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1787831263.418662:0:23558:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831263.418699:0:23558:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2321ef7240 going to sleep for 11 seconds 00000100:00100000:2.0:1787831263.419067:0:22827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443999104 00000100:00100000:2.0:1787831263.419075:0:22827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443999104 00000100:00100000:2.0:1787831263.419123:0:22827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787831263.419134:0:22827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204401e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23558:x1874676443999104:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1787831263.419204:0:22827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204401e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23558:x1874676443999104:12345-0@lo:900:osp-pre-0-1.0 Request processed in 72us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831263.419211:0:22827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787831263.419285:0:23558:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2204400f00 x1874676443999104/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787831279 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787831263.419297:0:23558:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204400f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23558:1874676443999104:0@lo:900:osp-pre-0-1.0 00010000:00010000:1.0:1787831263.850973:0:22805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787831263.974790:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787831263.974820:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203764000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443999232:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787831263.974913:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831263.975004:0:22820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443999232 00000100:00100000:1.0:1787831263.975024:0:22820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443999232 00000100:00100000:1.0:1787831263.975089:0:22820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787831263.975101:0:22820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d232f61e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676443999232:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787831263.975144:0:22820:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787831263.975197:0:22820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d232f61e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676443999232:12345-0@lo:41:osp-pre-1-0.0 Request processed in 99us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831263.975204:0:22820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787831263.975386:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203764000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676443999232:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787831263.975586:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d232f61e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443999360:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787831263.975619:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831263.975731:0:22821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443999360 00000100:00100000:2.0:1787831263.975736:0:22821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443999360 00000100:00100000:2.0:1787831263.975763:0:22821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787831263.975769:0:22821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220483e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443999360:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787831263.975789:0:22821:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1787831263.975820:0:22821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220483e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676443999360:12345-0@lo:41:osp-pre-0-1.0 Request processed in 52us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831263.975826:0:22821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787831263.975897:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d232f61e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676443999360:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787831264.871057:0:22804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787831265.325960:0:25135:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787831265.325965:0:25135:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:3.0:1787831265.325967:0:25135:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1787831265.326147:0:25135:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8d220341e000 00000020:01000004:3.0:1787831265.326173:0:25135:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1787831265.326193:0:25135:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1787831265.326210:0:25135:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8d2202a74d28) 00000020:00000080:3.0:1787831265.326333:0:25135:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1787831265.383361:0:25135:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1787831265.386443:0:25135:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1787831265.386674:0:25135:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1787831265.387100:0:25135:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1787831265.387260:0:25135:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1787831265.387500:0:25135:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1787831265.389216:0:25135:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:01000000:2.0:1787831265.393144:0:25135:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1787831265.393519:0:25135:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1787831265.393538:0:25135:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787831265.393554:0:25135:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x95459fb9d1d2a8f3 00000020:01000004:2.0:1787831265.393563:0:25135:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:2.0:1787831265.393592:0:25135:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.131@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787831265.393597:0:25135:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.131@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787831265.393604:0:25135:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1787831265.393684:0:25135:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:2.0:1787831265.393690:0:25135:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.131@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1787831265.418541:0:25135:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.131@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787831265.418810:0:25135:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.131@tcp, index=0001, flags=0x20002 00000020:01000004:0.0:1787831265.418823:0:25135:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787831265.418824:0:25135:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787831265.418826:0:25135:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787831265.418827:0:25135:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787831265.418829:0:25135:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787831265.418830:0:25135:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787831265.418831:0:25135:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787831265.418833:0:25135:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787831265.418834:0:25135:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787831265.418839:0:25135:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:0.0:1787831265.418841:0:25135:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787831265.418842:0:25135:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787831265.418843:0:25135:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787831265.418844:0:25135:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787831265.418845:0:25135:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787831265.418846:0:25135:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787831265.418846:0:25135:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787831265.418848:0:25135:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787831265.418848:0:25135:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787831265.418889:0:25135:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1787831265.420258:0:25135:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204403c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:25135:1874676443999488:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787831265.420381:0:25135:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831265.420451:0:25135:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2308334e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787831265.422951:0:22809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443999488 00000100:00100000:3.0:1787831265.422973:0:22809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443999488 00000100:00100000:3.0:1787831265.423076:0:22809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787831265.423090:0:22809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2305ff8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8057bc0f-773b-4151-9d37-d94ddea63831+21:25135:x1874676443999488:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787831265.423167:0:22809:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1787831265.423171:0:22809:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:3.0:1787831265.423175:0:22809:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1787831265.423794:0:22809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2305ff8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8057bc0f-773b-4151-9d37-d94ddea63831+21:25135:x1874676443999488:12345-0@lo:253:mount.lustre.0 Request processed in 705us (3412us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831265.423806:0:22809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787831265.423968:0:25135:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204403c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:25135:1874676443999488:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787831265.423987:0:25135:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1787831265.423990:0:25135:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787831265.423992:0:25135:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787831265.423993:0:25135:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787831265.423994:0:25135:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787831265.423996:0:25135:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787831265.423997:0:25135:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787831265.423999:0:25135:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787831265.424015:0:25135:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787831265.424017:0:25135:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787831265.424045:0:25135:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d220341e000 from lustre-OST0001 10000000:01000000:0.0:1787831265.424077:0:25135:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1787831265.424081:0:25135:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1787831265.424103:0:25135:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8d2306c6cd28 local copy 00010000:00010000:0.0:1787831265.424115:0:25135:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d2301668600/0x95459fb9d1d2a60d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2a614 expref: -99 pid: 22795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831265.424234:0:25135:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204403c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:25135:1874676443999616:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787831265.424278:0:25135:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831265.424315:0:25135:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2308334900 going to sleep for 11 seconds 00000100:00100000:3.0:1787831265.424371:0:22810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443999616 00000100:00100000:3.0:1787831265.424377:0:22810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443999616 00000100:00100000:3.0:1787831265.424413:0:22810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787831265.424423:0:22810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2305ffb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8057bc0f-773b-4151-9d37-d94ddea63831+21:25135:x1874676443999616:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787831265.424515:0:22810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2305ffb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8057bc0f-773b-4151-9d37-d94ddea63831+21:25135:x1874676443999616:12345-0@lo:501:mount.lustre.0 Request processed in 94us (235us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787831265.424524:0:22810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787831265.424531:0:25135:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204403c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:25135:1874676443999616:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1787831265.424547:0:25135:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.131@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1787831265.424563:0:25135:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.131@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1787831265.424569:0:25135:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d2301668600/0x95459fb9d1d2a60d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2a614 expref: -99 pid: 22795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831265.424578:0:25135:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8d2301668600/0x95459fb9d1d2a60d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2a614 expref: -99 pid: 22795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787831265.424607:0:25135:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d220341e000 10000000:01000000:0.0:1787831265.424613:0:25135:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787831265.424619:0:25135:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1787831265.424653:0:25135:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787831265.424660:0:25135:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1787831265.424663:0:25135:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1787831265.424688:0:25135:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233bf10600/0x95459fb9d1d2a8fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831265.424697:0:25135:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8d233bf10600/0x95459fb9d1d2a8fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831265.424706:0:25135:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8d233bf10600/0x95459fb9d1d2a8fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831265.424729:0:25135:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204403c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:25135:1874676443999744:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787831265.424809:0:25135:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831265.424835:0:25135:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2308334900 going to sleep for 11 seconds 00000100:00100000:3.0:1787831265.425062:0:22809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443999744 00000100:00100000:3.0:1787831265.425067:0:22809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443999744 00000100:00100000:3.0:1787831265.425104:0:22809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787831265.425112:0:22809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2305ff8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8057bc0f-773b-4151-9d37-d94ddea63831+21:25135:x1874676443999744:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787831265.425123:0:22809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787831265.425139:0:22809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2307c76600/0x95459fb9d1d2a901 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d2a8fa expref: -99 pid: 22809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831265.425179:0:22809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2307c76600/0x95459fb9d1d2a901 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d2a8fa expref: 22 pid: 22809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831265.425192:0:22809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2307c76600/0x95459fb9d1d2a901 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d2a8fa expref: 22 pid: 22809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831265.425201:0:22809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2307c76600, rc 0) 00000100:00100000:3.0:1787831265.425249:0:22809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2305ff8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8057bc0f-773b-4151-9d37-d94ddea63831+22:25135:x1874676443999744:12345-0@lo:101:mount.lustre.0 Request processed in 139us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831265.425256:0:22809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787831265.425353:0:25135:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204403c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:25135:1874676443999744:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787831265.425369:0:25135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8d233bf10600/0x95459fb9d1d2a8fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2a901 expref: -99 pid: 25135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831265.425379:0:25135:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8d233bf10600/0x95459fb9d1d2a8fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d2a901 expref: -99 pid: 25135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787831265.426531:0:25135:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:1.0:1787831265.427611:0:25135:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787831265.431668:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:1.0:1787831265.431759:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:1.0:1787831265.431904:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:1.0:1787831265.431923:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:1.0:1787831265.431951:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:1.0:1787831265.431969:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:1.0:1787831265.431983:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:1.0:1787831265.431997:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:1.0:1787831265.432028:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:1.0:1787831265.432061:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:1.0:1787831265.432067:0:25135:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:1.0:1787831265.432220:0:25135:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203765e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:25135:1874676443999872:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787831265.432333:0:25135:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831265.432418:0:25135:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d232f602a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787831265.432438:0:22810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676443999872 00000100:00100000:3.0:1787831265.432513:0:22810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676443999872 00000100:00100000:3.0:1787831265.432657:0:22810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787831265.432669:0:22810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2305ff9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8057bc0f-773b-4151-9d37-d94ddea63831+22:25135:x1874676443999872:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787831265.432873:0:22810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2305ff9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8057bc0f-773b-4151-9d37-d94ddea63831+22:25135:x1874676443999872:12345-0@lo:501:mount.lustre.0 Request processed in 206us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831265.432882:0:22810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787831265.432981:0:25135:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203765e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:25135:1874676443999872:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787831265.433052:0:25135:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d232f61f840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:25135:1874676444000000:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787831265.433107:0:25135:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831265.436322:0:22809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444000000 00000100:00100000:0.0:1787831265.436342:0:22809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444000000 00000100:00100000:2.0:1787831265.436375:0:25135:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2310a400c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787831265.436413:0:22809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787831265.436424:0:22809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2305ff9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8057bc0f-773b-4151-9d37-d94ddea63831+22:25135:x1874676444000000:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787831265.437921:0:22809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2305ff9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8057bc0f-773b-4151-9d37-d94ddea63831+22:25135:x1874676444000000:12345-0@lo:503:mount.lustre.0 Request processed in 1491us (4806us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831265.437937:0:22809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787831265.438513:0:25135:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d232f61f840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:25135:1874676444000000:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787831265.439943:0:25135:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787831265.441707:0:25135:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d232f61f840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:25135:1874676444000128:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787831265.442461:0:25135:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831265.442528:0:25135:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2310a400c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787831265.442669:0:22808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444000128 00000100:00100000:0.0:1787831265.442678:0:22808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444000128 00000100:00100000:0.0:1787831265.442747:0:22808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787831265.442758:0:22808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2305ffbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8057bc0f-773b-4151-9d37-d94ddea63831+22:25135:x1874676444000128:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787831265.443691:0:22808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2305ffbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8057bc0f-773b-4151-9d37-d94ddea63831+22:25135:x1874676444000128:12345-0@lo:502:mount.lustre.0 Request processed in 931us (1229us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831265.443703:0:22808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787831265.445617:0:25135:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d232f61f840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:25135:1874676444000128:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787831265.447856:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:2.0:1787831265.447923:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:2.0:1787831265.447937:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:2.0:1787831265.447949:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:2.0:1787831265.447965:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:2.0:1787831265.447977:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:2.0:1787831265.447988:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:2.0:1787831265.448486:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:2.0:1787831265.448514:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:2.0:1787831265.448776:0:25135:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d232f61f840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:25135:1874676444000256:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787831265.449185:0:25135:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831265.449313:0:25135:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2310a400c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787831265.449483:0:22810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444000256 00000100:00100000:0.0:1787831265.449493:0:22810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444000256 00000100:00100000:0.0:1787831265.449716:0:22810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787831265.449729:0:22810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2305ff9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8057bc0f-773b-4151-9d37-d94ddea63831+22:25135:x1874676444000256:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787831265.450177:0:22810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2305ff9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8057bc0f-773b-4151-9d37-d94ddea63831+22:25135:x1874676444000256:12345-0@lo:502:mount.lustre.0 Request processed in 450us (993us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831265.450187:0:22810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787831265.450351:0:25135:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d232f61f840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:25135:1874676444000256:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787831265.450493:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:2.0:1787831265.450509:0:25135:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:1.0:1787831265.452774:0:25139:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787831265.452789:0:25139:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:1.0:1787831265.452798:0:25139:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787831265.452800:0:25139:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1787831265.452998:0:25139:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787831265.453046:0:25139:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8d2201e199b8) 00000020:00000080:1.0:1787831265.453080:0:25139:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:1.0:1787831265.453089:0:25139:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787831265.453206:0:25139:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d220341e000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1787831265.453290:0:25139:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787831265.453298:0:25139:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x95459fb9d1d2a90f 00010000:00010000:1.0:1787831265.460901:0:25139:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:1.0:1787831265.461763:0:25139:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934599 00080000:10000000:1.0:1787831265.465156:0:25139:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:2.0:1787831265.469390:0:25139:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1787831265.469409:0:25139:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787831265.469419:0:25139:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787831265.469421:0:25139:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1787831265.469433:0:25139:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787831265.469439:0:25139:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787831265.469440:0:25139:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787831265.469444:0:25139:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787831265.469447:0:25139:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787831265.469450:0:25139:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787831265.469453:0:25139:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787831265.469454:0:25139:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787831265.469457:0:25139:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787831265.469459:0:25139:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787831265.469468:0:25139:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787831265.469473:0:25139:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1787831265.469508:0:25139:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787831265.469512:0:25139:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787831265.469513:0:25139:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787831265.469517:0:25139:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:3.0:1787831265.470978:0:25135:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1787831265.471037:0:25135:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1787831265.471066:0:25135:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233bf10600/0x95459fb9d1d2a8fa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2a901 expref: -99 pid: 25135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831265.471081:0:25135:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8d233bf10600/0x95459fb9d1d2a8fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2a901 expref: -99 pid: 25135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787831265.471091:0:25135:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d220341e000 from 1 10000000:01000000:3.0:1787831265.471094:0:25135:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787831265.471151:0:25135:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d2307c77000/0x95459fb9d1d2a916 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831265.471161:0:25135:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8d2307c77000/0x95459fb9d1d2a916 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831265.471174:0:25135:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8d2307c77000/0x95459fb9d1d2a916 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787831265.471218:0:25135:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220483da40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:25135:1874676444000384:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787831265.471322:0:25135:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831265.471381:0:25135:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2310003a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787831265.471733:0:22809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444000384 00000100:00100000:2.0:1787831265.471742:0:22809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444000384 00000100:00100000:2.0:1787831265.471848:0:22809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787831265.471859:0:22809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233cd45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8057bc0f-773b-4151-9d37-d94ddea63831+22:25135:x1874676444000384:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787831265.471876:0:22809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787831265.471892:0:22809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2303aa3c00/0x95459fb9d1d2a91d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d2a916 expref: -99 pid: 22809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831265.471922:0:22809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2303aa3c00/0x95459fb9d1d2a91d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d2a916 expref: 23 pid: 22809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831265.471935:0:22809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2303aa3c00/0x95459fb9d1d2a91d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d2a916 expref: 23 pid: 22809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831265.471945:0:22809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2303aa3c00, rc 0) 00000100:00100000:2.0:1787831265.472009:0:22809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233cd45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8057bc0f-773b-4151-9d37-d94ddea63831+23:25135:x1874676444000384:12345-0@lo:101:mount.lustre.0 Request processed in 144us (678us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831265.472017:0:22809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787831265.472136:0:25135:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220483da40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:25135:1874676444000384:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787831265.472153:0:25135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8d2307c77000/0x95459fb9d1d2a916 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2a91d expref: -99 pid: 25135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831265.472163:0:25135:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8d2307c77000/0x95459fb9d1d2a916 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d2a91d expref: -99 pid: 25135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787831265.475383:0:25135:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:3.0:1787831265.475945:0:25135:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787831265.476949:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:3.0:1787831265.476983:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:3.0:1787831265.478129:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:3.0:1787831265.478157:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:3.0:1787831265.478169:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:3.0:1787831265.478182:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:3.0:1787831265.478196:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:3.0:1787831265.478209:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:3.0:1787831265.478251:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:3.0:1787831265.478267:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:3.0:1787831265.478411:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:3.0:1787831265.479126:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:3.0:1787831265.479140:0:25135:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:3.0:1787831265.479519:0:25135:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220483da40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:25135:1874676444000512:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787831265.480147:0:25135:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831265.480205:0:25135:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2310003f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787831265.480377:0:22810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444000512 00000100:00100000:1.0:1787831265.480387:0:22810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444000512 00000100:00100000:1.0:1787831265.480536:0:22810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787831265.480548:0:22810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233cd44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8057bc0f-773b-4151-9d37-d94ddea63831+23:25135:x1874676444000512:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787831265.481226:0:22810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233cd44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8057bc0f-773b-4151-9d37-d94ddea63831+23:25135:x1874676444000512:12345-0@lo:501:mount.lustre.0 Request processed in 676us (1077us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831265.481238:0:22810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787831265.483199:0:25135:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220483da40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:25135:1874676444000512:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787831265.485017:0:25135:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d232f61f840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:25135:1874676444000640:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787831265.485159:0:25135:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831265.485235:0:25135:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2310a40180 going to sleep for 11 seconds 00000100:00100000:1.0:1787831265.485345:0:22808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444000640 00000100:00100000:1.0:1787831265.485355:0:22808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444000640 00000100:00100000:1.0:1787831265.485430:0:22808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787831265.485441:0:22808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233cd44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8057bc0f-773b-4151-9d37-d94ddea63831+23:25135:x1874676444000640:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787831265.485602:0:22808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233cd44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8057bc0f-773b-4151-9d37-d94ddea63831+23:25135:x1874676444000640:12345-0@lo:503:mount.lustre.0 Request processed in 163us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831265.485612:0:22808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787831265.486829:0:25135:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d232f61f840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:25135:1874676444000640:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787831265.487504:0:25135:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787831265.490480:0:25135:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220483f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:25135:1874676444000768:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787831265.490603:0:25135:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831265.490889:0:25135:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2310003f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787831265.490983:0:22809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444000768 00000100:00100000:2.0:1787831265.490994:0:22809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444000768 00000100:00100000:2.0:1787831265.491141:0:22809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787831265.491155:0:22809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233cd46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8057bc0f-773b-4151-9d37-d94ddea63831+23:25135:x1874676444000768:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787831265.491428:0:22809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233cd46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8057bc0f-773b-4151-9d37-d94ddea63831+23:25135:x1874676444000768:12345-0@lo:502:mount.lustre.0 Request processed in 275us (826us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831265.491438:0:22809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787831265.491613:0:25135:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220483f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:25135:1874676444000768:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787831265.491976:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:3.0:1787831265.492023:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:3.0:1787831265.492039:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:3.0:1787831265.492052:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:3.0:1787831265.492065:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:3.0:1787831265.492078:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:3.0:1787831265.492092:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:3.0:1787831265.492106:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:3.0:1787831265.492120:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:3.0:1787831265.492135:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:3.0:1787831265.492150:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:3.0:1787831265.492189:0:25135:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220483f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:25135:1874676444000896:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787831265.492417:0:25135:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831265.492599:0:25135:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2310003f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787831265.494364:0:22808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444000896 00000100:00100000:1.0:1787831265.494379:0:22808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444000896 00000100:00100000:1.0:1787831265.494449:0:22808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787831265.494459:0:22808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233cd47850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8057bc0f-773b-4151-9d37-d94ddea63831+23:25135:x1874676444000896:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787831265.494703:0:22808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233cd47850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8057bc0f-773b-4151-9d37-d94ddea63831+23:25135:x1874676444000896:12345-0@lo:502:mount.lustre.0 Request processed in 245us (2285us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831265.494786:0:22808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787831265.494887:0:25135:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220483f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:25135:1874676444000896:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787831265.495376:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:0.0:1787831265.495398:0:25135:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1787831265.497607:0:25143:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787831265.497655:0:25143:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787831265.497658:0:25143:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787831265.497668:0:25143:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d220341e000 00000020:00000080:0.0:1787831265.497671:0:25143:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787831265.497695:0:25143:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787831265.497699:0:25143:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787831265.497701:0:25143:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1787831265.497704:0:25143:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787831265.497707:0:25143:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787831265.497708:0:25143:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787831265.497716:0:25143:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d220341e000 00000020:00000080:0.0:1787831265.497719:0:25143:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787831265.497791:0:25143:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787831265.497795:0:25143:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787831265.497796:0:25143:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1787831265.497799:0:25143:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787831265.497801:0:25143:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787831265.497802:0:25143:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787831265.497806:0:25143:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d220341e000 00000020:00000080:0.0:1787831265.497808:0:25143:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787831265.497826:0:25143:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787831265.497829:0:25143:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787831265.497831:0:25143:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787831265.497833:0:25143:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787831265.497836:0:25143:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787831265.497837:0:25143:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1787831265.497841:0:25143:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d220341e000 00000020:00000080:0.0:1787831265.497843:0:25143:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787831265.497866:0:25143:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787831265.497876:0:25143:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787831265.497877:0:25143:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1787831265.497880:0:25143:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:1.0:1787831265.498906:0:25135:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1787831265.498961:0:25135:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787831265.499149:0:25135:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d2307c77000/0x95459fb9d1d2a916 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2a91d expref: -99 pid: 25135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831265.499166:0:25135:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8d2307c77000/0x95459fb9d1d2a916 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2a91d expref: -99 pid: 25135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787831265.499247:0:25135:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787831265.499251:0:25135:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d220341e000 10000000:01000000:1.0:1787831265.499255:0:25135:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d220341e000 10000000:01000000:1.0:1787831265.499260:0:25135:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787831265.499269:0:25135:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d220341e000 from 1 10000000:01000000:1.0:1787831265.499273:0:25135:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787831265.499335:0:25135:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233be94000/0x95459fb9d1d2a924 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831265.499345:0:25135:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8d233be94000/0x95459fb9d1d2a924 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831265.499358:0:25135:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8d233be94000/0x95459fb9d1d2a924 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831265.499395:0:25135:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203764000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:25135:1874676444001024:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787831265.499526:0:25135:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831265.499588:0:22808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444001024 00000100:00100000:1.0:1787831265.499594:0:25135:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d232f602540 going to sleep for 11 seconds 00000100:00100000:2.0:1787831265.499601:0:22808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444001024 00000100:00100000:2.0:1787831265.499702:0:22808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787831265.499714:0:22808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233cd45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8057bc0f-773b-4151-9d37-d94ddea63831+23:25135:x1874676444001024:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787831265.499733:0:22808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787831265.499752:0:22808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2303aa2200/0x95459fb9d1d2a92b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d2a924 expref: -99 pid: 22808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831265.499786:0:22808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2303aa2200/0x95459fb9d1d2a92b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d2a924 expref: 24 pid: 22808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831265.499800:0:22808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2303aa2200/0x95459fb9d1d2a92b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d2a924 expref: 24 pid: 22808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831265.499823:0:22808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2303aa2200, rc 0) 00000100:00100000:2.0:1787831265.500096:0:22808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233cd45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8057bc0f-773b-4151-9d37-d94ddea63831+24:25135:x1874676444001024:12345-0@lo:101:mount.lustre.0 Request processed in 374us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831265.500105:0:22808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787831265.500137:0:25135:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203764000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:25135:1874676444001024:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787831265.500159:0:25135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8d233be94000/0x95459fb9d1d2a924 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2a92b expref: -99 pid: 25135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831265.500180:0:25135:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8d233be94000/0x95459fb9d1d2a924 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d2a92b expref: -99 pid: 25135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787831265.503121:0:25135:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:1.0:1787831265.503810:0:25135:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787831265.504189:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:1.0:1787831265.504221:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:1.0:1787831265.504238:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:1.0:1787831265.504250:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:1.0:1787831265.504265:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:1.0:1787831265.504278:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:1.0:1787831265.504379:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:1.0:1787831265.504397:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:1.0:1787831265.504413:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:1.0:1787831265.504560:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:1.0:1787831265.504586:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:1.0:1787831265.504761:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:1.0:1787831265.504781:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:1.0:1787831265.504795:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:1.0:1787831265.504808:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:1.0:1787831265.504822:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:1.0:1787831265.504839:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:1.0:1787831265.504851:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:1.0:1787831265.504862:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:1.0:1787831265.504879:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:1.0:1787831265.504892:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:1.0:1787831265.504904:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:1.0:1787831265.504933:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:1.0:1787831265.504952:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:1.0:1787831265.504964:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:1.0:1787831265.505294:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:1.0:1787831265.505397:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:1.0:1787831265.505421:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:1.0:1787831265.505571:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:1.0:1787831265.505591:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:1.0:1787831265.505608:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:1.0:1787831265.505740:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:1.0:1787831265.505764:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:1.0:1787831265.505785:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:1.0:1787831265.505801:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:1.0:1787831265.505816:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:1.0:1787831265.505829:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:1.0:1787831265.505843:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:1.0:1787831265.505875:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:1.0:1787831265.505890:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:1.0:1787831265.505904:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:1.0:1787831265.505918:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:1.0:1787831265.505931:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:1.0:1787831265.505946:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:1.0:1787831265.505961:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:1.0:1787831265.506119:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:1.0:1787831265.506139:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:1.0:1787831265.506154:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:1.0:1787831265.507205:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:1.0:1787831265.507266:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:1.0:1787831265.507295:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:1.0:1787831265.507372:0:25135:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:1.0:1787831265.508238:0:25135:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203764000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:25135:1874676444001152:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787831265.508612:0:25135:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831265.508692:0:25135:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d232f6023c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787831265.509386:0:22810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444001152 00000100:00100000:3.0:1787831265.509398:0:22810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444001152 00000100:00100000:3.0:1787831265.509498:0:22810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787831265.509523:0:22810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233cd46c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8057bc0f-773b-4151-9d37-d94ddea63831+24:25135:x1874676444001152:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787831265.509818:0:22810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233cd46c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8057bc0f-773b-4151-9d37-d94ddea63831+24:25135:x1874676444001152:12345-0@lo:501:mount.lustre.0 Request processed in 298us (1206us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831265.509830:0:22810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787831265.510901:0:25135:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203764000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:25135:1874676444001152:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787831265.511115:0:25135:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203764000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:25135:1874676444001280:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787831265.511209:0:25135:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831265.511324:0:25135:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d232f6023c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787831265.512316:0:22808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444001280 00000100:00100000:3.0:1787831265.512323:0:22808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444001280 00000100:00100000:3.0:1787831265.512377:0:22808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787831265.512387:0:22808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233cd46050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8057bc0f-773b-4151-9d37-d94ddea63831+24:25135:x1874676444001280:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787831265.512550:0:22808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233cd46050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8057bc0f-773b-4151-9d37-d94ddea63831+24:25135:x1874676444001280:12345-0@lo:503:mount.lustre.0 Request processed in 165us (1342us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831265.512557:0:22808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787831265.514762:0:25135:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203764000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:25135:1874676444001280:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787831265.519019:0:25135:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787831265.519158:0:25135:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204400f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:25135:1874676444001408:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787831265.519281:0:25135:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831265.519354:0:25135:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d232f5ef840 going to sleep for 11 seconds 00000100:00100000:1.0:1787831265.519917:0:22810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444001408 00000100:00100000:1.0:1787831265.519926:0:22810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444001408 00000100:00100000:1.0:1787831265.520012:0:22810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787831265.520024:0:22810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233cd44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8057bc0f-773b-4151-9d37-d94ddea63831+24:25135:x1874676444001408:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787831265.520200:0:22810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233cd44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8057bc0f-773b-4151-9d37-d94ddea63831+24:25135:x1874676444001408:12345-0@lo:502:mount.lustre.0 Request processed in 179us (919us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831265.520210:0:22810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787831265.520824:0:25135:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204400f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:25135:1874676444001408:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787831265.521558:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:0.0:1787831265.521602:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:0.0:1787831265.521617:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:0.0:1787831265.521817:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:0.0:1787831265.521835:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:0.0:1787831265.521849:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:0.0:1787831265.521863:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:0.0:1787831265.521879:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:0.0:1787831265.521893:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:0.0:1787831265.521910:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:0.0:1787831265.522381:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:0.0:1787831265.522408:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:0.0:1787831265.522424:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:0.0:1787831265.522513:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:0.0:1787831265.522536:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:0.0:1787831265.522557:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:0.0:1787831265.522576:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:0.0:1787831265.522593:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:0.0:1787831265.522610:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:1.0:1787831265.522752:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:1.0:1787831265.522792:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:1.0:1787831265.522811:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:1.0:1787831265.522824:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:1.0:1787831265.522838:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:1.0:1787831265.522850:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:1.0:1787831265.522864:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:1.0:1787831265.522895:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:1.0:1787831265.522912:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:1.0:1787831265.522926:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:1.0:1787831265.522939:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:1.0:1787831265.522952:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:1.0:1787831265.522965:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:1.0:1787831265.522982:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:1.0:1787831265.523023:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:1.0:1787831265.523040:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:1.0:1787831265.523052:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:1.0:1787831265.523066:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:1.0:1787831265.523079:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:1.0:1787831265.523094:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:1.0:1787831265.523108:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:1.0:1787831265.523137:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:1.0:1787831265.523150:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:1.0:1787831265.523178:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:1.0:1787831265.523195:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:1.0:1787831265.523210:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:1.0:1787831265.523226:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:1.0:1787831265.523318:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:1.0:1787831265.523335:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:1.0:1787831265.523406:0:25135:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203766580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:25135:1874676444001536:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787831265.523508:0:25135:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831265.523559:0:25135:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d233be1bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787831265.523997:0:22809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444001536 00000100:00100000:0.0:1787831265.524017:0:22809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444001536 00000100:00100000:0.0:1787831265.524094:0:22809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787831265.524103:0:22809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233cd45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8057bc0f-773b-4151-9d37-d94ddea63831+24:25135:x1874676444001536:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787831265.524268:0:22809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233cd45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8057bc0f-773b-4151-9d37-d94ddea63831+24:25135:x1874676444001536:12345-0@lo:502:mount.lustre.0 Request processed in 165us (760us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831265.524277:0:22809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787831265.524338:0:25135:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203766580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:25135:1874676444001536:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787831265.524532:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:1.0:1787831265.524554:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:1.0:1787831265.524577:0:25135:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203766580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:25135:1874676444001664:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787831265.524613:0:25135:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831265.524680:0:25135:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d233be1bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787831265.524742:0:22808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444001664 00000100:00100000:3.0:1787831265.524747:0:22808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444001664 00000100:00100000:3.0:1787831265.524775:0:22808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787831265.524781:0:22808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233cd44450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8057bc0f-773b-4151-9d37-d94ddea63831+24:25135:x1874676444001664:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787831265.525025:0:22808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233cd44450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8057bc0f-773b-4151-9d37-d94ddea63831+24:25135:x1874676444001664:12345-0@lo:502:mount.lustre.0 Request processed in 243us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831265.525038:0:22808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787831265.525050:0:25135:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203766580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:25135:1874676444001664:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787831265.525095:0:25135:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:0.0:1787831265.525104:0:25135:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1787831265.525910:0:25148:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1787831265.525930:0:25148:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8d2312954d28) 00000020:00000080:0.0:1787831265.525959:0:25148:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:0.0:1787831265.526066:0:25148:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d220341e000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787831265.526070:0:25148:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d220341e000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787831265.526073:0:25148:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d220341e000 3 00010000:00080000:0.0:1787831265.526111:0:25148:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d233be51800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.131@tcp at head 00010000:00010000:1.0:1787831265.528838:0:25148:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:1.0:1787831265.529149:0:25148:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1787831265.529215:0:25148:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787831265.529231:0:25148:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x95459fb9d1d2a939 00000100:00080000:1.0:1787831265.529242:0:25148:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787831265.529248:0:25148:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8d233be51800 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:1.0:1787831265.529297:0:25148:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2203767480 x1874676444001792/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787831265.529349:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203767480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3618:1874676444001792:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787831265.529419:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831265.529498:0:22851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444001792 00000100:00100000:1.0:1787831265.529505:0:22851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444001792 00000100:00100000:1.0:1787831265.529542:0:22851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787831265.529549:0:22851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203765a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3618:x1874676444001792:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1787831265.529577:0:22851:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 556 last 0 00000020:00000080:1.0:1787831265.529683:0:22851:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x95459fb9d1d2a940 00000004:00100000:1.0:1787831265.529702:0:22851:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787831265.529742:0:22851:0:(import.c:65:import_set_state_nolock()) ffff8d220387c800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787831265.529821:0:22851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203765a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1874676444001792:12345-0@lo:38:llog_process_th.0 Request processed in 267us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831265.529830:0:22851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1787831265.529901:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2203767480 x1874676444001792/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787831275 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787831265.529912:0:3618:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787831265.529922:0:3618:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:1.0:1787831265.529932:0:3618:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787831265.529941:0:3618:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787831265.529947:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8d233be51800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787831265.529954:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203767480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3618:1874676444001792:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1787831265.530012:0:25148:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000020:01000004:1.0:1787831265.530942:0:25148:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1787831265.530962:0:25148:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff8d230333cd28) 00000020:00000080:1.0:1787831265.530984:0:25148:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:1.0:1787831265.531085:0:25148:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d220341e000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787831265.531090:0:25148:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d220341e000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787831265.531093:0:25148:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d220341e000 3 00010000:00080000:1.0:1787831265.531198:0:25148:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d220387a800@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.131@tcp at head 00000100:00080000:3.0:1787831265.531864:0:478:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787831265.531873:0:478:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787831265.531877:0:478:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787831265.531880:0:478:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787831265.531895:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220483f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676444001920:0@lo:400:kworker.0 00000100:00100000:2.0:1787831265.531939:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220483da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874676444002048:0@lo:400:kworker.0 00000100:00080000:3.0:1787831265.531943:0:478:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787831265.531952:0:478:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787831265.531966:0:478:0:(import.c:65:import_set_state_nolock()) ffff8d232b9ee000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787831265.531974:0:478:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 554 00000100:00080000:3.0:1787831265.531982:0:478:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1787831265.531992:0:478:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8d232b9ee000 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:0.0:1787831265.532012:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831265.532039:0:478:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2204627c00 x1874676444002432/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787831265.532053:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831265.532080:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787831265.532094:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204624b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676444002304:0@lo:400:kworker.0 00000100:00100000:2.0:1787831265.532122:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787831265.532126:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204627c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1874676444002432:0@lo:8:kworker.0 00000100:00100000:2.0:1787831265.532154:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22046243c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3619:1874676444002688:0@lo:400:kworker.0 00000100:00100000:0.0:1787831265.532155:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831265.532172:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787831265.532191:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204627480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3621:1874676444002560:0@lo:400:kworker.0 00000100:00100000:1.0:1787831265.532201:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831265.532220:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831265.532228:0:23556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444001920 00000100:00100000:0.0:1787831265.532239:0:23556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444001920 00000100:00100000:1.0:1787831265.532274:0:24319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444002304 00000100:00100000:3.0:1787831265.532283:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22046252c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3620:1874676444002816:0@lo:400:kworker.0 00000100:00100000:1.0:1787831265.532284:0:24319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444002304 00000100:00100000:0.0:1787831265.532320:0:23556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787831265.532336:0:23556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204400f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1874676444001920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787831265.532363:0:24319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444002432 00000100:00100000:1.0:1787831265.532370:0:24319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444002432 00000100:00100000:1.0:1787831265.532414:0:24319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787831265.532422:0:23556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204400f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1874676444001920:12345-0@lo:400:kworker.0 Request processed in 88us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831265.532432:0:25005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787831265.532434:0:24319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204402580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676444002304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787831265.532441:0:23556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787831265.532448:0:25005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203767480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3618:x1874676444002432:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1787831265.532543:0:25005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203767480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3618:x1874676444002432:12345-0@lo:8:kworker.0 Request processed in 94us (346us total) trans 0 rc -11/-11 00000100:00100000:0.0:1787831265.532544:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220483f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676444001920:0@lo:400:kworker.0 00000100:00100000:1.0:1787831265.532554:0:24319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204402580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676444002304:12345-0@lo:400:kworker.0 Request processed in 121us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831265.532567:0:25005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787831265.532580:0:24319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787831265.532594:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2204624b40 x1874676444002304/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787831281 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787831265.532607:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204624b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676444002304:0@lo:400:kworker.0 00000100:00080000:1.0:1787831265.532613:0:22811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787831265.532725:0:22816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444002048 00000100:00100000:3.0:1787831265.532732:0:22816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444002048 00000100:00100000:3.0:1787831265.532782:0:22816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444002688 00000100:00100000:3.0:1787831265.532787:0:22816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444002688 00000100:00100000:0.0:1787831265.532814:0:22851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787831265.532826:0:22851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d232f61f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874676444002048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787831265.532838:0:22816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787831265.532848:0:22816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d232f61e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874676444002688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787831265.532884:0:3618:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787831265.532896:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8d232b9ee000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787831265.532906:0:3618:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1787831265.532910:0:22816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d232f61e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874676444002688:12345-0@lo:400:kworker.0 Request processed in 56us (690us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831265.532917:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204627c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1874676444002432:0@lo:8:kworker.0 00000100:00100000:3.0:1787831265.532930:0:22816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787831265.532972:0:22851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d232f61f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874676444002048:12345-0@lo:400:kworker.0 Request processed in 146us (927us total) trans 0 rc 0/0 00010000:00080000:2.0:1787831265.532982:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22046243c0 x1874676444002688/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787831281 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787831265.532988:0:22851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:1.0:1787831265.532996:0:22811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787831265.533066:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22046243c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3619:1874676444002688:0@lo:400:kworker.0 00000100:00100000:2.0:1787831265.533076:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204627840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676444002176:0@lo:400:kworker.0 00000100:00100000:2.0:1787831265.533118:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1787831265.533151:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d220483da40 x1874676444002048/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787831281 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787831265.533163:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220483da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874676444002048:0@lo:400:kworker.0 00000100:00100000:2.0:1787831265.533205:0:22820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444002176 00000100:00100000:2.0:1787831265.533210:0:22820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444002176 00000100:00100000:2.0:1787831265.533274:0:22820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787831265.533285:0:22820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fae8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676444002176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787831265.533335:0:22820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fae8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676444002176:12345-0@lo:400:kworker.0 Request processed in 53us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831265.533343:0:22820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787831265.533372:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204627840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676444002176:0@lo:400:kworker.0 00000100:00100000:2.0:1787831265.533513:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831265.533558:0:22816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444002816 00000100:00100000:2.0:1787831265.533562:0:22816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444002816 00000100:00100000:2.0:1787831265.533611:0:22816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00080000:0.0:1787831265.533617:0:22811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787831265.533664:0:22816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233faea1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1874676444002816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787831265.533716:0:22816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233faea1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1874676444002816:12345-0@lo:400:kworker.0 Request processed in 98us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831265.533813:0:22816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:2.0:1787831265.533847:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22046252c0 x1874676444002816/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787831281 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787831265.533858:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22046252c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3620:1874676444002816:0@lo:400:kworker.0 00000100:00100000:2.0:1787831265.533974:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831265.534034:0:22851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444002560 00000100:00100000:0.0:1787831265.534042:0:22851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444002560 00000100:00100000:0.0:1787831265.534096:0:22851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787831265.534110:0:22851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233faeb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1874676444002560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787831265.534184:0:22851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233faeb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1874676444002560:12345-0@lo:400:kworker.0 Request processed in 79us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831265.534195:0:22851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:2.0:1787831265.534225:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2204627480 x1874676444002560/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787831281 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787831265.534304:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204627480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3621:1874676444002560:0@lo:400:kworker.0 00010000:00010000:1.0:1787831265.534891:0:25148:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:1.0:1787831265.535238:0:25148:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:1.0:1787831265.535370:0:25148:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787831265.535385:0:25148:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x95459fb9d1d2a94e 00000100:00080000:1.0:1787831265.535396:0:25148:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787831265.535403:0:25148:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8d220387a800 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:1.0:1787831265.535439:0:25148:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2203764b40 x1874676444002944/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787831265.535470:0:25148:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1787831265.535510:0:478:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787831265.535523:0:478:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787831265.535527:0:478:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787831265.535531:0:478:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787831265.535608:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203764b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3618:1874676444002944:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787831265.535729:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831265.535797:0:22816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444002944 00000100:00100000:2.0:1787831265.535803:0:22816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444002944 00000100:00100000:2.0:1787831265.535838:0:22816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787831265.535845:0:22816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233faeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3618:x1874676444002944:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787831265.535876:0:22816:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 556 last 0 00000020:00000080:2.0:1787831265.535920:0:22816:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x95459fb9d1d2a955 00000004:00100000:2.0:1787831265.535937:0:22816:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787831265.535974:0:22816:0:(import.c:65:import_set_state_nolock()) ffff8d231f440800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787831265.536056:0:22816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233faeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1874676444002944:12345-0@lo:38:llog_process_th.0 Request processed in 206us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831265.536066:0:22816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1787831265.536227:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2203764b40 x1874676444002944/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787831275 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787831265.536239:0:3618:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787831265.536247:0:3618:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 3 00000100:00080000:1.0:1787831265.536254:0:3618:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787831265.536577:0:3618:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1787831265.536582:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8d220387a800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787831265.536589:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203764b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3618:1874676444002944:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1787831265.536785:0:25148:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:0.0:1787831265.538521:0:25135:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1787831265.538570:0:25135:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787831265.538602:0:25135:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233be94000/0x95459fb9d1d2a924 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2a92b expref: -99 pid: 25135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831265.538614:0:25135:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8d233be94000/0x95459fb9d1d2a924 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2a92b expref: -99 pid: 25135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787831265.538799:0:25135:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787831265.538806:0:25135:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787831265.538807:0:25135:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787831265.538809:0:25135:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787831265.538810:0:25135:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787831265.538811:0:25135:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787831265.538813:0:25135:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787831265.538814:0:25135:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787831265.538816:0:25135:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787831265.538820:0:25135:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1787831265.538823:0:25135:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787831265.538824:0:25135:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787831265.538825:0:25135:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787831265.538826:0:25135:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787831265.538827:0:25135:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787831265.538828:0:25135:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787831265.538828:0:25135:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787831265.538829:0:25135:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787831265.538830:0:25135:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787831265.538863:0:25135:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1787831265.538889:0:25135:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22044012c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:25135:1874676444003072:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787831265.538988:0:25135:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831265.539084:0:25135:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d232f5ef840 going to sleep for 11 seconds 00000100:00100000:1.0:1787831265.539133:0:22809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444003072 00000100:00100000:1.0:1787831265.539143:0:22809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444003072 00000100:00100000:1.0:1787831265.539239:0:22809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787831265.539250:0:22809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233cd47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8057bc0f-773b-4151-9d37-d94ddea63831+24:25135:x1874676444003072:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787831265.539286:0:22809:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1787831265.539306:0:22809:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1787831265.547113:0:22809:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787831265.547138:0:22809:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1787831265.547435:0:22831:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787831265.547442:0:22831:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787831265.547472:0:22831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d233be94e00/0x95459fb9d1d2a95c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831265.547496:0:22831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2303aa3200/0x95459fb9d1d2a8d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d2a8c9 expref: 24 pid: 22808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831265.547505:0:22831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2303aa2a00/0x95459fb9d1d2a8de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d2a8d7 expref: 24 pid: 22809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831265.547525:0:22831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d233be94e00/0x95459fb9d1d2a95c lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831265.548684:0:22831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2303aa2a00/0x95459fb9d1d2a8de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x95459fb9d1d2a8d7 expref: 24 pid: 22809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831265.548708:0:22831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d2303aa2a00/0x95459fb9d1d2a8de lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x95459fb9d1d2a8d7 expref: 24 pid: 22809 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831265.549888:0:22831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203764b40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22831:1874676444003200:0@lo:104: 00000100:00100000:1.0:1787831265.549997:0:22831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831265.550085:0:22799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444003200 00000100:00100000:0.0:1787831265.550096:0:22799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444003200 00010000:00010000:1.0:1787831265.550109:0:22831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2303aa3200/0x95459fb9d1d2a8d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x95459fb9d1d2a8c9 expref: 24 pid: 22808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831265.550126:0:22831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d2303aa3200/0x95459fb9d1d2a8d0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x95459fb9d1d2a8c9 expref: 24 pid: 22808 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831265.550139:0:22831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203764f00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22831:1874676444003328:0@lo:104: 00000100:00100000:0.0:1787831265.550160:0:22799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787831265.550168:0:22831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831265.550174:0:22799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22037670c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8057bc0f-773b-4151-9d37-d94ddea63831+3:22831:x1874676444003200:12345-0@lo:104: 00000100:00100000:1.0:1787831265.550183:0:22831:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d233be1b000 going to sleep for 11 seconds 00010000:00010000:0.0:1787831265.550191:0:22799:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff8d233be95a00/0x95459fb9d1d2a8d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d2a8de expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831265.550259:0:22799:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787831265.550266:0:22799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22037670c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8057bc0f-773b-4151-9d37-d94ddea63831+3:22831:x1874676444003200:12345-0@lo:104: Request processed in 97us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831265.550273:0:22799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787831265.550290:0:22799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444003328 00000100:00100000:0.0:1787831265.550310:0:22799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444003328 00000100:00100000:0.0:1787831265.550327:0:22799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787831265.550332:0:22799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203766d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8057bc0f-773b-4151-9d37-d94ddea63831+3:22831:x1874676444003328:12345-0@lo:104: 00010000:00010000:0.0:1787831265.550340:0:22799:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff8d233bf10400/0x95459fb9d1d2a8c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d2a8d0 expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831265.550366:0:22805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787831265.550375:0:22805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8d233be95a00/0x95459fb9d1d2a8d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d2a8de expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831265.550381:0:22799:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:1.0:1787831265.550386:0:22805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233be95a00 already unused, calling callback (ffffffffc14f9c20) 00000100:00100000:0.0:1787831265.550389:0:22799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203766d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8057bc0f-773b-4151-9d37-d94ddea63831+3:22831:x1874676444003328:12345-0@lo:104: Request processed in 55us (221us total) trans 0 rc 0/0 10000000:00010000:1.0:1787831265.550393:0:22805:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8d233be95a00/0x95459fb9d1d2a8d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x95459fb9d1d2a8de expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831265.550401:0:22799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1787831265.550411:0:22805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8d233be95a00/0x95459fb9d1d2a8d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x95459fb9d1d2a8de expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787831265.550427:0:22805:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8d233be95a00/0x95459fb9d1d2a8d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x95459fb9d1d2a8de expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831265.550427:0:22804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:1.0:1787831265.550438:0:22805:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787831265.550478:0:22805:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8d233be95a00/0x95459fb9d1d2a8d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d2a8de expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831265.550485:0:22805:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787831265.550511:0:22805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8d233be95a00/0x95459fb9d1d2a8d7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d2a8de expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831265.550519:0:22805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8d233be95a00/0x95459fb9d1d2a8d7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d2a8de expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831265.550533:0:22805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787831265.550536:0:22805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787831265.550537:0:22805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787831265.550693:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787831265.550709:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22037643c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8057bc0f-773b-4151-9d37-d94ddea63831:3622:1874676444003456:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787831265.550720:0:22831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203764b40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22831:1874676444003200:0@lo:104: 00000100:00100000:0.0:1787831265.550733:0:22831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203764f00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22831:1874676444003328:0@lo:104: 00000100:00100000:1.0:1787831265.550758:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787831265.550778:0:22831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d233be94e00/0x95459fb9d1d2a95c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831265.550800:0:22802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444003456 00000100:00100000:2.0:1787831265.550806:0:22802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444003456 00010000:00010000:2.0:1787831265.550836:0:22802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2303aa2a00/0x95459fb9d1d2a8de lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d2a8d7 expref: 25 pid: 22809 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831265.550870:0:22802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787831265.550877:0:22802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203767c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8057bc0f-773b-4151-9d37-d94ddea63831+25:3622:x1874676444003456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787831265.550889:0:22802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787831265.550896:0:22802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2303aa2a00/0x95459fb9d1d2a8de lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d2a8d7 expref: 25 pid: 22809 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831265.550908:0:22802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2303aa2a00/0x95459fb9d1d2a8de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x95459fb9d1d2a8d7 expref: 25 pid: 22809 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831265.550923:0:22802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2303aa2a00/0x95459fb9d1d2a8de lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x95459fb9d1d2a8d7 expref: 25 pid: 22809 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831265.550936:0:22802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787831265.550949:0:25152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787831265.550954:0:25152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787831265.550957:0:25152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787831265.550960:0:22804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8d233bf10400/0x95459fb9d1d2a8c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d2a8d0 expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831265.550967:0:22804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233bf10400 already unused, calling callback (ffffffffc14f9c20) 10000000:00010000:0.0:1787831265.550971:0:22804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8d233bf10400/0x95459fb9d1d2a8c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x95459fb9d1d2a8d0 expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831265.550978:0:22804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8d233bf10400/0x95459fb9d1d2a8c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x95459fb9d1d2a8d0 expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787831265.550985:0:22804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8d233bf10400/0x95459fb9d1d2a8c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x95459fb9d1d2a8d0 expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831265.550990:0:22802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203767c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8057bc0f-773b-4151-9d37-d94ddea63831+24:3622:x1874676444003456:12345-0@lo:103:ldlm_bl.0 Request processed in 111us (233us total) trans 0 rc 0/0 10000000:01000000:0.0:1787831265.551022:0:22804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:2.0:1787831265.551024:0:22802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:0.0:1787831265.551058:0:22804:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8d233bf10400/0x95459fb9d1d2a8c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d2a8d0 expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831265.551059:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22037643c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8057bc0f-773b-4151-9d37-d94ddea63831:3622:1874676444003456:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787831265.551071:0:22804:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787831265.551165:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:0.0:1787831265.551183:0:22804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8d233bf10400/0x95459fb9d1d2a8c9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d2a8d0 expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831265.551191:0:22804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8d233bf10400/0x95459fb9d1d2a8c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d2a8d0 expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831265.551206:0:22804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787831265.551208:0:22804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787831265.551209:0:22804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787831265.551241:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22044030c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8057bc0f-773b-4151-9d37-d94ddea63831:3621:1874676444003584:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787831265.551271:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831265.551347:0:22801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444003584 00000100:00100000:0.0:1787831265.551352:0:22801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444003584 00010000:00010000:0.0:1787831265.551370:0:22801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2303aa3200/0x95459fb9d1d2a8d0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d2a8c9 expref: 24 pid: 22808 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831265.551395:0:22801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787831265.551402:0:22801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203765680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8057bc0f-773b-4151-9d37-d94ddea63831+24:3621:x1874676444003584:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787831265.551412:0:22801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787831265.551416:0:22801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2303aa3200/0x95459fb9d1d2a8d0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d2a8c9 expref: 24 pid: 22808 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831265.551426:0:22801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2303aa3200/0x95459fb9d1d2a8d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x95459fb9d1d2a8c9 expref: 24 pid: 22808 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831265.551438:0:22801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2303aa3200/0x95459fb9d1d2a8d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x95459fb9d1d2a8c9 expref: 24 pid: 22808 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831265.551457:0:22801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d233be94e00/0x95459fb9d1d2a95c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831265.551466:0:22801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d233be94e00/0x95459fb9d1d2a95c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787831265.551483:0:22801:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.030990682s 00010000:00010000:0.0:1787831265.551488:0:22801:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d233be94e00/0x95459fb9d1d2a95c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831265.551495:0:22801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d233be94e00/0x95459fb9d1d2a95c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831265.551503:0:22801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d233be94e00/0x95459fb9d1d2a95c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831265.551510:0:22801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d233be94e00/0x95459fb9d1d2a95c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831265.551515:0:22801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233be94e00 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:0.0:1787831265.551520:0:22801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d233be94e00/0x95459fb9d1d2a95c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831265.551527:0:22801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d233be94e00/0x95459fb9d1d2a95c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831265.551542:0:22801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d233be94e00/0x95459fb9d1d2a95c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831265.551552:0:22801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787831265.551559:0:22831:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d233be94e00/0x95459fb9d1d2a95c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831265.551577:0:22831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d233be94e00/0x95459fb9d1d2a95c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831265.551584:0:22831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d233be94e00/0x95459fb9d1d2a95c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831265.551589:0:22801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203765680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8057bc0f-773b-4151-9d37-d94ddea63831+23:3621:x1874676444003584:12345-0@lo:103:ldlm_bl.0 Request processed in 188us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831265.551596:0:22801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787831265.551620:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22044030c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8057bc0f-773b-4151-9d37-d94ddea63831:3621:1874676444003584:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787831265.555778:0:25135:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22044012c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8057bc0f-773b-4151-9d37-d94ddea63831:25135:1874676444003072:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787831265.555801:0:22809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233cd47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8057bc0f-773b-4151-9d37-d94ddea63831+22:25135:x1874676444003072:12345-0@lo:253:mount.lustre.0 Request processed in 16457us (16717us total) trans 0 rc 0/0 10000000:01000000:0.0:1787831265.555804:0:25135:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1787831265.555808:0:25135:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787831265.555810:0:25135:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787831265.555812:0:25135:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787831265.555813:0:25135:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787831265.555815:0:25135:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787831265.555816:0:25135:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787831265.555818:0:25135:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787831265.555820:0:25135:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787831265.555821:0:25135:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787831265.555843:0:25135:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1787831265.555866:0:22809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000001:00000004:0.0:1787831265.568381:0:25135:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:0.0:1787831265.575255:0:25135:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1787831265.575266:0:25135:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1787831265.575311:0:25135:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787831265.575359:0:25135:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.131@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787831265.575378:0:25135:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:0.0:1787831265.575401:0:25135:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:0.0:1787831265.576262:0:25135:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787831265.576557:0:25135:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787831265.895470:0:22805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787831266.350888:0:25202:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787831266.351151:0:25202:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787831266.920415:0:25152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787831267.240074:0:22852:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:1.0:1787831267.495847:0:22812:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787831267.495856:0:22812:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d2201e09000 from 14 10000000:01000000:1.0:1787831267.495861:0:22812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787831267.495918:0:22812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233be95600/0x95459fb9d1d2a963 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831267.495930:0:22812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8d233be95600/0x95459fb9d1d2a963 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831267.495941:0:22812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8d233be95600/0x95459fb9d1d2a963 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831267.495971:0:22812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22037643c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8057bc0f-773b-4151-9d37-d94ddea63831:22812:1874676444003712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787831267.496064:0:22812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831267.496110:0:22812:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d233be1b900 going to sleep for 11 seconds 00000100:00100000:3.0:1787831267.496459:0:22808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444003712 00000100:00100000:3.0:1787831267.496483:0:22808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444003712 00000100:00100000:3.0:1787831267.496588:0:22808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787831267.496599:0:22808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233cd46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8057bc0f-773b-4151-9d37-d94ddea63831+22:22812:x1874676444003712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787831267.496620:0:22808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787831267.496693:0:22808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2307c76800/0x95459fb9d1d2a96a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d2a963 expref: -99 pid: 22808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831267.496730:0:22808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2307c76800/0x95459fb9d1d2a96a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d2a963 expref: 23 pid: 22808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831267.496743:0:22808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2307c76800/0x95459fb9d1d2a96a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d2a963 expref: 23 pid: 22808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831267.496753:0:22808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2307c76800, rc 0) 00000100:00100000:3.0:1787831267.496850:0:22808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233cd46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8057bc0f-773b-4151-9d37-d94ddea63831+23:22812:x1874676444003712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 252us (785us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831267.496867:0:22808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787831267.497745:0:22812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22037643c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8057bc0f-773b-4151-9d37-d94ddea63831:22812:1874676444003712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787831267.497779:0:22812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8d233be95600/0x95459fb9d1d2a963 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2a96a expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831267.497792:0:22812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8d233be95600/0x95459fb9d1d2a963 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d2a96a expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831267.497893:0:22812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22037643c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8057bc0f-773b-4151-9d37-d94ddea63831:22812:1874676444003840:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787831267.497968:0:22812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831267.498025:0:22812:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d233be1b900 going to sleep for 11 seconds 00000100:00100000:0.0:1787831267.498161:0:22809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444003840 00000100:00100000:0.0:1787831267.498168:0:22809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444003840 00000100:00100000:0.0:1787831267.498228:0:22809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787831267.498237:0:22809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233cd47050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8057bc0f-773b-4151-9d37-d94ddea63831+23:22812:x1874676444003840:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787831267.498261:0:22809:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787831267.498285:0:22809:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787831267.498288:0:22809:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:0.0:1787831267.498407:0:22809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233cd47050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8057bc0f-773b-4151-9d37-d94ddea63831+23:22812:x1874676444003840:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 169us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831267.498415:0:22809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787831267.498420:0:22812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22037643c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8057bc0f-773b-4151-9d37-d94ddea63831:22812:1874676444003840:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787831267.498491:0:22812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787831267.498500:0:22812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d233be95600/0x95459fb9d1d2a963 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2a96a expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831267.498520:0:22812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8d233be95600/0x95459fb9d1d2a963 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2a96a expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787831267.498531:0:22812:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787831267.498533:0:22812:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d233fad3000 from 14 10000000:01000000:2.0:1787831267.498536:0:22812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787831267.498561:0:22812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d2303aa3200/0x95459fb9d1d2a971 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831267.498568:0:22812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8d2303aa3200/0x95459fb9d1d2a971 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831267.498577:0:22812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8d2303aa3200/0x95459fb9d1d2a971 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831267.498591:0:22812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233fae9a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8057bc0f-773b-4151-9d37-d94ddea63831:22812:1874676444003968:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787831267.498736:0:22812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831267.498771:0:22812:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2202852f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787831267.498813:0:22810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444003968 00000100:00100000:1.0:1787831267.498818:0:22810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444003968 00000100:00100000:1.0:1787831267.498845:0:22810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787831267.498851:0:22810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2320286050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8057bc0f-773b-4151-9d37-d94ddea63831+23:22812:x1874676444003968:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787831267.498860:0:22810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787831267.498873:0:22810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d233be94c00/0x95459fb9d1d2a978 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d2a971 expref: -99 pid: 22810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831267.498893:0:22810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d233be94c00/0x95459fb9d1d2a978 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d2a971 expref: 24 pid: 22810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831267.498903:0:22810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d233be94c00/0x95459fb9d1d2a978 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d2a971 expref: 24 pid: 22810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831267.498913:0:22810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233be94c00, rc 0) 00000100:00100000:1.0:1787831267.498955:0:22810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2320286050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8057bc0f-773b-4151-9d37-d94ddea63831+24:22812:x1874676444003968:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831267.498961:0:22810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787831267.499232:0:22812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233fae9a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8057bc0f-773b-4151-9d37-d94ddea63831:22812:1874676444003968:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787831267.499244:0:22812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8d2303aa3200/0x95459fb9d1d2a971 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2a978 expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831267.499252:0:22812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8d2303aa3200/0x95459fb9d1d2a971 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d2a978 expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831267.499293:0:22812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233fae9a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8057bc0f-773b-4151-9d37-d94ddea63831:22812:1874676444004096:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787831267.499323:0:22812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831267.499351:0:22812:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2202852f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787831267.499406:0:22810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444004096 00000100:00100000:1.0:1787831267.499411:0:22810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444004096 00000100:00100000:1.0:1787831267.499432:0:22810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787831267.499438:0:22810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2320286c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8057bc0f-773b-4151-9d37-d94ddea63831+24:22812:x1874676444004096:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787831267.499449:0:22810:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787831267.499467:0:22810:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787831267.499470:0:22810:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:1.0:1787831267.499553:0:22810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2320286c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8057bc0f-773b-4151-9d37-d94ddea63831+24:22812:x1874676444004096:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 114us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831267.499560:0:22810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787831267.499685:0:22812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233fae9a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8057bc0f-773b-4151-9d37-d94ddea63831:22812:1874676444004096:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787831267.499735:0:22812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787831267.499742:0:22812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d2303aa3200/0x95459fb9d1d2a971 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2a978 expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831267.499752:0:22812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8d2303aa3200/0x95459fb9d1d2a971 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2a978 expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831267.948910:0:22804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787831268.584406:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204401a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676444004224:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787831268.584482:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831268.584554:0:24323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444004224 00000100:00100000:3.0:1787831268.584561:0:24323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444004224 00000100:00100000:3.0:1787831268.584614:0:24323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787831268.584656:0:24323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fae9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676444004224:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787831268.584684:0:24323:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00080000:0.0:1787831268.587694:0:22811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787831268.589881:0:24323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fae9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676444004224:12345-0@lo:13:osp-pre-0-1.0 Request processed in 5251us (5390us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831268.589893:0:24323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787831268.592157:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2204401a40 x1874676444004224/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787831284 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787831268.592185:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204401a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676444004224:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1787831268.967525:0:22805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787831269.095813:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787831269.095839:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204627480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676444004352:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787831269.095916:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831269.097684:0:22821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444004352 00000100:00100000:0.0:1787831269.097708:0:22821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444004352 00000100:00100000:0.0:1787831269.097774:0:22821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787831269.097784:0:22821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22046252c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676444004352:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787831269.097820:0:22821:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1787831269.097902:0:22821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22046252c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676444004352:12345-0@lo:41:osp-pre-0-1.0 Request processed in 119us (1985us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831269.097915:0:22821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787831269.097989:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204627480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676444004352:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787831269.101173:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787831269.101205:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204627840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676444004480:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787831269.101277:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831269.101432:0:23556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444004480 00000100:00100000:0.0:1787831269.101441:0:23556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444004480 00000100:00100000:0.0:1787831269.101494:0:23556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787831269.101504:0:23556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22046243c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1874676444004480:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787831269.101539:0:23556:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787831269.101600:0:23556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22046243c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1874676444004480:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831269.101608:0:23556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787831269.102271:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204627840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676444004480:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787831269.991338:0:25152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787831270.119249:0:23569:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:1.0:1787831270.630778:0:478:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787831270.630786:0:478:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787831270.630789:0:478:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787831270.630792:0:478:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787831270.630815:0:478:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787831270.630818:0:478:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787831270.630822:0:478:0:(import.c:65:import_set_state_nolock()) ffff8d232b9ee000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787831270.630837:0:478:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8d232b9ee000 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:1.0:1787831270.630860:0:478:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2203765e00 x1874676444005248/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787831270.631348:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203766580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676444004992:0@lo:400:kworker.0 00000100:00100000:0.0:1787831270.631420:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831270.631460:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787831270.631465:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22037661c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8057bc0f-773b-4151-9d37-d94ddea63831:3621:1874676444004608:0@lo:400:kworker.0 00000100:00100000:0.0:1787831270.631490:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831270.631516:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203764000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676444005120:0@lo:400:kworker.0 00000100:00100000:0.0:1787831270.631536:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831270.631584:0:22820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444004992 00000100:00100000:0.0:1787831270.631591:0:22820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444004992 00000100:00100000:0.0:1787831270.631659:0:22820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787831270.631668:0:22820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204401a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676444004992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787831270.631720:0:22820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204401a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676444004992:12345-0@lo:400:kworker.0 Request processed in 53us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831270.631727:0:22820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787831270.631753:0:24322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444005120 00000100:00100000:0.0:1787831270.631757:0:24322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444005120 00000100:00100000:0.0:1787831270.631791:0:24322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787831270.631798:0:24322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204401680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676444005120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787831270.631830:0:24322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204401680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676444005120:12345-0@lo:400:kworker.0 Request processed in 32us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831270.631836:0:24322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1787831270.631855:0:22811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787831270.632340:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203764f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676444004736:0@lo:400:kworker.0 00000100:00100000:1.0:1787831270.632377:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831270.632396:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22037643c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874676444005376:0@lo:400:kworker.0 00000100:00100000:1.0:1787831270.632422:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831270.632438:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233fb40780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3619:1874676444005888:0@lo:400:kworker.0 00000100:00100000:1.0:1787831270.632457:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831270.632476:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787831270.632483:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203764b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874676444004864:0@lo:400:kworker.0 00000100:00100000:1.0:1787831270.632504:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831270.632530:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233fb42580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3619:1874676444005504:0@lo:400:kworker.0 00000100:00100000:1.0:1787831270.632554:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831270.632583:0:22810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444004608 00000100:00100000:1.0:1787831270.632588:0:22810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444004608 00000100:00100000:1.0:1787831270.632620:0:22810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787831270.633274:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203765e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1874676444005248:0@lo:8:kworker.0 00000100:00100000:2.0:1787831270.633311:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1787831270.633917:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2203764000 x1874676444005120/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787831286 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787831270.633933:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203764000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676444005120:0@lo:400:kworker.0 00000100:00100000:0.0:1787831270.633954:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203766580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676444004992:0@lo:400:kworker.0 00000100:00100000:0.0:1787831270.633995:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233fb412c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3621:1874676444005632:0@lo:400:kworker.0 00000100:00100000:1.0:1787831270.634061:0:22810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2320285c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8057bc0f-773b-4151-9d37-d94ddea63831+24:3621:x1874676444004608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787831270.634116:0:22810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2320285c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8057bc0f-773b-4151-9d37-d94ddea63831+24:3621:x1874676444004608:12345-0@lo:400:kworker.0 Request processed in 63us (2624us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831270.634123:0:22810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787831270.634165:0:22821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444004736 00000100:00100000:1.0:1787831270.634171:0:22821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444004736 00000100:00100000:0.0:1787831270.634195:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831270.634208:0:22821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787831270.634216:0:22821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676444004736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787831270.634221:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22037661c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8057bc0f-773b-4151-9d37-d94ddea63831:3621:1874676444004608:0@lo:400:kworker.0 00000100:00100000:0.0:1787831270.634238:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787831270.634246:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233fb41680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3621:1874676444005760:0@lo:400:kworker.0 00000100:00100000:1.0:1787831270.634265:0:22821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676444004736:12345-0@lo:400:kworker.0 Request processed in 49us (1886us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831270.634273:0:22821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787831270.634280:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831270.634299:0:22815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444005376 00000100:00100000:1.0:1787831270.634304:0:22815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444005376 00000100:00100000:1.0:1787831270.634322:0:22815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444005888 00000100:00100000:1.0:1787831270.634325:0:22815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444005888 00000100:00100000:1.0:1787831270.634351:0:22815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444004864 00000100:00100000:1.0:1787831270.634354:0:22815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444004864 00000100:00080000:0.0:1787831270.634366:0:22811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787831270.634367:0:22815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444005504 00000100:00100000:1.0:1787831270.634371:0:22815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444005504 00000100:00080000:0.0:1787831270.634392:0:22811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787831270.634396:0:22815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444005632 00000100:00100000:1.0:1787831270.634400:0:22815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444005632 00000100:00100000:1.0:1787831270.634416:0:22815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444005760 00000100:00100000:1.0:1787831270.634419:0:22815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444005760 00000100:00100000:1.0:1787831270.634433:0:22815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787831270.634439:0:22815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb421c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874676444005376:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787831270.634468:0:22811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787831270.634472:0:22811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787831270.634482:0:22815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb421c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874676444005376:12345-0@lo:400:kworker.0 Request processed in 42us (2058us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831270.634490:0:22815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787831270.634503:0:22815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787831270.634509:0:22815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb41e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874676444005888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787831270.634536:0:22815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb41e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874676444005888:12345-0@lo:400:kworker.0 Request processed in 28us (2078us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831270.634541:0:22815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787831270.634553:0:22815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787831270.634558:0:22815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb42940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874676444004864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787831270.634585:0:22815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb42940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874676444004864:12345-0@lo:400:kworker.0 Request processed in 27us (2081us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831270.634591:0:22815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787831270.634603:0:22815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787831270.634621:0:22815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874676444005504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787831270.634666:0:22815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874676444005504:12345-0@lo:400:kworker.0 Request processed in 58us (2111us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831270.634672:0:22815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787831270.634684:0:22815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787831270.634690:0:22815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22044012c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1874676444005632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787831270.634723:0:22815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22044012c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1874676444005632:12345-0@lo:400:kworker.0 Request processed in 33us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831270.634729:0:22815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787831270.634740:0:22815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787831270.634746:0:22815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22044030c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1874676444005760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787831270.634784:0:22815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22044030c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1874676444005760:12345-0@lo:400:kworker.0 Request processed in 38us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831270.634792:0:22815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:0.0:1787831270.634804:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d233fb41680 x1874676444005760/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787831286 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787831270.634814:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233fb41680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3621:1874676444005760:0@lo:400:kworker.0 00010000:00080000:0.0:1787831270.634826:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d233fb412c0 x1874676444005632/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787831286 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787831270.634833:0:24319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444005248 00000100:00100000:0.0:1787831270.634834:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233fb412c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3621:1874676444005632:0@lo:400:kworker.0 00000100:00100000:1.0:1787831270.634839:0:24319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444005248 00000100:00100000:1.0:1787831270.634871:0:24319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787831270.634878:0:24319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233faea940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3618:x1874676444005248:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1787831270.636134:0:24319:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 561 last 0 00000020:00000080:1.0:1787831270.636167:0:24319:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x95459fb9d1d2a97f 00002000:00100000:1.0:1787831270.636183:0:24319:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff8d220387f000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211393d ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:1.0:1787831270.636187:0:24319:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:1.0:1787831270.636189:0:24319:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1787831270.636363:0:24319:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:1.0:1787831270.636392:0:24319:0:(import.c:65:import_set_state_nolock()) ffff8d220387b800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787831270.636469:0:24319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233faea940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3618:x1874676444005248:12345-0@lo:8:kworker.0 Request processed in 1590us (3155us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831270.636478:0:24319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1787831270.636547:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2203765e00 x1874676444005248/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787831295 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787831270.636563:0:3618:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 3 00000100:00080000:3.0:1787831270.636571:0:3618:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787831270.636869:0:3618:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1787831270.636873:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8d232b9ee000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787831270.636924:0:3618:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787831270.636930:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203765e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1874676444005248:0@lo:8:kworker.0 00000004:00080000:3.0:1787831270.636976:0:23559:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787831270.637039:0:23559:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 561637413854ns, next at 0ns, rc = 0 00080000:00080000:3.0:1787831270.637044:0:23559:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00010000:00080000:1.0:1787831270.637643:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2203764b40 x1874676444004864/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787831286 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787831270.637657:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203764b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874676444004864:0@lo:400:kworker.0 00010000:00080000:1.0:1787831270.637678:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d233fb42580 x1874676444005504/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787831286 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787831270.637687:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233fb42580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3619:1874676444005504:0@lo:400:kworker.0 00000100:00100000:1.0:1787831270.637700:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203764f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676444004736:0@lo:400:kworker.0 00010000:00080000:1.0:1787831270.637725:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d22037643c0 x1874676444005376/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787831286 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787831270.637733:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22037643c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874676444005376:0@lo:400:kworker.0 00010000:00080000:1.0:1787831270.637744:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d233fb40780 x1874676444005888/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787831286 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787831270.637752:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233fb40780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3619:1874676444005888:0@lo:400:kworker.0 00000004:00080000:2.0:1787831270.642591:0:23548:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:3.0:1787831270.645477:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204400000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1874676444006016:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787831270.645543:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831270.645611:0:24324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444006016 00000100:00100000:1.0:1787831270.645619:0:24324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444006016 00000004:00080000:0.0:1787831270.645644:0:23560:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1787831270.645698:0:23560:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204403c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23560:1874676444006144:0@lo:7:osp-pre-1-1.0 00000100:00100000:0.0:1787831270.645731:0:23560:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831270.645787:0:24324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787831270.645797:0:24324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204627840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3620:x1874676444006016:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787831270.645826:0:24324:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923501056 avail 3691978752 00000100:00100000:0.0:1787831270.647248:0:23560:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2307235cc0 going to sleep for 11 seconds 00000100:00080000:0.0:1787831270.647276:0:22811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787831270.647293:0:24322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444006144 00000100:00100000:0.0:1787831270.647300:0:24322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444006144 00000100:00100000:0.0:1787831270.647352:0:24322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787831270.647361:0:24322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22037643c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+7:23560:x1874676444006144:12345-0@lo:7:osp-pre-1-1.0 00000100:00100000:1.0:1787831270.648685:0:24324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204627840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3620:x1874676444006016:12345-0@lo:13:osp-pre-1-1.0 Request processed in 2886us (3136us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831270.648700:0:24324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787831270.649890:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2204400000 x1874676444006016/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787831286 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787831270.649918:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204400000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1874676444006016:0@lo:13:osp-pre-1-1.0 00002000:00080000:0.0:1787831270.653144:0:24322:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:0.0:1787831270.653157:0:24322:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x41:0x0] 00000100:00100000:0.0:1787831270.653361:0:24322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22037643c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23560:x1874676444006144:12345-0@lo:7:osp-pre-1-1.0 Request processed in 5998us (7625us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831270.653372:0:24322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1787831270.653775:0:23560:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2204403c00 x1874676444006144/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787831286 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787831270.653789:0:23560:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204403c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23560:1874676444006144:0@lo:7:osp-pre-1-1.0 00000004:00080000:0.0:1787831270.653802:0:23560:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x41:0x0] 00000100:00100000:0.0:1787831270.654277:0:23560:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203764f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23560:1874676444006272:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1787831270.654318:0:23560:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831270.654353:0:23560:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2307235cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787831270.655301:0:24319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444006272 00000100:00100000:2.0:1787831270.655313:0:24319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444006272 00000100:00100000:2.0:1787831270.655373:0:24319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787831270.655380:0:24319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203764b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23560:x1874676444006272:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:2.0:1787831270.655408:0:24319:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:2.0:1787831270.656905:0:24319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203764b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23560:x1874676444006272:12345-0@lo:5:osp-pre-1-1.0 Request processed in 1519us (2580us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831270.656916:0:24319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1787831270.663329:0:23560:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2203764f00 x1874676444006272/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787831286 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787831270.663346:0:23560:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203764f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23560:1874676444006272:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1787831270.663361:0:23560:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x41:0x0] from OST, last_created [0x2c0000400:0x41:0x0]last_used is [0x2c0000400:0x41:0x0] 00000100:00100000:0.0:1787831270.663422:0:23560:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203764f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23560:1874676444006400:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1787831270.663476:0:23560:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831270.663516:0:23560:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2307235cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787831270.663593:0:25005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444006400 00000100:00100000:2.0:1787831270.663614:0:25005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444006400 00000100:00100000:2.0:1787831270.663711:0:25005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787831270.663719:0:25005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203765e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23560:x1874676444006400:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:2.0:1787831270.663757:0:25005:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 66 00000001:00080000:1.0:1787831270.700474:0:25136:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00000001:00100000:1.0:1787831270.700489:0:25136:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1787831270.701385:0:25005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203765e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:23560:x1874676444006400:12345-0@lo:5:osp-pre-1-1.0 Request processed in 37661us (37903us total) trans 12884901889 rc 0/0 00000100:00100000:0.0:1787831270.701398:0:25005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1787831270.701783:0:23560:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2203764f00 x1874676444006400/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787831286 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787831270.701795:0:23560:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:1.0:1787831270.701802:0:23560:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203764f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23560:1874676444006400:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1787831270.701819:0:23560:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x41:0x0]-[0x2c0000400:0x61:0x0] 00000100:00100000:1.0:1787831270.701869:0:23560:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233fb40780 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23560:1874676444006528:0@lo:900:osp-pre-1-1.0 00000100:00100000:1.0:1787831270.701905:0:23560:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831270.702065:0:23560:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2338560780 going to sleep for 11 seconds 00000100:00100000:0.0:1787831270.702085:0:22827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444006528 00000100:00100000:0.0:1787831270.702092:0:22827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444006528 00000100:00100000:0.0:1787831270.702175:0:22827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787831270.702185:0:22827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb42580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23560:x1874676444006528:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1787831270.702262:0:22827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb42580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23560:x1874676444006528:12345-0@lo:900:osp-pre-1-1.0 Request processed in 78us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831270.702270:0:22827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787831270.702320:0:23560:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d233fb40780 x1874676444006528/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787831286 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787831270.702330:0:23560:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233fb40780 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23560:1874676444006528:0@lo:900:osp-pre-1-1.0 00000001:02000400:0.0:1787831270.872401:0:25492:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg331-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787831271.015895:0:22804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787831271.655206:0:3618:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787831250/real 1787831250] req@ffff8d220442c3c0 x1874676443990272/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787831270 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787831271.655237:0:3618:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d220442c3c0 x1874676443990272/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787831270 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787831271.655247:0:3618:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787831250/real 1787831250] req@ffff8d220442c780 x1874676443990400/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787831270 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787831271.655257:0:3618:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d220442c780 x1874676443990400/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787831270 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787831271.655494:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8d233f541000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787831271.655514:0:3618:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787831271.655519:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220442c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1874676443990272:0@lo:8:kworker.0 00000100:00080000:1.0:1787831271.655525:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8d2202769000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787831271.655530:0:3618:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787831271.655533:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220442c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1874676443990400:0@lo:8:kworker.0 00000100:00080000:3.0:1787831271.663360:0:478:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787831271.663367:0:478:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787831271.663371:0:478:0:(import.c:65:import_set_state_nolock()) ffff8d233f541000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787831271.663378:0:478:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 541 00000100:00080000:3.0:1787831271.663384:0:478:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1787831271.663390:0:478:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d233f541000 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:3.0:1787831271.663427:0:478:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d22046270c0 x1874676444006912/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787831271.663445:0:478:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787831271.663448:0:478:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787831271.663450:0:478:0:(import.c:65:import_set_state_nolock()) ffff8d2202769000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787831271.663453:0:478:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 541 00000100:00080000:3.0:1787831271.663455:0:478:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1787831271.663459:0:478:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d2202769000 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:3.0:1787831271.663471:0:478:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2204627480 x1874676444007040/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787831271.663647:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204624b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8057bc0f-773b-4151-9d37-d94ddea63831:3621:1874676444006656:0@lo:400:kworker.0 00000100:00100000:3.0:1787831271.663714:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831271.663750:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a22d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676444007424:0@lo:400:kworker.0 00000100:00100000:3.0:1787831271.663776:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831271.663795:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a221c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3621:1874676444007936:0@lo:400:kworker.0 00000100:00100000:3.0:1787831271.663817:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831271.663838:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1787831271.663844:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204624780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676444006784:0@lo:400:kworker.0 00000100:00100000:3.0:1787831271.663866:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831271.663884:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a203c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676444007552:0@lo:400:kworker.0 00000100:00100000:3.0:1787831271.663902:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831271.663924:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a230c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3621:1874676444008064:0@lo:400:kworker.0 00000100:00100000:3.0:1787831271.663949:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831271.663989:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204403c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874676444007168:0@lo:400:kworker.0 00000100:00100000:3.0:1787831271.664020:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831271.664034:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a20780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874676444007680:0@lo:400:kworker.0 00000100:00100000:3.0:1787831271.664053:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831271.664065:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a212c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3619:1874676444008192:0@lo:400:kworker.0 00000100:00100000:3.0:1787831271.664086:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831271.664098:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787831271.664103:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204400000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676444007296:0@lo:400:kworker.0 00000100:00100000:3.0:1787831271.664123:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831271.664136:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3619:1874676444007808:0@lo:400:kworker.0 00000100:00100000:3.0:1787831271.664154:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831271.664179:0:22809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444006656 00000100:00100000:3.0:1787831271.664185:0:22809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444006656 00000100:00100000:3.0:1787831271.664224:0:22809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1787831271.664232:0:22809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2320287850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8057bc0f-773b-4151-9d37-d94ddea63831+24:3621:x1874676444006656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787831271.664277:0:22809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2320287850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8057bc0f-773b-4151-9d37-d94ddea63831+24:3621:x1874676444006656:12345-0@lo:400:kworker.0 Request processed in 46us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831271.664284:0:22809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1787831271.664315:0:24321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444007424 00000100:00100000:3.0:1787831271.664318:0:24321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444007424 00000100:00100000:3.0:1787831271.664341:0:24321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444007552 00000100:00100000:3.0:1787831271.664344:0:24321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444007552 00000100:00100000:3.0:1787831271.664368:0:24321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787831271.664375:0:24321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a23840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676444007424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787831271.664406:0:24321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a23840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676444007424:12345-0@lo:400:kworker.0 Request processed in 32us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831271.664412:0:24321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787831271.664432:0:24321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787831271.664438:0:24321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a21e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676444007552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787831271.664470:0:24321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a21e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676444007552:12345-0@lo:400:kworker.0 Request processed in 32us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831271.664476:0:24321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787831271.664492:0:23556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444006784 00000100:00100000:3.0:1787831271.664496:0:23556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444006784 00000100:00100000:3.0:1787831271.664519:0:23556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444007296 00000100:00100000:3.0:1787831271.664521:0:23556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444007296 00000100:00100000:3.0:1787831271.664539:0:23556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787831271.664545:0:23556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a21a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1874676444006784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787831271.664576:0:23556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a21a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1874676444006784:12345-0@lo:400:kworker.0 Request processed in 31us (708us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831271.664581:0:23556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787831271.664592:0:23556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787831271.664598:0:23556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a23c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676444007296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787831271.664648:0:23556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a23c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676444007296:12345-0@lo:400:kworker.0 Request processed in 51us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831271.664654:0:23556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787831271.664690:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204624780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676444006784:0@lo:400:kworker.0 00010000:00080000:3.0:1787831271.664703:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2203a203c0 x1874676444007552/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787831287 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787831271.664712:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a203c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676444007552:0@lo:400:kworker.0 00000100:00100000:3.0:1787831271.664720:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204624b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8057bc0f-773b-4151-9d37-d94ddea63831:3621:1874676444006656:0@lo:400:kworker.0 00010000:00080000:3.0:1787831271.664729:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2203a22d00 x1874676444007424/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787831287 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787831271.664744:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a22d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676444007424:0@lo:400:kworker.0 00000100:00100000:3.0:1787831271.664783:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204400000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676444007296:0@lo:400:kworker.0 00000100:00100000:3.0:1787831271.664800:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22046270c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1874676444006912:0@lo:8:kworker.0 00000100:00100000:3.0:1787831271.664828:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831271.664845:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204627480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1874676444007040:0@lo:8:kworker.0 00000100:00100000:3.0:1787831271.664867:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831271.664889:0:24321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444006912 00000100:00100000:3.0:1787831271.664893:0:24321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444006912 00000100:00100000:3.0:1787831271.664903:0:24321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444007040 00000100:00100000:3.0:1787831271.664906:0:24321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444007040 00000100:00100000:3.0:1787831271.664913:0:24321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787831271.664917:0:24321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a22d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3618:x1874676444006912:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1787831271.664941:0:24321:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 562 last 0 00000020:00000080:3.0:1787831271.664979:0:24321:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x95459fb9d1d2a986 00002000:00100000:3.0:1787831271.664992:0:24321:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8d220340b000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211393d ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1787831271.664997:0:24321:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1787831271.665000:0:24321:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1787831271.665070:0:24321:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787831271.665094:0:24321:0:(import.c:65:import_set_state_nolock()) ffff8d220340e000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787831271.665132:0:24321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a22d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3618:x1874676444006912:12345-0@lo:8:kworker.0 Request processed in 213us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831271.665140:0:24321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787831271.665154:0:24321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787831271.665158:0:24321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a203c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3618:x1874676444007040:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1787831271.665163:0:22815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444007936 00000100:00100000:1.0:1787831271.665171:0:22815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444007936 00010000:00080000:3.0:1787831271.665187:0:24321:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 562 last 0 00000020:00000080:3.0:1787831271.665206:0:24321:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x95459fb9d1d2a98d 00000100:00100000:1.0:1787831271.665211:0:22815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444008064 00002000:00100000:3.0:1787831271.665214:0:24321:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8d2203409000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211393d ocd_grant: 0 ocd_index: 1 ocd_group 0 00000100:00100000:1.0:1787831271.665216:0:22815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444008064 00002000:00080000:3.0:1787831271.665221:0:24321:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1787831271.665224:0:24321:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:1.0:1787831271.665231:0:22815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444007168 00000100:00100000:1.0:1787831271.665235:0:22815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444007168 00000100:00100000:1.0:1787831271.665251:0:22815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444007680 00000100:00100000:1.0:1787831271.665254:0:22815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444007680 00002000:00080000:3.0:1787831271.665266:0:24321:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787831271.665280:0:24321:0:(import.c:65:import_set_state_nolock()) ffff8d220340b800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787831271.665293:0:22815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444008192 00000100:00100000:1.0:1787831271.665298:0:22815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444008192 00000100:00100000:1.0:1787831271.665313:0:22815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444007808 00000100:00100000:3.0:1787831271.665315:0:24321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a203c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3618:x1874676444007040:12345-0@lo:8:kworker.0 Request processed in 155us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831271.665317:0:22815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444007808 00000100:00100000:3.0:1787831271.665326:0:24321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787831271.665336:0:22815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787831271.665345:0:22815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a21680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1874676444007936:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1787831271.665360:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d22046270c0 x1874676444006912/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787831296 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787831271.665369:0:3618:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787831271.665375:0:3618:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:3.0:1787831271.665383:0:3618:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787831271.665389:0:3618:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1787831271.665393:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8d233f541000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787831271.665394:0:22815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a21680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1874676444007936:12345-0@lo:400:kworker.0 Request processed in 50us (1574us total) trans 0 rc 0/0 00000004:00080000:3.0:1787831271.665414:0:3618:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787831271.665419:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22046270c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1874676444006912:0@lo:8:kworker.0 00010000:00080000:3.0:1787831271.665430:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2204627480 x1874676444007040/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787831296 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787831271.665436:0:3618:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787831271.665440:0:3618:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:3.0:1787831271.665444:0:3618:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787831271.665446:0:3618:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1787831271.665454:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8d2202769000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787831271.665465:0:3618:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787831271.665469:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204627480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1874676444007040:0@lo:8:kworker.0 00000004:00080000:3.0:1787831271.665512:0:22840:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x22:0x0] 00000100:00100000:3.0:1787831271.665527:0:22840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204627480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22840:1874676444008448:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1787831271.665551:0:22840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831271.665565:0:22840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2302f5e180 going to sleep for 11 seconds 00000004:00080000:3.0:1787831271.665579:0:22841:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:1.0:1787831271.665646:0:22815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000004:00080000:3.0:1787831271.665658:0:22841:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 562666032474ns, next at 0ns, rc = 0 00080000:00080000:3.0:1787831271.665667:0:22841:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1787831271.665668:0:22815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787831271.665679:0:22815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a22580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1874676444008064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787831271.665695:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204400000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1874676444008320:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787831271.665721:0:22815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a22580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1874676444008064:12345-0@lo:400:kworker.0 Request processed in 44us (1771us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831271.665732:0:22815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787831271.665735:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831271.665749:0:22815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787831271.665756:0:22815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a22940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874676444007168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787831271.665777:0:24321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444008448 00000100:00100000:3.0:1787831271.665782:0:24321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444008448 00000100:00100000:1.0:1787831271.665799:0:22815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a22940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874676444007168:12345-0@lo:400:kworker.0 Request processed in 43us (1777us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831271.665806:0:22815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787831271.665819:0:24321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787831271.665824:0:22815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787831271.665829:0:24321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22046270c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22840:x1874676444008448:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1787831271.665835:0:22815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a20f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874676444007680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787831271.665868:0:22815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a20f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874676444007680:12345-0@lo:400:kworker.0 Request processed in 38us (1814us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831271.665876:0:22815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787831271.665888:0:22815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787831271.665894:0:22815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a20b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874676444008192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787831271.665943:0:22815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a20b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874676444008192:12345-0@lo:400:kworker.0 Request processed in 48us (1854us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831271.665949:0:22815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787831271.665973:0:22815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787831271.665979:0:22815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874676444007808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787831271.666007:0:22815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874676444007808:12345-0@lo:400:kworker.0 Request processed in 29us (1852us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831271.666012:0:22815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:1.0:1787831271.666059:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2203a230c0 x1874676444008064/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787831287 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787831271.666070:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a230c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3621:1874676444008064:0@lo:400:kworker.0 00010000:00080000:1.0:1787831271.666082:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2203a221c0 x1874676444007936/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787831287 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787831271.666091:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a221c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3621:1874676444007936:0@lo:400:kworker.0 00000100:00100000:1.0:1787831271.666351:0:24324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444008320 00000100:00100000:1.0:1787831271.666355:0:24324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444008320 00000100:00100000:1.0:1787831271.666384:0:24324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787831271.666392:0:24324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204624b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3620:x1874676444008320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787831271.666476:0:24324:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1787831271.666520:0:24324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204624b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3620:x1874676444008320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 129us (789us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831271.666527:0:24324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1787831271.666557:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2203a23480 x1874676444007808/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787831287 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787831271.666581:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3619:1874676444007808:0@lo:400:kworker.0 00010000:00080000:1.0:1787831271.666596:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2204403c00 x1874676444007168/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787831287 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787831271.666605:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204403c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874676444007168:0@lo:400:kworker.0 00010000:00080000:1.0:1787831271.666616:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2203a20780 x1874676444007680/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787831287 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787831271.666623:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a20780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874676444007680:0@lo:400:kworker.0 00010000:00080000:1.0:1787831271.666663:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2203a212c0 x1874676444008192/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787831287 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787831271.666672:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a212c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3619:1874676444008192:0@lo:400:kworker.0 00010000:00080000:1.0:1787831271.666715:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2204400000 x1874676444008320/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787831287 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787831271.666729:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204400000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1874676444008320:0@lo:13:osp-pre-0-0.0 00000004:00080000:2.0:1787831271.667407:0:22839:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1787831271.667476:0:22839:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 562667850720ns, next at 0ns, rc = 0 00080000:00080000:2.0:1787831271.667483:0:22839:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:2.0:1787831271.667544:0:22842:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x22:0x0] 00000100:00100000:2.0:1787831271.667565:0:22842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233fae8780 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22842:1874676444008704:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1787831271.667607:0:22842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831271.667648:0:22842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d232f6e29c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787831271.667742:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233fae8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676444008576:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787831271.667780:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831271.667812:0:24319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444008704 00000100:00100000:1.0:1787831271.667817:0:24324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444008576 00000100:00100000:2.0:1787831271.667819:0:24319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444008704 00000100:00100000:1.0:1787831271.667824:0:24324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444008576 00000100:00100000:2.0:1787831271.667859:0:24319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787831271.667863:0:24324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787831271.667871:0:24319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb1d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:22842:x1874676444008704:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1787831271.667875:0:24324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb40780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3621:x1874676444008576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787831271.667891:0:24324:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923501056 avail 3691978752 00000100:00080000:2.0:1787831271.668092:0:22811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787831271.668096:0:22811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787831271.670706:0:24324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb40780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3621:x1874676444008576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2828us (2918us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831271.670731:0:24324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1787831271.671619:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d233fae8b40 x1874676444008576/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787831287 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787831271.671670:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233fae8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676444008576:0@lo:13:osp-pre-1-0.0 00002000:00080000:2.0:1787831271.678562:0:24319:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:2.0:1787831271.678574:0:24319:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:2.0:1787831271.678581:0:24319:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:35 to 0x2c0000401:65) 00002000:00080000:3.0:1787831271.679132:0:24321:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:3.0:1787831271.679140:0:24321:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:3.0:1787831271.679144:0:24321:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:35 to 0x280000401:65) 00000004:00080000:0.0:1787831271.699933:0:22796:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:0.0:1787831271.699948:0:22796:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:2.0:1787831271.700950:0:24319:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787831271.700973:0:24319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cfdc5d2d/0x95459fb9d1d2a994 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831271.700990:0:24319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=562s v=(0 0) 00010000:00010000:2.0:1787831271.700995:0:24319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787831271.701001:0:24319:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cfdc5d2d/0x95459fb9d1d2a994 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831271.701027:0:24319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cfdc5d2d/0x95459fb9d1d2a994 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831271.701038:0:24319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cfdc5d2d/0x95459fb9d1d2a994 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831271.701046:0:24319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cfdc5d2d/0x95459fb9d1d2a994 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831271.701061:0:24319:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787831271.702400:0:22805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787831271.702409:0:22805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cfdc5d2d/0x95459fb9d1d2a994 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.702420:0:22805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2303aa3e00 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:0.0:1787831271.702425:0:22805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cfdc5d2d/0x95459fb9d1d2a994 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.702436:0:22805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cfdc5d2d/0x95459fb9d1d2a994 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.702458:0:22805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cfdc5d2d/0x95459fb9d1d2a994 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.702466:0:22805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cfdc5d2d/0x95459fb9d1d2a994 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.702486:0:22805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787831271.702488:0:22805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787831271.702495:0:22805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787831271.708333:0:24319:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787831271.708346:0:24319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067cf9e2b/0x95459fb9d1d2a99b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831271.708363:0:24319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=562s v=(0 0) 00010000:00010000:2.0:1787831271.708367:0:24319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787831271.708374:0:24319:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000067cf9e2b/0x95459fb9d1d2a99b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831271.708387:0:24319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000067cf9e2b/0x95459fb9d1d2a99b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831271.708397:0:24319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067cf9e2b/0x95459fb9d1d2a99b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831271.708452:0:24319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000067cf9e2b/0x95459fb9d1d2a99b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831271.708480:0:24319:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787831271.709479:0:25152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787831271.709489:0:25152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000067cf9e2b/0x95459fb9d1d2a99b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.709500:0:25152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2303aa2a00 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:0.0:1787831271.709504:0:25152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000067cf9e2b/0x95459fb9d1d2a99b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.709514:0:25152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000067cf9e2b/0x95459fb9d1d2a99b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.709531:0:25152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000067cf9e2b/0x95459fb9d1d2a99b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.709537:0:25152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000067cf9e2b/0x95459fb9d1d2a99b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.709553:0:25152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787831271.709554:0:25152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787831271.709556:0:25152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787831271.712510:0:24319:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787831271.712524:0:24319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa277979/0x95459fb9d1d2a9a2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831271.712541:0:24319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=562s v=(0 0) 00010000:00010000:2.0:1787831271.712546:0:24319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787831271.712554:0:24319:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fa277979/0x95459fb9d1d2a9a2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831271.712568:0:24319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fa277979/0x95459fb9d1d2a9a2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831271.712581:0:24319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa277979/0x95459fb9d1d2a9a2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831271.712589:0:24319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fa277979/0x95459fb9d1d2a9a2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831271.712617:0:24319:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787831271.713082:0:22804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787831271.713090:0:22804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fa277979/0x95459fb9d1d2a9a2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831271.713099:0:22804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22039c1600 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:1.0:1787831271.713104:0:22804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa277979/0x95459fb9d1d2a9a2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831271.713113:0:22804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa277979/0x95459fb9d1d2a9a2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831271.713134:0:22804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fa277979/0x95459fb9d1d2a9a2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831271.713142:0:22804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fa277979/0x95459fb9d1d2a9a2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831271.713162:0:22804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787831271.713164:0:22804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787831271.713166:0:22804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787831271.714136:0:24321:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787831271.714146:0:24321:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000044ec40b6/0x95459fb9d1d2a9a9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.714159:0:24321:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=562s v=(0 0) 00010000:00010000:3.0:1787831271.714164:0:24321:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787831271.714170:0:24321:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000044ec40b6/0x95459fb9d1d2a9a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.714199:0:24321:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000044ec40b6/0x95459fb9d1d2a9a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.714282:0:24321:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000044ec40b6/0x95459fb9d1d2a9a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.714291:0:24321:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000044ec40b6/0x95459fb9d1d2a9a9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.714308:0:24321:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787831271.714325:0:22805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787831271.714333:0:22805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000044ec40b6/0x95459fb9d1d2a9a9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.714340:0:22805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2307c76c00 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:3.0:1787831271.714344:0:22805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000044ec40b6/0x95459fb9d1d2a9a9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.714352:0:22805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000044ec40b6/0x95459fb9d1d2a9a9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.714365:0:22805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000044ec40b6/0x95459fb9d1d2a9a9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.714373:0:22805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000044ec40b6/0x95459fb9d1d2a9a9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.714404:0:22805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787831271.714463:0:22805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787831271.714466:0:22805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787831271.715252:0:24321:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787831271.715261:0:24321:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ffb6e523/0x95459fb9d1d2a9b0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.715272:0:24321:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=562s v=(0 0) 00010000:00010000:3.0:1787831271.715276:0:24321:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787831271.715281:0:24321:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ffb6e523/0x95459fb9d1d2a9b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.715292:0:24321:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ffb6e523/0x95459fb9d1d2a9b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.715302:0:24321:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ffb6e523/0x95459fb9d1d2a9b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.715310:0:24321:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ffb6e523/0x95459fb9d1d2a9b0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.715329:0:24321:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787831271.715339:0:25152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787831271.715343:0:25152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ffb6e523/0x95459fb9d1d2a9b0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.715362:0:25152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2307c76000 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:3.0:1787831271.715366:0:25152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ffb6e523/0x95459fb9d1d2a9b0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.715374:0:25152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ffb6e523/0x95459fb9d1d2a9b0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.715386:0:25152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ffb6e523/0x95459fb9d1d2a9b0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.715394:0:25152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ffb6e523/0x95459fb9d1d2a9b0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.715407:0:25152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787831271.715408:0:25152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787831271.715410:0:25152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787831271.720761:0:24321:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787831271.720778:0:24321:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7a8e00e/0x95459fb9d1d2a9b7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.720797:0:24321:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=562s v=(0 0) 00010000:00010000:3.0:1787831271.720802:0:24321:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787831271.720809:0:24321:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7a8e00e/0x95459fb9d1d2a9b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.720823:0:24321:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d7a8e00e/0x95459fb9d1d2a9b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.720850:0:24321:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7a8e00e/0x95459fb9d1d2a9b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.720858:0:24321:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d7a8e00e/0x95459fb9d1d2a9b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.720878:0:24321:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787831271.724697:0:24319:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787831271.724712:0:24319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aeaf12e9/0x95459fb9d1d2a9be lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831271.724743:0:24319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=562s v=(0 0) 00010000:00010000:2.0:1787831271.724748:0:24319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787831271.724755:0:24319:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aeaf12e9/0x95459fb9d1d2a9be lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831271.724770:0:24319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aeaf12e9/0x95459fb9d1d2a9be lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831271.724791:0:24319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aeaf12e9/0x95459fb9d1d2a9be lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831271.724800:0:24319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aeaf12e9/0x95459fb9d1d2a9be lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.724997:0:24319:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787831271.725153:0:22805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787831271.725161:0:22805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d7a8e00e/0x95459fb9d1d2a9b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831271.725184:0:22805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2307c77600 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:2.0:1787831271.725189:0:22805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7a8e00e/0x95459fb9d1d2a9b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831271.725199:0:22805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7a8e00e/0x95459fb9d1d2a9b7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831271.725231:0:22805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d7a8e00e/0x95459fb9d1d2a9b7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831271.725238:0:22805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7a8e00e/0x95459fb9d1d2a9b7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831271.725260:0:22805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787831271.725264:0:22805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aeaf12e9/0x95459fb9d1d2a9be lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831271.725270:0:22805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22039c0800 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:2.0:1787831271.725273:0:22805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aeaf12e9/0x95459fb9d1d2a9be lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831271.725281:0:22805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aeaf12e9/0x95459fb9d1d2a9be lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787831271.725283:0:24321:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787831271.725294:0:22805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aeaf12e9/0x95459fb9d1d2a9be lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.725295:0:24321:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004d8562d5/0x95459fb9d1d2a9c5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831271.725313:0:22805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aeaf12e9/0x95459fb9d1d2a9be lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.725316:0:24321:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=562s v=(0 0) 00010000:00010000:3.0:1787831271.725325:0:24321:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787831271.725332:0:24321:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004d8562d5/0x95459fb9d1d2a9c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831271.725333:0:22805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787831271.725336:0:22805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787831271.725344:0:22805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787831271.725346:0:24321:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004d8562d5/0x95459fb9d1d2a9c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.725355:0:24321:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004d8562d5/0x95459fb9d1d2a9c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.725362:0:24321:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004d8562d5/0x95459fb9d1d2a9c5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.725394:0:24321:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787831271.725405:0:25152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787831271.725410:0:25152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004d8562d5/0x95459fb9d1d2a9c5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.725417:0:25152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2307c76e00 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:3.0:1787831271.725421:0:25152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004d8562d5/0x95459fb9d1d2a9c5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.725429:0:25152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004d8562d5/0x95459fb9d1d2a9c5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.725442:0:25152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004d8562d5/0x95459fb9d1d2a9c5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.725450:0:25152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004d8562d5/0x95459fb9d1d2a9c5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.725487:0:25152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787831271.725490:0:25152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787831271.725493:0:25152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787831271.725537:0:24319:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787831271.725544:0:24319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f7c0c50/0x95459fb9d1d2a9cc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.725552:0:24319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=562s v=(0 0) 00010000:00010000:3.0:1787831271.725562:0:24319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787831271.725708:0:24319:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f7c0c50/0x95459fb9d1d2a9cc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.725726:0:24319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008f7c0c50/0x95459fb9d1d2a9cc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.725736:0:24319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f7c0c50/0x95459fb9d1d2a9cc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.725744:0:24319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008f7c0c50/0x95459fb9d1d2a9cc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.725764:0:24319:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787831271.725800:0:22804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787831271.725807:0:22804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008f7c0c50/0x95459fb9d1d2a9cc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831271.725821:0:22804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2307c76a00 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:1.0:1787831271.725825:0:22804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008f7c0c50/0x95459fb9d1d2a9cc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831271.725833:0:22804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008f7c0c50/0x95459fb9d1d2a9cc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831271.725846:0:22804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008f7c0c50/0x95459fb9d1d2a9cc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831271.725853:0:22804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008f7c0c50/0x95459fb9d1d2a9cc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831271.725867:0:22804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787831271.725869:0:22804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787831271.725871:0:22804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787831271.725983:0:22805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787831271.726726:0:24319:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787831271.726737:0:24319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000697613f/0x95459fb9d1d2a9d3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.726748:0:24319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=562s v=(0 0) 00010000:00010000:0.0:1787831271.726752:0:24319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787831271.726764:0:24319:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000697613f/0x95459fb9d1d2a9d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.726777:0:24319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000697613f/0x95459fb9d1d2a9d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.726787:0:24319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000697613f/0x95459fb9d1d2a9d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.726794:0:24319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000697613f/0x95459fb9d1d2a9d3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.726812:0:24319:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787831271.726951:0:25152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787831271.726966:0:25152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000697613f/0x95459fb9d1d2a9d3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.726975:0:25152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233bf10400 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:0.0:1787831271.726980:0:25152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000697613f/0x95459fb9d1d2a9d3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.726989:0:25152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000697613f/0x95459fb9d1d2a9d3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.727005:0:25152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000697613f/0x95459fb9d1d2a9d3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.727023:0:25152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000697613f/0x95459fb9d1d2a9d3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.727038:0:25152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787831271.727040:0:25152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787831271.727041:0:25152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787831271.727746:0:24321:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787831271.727757:0:24321:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000044ec40b6/0x95459fb9d1d2a9da lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.727770:0:24321:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=562s v=(0 0) 00010000:00010000:3.0:1787831271.727774:0:24321:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787831271.727779:0:24321:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000044ec40b6/0x95459fb9d1d2a9da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.727792:0:24321:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000044ec40b6/0x95459fb9d1d2a9da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.727802:0:24321:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000044ec40b6/0x95459fb9d1d2a9da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.727816:0:24321:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000044ec40b6/0x95459fb9d1d2a9da lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.727836:0:24321:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787831271.728308:0:22804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787831271.728316:0:22804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000044ec40b6/0x95459fb9d1d2a9da lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.728324:0:22804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2307c76c00 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:0.0:1787831271.728329:0:22804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000044ec40b6/0x95459fb9d1d2a9da lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.728337:0:22804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000044ec40b6/0x95459fb9d1d2a9da lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.728357:0:22804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000044ec40b6/0x95459fb9d1d2a9da lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.728366:0:22804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000044ec40b6/0x95459fb9d1d2a9da lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.728388:0:22804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787831271.728390:0:22804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787831271.728392:0:22804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787831271.728411:0:24319:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787831271.728419:0:24319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b2f1a89/0x95459fb9d1d2a9e1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.728427:0:24319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=562s v=(0 0) 00010000:00010000:3.0:1787831271.728431:0:24319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787831271.728435:0:24319:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b2f1a89/0x95459fb9d1d2a9e1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.728446:0:24319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009b2f1a89/0x95459fb9d1d2a9e1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.728453:0:24319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b2f1a89/0x95459fb9d1d2a9e1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.728460:0:24319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009b2f1a89/0x95459fb9d1d2a9e1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.728482:0:24319:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787831271.728520:0:22805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787831271.728527:0:22805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009b2f1a89/0x95459fb9d1d2a9e1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.728535:0:22805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2307c77a00 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:0.0:1787831271.728539:0:22805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009b2f1a89/0x95459fb9d1d2a9e1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.728547:0:22805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009b2f1a89/0x95459fb9d1d2a9e1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.728560:0:22805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009b2f1a89/0x95459fb9d1d2a9e1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.728566:0:22805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009b2f1a89/0x95459fb9d1d2a9e1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.728579:0:22805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787831271.728581:0:22805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787831271.728582:0:22805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787831271.728727:0:24321:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787831271.728733:0:24321:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ffb6e523/0x95459fb9d1d2a9e8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.728748:0:24321:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=562s v=(0 0) 00010000:00010000:3.0:1787831271.728751:0:24321:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787831271.728755:0:24321:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ffb6e523/0x95459fb9d1d2a9e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.728764:0:24321:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ffb6e523/0x95459fb9d1d2a9e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.728771:0:24321:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ffb6e523/0x95459fb9d1d2a9e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.728778:0:24321:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ffb6e523/0x95459fb9d1d2a9e8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.728795:0:24321:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787831271.730090:0:24319:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787831271.730102:0:24319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f3975c6/0x95459fb9d1d2a9ef lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.730116:0:24319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=562s v=(0 0) 00010000:00010000:3.0:1787831271.730120:0:24319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787831271.730125:0:24319:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007f3975c6/0x95459fb9d1d2a9ef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.730138:0:24319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007f3975c6/0x95459fb9d1d2a9ef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.730163:0:24319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f3975c6/0x95459fb9d1d2a9ef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.730171:0:24319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007f3975c6/0x95459fb9d1d2a9ef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.730184:0:24319:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1787831271.730371:0:24321:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787831271.730376:0:24321:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000868d9877/0x95459fb9d1d2a9f6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.730384:0:24321:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=562s v=(0 0) 00010000:00010000:3.0:1787831271.730387:0:24321:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787831271.730391:0:24321:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000868d9877/0x95459fb9d1d2a9f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.730401:0:24321:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000868d9877/0x95459fb9d1d2a9f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.730408:0:24321:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000868d9877/0x95459fb9d1d2a9f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.730416:0:24321:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000868d9877/0x95459fb9d1d2a9f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.730447:0:24321:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1787831271.731652:0:24319:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787831271.731663:0:24319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000023de687f/0x95459fb9d1d2a9fd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.731676:0:24319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=562s v=(0 0) 00010000:00010000:3.0:1787831271.731679:0:24319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787831271.731685:0:24319:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000023de687f/0x95459fb9d1d2a9fd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.731697:0:24319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000023de687f/0x95459fb9d1d2a9fd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.731706:0:24319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000023de687f/0x95459fb9d1d2a9fd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.731712:0:24319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000023de687f/0x95459fb9d1d2a9fd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.731722:0:24319:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1787831271.731979:0:24321:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787831271.731985:0:24321:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027d68771/0x95459fb9d1d2aa04 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.731993:0:24321:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=562s v=(0 0) 00010000:00010000:3.0:1787831271.732002:0:24321:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787831271.732007:0:24321:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027d68771/0x95459fb9d1d2aa04 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.732017:0:24321:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027d68771/0x95459fb9d1d2aa04 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.732024:0:24321:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027d68771/0x95459fb9d1d2aa04 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.732031:0:24321:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027d68771/0x95459fb9d1d2aa04 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.732040:0:24321:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:3.0:1787831271.732558:0:24319:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787831271.732566:0:24319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b20c1294/0x95459fb9d1d2aa0b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787831271.733166:0:24321:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787831271.733176:0:24321:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002380330d/0x95459fb9d1d2aa12 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831271.733191:0:24321:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=562s v=(0 0) 00010000:00010000:2.0:1787831271.733194:0:24321:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787831271.733200:0:24321:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002380330d/0x95459fb9d1d2aa12 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831271.733227:0:24321:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002380330d/0x95459fb9d1d2aa12 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831271.733238:0:24321:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002380330d/0x95459fb9d1d2aa12 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831271.733246:0:24321:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002380330d/0x95459fb9d1d2aa12 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831271.733258:0:24321:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:3.0:1787831271.733452:0:24319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=562s v=(0 0) 00010000:00010000:3.0:1787831271.733456:0:24319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787831271.733460:0:24319:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b20c1294/0x95459fb9d1d2aa0b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.733472:0:24319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b20c1294/0x95459fb9d1d2aa0b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.733480:0:24319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b20c1294/0x95459fb9d1d2aa0b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.733495:0:24319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b20c1294/0x95459fb9d1d2aa0b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.733503:0:24319:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:3.0:1787831271.734050:0:24319:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787831271.734058:0:24319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000778ffcc/0x95459fb9d1d2aa19 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.734068:0:24319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=562s v=(0 0) 00010000:00010000:3.0:1787831271.734070:0:24319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787831271.734075:0:24319:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000778ffcc/0x95459fb9d1d2aa19 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.734085:0:24319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000778ffcc/0x95459fb9d1d2aa19 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.734093:0:24319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000778ffcc/0x95459fb9d1d2aa19 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.734100:0:24319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000778ffcc/0x95459fb9d1d2aa19 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.734109:0:24319:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:3.0:1787831271.734255:0:24321:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787831271.734262:0:24321:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7a8e00e/0x95459fb9d1d2aa20 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.734276:0:24321:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=562s v=(0 0) 00010000:00010000:3.0:1787831271.734279:0:24321:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787831271.734284:0:24321:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7a8e00e/0x95459fb9d1d2aa20 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.734294:0:24321:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d7a8e00e/0x95459fb9d1d2aa20 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.734302:0:24321:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7a8e00e/0x95459fb9d1d2aa20 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.734309:0:24321:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d7a8e00e/0x95459fb9d1d2aa20 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.734318:0:24321:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00002000:00010000:3.0:1787831271.734409:0:24319:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787831271.734415:0:24319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d8562d5/0x95459fb9d1d2aa27 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.734422:0:24319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=562s v=(0 0) 00010000:00010000:3.0:1787831271.734426:0:24319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787831271.734430:0:24319:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004d8562d5/0x95459fb9d1d2aa27 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.734440:0:24319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004d8562d5/0x95459fb9d1d2aa27 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.734460:0:24319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d8562d5/0x95459fb9d1d2aa27 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.734466:0:24319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004d8562d5/0x95459fb9d1d2aa27 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.734475:0:24319:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/10 locks to regular blp list, 10 blwis in pool 00010000:00010000:0.0:1787831271.734687:0:22804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 9 total in blp. (9 blwis in pool) 00010000:00010000:0.0:1787831271.734696:0:22804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ffb6e523/0x95459fb9d1d2a9e8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.734706:0:22804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2307c76000 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:0.0:1787831271.734710:0:22804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ffb6e523/0x95459fb9d1d2a9e8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.734731:0:22804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ffb6e523/0x95459fb9d1d2a9e8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.734749:0:22804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ffb6e523/0x95459fb9d1d2a9e8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.734757:0:22804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ffb6e523/0x95459fb9d1d2a9e8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.734774:0:22804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:0.0:1787831271.734778:0:22804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007f3975c6/0x95459fb9d1d2a9ef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.734785:0:22804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2307c76400 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:0.0:1787831271.734788:0:22804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007f3975c6/0x95459fb9d1d2a9ef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.734796:0:22804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007f3975c6/0x95459fb9d1d2a9ef lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.734807:0:22804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007f3975c6/0x95459fb9d1d2a9ef lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.734814:0:22804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007f3975c6/0x95459fb9d1d2a9ef lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.734837:0:22804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:0.0:1787831271.734841:0:22804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000868d9877/0x95459fb9d1d2a9f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.734847:0:22804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2307c77400 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:0.0:1787831271.734850:0:22804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000868d9877/0x95459fb9d1d2a9f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.734858:0:22804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000868d9877/0x95459fb9d1d2a9f6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.734868:0:22804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000868d9877/0x95459fb9d1d2a9f6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.734875:0:22804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000868d9877/0x95459fb9d1d2a9f6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.734887:0:22804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1787831271.734890:0:22804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000023de687f/0x95459fb9d1d2a9fd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.734896:0:22804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2307c77800 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:0.0:1787831271.734899:0:22804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000023de687f/0x95459fb9d1d2a9fd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.734915:0:22804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000023de687f/0x95459fb9d1d2a9fd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.734924:0:22804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000023de687f/0x95459fb9d1d2a9fd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.734931:0:22804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000023de687f/0x95459fb9d1d2a9fd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.734942:0:22804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1787831271.734945:0:22804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027d68771/0x95459fb9d1d2aa04 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.734951:0:22804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2307c76200 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:0.0:1787831271.734954:0:22804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027d68771/0x95459fb9d1d2aa04 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.734974:0:22804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027d68771/0x95459fb9d1d2aa04 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.734984:0:22804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027d68771/0x95459fb9d1d2aa04 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.734992:0:22804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027d68771/0x95459fb9d1d2aa04 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.735022:0:22804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1787831271.735025:0:22804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002380330d/0x95459fb9d1d2aa12 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.735032:0:22804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22039c0400 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:0.0:1787831271.735035:0:22804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002380330d/0x95459fb9d1d2aa12 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.735042:0:22804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002380330d/0x95459fb9d1d2aa12 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.735053:0:22804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002380330d/0x95459fb9d1d2aa12 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.735060:0:22804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002380330d/0x95459fb9d1d2aa12 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.735072:0:22804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1787831271.735075:0:22804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b20c1294/0x95459fb9d1d2aa0b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.735081:0:22804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2301668800 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:0.0:1787831271.735084:0:22804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b20c1294/0x95459fb9d1d2aa0b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.735100:0:22804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b20c1294/0x95459fb9d1d2aa0b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.735110:0:22804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b20c1294/0x95459fb9d1d2aa0b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.735117:0:22804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b20c1294/0x95459fb9d1d2aa0b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.735129:0:22804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787831271.735132:0:22804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000778ffcc/0x95459fb9d1d2aa19 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.735139:0:22804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2301668e00 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:0.0:1787831271.735142:0:22804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000778ffcc/0x95459fb9d1d2aa19 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.735149:0:22804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000778ffcc/0x95459fb9d1d2aa19 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.735158:0:22804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000778ffcc/0x95459fb9d1d2aa19 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.735165:0:22804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000778ffcc/0x95459fb9d1d2aa19 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.735187:0:22804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787831271.735190:0:22804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d7a8e00e/0x95459fb9d1d2aa20 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.735197:0:22804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2307c77600 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:0.0:1787831271.735200:0:22804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7a8e00e/0x95459fb9d1d2aa20 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.735207:0:22804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7a8e00e/0x95459fb9d1d2aa20 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.735217:0:22804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d7a8e00e/0x95459fb9d1d2aa20 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.735224:0:22804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7a8e00e/0x95459fb9d1d2aa20 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.735235:0:22804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787831271.735238:0:22804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004d8562d5/0x95459fb9d1d2aa27 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.735244:0:22804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2307c76e00 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:0.0:1787831271.735247:0:22804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004d8562d5/0x95459fb9d1d2aa27 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.735264:0:22804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004d8562d5/0x95459fb9d1d2aa27 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.735274:0:22804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004d8562d5/0x95459fb9d1d2aa27 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.735281:0:22804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004d8562d5/0x95459fb9d1d2aa27 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.735293:0:22804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787831271.735295:0:22804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787831271.735297:0:22804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787831271.735306:0:25152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787831271.735581:0:22805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787831271.736022:0:24321:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787831271.736031:0:24321:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f7c0c50/0x95459fb9d1d2aa2e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.736042:0:24321:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=562s v=(0 0) 00010000:00010000:3.0:1787831271.736047:0:24321:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787831271.736052:0:24321:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f7c0c50/0x95459fb9d1d2aa2e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.736063:0:24321:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008f7c0c50/0x95459fb9d1d2aa2e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.736071:0:24321:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f7c0c50/0x95459fb9d1d2aa2e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.736078:0:24321:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008f7c0c50/0x95459fb9d1d2aa2e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.736114:0:24321:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787831271.736305:0:22804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787831271.736312:0:22804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008f7c0c50/0x95459fb9d1d2aa2e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831271.736319:0:22804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2307c76a00 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:1.0:1787831271.736323:0:22804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008f7c0c50/0x95459fb9d1d2aa2e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831271.736342:0:22804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008f7c0c50/0x95459fb9d1d2aa2e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831271.736358:0:22804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008f7c0c50/0x95459fb9d1d2aa2e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831271.736365:0:22804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008f7c0c50/0x95459fb9d1d2aa2e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831271.736384:0:22804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787831271.736386:0:22804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787831271.736388:0:22804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787831271.736460:0:24321:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787831271.736467:0:24321:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050e3bbdb/0x95459fb9d1d2aa35 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.736476:0:24321:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=562s v=(0 0) 00010000:00010000:3.0:1787831271.736479:0:24321:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787831271.736484:0:24321:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050e3bbdb/0x95459fb9d1d2aa35 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.736495:0:24321:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050e3bbdb/0x95459fb9d1d2aa35 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.736503:0:24321:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050e3bbdb/0x95459fb9d1d2aa35 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.736510:0:24321:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000050e3bbdb/0x95459fb9d1d2aa35 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787831271.736518:0:24319:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787831271.736526:0:24319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e6fafee/0x95459fb9d1d2aa3c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.736530:0:24321:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787831271.736539:0:24319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=562s v=(0 0) 00010000:00010000:0.0:1787831271.736542:0:24319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787831271.736546:0:24319:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e6fafee/0x95459fb9d1d2aa3c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.736556:0:24319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009e6fafee/0x95459fb9d1d2aa3c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.736563:0:24319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e6fafee/0x95459fb9d1d2aa3c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.736576:0:24319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009e6fafee/0x95459fb9d1d2aa3c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.736588:0:25152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787831271.736593:0:25152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000050e3bbdb/0x95459fb9d1d2aa35 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.736599:0:25152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233837a200 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:0.0:1787831271.736601:0:25152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000050e3bbdb/0x95459fb9d1d2aa35 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.736609:0:25152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000050e3bbdb/0x95459fb9d1d2aa35 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.736619:0:25152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000050e3bbdb/0x95459fb9d1d2aa35 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.736645:0:25152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050e3bbdb/0x95459fb9d1d2aa35 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.736659:0:25152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787831271.736661:0:25152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787831271.736662:0:25152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787831271.736673:0:24319:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787831271.736681:0:22805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787831271.736691:0:22805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009e6fafee/0x95459fb9d1d2aa3c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.736698:0:22805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233bf10a00 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:0.0:1787831271.736701:0:22805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009e6fafee/0x95459fb9d1d2aa3c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.736708:0:22805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009e6fafee/0x95459fb9d1d2aa3c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.736718:0:22805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009e6fafee/0x95459fb9d1d2aa3c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.736725:0:22805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009e6fafee/0x95459fb9d1d2aa3c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.736740:0:22805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787831271.736742:0:22805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787831271.736744:0:22805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787831271.737517:0:24321:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787831271.737526:0:24321:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000634d5a22/0x95459fb9d1d2aa43 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.737536:0:24321:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=562s v=(0 0) 00010000:00010000:3.0:1787831271.737545:0:24321:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787831271.737550:0:24321:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000634d5a22/0x95459fb9d1d2aa43 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.737561:0:24321:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000634d5a22/0x95459fb9d1d2aa43 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.737996:0:24321:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000634d5a22/0x95459fb9d1d2aa43 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.738006:0:24321:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000634d5a22/0x95459fb9d1d2aa43 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.738030:0:24321:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787831271.738253:0:22804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787831271.738261:0:22804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000634d5a22/0x95459fb9d1d2aa43 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831271.738268:0:22804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233837ac00 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:1.0:1787831271.738273:0:22804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000634d5a22/0x95459fb9d1d2aa43 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831271.738282:0:22804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000634d5a22/0x95459fb9d1d2aa43 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831271.738296:0:22804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000634d5a22/0x95459fb9d1d2aa43 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831271.738316:0:22804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000634d5a22/0x95459fb9d1d2aa43 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831271.738336:0:22804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787831271.738339:0:22804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787831271.738340:0:22804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787831271.738500:0:24321:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:0.0:1787831271.738500:0:24319:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787831271.738513:0:24319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000697613f/0x95459fb9d1d2aa4a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.738514:0:24321:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000091c5273c/0x95459fb9d1d2aa51 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.738537:0:24319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=562s v=(0 0) 00010000:00010000:3.0:1787831271.738538:0:24321:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=562s v=(0 0) 00010000:00010000:3.0:1787831271.738547:0:24321:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787831271.738547:0:24319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787831271.738559:0:24321:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000091c5273c/0x95459fb9d1d2aa51 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.738560:0:24319:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000697613f/0x95459fb9d1d2aa4a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.738588:0:24319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000697613f/0x95459fb9d1d2aa4a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.738596:0:24319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000697613f/0x95459fb9d1d2aa4a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.738603:0:24319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000697613f/0x95459fb9d1d2aa4a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.738646:0:24319:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787831271.738800:0:25152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787831271.738805:0:25152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000697613f/0x95459fb9d1d2aa4a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831271.738813:0:25152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233bf10400 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:1.0:1787831271.738816:0:25152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000697613f/0x95459fb9d1d2aa4a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831271.738823:0:25152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000697613f/0x95459fb9d1d2aa4a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831271.738834:0:25152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000697613f/0x95459fb9d1d2aa4a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831271.738842:0:25152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000697613f/0x95459fb9d1d2aa4a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831271.738856:0:25152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787831271.738858:0:25152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787831271.738859:0:25152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787831271.739093:0:24319:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787831271.739099:0:24319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000509b85e5/0x95459fb9d1d2aa58 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.739108:0:24319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=562s v=(0 0) 00010000:00010000:0.0:1787831271.739111:0:24319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787831271.739116:0:24319:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000509b85e5/0x95459fb9d1d2aa58 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.739125:0:24319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000509b85e5/0x95459fb9d1d2aa58 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.739132:0:24319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000509b85e5/0x95459fb9d1d2aa58 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.739150:0:24319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000509b85e5/0x95459fb9d1d2aa58 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.739266:0:24319:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787831271.739267:0:24321:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000091c5273c/0x95459fb9d1d2aa51 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.739278:0:24321:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000091c5273c/0x95459fb9d1d2aa51 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.739293:0:24321:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000091c5273c/0x95459fb9d1d2aa51 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.748078:0:24321:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787831271.748109:0:22804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787831271.748119:0:22804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000509b85e5/0x95459fb9d1d2aa58 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.748134:0:22804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233bf10800 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:3.0:1787831271.748139:0:22804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000509b85e5/0x95459fb9d1d2aa58 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.748152:0:22804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000509b85e5/0x95459fb9d1d2aa58 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.748175:0:22804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000509b85e5/0x95459fb9d1d2aa58 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.748183:0:22804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000509b85e5/0x95459fb9d1d2aa58 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.748808:0:22804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787831271.748816:0:22804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000091c5273c/0x95459fb9d1d2aa51 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.748841:0:22804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233837a400 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:3.0:1787831271.748845:0:22804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000091c5273c/0x95459fb9d1d2aa51 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.748855:0:22804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000091c5273c/0x95459fb9d1d2aa51 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.748869:0:22804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000091c5273c/0x95459fb9d1d2aa51 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.748877:0:22804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000091c5273c/0x95459fb9d1d2aa51 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.748892:0:22804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787831271.748894:0:22804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787831271.748896:0:22804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787831271.749429:0:24319:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787831271.749438:0:24319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000056a6f52d/0x95459fb9d1d2aa5f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.749452:0:24319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=562s v=(0 0) 00010000:00010000:0.0:1787831271.749456:0:24319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787831271.749462:0:24319:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000056a6f52d/0x95459fb9d1d2aa5f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.749474:0:24319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000056a6f52d/0x95459fb9d1d2aa5f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.749483:0:24319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000056a6f52d/0x95459fb9d1d2aa5f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.749491:0:24319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000056a6f52d/0x95459fb9d1d2aa5f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.749516:0:24319:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787831271.751816:0:25152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787831271.751831:0:25152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000056a6f52d/0x95459fb9d1d2aa5f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831271.751844:0:25152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233bf11a00 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:2.0:1787831271.751850:0:25152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000056a6f52d/0x95459fb9d1d2aa5f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831271.751875:0:25152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000056a6f52d/0x95459fb9d1d2aa5f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831271.751896:0:25152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000056a6f52d/0x95459fb9d1d2aa5f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831271.751903:0:25152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000056a6f52d/0x95459fb9d1d2aa5f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831271.751932:0:25152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787831271.751934:0:25152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787831271.751936:0:25152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787831271.752816:0:24321:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787831271.752828:0:24321:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ca36c01a/0x95459fb9d1d2aa66 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.752850:0:24321:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=562s v=(0 0) 00010000:00010000:0.0:1787831271.752855:0:24321:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787831271.752862:0:24321:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ca36c01a/0x95459fb9d1d2aa66 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.752877:0:24321:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ca36c01a/0x95459fb9d1d2aa66 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.752887:0:24321:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ca36c01a/0x95459fb9d1d2aa66 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.752895:0:24321:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ca36c01a/0x95459fb9d1d2aa66 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.752909:0:24321:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787831271.755713:0:24319:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787831271.755727:0:24319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6e95077/0x95459fb9d1d2aa6d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.755744:0:24319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=562s v=(0 0) 00010000:00010000:0.0:1787831271.755748:0:24319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787831271.755755:0:24319:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e6e95077/0x95459fb9d1d2aa6d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.755768:0:24319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e6e95077/0x95459fb9d1d2aa6d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.755792:0:24319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6e95077/0x95459fb9d1d2aa6d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.755800:0:24319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e6e95077/0x95459fb9d1d2aa6d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.755822:0:24319:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787831271.755833:0:22804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787831271.755842:0:22804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ca36c01a/0x95459fb9d1d2aa66 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.755852:0:22804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233bf10e00 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:3.0:1787831271.755856:0:22804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca36c01a/0x95459fb9d1d2aa66 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.755867:0:22804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca36c01a/0x95459fb9d1d2aa66 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.755891:0:22804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ca36c01a/0x95459fb9d1d2aa66 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.755906:0:22804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ca36c01a/0x95459fb9d1d2aa66 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.755927:0:22804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787831271.755931:0:22804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e6e95077/0x95459fb9d1d2aa6d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.755937:0:22804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233bf11000 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:3.0:1787831271.755941:0:22804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6e95077/0x95459fb9d1d2aa6d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.755949:0:22804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6e95077/0x95459fb9d1d2aa6d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.755969:0:22804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e6e95077/0x95459fb9d1d2aa6d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.755978:0:22804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e6e95077/0x95459fb9d1d2aa6d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.755995:0:22804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787831271.755997:0:22804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787831271.756004:0:22804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787831271.756235:0:24319:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787831271.756242:0:24319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ebc62a4b/0x95459fb9d1d2aa74 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.756252:0:24319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=562s v=(0 0) 00010000:00010000:0.0:1787831271.756255:0:24319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787831271.756260:0:24319:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ebc62a4b/0x95459fb9d1d2aa74 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.756271:0:24319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ebc62a4b/0x95459fb9d1d2aa74 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.756280:0:24319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ebc62a4b/0x95459fb9d1d2aa74 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.756287:0:24319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ebc62a4b/0x95459fb9d1d2aa74 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.756315:0:24319:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787831271.757703:0:24319:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787831271.757715:0:24319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000778ffcc/0x95459fb9d1d2aa7b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.757729:0:24319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=562s v=(0 0) 00010000:00010000:0.0:1787831271.757733:0:24319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787831271.757738:0:24319:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000778ffcc/0x95459fb9d1d2aa7b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.757750:0:24319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000778ffcc/0x95459fb9d1d2aa7b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.757760:0:24319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000778ffcc/0x95459fb9d1d2aa7b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.757768:0:24319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000778ffcc/0x95459fb9d1d2aa7b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.757850:0:24319:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787831271.759603:0:22805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787831271.759615:0:22805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ebc62a4b/0x95459fb9d1d2aa74 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831271.759641:0:22805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233bf10200 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:1.0:1787831271.759646:0:22805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ebc62a4b/0x95459fb9d1d2aa74 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831271.759658:0:22805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ebc62a4b/0x95459fb9d1d2aa74 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787831271.759680:0:24319:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787831271.759688:0:24319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b20c1294/0x95459fb9d1d2aa82 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.759699:0:24319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=562s v=(0 0) 00010000:00010000:0.0:1787831271.759718:0:24319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787831271.759724:0:24319:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b20c1294/0x95459fb9d1d2aa82 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831271.759731:0:22805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ebc62a4b/0x95459fb9d1d2aa74 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.759735:0:24319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b20c1294/0x95459fb9d1d2aa82 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831271.759739:0:22805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ebc62a4b/0x95459fb9d1d2aa74 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.759744:0:24319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b20c1294/0x95459fb9d1d2aa82 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.759751:0:24319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b20c1294/0x95459fb9d1d2aa82 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831271.759759:0:22805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787831271.759760:0:24319:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787831271.759763:0:22805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000778ffcc/0x95459fb9d1d2aa7b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831271.759770:0:22805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2301668e00 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:1.0:1787831271.759773:0:22805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000778ffcc/0x95459fb9d1d2aa7b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831271.759779:0:22805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000778ffcc/0x95459fb9d1d2aa7b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831271.759800:0:22805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000778ffcc/0x95459fb9d1d2aa7b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831271.759807:0:22805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000778ffcc/0x95459fb9d1d2aa7b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831271.759819:0:22805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787831271.759823:0:22805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b20c1294/0x95459fb9d1d2aa82 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831271.759829:0:22805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2301668800 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:1.0:1787831271.759832:0:22805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b20c1294/0x95459fb9d1d2aa82 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831271.759838:0:22805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b20c1294/0x95459fb9d1d2aa82 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831271.759847:0:22805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b20c1294/0x95459fb9d1d2aa82 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831271.759854:0:22805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b20c1294/0x95459fb9d1d2aa82 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831271.759865:0:22805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787831271.759867:0:22805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787831271.759873:0:22805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787831271.760043:0:25152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787831271.760355:0:22804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787831271.761591:0:24319:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787831271.761605:0:24319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f7c0c50/0x95459fb9d1d2aa89 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.761634:0:24319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=562s v=(0 0) 00010000:00010000:0.0:1787831271.761639:0:24319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787831271.761646:0:24319:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f7c0c50/0x95459fb9d1d2aa89 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.761661:0:24319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008f7c0c50/0x95459fb9d1d2aa89 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.761672:0:24319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f7c0c50/0x95459fb9d1d2aa89 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.761688:0:24319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008f7c0c50/0x95459fb9d1d2aa89 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.761708:0:24319:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787831271.762083:0:22805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787831271.762090:0:22805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008f7c0c50/0x95459fb9d1d2aa89 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831271.762098:0:22805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2307c76a00 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:2.0:1787831271.762102:0:22805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008f7c0c50/0x95459fb9d1d2aa89 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831271.762111:0:22805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008f7c0c50/0x95459fb9d1d2aa89 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831271.762126:0:22805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008f7c0c50/0x95459fb9d1d2aa89 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831271.762141:0:22805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008f7c0c50/0x95459fb9d1d2aa89 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831271.762159:0:22805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787831271.762162:0:22805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787831271.762163:0:22805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787831271.762523:0:24319:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787831271.762530:0:24319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d8562d5/0x95459fb9d1d2aa90 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.762539:0:24319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=562s v=(0 0) 00010000:00010000:0.0:1787831271.762543:0:24319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787831271.762548:0:24319:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004d8562d5/0x95459fb9d1d2aa90 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.762557:0:24319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004d8562d5/0x95459fb9d1d2aa90 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.762565:0:24319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d8562d5/0x95459fb9d1d2aa90 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.762572:0:24319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004d8562d5/0x95459fb9d1d2aa90 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.762596:0:24319:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787831271.762775:0:24321:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787831271.762780:0:24321:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7a8e00e/0x95459fb9d1d2aa97 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.762795:0:24321:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=562s v=(0 0) 00010000:00010000:0.0:1787831271.762798:0:24321:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787831271.762802:0:24321:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7a8e00e/0x95459fb9d1d2aa97 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.762810:0:24321:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d7a8e00e/0x95459fb9d1d2aa97 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.762818:0:24321:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7a8e00e/0x95459fb9d1d2aa97 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.762824:0:24321:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d7a8e00e/0x95459fb9d1d2aa97 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.762835:0:24321:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1787831271.763372:0:24319:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787831271.763380:0:24319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027d68771/0x95459fb9d1d2aa9e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.763391:0:24319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=562s v=(0 0) 00010000:00010000:0.0:1787831271.763395:0:24319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787831271.763400:0:24319:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000027d68771/0x95459fb9d1d2aa9e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.763427:0:24319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000027d68771/0x95459fb9d1d2aa9e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.763451:0:24319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027d68771/0x95459fb9d1d2aa9e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.763458:0:24319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000027d68771/0x95459fb9d1d2aa9e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.763883:0:24319:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1787831271.764359:0:24319:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787831271.764367:0:24319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000023de687f/0x95459fb9d1d2aaa5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.764378:0:24319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=562s v=(0 0) 00010000:00010000:0.0:1787831271.764381:0:24319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787831271.764386:0:24319:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000023de687f/0x95459fb9d1d2aaa5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.764397:0:24319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000023de687f/0x95459fb9d1d2aaa5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.764462:0:24319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000023de687f/0x95459fb9d1d2aaa5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.764470:0:24319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000023de687f/0x95459fb9d1d2aaa5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787831271.765449:0:24321:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787831271.765460:0:24321:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000053add3e/0x95459fb9d1d2aaac lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831271.765471:0:24321:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=562s v=(0 0) 00010000:00010000:1.0:1787831271.765475:0:24321:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787831271.765481:0:24321:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000053add3e/0x95459fb9d1d2aaac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831271.765493:0:24321:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000053add3e/0x95459fb9d1d2aaac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831271.765502:0:24321:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000053add3e/0x95459fb9d1d2aaac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831271.765510:0:24321:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000053add3e/0x95459fb9d1d2aaac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831271.766090:0:24321:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:2.0:1787831271.766372:0:22805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1787831271.766382:0:22805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004d8562d5/0x95459fb9d1d2aa90 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831271.766393:0:22805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2307c76e00 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:2.0:1787831271.766397:0:22805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004d8562d5/0x95459fb9d1d2aa90 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831271.766407:0:22805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004d8562d5/0x95459fb9d1d2aa90 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831271.766425:0:22805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004d8562d5/0x95459fb9d1d2aa90 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831271.766433:0:22805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004d8562d5/0x95459fb9d1d2aa90 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831271.766458:0:22805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1787831271.766462:0:22805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d7a8e00e/0x95459fb9d1d2aa97 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831271.766475:0:22805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2307c77600 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:2.0:1787831271.766478:0:22805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7a8e00e/0x95459fb9d1d2aa97 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831271.766485:0:22805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7a8e00e/0x95459fb9d1d2aa97 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831271.766497:0:22805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d7a8e00e/0x95459fb9d1d2aa97 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831271.766504:0:22805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7a8e00e/0x95459fb9d1d2aa97 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831271.766519:0:22805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787831271.766522:0:22805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000027d68771/0x95459fb9d1d2aa9e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831271.766529:0:22805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2307c76200 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:2.0:1787831271.766533:0:22805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000027d68771/0x95459fb9d1d2aa9e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831271.766540:0:22805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000027d68771/0x95459fb9d1d2aa9e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831271.766549:0:22805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000027d68771/0x95459fb9d1d2aa9e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831271.766563:0:22805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000027d68771/0x95459fb9d1d2aa9e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831271.766576:0:22805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787831271.766580:0:22805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000023de687f/0x95459fb9d1d2aaa5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831271.766586:0:22805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2307c77800 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:2.0:1787831271.766594:0:22805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000023de687f/0x95459fb9d1d2aaa5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831271.766602:0:22805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000023de687f/0x95459fb9d1d2aaa5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831271.766612:0:22805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000023de687f/0x95459fb9d1d2aaa5 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831271.766620:0:22805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787831271.766643:0:22805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000053add3e/0x95459fb9d1d2aaac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831271.766649:0:22805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233be94a00 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:2.0:1787831271.766652:0:22805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000053add3e/0x95459fb9d1d2aaac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831271.766680:0:22805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000053add3e/0x95459fb9d1d2aaac lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831271.766691:0:22805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000053add3e/0x95459fb9d1d2aaac lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831271.766698:0:22805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000053add3e/0x95459fb9d1d2aaac lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831271.766712:0:22805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787831271.766713:0:22805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787831271.766716:0:22805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787831271.766743:0:24319:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787831271.766750:0:24319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000023de687f/0x95459fb9d1d2aaa5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787831271.767721:0:24319:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787831271.767730:0:24319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000868d9877/0x95459fb9d1d2aab3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.767743:0:24319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=562s v=(0 0) 00010000:00010000:0.0:1787831271.767748:0:24319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787831271.767754:0:24319:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000868d9877/0x95459fb9d1d2aab3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.767766:0:24319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000868d9877/0x95459fb9d1d2aab3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.767775:0:24319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000868d9877/0x95459fb9d1d2aab3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.767782:0:24319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000868d9877/0x95459fb9d1d2aab3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.767807:0:24319:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787831271.767817:0:22805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787831271.767823:0:22805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000868d9877/0x95459fb9d1d2aab3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831271.767831:0:22805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2307c77400 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:2.0:1787831271.767834:0:22805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000868d9877/0x95459fb9d1d2aab3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831271.767842:0:22805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000868d9877/0x95459fb9d1d2aab3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831271.767855:0:22805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000868d9877/0x95459fb9d1d2aab3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831271.767872:0:22805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000868d9877/0x95459fb9d1d2aab3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831271.767886:0:22805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787831271.767887:0:22805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787831271.767889:0:22805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787831271.768259:0:24321:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787831271.768266:0:24321:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fadda30d/0x95459fb9d1d2aaba lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831271.768276:0:24321:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=562s v=(0 0) 00010000:00010000:1.0:1787831271.768279:0:24321:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787831271.768283:0:24321:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fadda30d/0x95459fb9d1d2aaba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831271.768305:0:24321:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fadda30d/0x95459fb9d1d2aaba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831271.768312:0:24321:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fadda30d/0x95459fb9d1d2aaba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831271.768319:0:24321:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fadda30d/0x95459fb9d1d2aaba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831271.768340:0:24321:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787831271.768464:0:22805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787831271.768469:0:22805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fadda30d/0x95459fb9d1d2aaba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831271.768476:0:22805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233be94800 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:2.0:1787831271.768479:0:22805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fadda30d/0x95459fb9d1d2aaba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831271.768487:0:22805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fadda30d/0x95459fb9d1d2aaba lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831271.768499:0:22805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fadda30d/0x95459fb9d1d2aaba lrc: 1/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831271.768507:0:22805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fadda30d/0x95459fb9d1d2aaba lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831271.768523:0:22805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787831271.768524:0:22805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787831271.768526:0:22805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787831271.770572:0:25152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787831271.770923:0:24319:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:0.0:1787831271.770923:0:24321:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787831271.770932:0:24319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084b8f1cf/0x95459fb9d1d2aac1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.770936:0:24321:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f3975c6/0x95459fb9d1d2aac8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831271.770949:0:24319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=562s v=(0 0) 00010000:00010000:0.0:1787831271.770949:0:24321:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=562s v=(0 0) 00010000:00010000:1.0:1787831271.770953:0:24319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787831271.770953:0:24321:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787831271.770970:0:24319:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000084b8f1cf/0x95459fb9d1d2aac1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.770970:0:24321:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f3975c6/0x95459fb9d1d2aac8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831271.770986:0:24319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000084b8f1cf/0x95459fb9d1d2aac1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.770986:0:24321:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f3975c6/0x95459fb9d1d2aac8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831271.770998:0:24319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084b8f1cf/0x95459fb9d1d2aac1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.770998:0:24321:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f3975c6/0x95459fb9d1d2aac8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.771006:0:24321:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007f3975c6/0x95459fb9d1d2aac8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831271.771016:0:24319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000084b8f1cf/0x95459fb9d1d2aac1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.771029:0:24321:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787831271.771544:0:22804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787831271.771552:0:22804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007f3975c6/0x95459fb9d1d2aac8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.771561:0:22804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2307c76400 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:3.0:1787831271.771566:0:22804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007f3975c6/0x95459fb9d1d2aac8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.771576:0:22804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007f3975c6/0x95459fb9d1d2aac8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.771594:0:22804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007f3975c6/0x95459fb9d1d2aac8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.771601:0:22804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f3975c6/0x95459fb9d1d2aac8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.771617:0:22804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787831271.771621:0:22804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000084b8f1cf/0x95459fb9d1d2aac1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.771642:0:22804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233be95e00 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:3.0:1787831271.771645:0:22804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000084b8f1cf/0x95459fb9d1d2aac1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.771665:0:22804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000084b8f1cf/0x95459fb9d1d2aac1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.771992:0:22804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000084b8f1cf/0x95459fb9d1d2aac1 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.772002:0:22804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787831271.772004:0:22804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787831271.772058:0:24319:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787831271.772064:0:24319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000084b8f1cf/0x95459fb9d1d2aac1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.772075:0:25152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787831271.772128:0:24321:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787831271.772134:0:24321:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ffb6e523/0x95459fb9d1d2aacf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.772143:0:24321:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=562s v=(0 0) 00010000:00010000:0.0:1787831271.772147:0:24321:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787831271.772153:0:24321:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ffb6e523/0x95459fb9d1d2aacf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.772174:0:24321:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ffb6e523/0x95459fb9d1d2aacf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.772183:0:24321:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ffb6e523/0x95459fb9d1d2aacf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.772190:0:24321:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ffb6e523/0x95459fb9d1d2aacf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.772204:0:24321:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787831271.772211:0:25152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787831271.772215:0:25152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ffb6e523/0x95459fb9d1d2aacf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.772222:0:25152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2307c76000 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:0.0:1787831271.772225:0:25152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ffb6e523/0x95459fb9d1d2aacf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.772234:0:25152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ffb6e523/0x95459fb9d1d2aacf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.772244:0:25152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ffb6e523/0x95459fb9d1d2aacf lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.772251:0:25152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ffb6e523/0x95459fb9d1d2aacf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.772271:0:25152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787831271.772273:0:25152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787831271.772274:0:25152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787831271.772340:0:22805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787831271.772925:0:24321:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787831271.772933:0:24321:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b2f1a89/0x95459fb9d1d2aad6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.772942:0:24321:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=562s v=(0 0) 00010000:00010000:0.0:1787831271.772945:0:24321:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787831271.772950:0:24321:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b2f1a89/0x95459fb9d1d2aad6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.772970:0:24321:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b2f1a89/0x95459fb9d1d2aad6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.772978:0:24321:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b2f1a89/0x95459fb9d1d2aad6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.772985:0:24321:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b2f1a89/0x95459fb9d1d2aad6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.773001:0:24321:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787831271.773010:0:25152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787831271.773014:0:25152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b2f1a89/0x95459fb9d1d2aad6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.773032:0:25152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2307c77a00 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:0.0:1787831271.773035:0:25152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b2f1a89/0x95459fb9d1d2aad6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.773043:0:25152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b2f1a89/0x95459fb9d1d2aad6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.773055:0:25152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b2f1a89/0x95459fb9d1d2aad6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.773063:0:25152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b2f1a89/0x95459fb9d1d2aad6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.773075:0:25152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787831271.773077:0:25152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787831271.773078:0:25152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787831271.773389:0:24321:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787831271.773396:0:24321:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000044ec40b6/0x95459fb9d1d2aadd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.773413:0:24321:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=562s v=(0 0) 00010000:00010000:0.0:1787831271.773416:0:24321:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787831271.773421:0:24321:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000044ec40b6/0x95459fb9d1d2aadd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.773429:0:24321:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000044ec40b6/0x95459fb9d1d2aadd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.773442:0:24321:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000044ec40b6/0x95459fb9d1d2aadd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.773450:0:24321:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000044ec40b6/0x95459fb9d1d2aadd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.773469:0:24321:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787831271.773547:0:22805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787831271.773553:0:22805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000044ec40b6/0x95459fb9d1d2aadd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831271.773561:0:22805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2307c76c00 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:2.0:1787831271.773564:0:22805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000044ec40b6/0x95459fb9d1d2aadd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831271.773572:0:22805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000044ec40b6/0x95459fb9d1d2aadd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831271.773584:0:22805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000044ec40b6/0x95459fb9d1d2aadd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831271.773592:0:22805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000044ec40b6/0x95459fb9d1d2aadd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831271.773607:0:22805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787831271.773609:0:22805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787831271.773611:0:22805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787831271.773766:0:24321:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787831271.773771:0:24321:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6e95077/0x95459fb9d1d2aae4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.773779:0:24321:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=562s v=(0 0) 00010000:00010000:0.0:1787831271.773782:0:24321:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787831271.773786:0:24321:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6e95077/0x95459fb9d1d2aae4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.773794:0:24321:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e6e95077/0x95459fb9d1d2aae4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.773802:0:24321:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6e95077/0x95459fb9d1d2aae4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.773809:0:24321:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e6e95077/0x95459fb9d1d2aae4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.773832:0:24321:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787831271.773840:0:25152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787831271.773844:0:25152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e6e95077/0x95459fb9d1d2aae4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.773851:0:25152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233bf11000 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:0.0:1787831271.773854:0:25152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6e95077/0x95459fb9d1d2aae4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.773862:0:25152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6e95077/0x95459fb9d1d2aae4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.773873:0:25152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e6e95077/0x95459fb9d1d2aae4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.773881:0:25152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6e95077/0x95459fb9d1d2aae4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.773896:0:25152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787831271.773898:0:25152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787831271.773900:0:25152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787831271.774262:0:24321:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787831271.774267:0:24321:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ca36c01a/0x95459fb9d1d2aaeb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.774275:0:24321:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=562s v=(0 0) 00010000:00010000:0.0:1787831271.774285:0:24321:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787831271.774290:0:24321:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ca36c01a/0x95459fb9d1d2aaeb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.774299:0:24321:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ca36c01a/0x95459fb9d1d2aaeb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.774306:0:24321:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ca36c01a/0x95459fb9d1d2aaeb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.774313:0:24321:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ca36c01a/0x95459fb9d1d2aaeb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.774331:0:24321:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787831271.774575:0:24319:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787831271.774580:0:24319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ebc62a4b/0x95459fb9d1d2aaf2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.774587:0:24319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=562s v=(0 0) 00010000:00010000:0.0:1787831271.774590:0:24319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787831271.774593:0:24319:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ebc62a4b/0x95459fb9d1d2aaf2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.774602:0:24319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ebc62a4b/0x95459fb9d1d2aaf2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.774610:0:24319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ebc62a4b/0x95459fb9d1d2aaf2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.774639:0:24319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ebc62a4b/0x95459fb9d1d2aaf2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.774654:0:24319:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1787831271.774935:0:24321:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787831271.774940:0:24321:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000697613f/0x95459fb9d1d2aaf9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.774948:0:24321:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=562s v=(0 0) 00010000:00010000:0.0:1787831271.774951:0:24321:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787831271.774955:0:24321:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000697613f/0x95459fb9d1d2aaf9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.774975:0:24321:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000697613f/0x95459fb9d1d2aaf9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.774982:0:24321:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000697613f/0x95459fb9d1d2aaf9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.774988:0:24321:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000697613f/0x95459fb9d1d2aaf9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.774996:0:24321:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1787831271.775230:0:24319:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787831271.775235:0:24319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000509b85e5/0x95459fb9d1d2ab00 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.775250:0:24319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=562s v=(0 0) 00010000:00010000:0.0:1787831271.775253:0:24319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787831271.775257:0:24319:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000509b85e5/0x95459fb9d1d2ab00 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.775266:0:24319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000509b85e5/0x95459fb9d1d2ab00 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.775274:0:24319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000509b85e5/0x95459fb9d1d2ab00 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.775281:0:24319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000509b85e5/0x95459fb9d1d2ab00 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.775290:0:24319:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:1.0:1787831271.775315:0:25152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1787831271.775321:0:25152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ca36c01a/0x95459fb9d1d2aaeb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831271.775329:0:25152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233bf10e00 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:1.0:1787831271.775333:0:25152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca36c01a/0x95459fb9d1d2aaeb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831271.775342:0:25152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca36c01a/0x95459fb9d1d2aaeb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831271.775357:0:25152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ca36c01a/0x95459fb9d1d2aaeb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831271.775365:0:25152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ca36c01a/0x95459fb9d1d2aaeb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831271.775384:0:25152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787831271.775394:0:25152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ebc62a4b/0x95459fb9d1d2aaf2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831271.775400:0:25152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233bf10200 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:1.0:1787831271.775403:0:25152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ebc62a4b/0x95459fb9d1d2aaf2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831271.775411:0:25152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ebc62a4b/0x95459fb9d1d2aaf2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831271.775422:0:25152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ebc62a4b/0x95459fb9d1d2aaf2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831271.775429:0:25152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ebc62a4b/0x95459fb9d1d2aaf2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831271.775443:0:25152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787831271.775446:0:25152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000697613f/0x95459fb9d1d2aaf9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831271.775453:0:25152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233bf10400 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:1.0:1787831271.775456:0:25152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000697613f/0x95459fb9d1d2aaf9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831271.775464:0:25152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000697613f/0x95459fb9d1d2aaf9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831271.775487:0:25152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000697613f/0x95459fb9d1d2aaf9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831271.775494:0:25152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000697613f/0x95459fb9d1d2aaf9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831271.775507:0:25152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787831271.775510:0:25152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000509b85e5/0x95459fb9d1d2ab00 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831271.775516:0:25152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233bf10800 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:1.0:1787831271.775519:0:25152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000509b85e5/0x95459fb9d1d2ab00 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831271.775526:0:25152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000509b85e5/0x95459fb9d1d2ab00 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831271.775535:0:25152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000509b85e5/0x95459fb9d1d2ab00 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787831271.775537:0:24321:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787831271.775542:0:24321:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e6fafee/0x95459fb9d1d2ab07 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831271.775543:0:25152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000509b85e5/0x95459fb9d1d2ab00 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.775550:0:24321:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=562s v=(0 0) 00010000:00010000:0.0:1787831271.775553:0:24321:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787831271.775556:0:25152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787831271.775557:0:24321:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e6fafee/0x95459fb9d1d2ab07 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831271.775558:0:25152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787831271.775564:0:25152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787831271.775566:0:24321:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009e6fafee/0x95459fb9d1d2ab07 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.775583:0:24321:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e6fafee/0x95459fb9d1d2ab07 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.775590:0:24321:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009e6fafee/0x95459fb9d1d2ab07 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.775610:0:24321:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787831271.775900:0:24319:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787831271.775905:0:24319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067cf9e2b/0x95459fb9d1d2ab0e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.775912:0:24319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=562s v=(0 0) 00010000:00010000:0.0:1787831271.775915:0:24319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787831271.775919:0:24319:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000067cf9e2b/0x95459fb9d1d2ab0e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.775927:0:24319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000067cf9e2b/0x95459fb9d1d2ab0e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.775934:0:24319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067cf9e2b/0x95459fb9d1d2ab0e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.775940:0:24319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000067cf9e2b/0x95459fb9d1d2ab0e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.775970:0:24319:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1787831271.776084:0:24321:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787831271.776089:0:24321:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfdc5d2d/0x95459fb9d1d2ab15 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.776097:0:24321:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=562s v=(0 0) 00010000:00010000:0.0:1787831271.776100:0:24321:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787831271.776105:0:24321:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cfdc5d2d/0x95459fb9d1d2ab15 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.776113:0:24321:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cfdc5d2d/0x95459fb9d1d2ab15 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.776121:0:24321:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfdc5d2d/0x95459fb9d1d2ab15 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.776128:0:24321:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cfdc5d2d/0x95459fb9d1d2ab15 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.776137:0:24321:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1787831271.776482:0:22805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787831271.776490:0:22805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009e6fafee/0x95459fb9d1d2ab07 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831271.776497:0:22805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233bf10a00 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:2.0:1787831271.776501:0:22805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009e6fafee/0x95459fb9d1d2ab07 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831271.776519:0:22805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009e6fafee/0x95459fb9d1d2ab07 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831271.776531:0:22805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009e6fafee/0x95459fb9d1d2ab07 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831271.776538:0:22805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e6fafee/0x95459fb9d1d2ab07 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831271.776554:0:22805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787831271.776558:0:22805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000067cf9e2b/0x95459fb9d1d2ab0e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831271.776564:0:22805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2303aa2a00 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:2.0:1787831271.776567:0:22805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000067cf9e2b/0x95459fb9d1d2ab0e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831271.776573:0:22805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000067cf9e2b/0x95459fb9d1d2ab0e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831271.776582:0:22805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000067cf9e2b/0x95459fb9d1d2ab0e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831271.776589:0:22805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000067cf9e2b/0x95459fb9d1d2ab0e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831271.776614:0:22805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787831271.776617:0:22805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cfdc5d2d/0x95459fb9d1d2ab15 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831271.776641:0:22805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2303aa3e00 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:2.0:1787831271.776644:0:22805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfdc5d2d/0x95459fb9d1d2ab15 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831271.776652:0:22805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfdc5d2d/0x95459fb9d1d2ab15 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831271.776663:0:22805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cfdc5d2d/0x95459fb9d1d2ab15 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787831271.776785:0:24319:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787831271.776791:0:24319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a083af14/0x95459fb9d1d2ab1c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.776799:0:24319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=562s v=(0 0) 00010000:00010000:0.0:1787831271.776807:0:24319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787831271.776812:0:24319:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a083af14/0x95459fb9d1d2ab1c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.776821:0:24319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a083af14/0x95459fb9d1d2ab1c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.776829:0:24319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a083af14/0x95459fb9d1d2ab1c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.776836:0:24319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a083af14/0x95459fb9d1d2ab1c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.776844:0:24319:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787831271.777211:0:24319:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787831271.777216:0:24319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000716cb908/0x95459fb9d1d2ab23 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.777224:0:24319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=562s v=(0 0) 00010000:00010000:0.0:1787831271.777227:0:24319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787831271.777230:0:24319:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000716cb908/0x95459fb9d1d2ab23 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.777238:0:24319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000716cb908/0x95459fb9d1d2ab23 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.777245:0:24319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000716cb908/0x95459fb9d1d2ab23 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.777257:0:24319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000716cb908/0x95459fb9d1d2ab23 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.777264:0:24319:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00080000:0.0:1787831271.777305:0:24319:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:34 00000100:00100000:0.0:1787831271.777403:0:24319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb1d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:22842:x1874676444008704:12345-0@lo:5:osp-pre-1-0.0 Request processed in 109531us (109792us total) trans 0 rc 0/0 00010000:00010000:2.0:1787831271.777437:0:22805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cfdc5d2d/0x95459fb9d1d2ab15 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831271.777459:0:22805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787831271.777463:0:22805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a083af14/0x95459fb9d1d2ab1c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831271.777469:0:22805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22034a7c00 already unused, calling callback (ffffffffc0ed6420) 00000100:00100000:0.0:1787831271.777470:0:24319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:2.0:1787831271.777473:0:22805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a083af14/0x95459fb9d1d2ab1c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831271.777489:0:22805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a083af14/0x95459fb9d1d2ab1c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831271.777502:0:22805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a083af14/0x95459fb9d1d2ab1c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831271.777509:0:22805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a083af14/0x95459fb9d1d2ab1c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831271.777521:0:22805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787831271.777524:0:22805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000716cb908/0x95459fb9d1d2ab23 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831271.777530:0:22805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22034a7600 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:2.0:1787831271.777533:0:22805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000716cb908/0x95459fb9d1d2ab23 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787831271.777534:0:24321:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787831271.777539:0:24321:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000109b8d99/0x95459fb9d1d2ab2a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831271.777541:0:22805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000716cb908/0x95459fb9d1d2ab23 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.777547:0:24321:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=562s v=(0 0) 00010000:00010000:0.0:1787831271.777550:0:24321:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787831271.777551:0:22805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000716cb908/0x95459fb9d1d2ab23 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.777555:0:24321:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000109b8d99/0x95459fb9d1d2ab2a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831271.777558:0:22805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000716cb908/0x95459fb9d1d2ab23 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.777564:0:24321:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000109b8d99/0x95459fb9d1d2ab2a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.777572:0:24321:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000109b8d99/0x95459fb9d1d2ab2a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831271.777579:0:22805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787831271.777579:0:24321:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000109b8d99/0x95459fb9d1d2ab2a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831271.777581:0:22805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787831271.777583:0:22805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787831271.777600:0:24321:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787831271.777621:0:22842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233fae8780 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22842:1874676444008704:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1787831271.777657:0:22842:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x41:0x0] from OST, last_created [0x2c0000401:0x41:0x0]last_used is [0x2c0000401:0x22:0x0] 00000100:00100000:2.0:1787831271.777711:0:22842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233fb1e1c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22842:1874676444008832:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1787831271.777746:0:22842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831271.777775:0:22842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2303e72540 going to sleep for 11 seconds 00010000:00010000:2.0:1787831271.777787:0:22805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787831271.777791:0:22805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000109b8d99/0x95459fb9d1d2ab2a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831271.777799:0:22805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22034a7e00 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:2.0:1787831271.777802:0:22805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000109b8d99/0x95459fb9d1d2ab2a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831271.777810:0:22805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000109b8d99/0x95459fb9d1d2ab2a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831271.777821:0:22805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000109b8d99/0x95459fb9d1d2ab2a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831271.777828:0:22805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000109b8d99/0x95459fb9d1d2ab2a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831271.777853:0:22805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787831271.777854:0:22805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787831271.777856:0:22805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787831271.777869:0:25005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444008832 00000100:00100000:0.0:1787831271.777876:0:25005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444008832 00000100:00100000:0.0:1787831271.777911:0:25005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787831271.777919:0:25005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb1de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:22842:x1874676444008832:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1787831271.777951:0:25005:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 66 00010000:00010000:1.0:1787831271.779043:0:25152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787831271.779339:0:22804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787831271.779760:0:24321:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787831271.779770:0:24321:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d09dd8d7/0x95459fb9d1d2ab31 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831271.779785:0:24321:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=562s v=(0 0) 00010000:00010000:1.0:1787831271.779789:0:24321:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787831271.779795:0:24321:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d09dd8d7/0x95459fb9d1d2ab31 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831271.779810:0:24321:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d09dd8d7/0x95459fb9d1d2ab31 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831271.779819:0:24321:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d09dd8d7/0x95459fb9d1d2ab31 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831271.779827:0:24321:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d09dd8d7/0x95459fb9d1d2ab31 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831271.779849:0:24321:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787831271.780063:0:22805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787831271.780070:0:22805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d09dd8d7/0x95459fb9d1d2ab31 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.780079:0:22805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233be94e00 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:3.0:1787831271.780092:0:22805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d09dd8d7/0x95459fb9d1d2ab31 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.780102:0:22805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d09dd8d7/0x95459fb9d1d2ab31 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.780119:0:22805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d09dd8d7/0x95459fb9d1d2ab31 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.780126:0:22805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d09dd8d7/0x95459fb9d1d2ab31 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831271.780156:0:22805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787831271.780158:0:22805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787831271.780160:0:22805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787831271.782165:0:24321:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787831271.782178:0:24321:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5b405b6/0x95459fb9d1d2ab38 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831271.782195:0:24321:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=562s v=(0 0) 00010000:00010000:1.0:1787831271.782200:0:24321:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787831271.782207:0:24321:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5b405b6/0x95459fb9d1d2ab38 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831271.782228:0:24321:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5b405b6/0x95459fb9d1d2ab38 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831271.782239:0:24321:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5b405b6/0x95459fb9d1d2ab38 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831271.782246:0:24321:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5b405b6/0x95459fb9d1d2ab38 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831271.782265:0:24321:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787831271.782634:0:25152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787831271.782642:0:25152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5b405b6/0x95459fb9d1d2ab38 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.782651:0:25152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233be95a00 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:0.0:1787831271.782656:0:25152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5b405b6/0x95459fb9d1d2ab38 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.782665:0:25152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5b405b6/0x95459fb9d1d2ab38 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.782752:0:25152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5b405b6/0x95459fb9d1d2ab38 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.782760:0:25152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5b405b6/0x95459fb9d1d2ab38 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.782778:0:25152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787831271.782780:0:25152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787831271.782787:0:25152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787831271.782885:0:24321:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787831271.782893:0:24321:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aeaf12e9/0x95459fb9d1d2ab3f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831271.782903:0:24321:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=562s v=(0 0) 00010000:00010000:2.0:1787831271.782906:0:24321:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787831271.782911:0:24321:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aeaf12e9/0x95459fb9d1d2ab3f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831271.782922:0:24321:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aeaf12e9/0x95459fb9d1d2ab3f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831271.782929:0:24321:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aeaf12e9/0x95459fb9d1d2ab3f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831271.782936:0:24321:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aeaf12e9/0x95459fb9d1d2ab3f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831271.782965:0:24321:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:2.0:1787831271.783004:0:24321:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:34 00010000:00010000:0.0:1787831271.783062:0:22804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787831271.783067:0:22804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aeaf12e9/0x95459fb9d1d2ab3f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.783075:0:22804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22039c0800 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:0.0:1787831271.783078:0:22804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aeaf12e9/0x95459fb9d1d2ab3f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.783085:0:22804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aeaf12e9/0x95459fb9d1d2ab3f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831271.783097:0:22804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aeaf12e9/0x95459fb9d1d2ab3f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831271.783102:0:24321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22046270c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22840:x1874676444008448:12345-0@lo:5:osp-pre-0-0.0 Request processed in 117273us (117547us total) trans 0 rc 0/0 00010000:00010000:0.0:1787831271.783104:0:22804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aeaf12e9/0x95459fb9d1d2ab3f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831271.783112:0:24321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:0.0:1787831271.783117:0:22804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787831271.783118:0:22804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787831271.783120:0:22804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787831271.784275:0:22840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204627480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22840:1874676444008448:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1787831271.784294:0:22840:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x41:0x0] from OST, last_created [0x280000401:0x41:0x0]last_used is [0x280000401:0x22:0x0] 00000100:00100000:1.0:1787831271.784338:0:22840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233fb43840 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22840:1874676444008960:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1787831271.784382:0:22840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831271.784414:0:22840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d23088ad9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787831271.784431:0:24319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444008960 00000100:00100000:0.0:1787831271.784438:0:24319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444008960 00000100:00100000:0.0:1787831271.784478:0:24319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787831271.784487:0:24319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb42d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:22840:x1874676444008960:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1787831271.784525:0:24319:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 66 00000001:00080000:1.0:1787831271.787675:0:25136:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901890 is committed 00000001:00100000:1.0:1787831271.787730:0:25136:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1787831271.788050:0:25005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb1de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:22842:x1874676444008832:12345-0@lo:5:osp-pre-1-0.0 Request processed in 10127us (10299us total) trans 12884901890 rc 0/0 00000100:00100000:1.0:1787831271.788061:0:25005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787831271.788155:0:22842:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:2.0:1787831271.788163:0:22842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233fb1e1c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22842:1874676444008832:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1787831271.788190:0:22842:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x41:0x0]-[0x2c0000401:0x61:0x0] 00000001:00080000:0.0:1787831271.796888:0:24316:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901890 is committed 00000001:00100000:0.0:1787831271.796937:0:24316:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1787831271.798496:0:24319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb42d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:22840:x1874676444008960:12345-0@lo:5:osp-pre-0-0.0 Request processed in 14003us (14107us total) trans 12884901890 rc 0/0 00000100:00100000:2.0:1787831271.798508:0:24319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787831271.798578:0:22840:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:1.0:1787831271.798587:0:22840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233fb43840 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22840:1874676444008960:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1787831271.798605:0:22840:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x41:0x0]-[0x280000401:0x61:0x0] 00000020:00000004:1.0:1787831271.832072:0:25544:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787831271.832304:0:25544:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787831272.041086:0:22805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787831272.708772:0:25594:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787831272.709267:0:25594:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1787831273.010438:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831273.010517:0:22808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433451648 00000100:00100000:3.0:1787831273.010528:0:22808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433451648 00000100:00100000:3.0:1787831273.010587:0:22808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 115 00000100:00100000:3.0:1787831273.010597:0:22808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2320286450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2393:x1874676433451648:12345-192.168.203.31@tcp:250:mount.lustre.0 00010000:00080000:3.0:1787831273.010658:0:22808:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from c04154b7-8c89-4cf2-a4c4-5dd132db0903@192.168.203.31@tcp t0 exp 0000000000000000 cur 564 last 0 00000020:00000080:3.0:1787831273.010703:0:22808:0:(genops.c:1385:class_connect()) connect: client c04154b7-8c89-4cf2-a4c4-5dd132db0903, cookie 0x95459fb9d1d2ab46 00000100:00080000:3.0:1787831273.010896:0:22808:0:(import.c:65:import_set_state_nolock()) ffff8d220340c000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787831273.011008:0:22808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2320286450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c04154b7-8c89-4cf2-a4c4-5dd132db0903+5:2393:x1874676433451648:12345-192.168.203.31@tcp:250:mount.lustre.0 Request processed in 410us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831273.011016:0:22808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 115 00000100:00100000:3.0:1787831273.014565:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831273.014666:0:22810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433451776 00000100:00100000:1.0:1787831273.014678:0:22810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433451776 00000100:00100000:1.0:1787831273.014739:0:22810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 116 00000100:00100000:1.0:1787831273.014751:0:22810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2320285450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c04154b7-8c89-4cf2-a4c4-5dd132db0903+5:18233:x1874676433451776:12345-192.168.203.31@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787831273.014771:0:22810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787831273.014792:0:22810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d233be94e00/0x95459fb9d1d2ab4d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xe558a92a994243d4 expref: -99 pid: 22810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831273.014828:0:22810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d233be94e00/0x95459fb9d1d2ab4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994243d4 expref: 6 pid: 22810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831273.014840:0:22810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d233be94e00/0x95459fb9d1d2ab4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994243d4 expref: 6 pid: 22810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831273.014850:0:22810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233be94e00, rc 0) 00000100:00100000:1.0:1787831273.014925:0:22810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2320285450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c04154b7-8c89-4cf2-a4c4-5dd132db0903+6:18233:x1874676433451776:12345-192.168.203.31@tcp:101:mount.lustre.0 Request processed in 177us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831273.014933:0:22810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 116 00000100:00100000:3.0:1787831273.017978:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831273.019245:0:22809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433451904 00000100:00100000:0.0:1787831273.019262:0:22809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433451904 00000100:00100000:0.0:1787831273.019342:0:22809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 117 00000100:00100000:0.0:1787831273.019355:0:22809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2320284850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c04154b7-8c89-4cf2-a4c4-5dd132db0903+6:18233:x1874676433451904:12345-192.168.203.31@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787831273.019541:0:22809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2320284850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c04154b7-8c89-4cf2-a4c4-5dd132db0903+6:18233:x1874676433451904:12345-192.168.203.31@tcp:501:mount.lustre.0 Request processed in 188us (1579us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787831273.019551:0:22809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 117 00000100:00100000:2.0:1787831273.028818:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831273.028881:0:22808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433452032 00000100:00100000:3.0:1787831273.028894:0:22808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433452032 00000100:00100000:3.0:1787831273.028977:0:22808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 118 00000100:00100000:3.0:1787831273.028992:0:22808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2320284450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c04154b7-8c89-4cf2-a4c4-5dd132db0903+6:18233:x1874676433452032:12345-192.168.203.31@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787831273.029014:0:22808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787831273.029036:0:22808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d233837a400/0x95459fb9d1d2ab54 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xe558a92a994243db expref: -99 pid: 22808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831273.029075:0:22808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d233837a400/0x95459fb9d1d2ab54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994243db expref: 7 pid: 22808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831273.029109:0:22808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d233837a400/0x95459fb9d1d2ab54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994243db expref: 7 pid: 22808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831273.029121:0:22808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233837a400, rc 0) 00000100:00100000:3.0:1787831273.029219:0:22808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2320284450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c04154b7-8c89-4cf2-a4c4-5dd132db0903+7:18233:x1874676433452032:12345-192.168.203.31@tcp:101:mount.lustre.0 Request processed in 229us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831273.029227:0:22808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 118 00000100:00100000:3.0:1787831273.033177:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831273.033364:0:22810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433452160 00000100:00100000:1.0:1787831273.033375:0:22810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433452160 00000100:00100000:1.0:1787831273.033538:0:22810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 119 00000100:00100000:1.0:1787831273.033549:0:22810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2320287050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c04154b7-8c89-4cf2-a4c4-5dd132db0903+7:18233:x1874676433452160:12345-192.168.203.31@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787831273.033817:0:22810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2320287050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c04154b7-8c89-4cf2-a4c4-5dd132db0903+8:18233:x1874676433452160:12345-192.168.203.31@tcp:501:mount.lustre.0 Request processed in 269us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831273.033830:0:22810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 119 00000100:00100000:1.0:1787831273.038575:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831273.039682:0:22809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433452288 00000100:00100000:0.0:1787831273.039701:0:22809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433452288 00000100:00100000:0.0:1787831273.039788:0:22809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 120 00000100:00100000:0.0:1787831273.039800:0:22809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2320284050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c04154b7-8c89-4cf2-a4c4-5dd132db0903+8:18233:x1874676433452288:12345-192.168.203.31@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787831273.040920:0:22809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2320284050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c04154b7-8c89-4cf2-a4c4-5dd132db0903+8:18233:x1874676433452288:12345-192.168.203.31@tcp:503:mount.lustre.0 Request processed in 1113us (2351us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831273.040934:0:22809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 120 00000100:00100000:2.0:1787831273.049608:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831273.049884:0:22810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433452416 00000100:00100000:1.0:1787831273.049897:0:22810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433452416 00000100:00100000:1.0:1787831273.049984:0:22810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 121 00000100:00100000:1.0:1787831273.049996:0:22810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2320284c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c04154b7-8c89-4cf2-a4c4-5dd132db0903+8:18251:x1874676433452416:12345-192.168.203.31@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787831273.050216:0:22810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2320284c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c04154b7-8c89-4cf2-a4c4-5dd132db0903+8:18251:x1874676433452416:12345-192.168.203.31@tcp:502:llog_process_th.0 Request processed in 222us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831273.050226:0:22810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 121 00010000:00010000:0.0:1787831273.063261:0:25152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787831273.107679:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831273.107810:0:22809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433452544 00000100:00100000:0.0:1787831273.107823:0:22809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433452544 00000100:00100000:0.0:1787831273.107891:0:22809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 122 00000100:00100000:0.0:1787831273.107903:0:22809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2320287c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c04154b7-8c89-4cf2-a4c4-5dd132db0903+8:18251:x1874676433452544:12345-192.168.203.31@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787831273.108126:0:22809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2320287c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c04154b7-8c89-4cf2-a4c4-5dd132db0903+8:18251:x1874676433452544:12345-192.168.203.31@tcp:502:llog_process_th.0 Request processed in 225us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831273.108136:0:22809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 122 00000100:00100000:3.0:1787831273.125380:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831273.126506:0:22810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433452672 00000100:00100000:1.0:1787831273.126665:0:22810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433452672 00000100:00100000:1.0:1787831273.126930:0:22810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 123 00000100:00100000:1.0:1787831273.126943:0:22810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203901050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c04154b7-8c89-4cf2-a4c4-5dd132db0903+8:18251:x1874676433452672:12345-192.168.203.31@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787831273.127199:0:22810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203901050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c04154b7-8c89-4cf2-a4c4-5dd132db0903+8:18251:x1874676433452672:12345-192.168.203.31@tcp:502:llog_process_th.0 Request processed in 257us (1833us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831273.127208:0:22810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 123 00000100:00100000:2.0:1787831273.137382:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831273.140017:0:22808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433452800 00000100:00100000:1.0:1787831273.140039:0:22808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433452800 00000100:00100000:1.0:1787831273.140212:0:22808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 124 00000100:00100000:1.0:1787831273.140225:0:22808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203902050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c04154b7-8c89-4cf2-a4c4-5dd132db0903+8:18233:x1874676433452800:12345-192.168.203.31@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787831273.140248:0:22808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787831273.140272:0:22808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d233be94800/0x95459fb9d1d2ab5b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe558a92a9942440c expref: -99 pid: 22808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831273.140311:0:22808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d233be94800/0x95459fb9d1d2ab5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a9942440c expref: 9 pid: 22808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831273.140323:0:22808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d233be94800/0x95459fb9d1d2ab5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a9942440c expref: 9 pid: 22808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831273.140353:0:22808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233be94800, rc 0) 00000100:00100000:1.0:1787831273.140461:0:22808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203902050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c04154b7-8c89-4cf2-a4c4-5dd132db0903+9:18233:x1874676433452800:12345-192.168.203.31@tcp:101:mount.lustre.0 Request processed in 239us (3096us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831273.140470:0:22808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 124 00000100:00100000:3.0:1787831273.144196:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831273.144368:0:22809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433452928 00000100:00100000:0.0:1787831273.144382:0:22809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433452928 00000100:00100000:0.0:1787831273.144489:0:22809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 125 00000100:00100000:0.0:1787831273.144510:0:22809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203901850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c04154b7-8c89-4cf2-a4c4-5dd132db0903+9:18233:x1874676433452928:12345-192.168.203.31@tcp:256:mount.lustre.0 20000000:01000000:0.0:1787831273.144544:0:22809:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1787831273.144566:0:22809:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787831273.144571:0:22809:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1787831273.144575:0:22809:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1787831273.144579:0:22809:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1787831273.144581:0:22809:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:0.0:1787831273.146768:0:22809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203901850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c04154b7-8c89-4cf2-a4c4-5dd132db0903+9:18233:x1874676433452928:12345-192.168.203.31@tcp:256:mount.lustre.0 Request processed in 2256us (2575us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831273.146786:0:22809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 125 00000100:00100000:2.0:1787831273.150613:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831273.150831:0:22810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433453056 00000100:00100000:1.0:1787831273.150844:0:22810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433453056 00000100:00100000:1.0:1787831273.150916:0:22810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 126 00000100:00100000:1.0:1787831273.150927:0:22810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203901450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c04154b7-8c89-4cf2-a4c4-5dd132db0903+9:18233:x1874676433453056:12345-192.168.203.31@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787831273.150960:0:22810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787831273.150985:0:22810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d233be94a00/0x95459fb9d1d2ab62 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe558a92a99424413 expref: -99 pid: 22810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831273.151024:0:22810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d233be94a00/0x95459fb9d1d2ab62 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424413 expref: 10 pid: 22810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831273.151037:0:22810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d233be94a00/0x95459fb9d1d2ab62 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424413 expref: 10 pid: 22810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831273.151048:0:22810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233be94a00, rc 0) 00000100:00100000:1.0:1787831273.151120:0:22810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203901450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c04154b7-8c89-4cf2-a4c4-5dd132db0903+10:18233:x1874676433453056:12345-192.168.203.31@tcp:101:mount.lustre.0 Request processed in 195us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831273.151128:0:22810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 126 00000100:00100000:3.0:1787831273.154051:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831273.154237:0:22809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433453184 00000100:00100000:1.0:1787831273.154249:0:22809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433453184 00000100:00100000:1.0:1787831273.154316:0:22809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 127 00000100:00100000:1.0:1787831273.154327:0:22809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203902850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c04154b7-8c89-4cf2-a4c4-5dd132db0903+10:18233:x1874676433453184:12345-192.168.203.31@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787831273.154831:0:22809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203902850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c04154b7-8c89-4cf2-a4c4-5dd132db0903+10:18233:x1874676433453184:12345-192.168.203.31@tcp:501:mount.lustre.0 Request processed in 504us (792us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831273.154842:0:22809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 127 00000100:00100000:3.0:1787831273.157222:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831273.157369:0:22808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433453312 00000100:00100000:2.0:1787831273.157380:0:22808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433453312 00000100:00100000:2.0:1787831273.157461:0:22808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 128 00000100:00100000:2.0:1787831273.157473:0:22808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d23061c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c04154b7-8c89-4cf2-a4c4-5dd132db0903+10:18233:x1874676433453312:12345-192.168.203.31@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787831273.157720:0:22808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d23061c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c04154b7-8c89-4cf2-a4c4-5dd132db0903+10:18233:x1874676433453312:12345-192.168.203.31@tcp:503:mount.lustre.0 Request processed in 249us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831273.157729:0:22808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 128 00000100:00100000:3.0:1787831273.161865:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831273.162113:0:22810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433453440 00000100:00100000:2.0:1787831273.162126:0:22810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433453440 00000100:00100000:2.0:1787831273.162252:0:22810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 129 00000100:00100000:2.0:1787831273.162264:0:22810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d23061c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c04154b7-8c89-4cf2-a4c4-5dd132db0903+10:18259:x1874676433453440:12345-192.168.203.31@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787831273.162487:0:22810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d23061c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c04154b7-8c89-4cf2-a4c4-5dd132db0903+10:18259:x1874676433453440:12345-192.168.203.31@tcp:502:llog_process_th.0 Request processed in 224us (636us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831273.162496:0:22810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 129 00000100:00100000:3.0:1787831273.169274:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831273.169419:0:22810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433453568 00000100:00100000:2.0:1787831273.169450:0:22810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433453568 00000100:00100000:2.0:1787831273.169523:0:22810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 130 00000100:00100000:2.0:1787831273.169534:0:22810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d23061c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c04154b7-8c89-4cf2-a4c4-5dd132db0903+10:18259:x1874676433453568:12345-192.168.203.31@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787831273.169715:0:22810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d23061c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c04154b7-8c89-4cf2-a4c4-5dd132db0903+10:18259:x1874676433453568:12345-192.168.203.31@tcp:502:llog_process_th.0 Request processed in 183us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831273.169723:0:22810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 130 00000100:00100000:3.0:1787831273.178787:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831273.178900:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831273.179296:0:22815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433453696 00000100:00100000:1.0:1787831273.179309:0:22815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433453696 00000100:00100000:1.0:1787831273.179364:0:22815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433453952 00000100:00100000:1.0:1787831273.179366:0:22815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433453952 00000100:00100000:1.0:1787831273.179392:0:22815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 7 00000100:00100000:1.0:1787831273.179408:0:22815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204624780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2393:x1874676433453696:12345-192.168.203.31@tcp:38:mount.lustre.0 00010000:00080000:1.0:1787831273.179447:0:22815:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 805921bb-0b9c-4b6e-91c0-2cd3c152e40d@192.168.203.31@tcp t0 exp 0000000000000000 cur 564 last 0 00000020:00000080:1.0:1787831273.179509:0:22815:0:(genops.c:1385:class_connect()) connect: client 805921bb-0b9c-4b6e-91c0-2cd3c152e40d, cookie 0x95459fb9d1d2ab69 00000004:00100000:1.0:1787831273.179542:0:22815:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return 37 00000100:00080000:1.0:1787831273.179848:0:22815:0:(import.c:65:import_set_state_nolock()) ffff8d2203878800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787831273.179934:0:22815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204624780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+6:2393:x1874676433453696:12345-192.168.203.31@tcp:38:mount.lustre.0 Request processed in 524us (1160us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831273.179942:0:22815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 7 00000100:00100000:3.0:1787831273.180106:0:22816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 8 00000100:00100000:3.0:1787831273.180114:0:22816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204627c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2393:x1874676433453952:12345-192.168.203.31@tcp:38:mount.lustre.0 00010000:00080000:3.0:1787831273.180137:0:22816:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 805921bb-0b9c-4b6e-91c0-2cd3c152e40d@192.168.203.31@tcp t0 exp 0000000000000000 cur 564 last 0 00000020:00000080:3.0:1787831273.180184:0:22816:0:(genops.c:1385:class_connect()) connect: client 805921bb-0b9c-4b6e-91c0-2cd3c152e40d, cookie 0x95459fb9d1d2ab70 00000004:00100000:3.0:1787831273.180202:0:22816:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return 37 00000100:00080000:3.0:1787831273.180385:0:22816:0:(import.c:65:import_set_state_nolock()) ffff8d220340f000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787831273.180430:0:22816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204627c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+6:2393:x1874676433453952:12345-192.168.203.31@tcp:38:mount.lustre.0 Request processed in 315us (1529us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831273.180458:0:22816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 8 00000100:00100000:0.0:1787831273.191674:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831273.191783:0:22816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433454208 00000100:00100000:3.0:1787831273.191797:0:22816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433454208 00000100:00100000:3.0:1787831273.191893:0:22816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 9 00000100:00100000:3.0:1787831273.191906:0:22816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203766580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+6:18233:x1874676433454208:12345-192.168.203.31@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787831273.192029:0:22816:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1787831273.192154:0:22816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203766580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+6:18233:x1874676433454208:12345-192.168.203.31@tcp:41:mount.lustre.0 Request processed in 249us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831273.192163:0:22816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 9 00000100:00080000:2.0:1787831273.192972:0:22811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787831273.193287:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831273.193364:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831273.198502:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831273.199718:0:22815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433454080 00000100:00100000:1.0:1787831273.199739:0:22815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433454080 00000100:00100000:1.0:1787831273.199845:0:22815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433453824 00000100:00100000:1.0:1787831273.199849:0:22815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433453824 00000100:00100000:1.0:1787831273.199879:0:22815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 10 00000100:00100000:1.0:1787831273.199891:0:22815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204627480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+6:0:x1874676433454080:12345-192.168.203.31@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787831273.199962:0:22815:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787831273.200096:0:22815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204627480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+6:0:x1874676433454080:12345-192.168.203.31@tcp:41:mount.lustre.0 Request processed in 206us (6811us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831273.200104:0:22815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 10 00000100:00100000:1.0:1787831273.200147:0:22815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 11 00000100:00100000:1.0:1787831273.200155:0:22815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203aff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+6:0:x1874676433453824:12345-192.168.203.31@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787831273.200169:0:22815:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1787831273.200201:0:22815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203aff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+6:0:x1874676433453824:12345-192.168.203.31@tcp:41:mount.lustre.0 Request processed in 47us (6837us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831273.200207:0:22815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 11 00000100:00080000:2.0:1787831273.200559:0:22811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787831273.201975:0:22817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433454336 00000100:00100000:0.0:1787831273.201990:0:22817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433454336 00000100:00100000:1.0:1787831273.202139:0:22815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 12 00000100:00100000:1.0:1787831273.202152:0:22815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203afc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+6:18233:x1874676433454336:12345-192.168.203.31@tcp:40:mount.lustre.0 00000100:00100000:1.0:1787831273.202300:0:22815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203afc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+6:18233:x1874676433454336:12345-192.168.203.31@tcp:40:mount.lustre.0 Request processed in 151us (3813us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831273.202309:0:22815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 12 00000100:00100000:3.0:1787831273.209966:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831273.210058:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831273.210149:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831273.210222:0:24321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433454464 00000100:00100000:0.0:1787831273.210236:0:24321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433454464 00000100:00100000:0.0:1787831273.210280:0:24321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433454592 00000100:00100000:0.0:1787831273.210283:0:24321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433454592 00000100:00100000:0.0:1787831273.210305:0:24321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 16 00000100:00100000:0.0:1787831273.210314:0:24321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203afcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2393:x1874676433454464:12345-192.168.203.31@tcp:8:mount.lustre.0 00010000:00080000:0.0:1787831273.210359:0:24321:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 805921bb-0b9c-4b6e-91c0-2cd3c152e40d@192.168.203.31@tcp t0 exp 0000000000000000 cur 564 last 0 00000020:00000080:0.0:1787831273.210418:0:24321:0:(genops.c:1385:class_connect()) connect: client 805921bb-0b9c-4b6e-91c0-2cd3c152e40d, cookie 0x95459fb9d1d2ab77 00002000:00100000:0.0:1787831273.210434:0:24321:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 805921bb-0b9c-4b6e-91c0-2cd3c152e40d/ffff8d22044d4000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211393d ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787831273.210457:0:24321:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return 37 00002000:00080000:0.0:1787831273.210707:0:24321:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787831273.210749:0:24321:0:(import.c:65:import_set_state_nolock()) ffff8d22044d1800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787831273.214136:0:22826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433454720 00000100:00100000:2.0:1787831273.214158:0:22826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433454720 00000100:00100000:2.0:1787831273.214264:0:22826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 3 00000100:00100000:2.0:1787831273.214275:0:22826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203afde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+6:18233:x1874676433454720:12345-192.168.203.31@tcp:900:mount.lustre.0 00000100:00100000:0.0:1787831273.219841:0:24321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203afcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+6:2393:x1874676433454464:12345-192.168.203.31@tcp:8:mount.lustre.0 Request processed in 9507us (9762us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831273.219886:0:24321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 16 00000100:00100000:0.0:1787831273.219960:0:24321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 17 00000100:00100000:0.0:1787831273.219971:0:24321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203aff0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2393:x1874676433454592:12345-192.168.203.31@tcp:8:mount.lustre.0 00010000:00080000:0.0:1787831273.220023:0:24321:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 805921bb-0b9c-4b6e-91c0-2cd3c152e40d@192.168.203.31@tcp t0 exp 0000000000000000 cur 564 last 0 00000020:00000080:0.0:1787831273.220064:0:24321:0:(genops.c:1385:class_connect()) connect: client 805921bb-0b9c-4b6e-91c0-2cd3c152e40d, cookie 0x95459fb9d1d2ab7e 00002000:00100000:0.0:1787831273.220083:0:24321:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 805921bb-0b9c-4b6e-91c0-2cd3c152e40d/ffff8d22044d0000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211393d ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787831273.220105:0:24321:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return 37 00002000:00080000:0.0:1787831273.220363:0:24321:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787831273.221180:0:24321:0:(import.c:65:import_set_state_nolock()) ffff8d22044d1000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787831273.223142:0:22826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203afde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+6:18233:x1874676433454720:12345-192.168.203.31@tcp:900:mount.lustre.0 Request processed in 8851us (13183us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831273.223164:0:22826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 3 00000100:00100000:0.0:1787831273.225866:0:24321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203aff0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+6:2393:x1874676433454592:12345-192.168.203.31@tcp:8:mount.lustre.0 Request processed in 5877us (15698us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831273.225886:0:24321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 17 00000100:00100000:1.0:1787831273.226141:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831273.227244:0:22818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433454848 00000100:00100000:0.0:1787831273.227261:0:22818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433454848 00000100:00100000:0.0:1787831273.227332:0:22818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 0 00000100:00100000:0.0:1787831273.227345:0:22818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb43840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+6:18233:x1874676433454848:12345-192.168.203.31@tcp:33:mount.lustre.0 00000004:00080000:2.0:1787831273.229491:0:22818:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1406us 00000004:00200000:1.0:1787831273.247298:0:22818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1787831273.247490:0:22818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb43840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+6:18233:x1874676433454848:12345-192.168.203.31@tcp:33:mount.lustre.0 Request processed in 20139us (21342us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831273.247511:0:22818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 0 00000100:00100000:2.0:1787831273.414735:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831273.414928:0:22816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433454976 00000100:00100000:1.0:1787831273.414957:0:22816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433454976 00000100:00100000:1.0:1787831273.415048:0:22816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 13 00000100:00100000:1.0:1787831273.415060:0:22816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb1e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+6:18282:x1874676433454976:12345-192.168.203.31@tcp:101:mkdir.0 00010000:00010000:1.0:1787831273.415091:0:22816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787831273.415131:0:22816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95200/0x95459fb9d1d2ab85 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99424444 expref: -99 pid: 22816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831273.415223:0:22816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95c00/0x95459fb9d1d2ab8c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831273.415257:0:22816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95c00/0x95459fb9d1d2ab8c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831273.415275:0:22816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95c00/0x95459fb9d1d2ab8c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787831273.415336:0:22816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787831273.415341:0:22816:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787831273.415388:0:22816:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95c00/0x95459fb9d1d2ab8c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831273.415433:0:22816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95200/0x95459fb9d1d2ab85 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424444 expref: 8 pid: 22816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831273.415455:0:22816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95c00/0x95459fb9d1d2ab8c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424444 expref: 7 pid: 22816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831273.415464:0:22816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d22035dcb00) 00010000:00010000:1.0:1787831273.415467:0:22816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787831273.415471:0:22816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233be95c00, rc 0) 00000100:00100000:1.0:1787831273.415548:0:22816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb1e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+7:18282:x1874676433454976:12345-192.168.203.31@tcp:101:mkdir.0 Request processed in 489us (830us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831273.415557:0:22816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 13 00000100:00100000:2.0:1787831273.703284:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203764000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676444009088:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787831273.703387:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831273.703459:0:24324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444009088 00000100:00100000:3.0:1787831273.703469:0:24324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444009088 00000100:00100000:3.0:1787831273.703620:0:24324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787831273.703656:0:24324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb1f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676444009088:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787831273.703689:0:24324:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787831273.703764:0:24324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb1f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676444009088:12345-0@lo:13:osp-pre-0-1.0 Request processed in 111us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831273.703772:0:24324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787831273.703893:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203764000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676444009088:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1787831273.707036:0:22811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787831274.087054:0:22804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787831274.215067:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203aff840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676444009216:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787831274.215223:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831274.215495:0:23556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444009216 00000100:00100000:2.0:1787831274.215505:0:23556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444009216 00000100:00100000:2.0:1787831274.215572:0:23556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787831274.215593:0:23556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb40f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676444009216:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787831274.215663:0:23556:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787831274.219362:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203764000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1874676444009344:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787831274.219511:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831274.221339:0:22821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444009344 00000100:00100000:1.0:1787831274.221357:0:22821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444009344 00000100:00100000:1.0:1787831274.221434:0:22821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787831274.221463:0:22821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203affc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1874676444009344:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787831274.221520:0:22821:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1787831274.221643:0:22821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203affc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1874676444009344:12345-0@lo:41:osp-pre-0-1.0 Request processed in 166us (2116us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831274.221651:0:22821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787831274.223401:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203764000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1874676444009344:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787831274.225238:0:23556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb40f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676444009216:12345-0@lo:41:osp-pre-1-0.0 Request processed in 9644us (10002us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831274.225277:0:23556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787831274.232401:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203aff840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676444009216:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787831275.110867:0:22805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787831275.556577:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831275.556697:0:22817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433455104 00000100:00100000:1.0:1787831275.556714:0:22817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433455104 00000100:00100000:1.0:1787831275.556834:0:22817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 14 00000100:00100000:1.0:1787831275.556846:0:22817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203764000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+7:18334:x1874676433455104:12345-192.168.203.31@tcp:41:lfs.0 00000004:00000024:1.0:1787831275.556900:0:22817:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1787831275.557045:0:22817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203764000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+7:18334:x1874676433455104:12345-192.168.203.31@tcp:41:lfs.0 Request processed in 201us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831275.557054:0:22817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 14 00000100:00080000:2.0:1787831275.557176:0:22811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787831275.562012:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831275.562322:0:22816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433455232 00000100:00100000:1.0:1787831275.562333:0:22816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433455232 00000100:00100000:1.0:1787831275.562442:0:22816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 15 00000100:00100000:1.0:1787831275.562453:0:22816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22037661c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+6:18334:x1874676433455232:12345-192.168.203.31@tcp:41:lfs.0 00000004:00000024:1.0:1787831275.562492:0:22816:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00080000:2.0:1787831275.562662:0:22811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787831275.563005:0:22816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22037661c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+6:18334:x1874676433455232:12345-192.168.203.31@tcp:41:lfs.0 Request processed in 553us (1001us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831275.563013:0:22816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 15 00000100:00100000:2.0:1787831275.582104:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831275.582205:0:24323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433455360 00000100:00100000:1.0:1787831275.582215:0:24323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433455360 00000100:00100000:1.0:1787831275.582287:0:24323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 6 00000100:00100000:1.0:1787831275.582298:0:24323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb1ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+6:18334:x1874676433455360:12345-192.168.203.31@tcp:13:lfs.0 00002000:00000024:1.0:1787831275.582340:0:24323:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00080000:2.0:1787831275.582499:0:22811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787831275.582607:0:24323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb1ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+6:18334:x1874676433455360:12345-192.168.203.31@tcp:13:lfs.0 Request processed in 311us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831275.582615:0:24323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 6 00000100:00100000:0.0:1787831275.587717:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831275.587843:0:24324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433455488 00000100:00100000:3.0:1787831275.587852:0:24324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433455488 00000100:00100000:3.0:1787831275.587920:0:24324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 7 00000100:00100000:3.0:1787831275.587940:0:24324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203764f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+6:18334:x1874676433455488:12345-192.168.203.31@tcp:13:lfs.0 00002000:00000024:3.0:1787831275.587974:0:24324:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923501056 avail 3691978752 00000100:00100000:3.0:1787831275.588088:0:24324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203764f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+6:18334:x1874676433455488:12345-192.168.203.31@tcp:13:lfs.0 Request processed in 159us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831275.588096:0:24324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 7 00000100:00080000:2.0:1787831275.588166:0:22811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787831275.751323:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787831275.751348:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233fb43c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676444009472:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787831275.751432:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831275.751550:0:24324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444009472 00000100:00100000:1.0:1787831275.751558:0:24324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444009472 00000100:00100000:1.0:1787831275.751621:0:24324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787831275.752020:0:24324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220483da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676444009472:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787831275.752045:0:24324:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923501056 avail 3691978752 00000100:00100000:1.0:1787831275.752098:0:24324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220483da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676444009472:12345-0@lo:13:osp-pre-1-1.0 Request processed in 452us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831275.752106:0:24324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787831275.752156:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233fb43c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676444009472:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1787831275.752876:0:22811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787831275.928392:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831275.928764:0:22810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433455616 00000100:00100000:2.0:1787831275.928776:0:22810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433455616 00000100:00100000:2.0:1787831275.928835:0:22810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 131 00000100:00100000:2.0:1787831275.928845:0:22810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d23061c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c04154b7-8c89-4cf2-a4c4-5dd132db0903+10:18369:x1874676433455616:12345-192.168.203.31@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787831275.928860:0:22810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787831275.928878:0:22810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d22039c1400/0x95459fb9d1d2ab93 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xe558a92a9942444b expref: -99 pid: 22810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831275.928906:0:22810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22039c1400/0x95459fb9d1d2ab93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a9942444b expref: 11 pid: 22810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831275.928918:0:22810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d22039c1400/0x95459fb9d1d2ab93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a9942444b expref: 11 pid: 22810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831275.929108:0:22810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22039c1400, rc 0) 00000100:00100000:2.0:1787831275.929214:0:22810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d23061c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c04154b7-8c89-4cf2-a4c4-5dd132db0903+11:18369:x1874676433455616:12345-192.168.203.31@tcp:101:mount.lustre.0 Request processed in 369us (840us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831275.929222:0:22810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 131 00000100:00100000:0.0:1787831275.955426:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831275.955561:0:22809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433455744 00000100:00100000:1.0:1787831275.955572:0:22809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433455744 00000100:00100000:1.0:1787831275.955649:0:22809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 132 00000100:00100000:1.0:1787831275.955659:0:22809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d23061c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c04154b7-8c89-4cf2-a4c4-5dd132db0903+11:18369:x1874676433455744:12345-192.168.203.31@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787831275.955824:0:22809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d23061c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c04154b7-8c89-4cf2-a4c4-5dd132db0903+11:18369:x1874676433455744:12345-192.168.203.31@tcp:501:mount.lustre.0 Request processed in 166us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831275.955830:0:22809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 132 00000100:00100000:1.0:1787831275.959259:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831275.959876:0:22810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433455872 00000100:00100000:2.0:1787831275.959887:0:22810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433455872 00000100:00100000:2.0:1787831275.959964:0:22810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 133 00000100:00100000:2.0:1787831275.959974:0:22810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d23061c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c04154b7-8c89-4cf2-a4c4-5dd132db0903+11:18369:x1874676433455872:12345-192.168.203.31@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787831275.960136:0:22810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d23061c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c04154b7-8c89-4cf2-a4c4-5dd132db0903+11:18369:x1874676433455872:12345-192.168.203.31@tcp:503:mount.lustre.0 Request processed in 163us (885us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831275.960145:0:22810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 133 00000100:00100000:0.0:1787831275.970309:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831275.970417:0:22808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433456000 00000100:00100000:3.0:1787831275.970428:0:22808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433456000 00000100:00100000:3.0:1787831275.970485:0:22808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 134 00000100:00100000:3.0:1787831275.970495:0:22808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d23061c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c04154b7-8c89-4cf2-a4c4-5dd132db0903+11:18373:x1874676433456000:12345-192.168.203.31@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787831275.970680:0:22808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d23061c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c04154b7-8c89-4cf2-a4c4-5dd132db0903+11:18373:x1874676433456000:12345-192.168.203.31@tcp:502:llog_process_th.0 Request processed in 186us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831275.970688:0:22808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 134 00000100:00100000:0.0:1787831276.024233:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831276.024847:0:22809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433456128 00000100:00100000:1.0:1787831276.025024:0:22809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433456128 00000100:00100000:1.0:1787831276.025166:0:22809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 135 00000100:00100000:1.0:1787831276.025177:0:22809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22025d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c04154b7-8c89-4cf2-a4c4-5dd132db0903+11:18373:x1874676433456128:12345-192.168.203.31@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787831276.025340:0:22809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22025d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c04154b7-8c89-4cf2-a4c4-5dd132db0903+11:18373:x1874676433456128:12345-192.168.203.31@tcp:502:llog_process_th.0 Request processed in 164us (1116us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831276.025349:0:22809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 135 00000100:00100000:1.0:1787831276.046087:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831276.048176:0:22808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433456256 00000100:00100000:3.0:1787831276.048191:0:22808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433456256 00000100:00100000:3.0:1787831276.048260:0:22808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 136 00000100:00100000:3.0:1787831276.048270:0:22808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22025d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c04154b7-8c89-4cf2-a4c4-5dd132db0903+11:18373:x1874676433456256:12345-192.168.203.31@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787831276.048709:0:22808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22025d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c04154b7-8c89-4cf2-a4c4-5dd132db0903+11:18373:x1874676433456256:12345-192.168.203.31@tcp:502:llog_process_th.0 Request processed in 438us (2631us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831276.048718:0:22808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 136 00000100:00100000:0.0:1787831276.058474:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831276.059550:0:22809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433456384 00000100:00100000:1.0:1787831276.059561:0:22809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433456384 00000100:00100000:1.0:1787831276.059615:0:22809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 137 00000100:00100000:1.0:1787831276.059664:0:22809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22025d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c04154b7-8c89-4cf2-a4c4-5dd132db0903+11:18369:x1874676433456384:12345-192.168.203.31@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787831276.059680:0:22809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787831276.059696:0:22809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d233be95000/0x95459fb9d1d2ab9a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe558a92a9942447c expref: -99 pid: 22809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831276.059728:0:22809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d233be95000/0x95459fb9d1d2ab9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a9942447c expref: 12 pid: 22809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831276.059740:0:22809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d233be95000/0x95459fb9d1d2ab9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a9942447c expref: 12 pid: 22809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831276.059748:0:22809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233be95000, rc 0) 00000100:00100000:1.0:1787831276.059812:0:22809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22025d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c04154b7-8c89-4cf2-a4c4-5dd132db0903+12:18369:x1874676433456384:12345-192.168.203.31@tcp:101:mount.lustre.0 Request processed in 189us (1348us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831276.059819:0:22809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 137 00000100:00100000:0.0:1787831276.072129:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831276.072241:0:22808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433456512 00000100:00100000:2.0:1787831276.072251:0:22808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433456512 00000100:00100000:2.0:1787831276.072306:0:22808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 138 00000100:00100000:2.0:1787831276.072317:0:22808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22025d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c04154b7-8c89-4cf2-a4c4-5dd132db0903+12:18369:x1874676433456512:12345-192.168.203.31@tcp:256:mount.lustre.0 20000000:01000000:2.0:1787831276.072346:0:22808:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1787831276.072371:0:22808:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787831276.072376:0:22808:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1787831276.072379:0:22808:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1787831276.072382:0:22808:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1787831276.072385:0:22808:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:2.0:1787831276.075544:0:22808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22025d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c04154b7-8c89-4cf2-a4c4-5dd132db0903+12:18369:x1874676433456512:12345-192.168.203.31@tcp:256:mount.lustre.0 Request processed in 3219us (3413us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831276.075559:0:22808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 138 00000100:00100000:0.0:1787831276.087003:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831276.088605:0:22810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433456640 00000100:00100000:2.0:1787831276.088618:0:22810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433456640 00000100:00100000:2.0:1787831276.088734:0:22810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 139 00000100:00100000:2.0:1787831276.088746:0:22810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22025d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c04154b7-8c89-4cf2-a4c4-5dd132db0903+12:18369:x1874676433456640:12345-192.168.203.31@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787831276.088763:0:22810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787831276.088781:0:22810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d22039c0600/0x95459fb9d1d2aba1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xe558a92a99424483 expref: -99 pid: 22810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831276.088810:0:22810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22039c0600/0x95459fb9d1d2aba1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424483 expref: 13 pid: 22810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831276.088840:0:22810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d22039c0600/0x95459fb9d1d2aba1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424483 expref: 13 pid: 22810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831276.088849:0:22810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22039c0600, rc 0) 00000100:00100000:2.0:1787831276.088915:0:22810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22025d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c04154b7-8c89-4cf2-a4c4-5dd132db0903+13:18369:x1874676433456640:12345-192.168.203.31@tcp:101:mount.lustre.0 Request processed in 171us (1922us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831276.089797:0:22810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 139 00000100:00100000:0.0:1787831276.093583:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831276.095040:0:22808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433456768 00000100:00100000:2.0:1787831276.095051:0:22808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433456768 00000100:00100000:2.0:1787831276.095110:0:22808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 140 00000100:00100000:2.0:1787831276.095119:0:22808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22025d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c04154b7-8c89-4cf2-a4c4-5dd132db0903+13:18369:x1874676433456768:12345-192.168.203.31@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787831276.095265:0:22808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22025d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c04154b7-8c89-4cf2-a4c4-5dd132db0903+13:18369:x1874676433456768:12345-192.168.203.31@tcp:501:mount.lustre.0 Request processed in 142us (1686us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831276.095272:0:22808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 140 00000100:00100000:3.0:1787831276.097105:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831276.097580:0:22810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433456896 00000100:00100000:1.0:1787831276.097590:0:22810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433456896 00000100:00100000:1.0:1787831276.097694:0:22810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 141 00000100:00100000:1.0:1787831276.097704:0:22810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22025d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c04154b7-8c89-4cf2-a4c4-5dd132db0903+13:18369:x1874676433456896:12345-192.168.203.31@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787831276.097843:0:22810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22025d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c04154b7-8c89-4cf2-a4c4-5dd132db0903+13:18369:x1874676433456896:12345-192.168.203.31@tcp:503:mount.lustre.0 Request processed in 140us (745us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831276.097851:0:22810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 141 00000100:00100000:0.0:1787831276.111802:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831276.112764:0:22809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433457024 00000100:00100000:1.0:1787831276.112775:0:22809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433457024 00000100:00100000:1.0:1787831276.112836:0:22809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 142 00000100:00100000:1.0:1787831276.112847:0:22809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22025d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c04154b7-8c89-4cf2-a4c4-5dd132db0903+13:18377:x1874676433457024:12345-192.168.203.31@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787831276.113026:0:22809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22025d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c04154b7-8c89-4cf2-a4c4-5dd132db0903+13:18377:x1874676433457024:12345-192.168.203.31@tcp:502:llog_process_th.0 Request processed in 181us (1233us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831276.113034:0:22809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 142 00000100:00100000:0.0:1787831276.116579:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831276.123032:0:22808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433457152 00000100:00100000:2.0:1787831276.123046:0:22808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433457152 00000100:00100000:2.0:1787831276.123117:0:22808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 143 00000100:00100000:2.0:1787831276.123128:0:22808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22025d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c04154b7-8c89-4cf2-a4c4-5dd132db0903+13:18377:x1874676433457152:12345-192.168.203.31@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787831276.123281:0:22808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22025d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c04154b7-8c89-4cf2-a4c4-5dd132db0903+13:18377:x1874676433457152:12345-192.168.203.31@tcp:502:llog_process_th.0 Request processed in 154us (6709us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831276.123288:0:22808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 143 00000100:00100000:0.0:1787831276.128942:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831276.129461:0:22851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433457280 00000100:00100000:3.0:1787831276.129471:0:22851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433457280 00000100:00100000:3.0:1787831276.129524:0:22851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 16 00000100:00100000:3.0:1787831276.129532:0:22851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220483f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2393:x1874676433457280:12345-192.168.203.31@tcp:38:mount.lustre.0 00010000:00080000:3.0:1787831276.129560:0:22851:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 7c60c7f3-708e-4896-8908-a503cf94fb51@192.168.203.31@tcp t0 exp 0000000000000000 cur 567 last 0 00000020:00000080:3.0:1787831276.129617:0:22851:0:(genops.c:1385:class_connect()) connect: client 7c60c7f3-708e-4896-8908-a503cf94fb51, cookie 0x95459fb9d1d2aba8 00000004:00100000:3.0:1787831276.131308:0:22851:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return 37 00000100:00080000:3.0:1787831276.131428:0:22851:0:(import.c:65:import_set_state_nolock()) ffff8d2201d98800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787831276.131511:0:22851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220483f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c60c7f3-708e-4896-8908-a503cf94fb51+6:2393:x1874676433457280:12345-192.168.203.31@tcp:38:mount.lustre.0 Request processed in 1975us (2585us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831276.131523:0:22851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 16 00000100:00100000:1.0:1787831276.135918:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831276.135962:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831276.135980:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831276.136002:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831276.136025:0:25005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433458176 00000100:00100000:1.0:1787831276.136035:0:25005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433458176 00000100:00100000:1.0:1787831276.136083:0:25005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433458304 00000100:00100000:1.0:1787831276.136086:0:25005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433458304 00000100:00100000:1.0:1787831276.136103:0:25005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 4 00000100:00100000:1.0:1787831276.136111:0:25005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb430c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+6:2395:x1874676433458176:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1787831276.136175:0:25005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb430c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+6:2395:x1874676433458176:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 65us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831276.136182:0:25005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 4 00000100:00100000:1.0:1787831276.136196:0:25005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 5 00000100:00100000:1.0:1787831276.136201:0:25005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb40b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+6:2395:x1874676433458304:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1787831276.136234:0:25005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb40b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+6:2395:x1874676433458304:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 33us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831276.136240:0:25005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 5 00000100:00100000:1.0:1787831276.136255:0:22816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433457920 00000100:00100000:1.0:1787831276.136257:0:22816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433457920 00000100:00100000:1.0:1787831276.136286:0:22816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433458048 00000100:00100000:1.0:1787831276.136289:0:22816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433458048 00000100:00100000:1.0:1787831276.136303:0:22816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 38 00000100:00100000:1.0:1787831276.136309:0:22816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb43c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+7:2395:x1874676433457920:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1787831276.136331:0:22816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb43c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+7:2395:x1874676433457920:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 23us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831276.136337:0:22816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 38 00000100:00100000:1.0:1787831276.136346:0:22816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 39 00000100:00100000:1.0:1787831276.136351:0:22816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+6:2395:x1874676433458048:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1787831276.136367:0:22816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+6:2395:x1874676433458048:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 16us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831276.136381:0:22816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 39 00010000:00010000:0.0:1787831276.136814:0:25152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787831276.143691:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831276.145712:0:22816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433457536 00000100:00100000:1.0:1787831276.145726:0:22816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433457536 00000100:00100000:1.0:1787831276.145785:0:22816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 17 00000100:00100000:1.0:1787831276.145792:0:22816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220442c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2393:x1874676433457536:12345-192.168.203.31@tcp:38:mount.lustre.0 00010000:00080000:1.0:1787831276.145824:0:22816:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 7c60c7f3-708e-4896-8908-a503cf94fb51@192.168.203.31@tcp t0 exp 0000000000000000 cur 567 last 0 00000020:00000080:1.0:1787831276.145885:0:22816:0:(genops.c:1385:class_connect()) connect: client 7c60c7f3-708e-4896-8908-a503cf94fb51, cookie 0x95459fb9d1d2abaf 00000004:00100000:1.0:1787831276.145911:0:22816:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return 37 00000100:00080000:1.0:1787831276.146017:0:22816:0:(import.c:65:import_set_state_nolock()) ffff8d22029a4000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787831276.146103:0:22816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220442c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c60c7f3-708e-4896-8908-a503cf94fb51+6:2393:x1874676433457536:12345-192.168.203.31@tcp:38:mount.lustre.0 Request processed in 309us (2421us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831276.146111:0:22816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 17 00000100:00100000:0.0:1787831276.147547:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831276.147587:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831276.147668:0:22817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433457408 00000100:00100000:1.0:1787831276.147676:0:22817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433457408 00000100:00100000:1.0:1787831276.147739:0:22817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433457792 00000100:00100000:1.0:1787831276.147751:0:22817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433457792 00000100:00100000:1.0:1787831276.147774:0:22817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 18 00000100:00100000:1.0:1787831276.147782:0:22817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220442c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c60c7f3-708e-4896-8908-a503cf94fb51+7:0:x1874676433457408:12345-192.168.203.31@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787831276.147827:0:22817:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1787831276.148023:0:22817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220442c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c60c7f3-708e-4896-8908-a503cf94fb51+7:0:x1874676433457408:12345-192.168.203.31@tcp:41:mount.lustre.0 Request processed in 240us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831276.148031:0:22817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 18 00000100:00100000:1.0:1787831276.148050:0:22817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 19 00000100:00100000:1.0:1787831276.148056:0:22817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220442fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c60c7f3-708e-4896-8908-a503cf94fb51+6:18369:x1874676433457792:12345-192.168.203.31@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787831276.148085:0:22817:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1787831276.148110:0:22817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220442fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c60c7f3-708e-4896-8908-a503cf94fb51+6:18369:x1874676433457792:12345-192.168.203.31@tcp:41:mount.lustre.0 Request processed in 54us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831276.148116:0:22817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 19 00000100:00080000:0.0:1787831276.148681:0:22811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787831276.152424:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831276.152672:0:22817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433458432 00000100:00100000:1.0:1787831276.152682:0:22817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433458432 00000100:00100000:1.0:1787831276.152738:0:22817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 20 00000100:00100000:1.0:1787831276.152758:0:22817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220442e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c60c7f3-708e-4896-8908-a503cf94fb51+6:18369:x1874676433458432:12345-192.168.203.31@tcp:40:mount.lustre.0 00000100:00100000:1.0:1787831276.152841:0:22817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220442e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c60c7f3-708e-4896-8908-a503cf94fb51+6:18369:x1874676433458432:12345-192.168.203.31@tcp:40:mount.lustre.0 Request processed in 95us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831276.152847:0:22817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 20 00000100:00100000:0.0:1787831276.165165:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831276.165282:0:22826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433458816 00000100:00100000:2.0:1787831276.165293:0:22826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433458816 00000100:00100000:2.0:1787831276.165354:0:22826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 4 00000100:00100000:2.0:1787831276.165364:0:22826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220442e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:7c60c7f3-708e-4896-8908-a503cf94fb51+6:18369:x1874676433458816:12345-192.168.203.31@tcp:900:mount.lustre.0 00000100:00100000:2.0:1787831276.165488:0:22826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220442e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:7c60c7f3-708e-4896-8908-a503cf94fb51+6:18369:x1874676433458816:12345-192.168.203.31@tcp:900:mount.lustre.0 Request processed in 125us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831276.165497:0:22826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 4 00000100:00100000:0.0:1787831276.172360:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831276.172532:0:22819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433458944 00000100:00100000:1.0:1787831276.172542:0:22819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433458944 00000100:00100000:1.0:1787831276.172613:0:22819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 1 00000100:00100000:1.0:1787831276.172655:0:22819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220442cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c60c7f3-708e-4896-8908-a503cf94fb51+6:18369:x1874676433458944:12345-192.168.203.31@tcp:33:mount.lustre.0 00000004:00200000:1.0:1787831276.172735:0:22819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1787831276.172830:0:22819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220442cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c60c7f3-708e-4896-8908-a503cf94fb51+6:18369:x1874676433458944:12345-192.168.203.31@tcp:33:mount.lustre.0 Request processed in 209us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831276.172839:0:22819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 1 00000100:00100000:1.0:1787831276.176660:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831276.176706:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831276.176788:0:24321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433458560 00000100:00100000:0.0:1787831276.176797:0:24321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433458560 00000100:00100000:0.0:1787831276.176846:0:24321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433458688 00000100:00100000:0.0:1787831276.176857:0:24321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433458688 00000100:00100000:0.0:1787831276.176883:0:24321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 18 00000100:00100000:0.0:1787831276.176891:0:24321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb41a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2393:x1874676433458560:12345-192.168.203.31@tcp:8:mount.lustre.0 00010000:00080000:0.0:1787831276.176935:0:24321:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 7c60c7f3-708e-4896-8908-a503cf94fb51@192.168.203.31@tcp t0 exp 0000000000000000 cur 567 last 0 00000020:00000080:0.0:1787831276.176976:0:24321:0:(genops.c:1385:class_connect()) connect: client 7c60c7f3-708e-4896-8908-a503cf94fb51, cookie 0x95459fb9d1d2abb6 00002000:00100000:0.0:1787831276.176988:0:24321:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 7c60c7f3-708e-4896-8908-a503cf94fb51/ffff8d22044d2000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211393d ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787831276.177000:0:24321:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return 37 00002000:00080000:0.0:1787831276.177063:0:24321:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787831276.177093:0:24321:0:(import.c:65:import_set_state_nolock()) ffff8d22044d3000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787831276.177097:0:25005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 19 00000100:00100000:2.0:1787831276.177103:0:25005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb412c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2393:x1874676433458688:12345-192.168.203.31@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787831276.177119:0:25005:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 7c60c7f3-708e-4896-8908-a503cf94fb51@192.168.203.31@tcp t0 exp 0000000000000000 cur 567 last 0 00000020:00000080:2.0:1787831276.177135:0:25005:0:(genops.c:1385:class_connect()) connect: client 7c60c7f3-708e-4896-8908-a503cf94fb51, cookie 0x95459fb9d1d2abbd 00002000:00100000:2.0:1787831276.177140:0:25005:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 7c60c7f3-708e-4896-8908-a503cf94fb51/ffff8d231f440000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211393d ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787831276.177146:0:25005:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return 37 00000100:00100000:0.0:1787831276.177155:0:24321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb41a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7c60c7f3-708e-4896-8908-a503cf94fb51+6:2393:x1874676433458560:12345-192.168.203.31@tcp:8:mount.lustre.0 Request processed in 264us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831276.177162:0:24321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 18 00002000:00080000:2.0:1787831276.177180:0:25005:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787831276.177195:0:25005:0:(import.c:65:import_set_state_nolock()) ffff8d2203513000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787831276.177217:0:25005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb412c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7c60c7f3-708e-4896-8908-a503cf94fb51+6:2393:x1874676433458688:12345-192.168.203.31@tcp:8:mount.lustre.0 Request processed in 113us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831276.177223:0:25005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 19 00000100:00100000:0.0:1787831276.187345:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831276.192680:0:22851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433457664 00000100:00100000:3.0:1787831276.192695:0:22851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433457664 00000100:00100000:3.0:1787831276.192779:0:22851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 21 00000100:00100000:3.0:1787831276.192790:0:22851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220442de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c60c7f3-708e-4896-8908-a503cf94fb51+6:0:x1874676433457664:12345-192.168.203.31@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787831276.192895:0:22851:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787831276.193202:0:22851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220442de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c60c7f3-708e-4896-8908-a503cf94fb51+6:0:x1874676433457664:12345-192.168.203.31@tcp:41:mount.lustre.0 Request processed in 414us (5865us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831276.193211:0:22851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 21 00000100:00080000:0.0:1787831276.194769:0:22811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787831276.454345:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831276.454451:0:22817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433459072 00000100:00100000:1.0:1787831276.454465:0:22817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433459072 00000100:00100000:1.0:1787831276.454529:0:22817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 22 00000100:00100000:1.0:1787831276.454540:0:22817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2309cf8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c60c7f3-708e-4896-8908-a503cf94fb51+6:18400:x1874676433459072:12345-192.168.203.31@tcp:101:mkdir.0 00010000:00010000:1.0:1787831276.454561:0:22817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787831276.454582:0:22817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95200/0x95459fb9d1d2abc4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a994244b4 expref: -99 pid: 22817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831276.455354:0:22817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94600/0x95459fb9d1d2abcb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831276.455371:0:22817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94600/0x95459fb9d1d2abcb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831276.455382:0:22817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94600/0x95459fb9d1d2abcb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787831276.455467:0:22817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787831276.455471:0:22817:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787831276.455503:0:22817:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94600/0x95459fb9d1d2abcb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831276.455531:0:22817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95200/0x95459fb9d1d2abc4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994244b4 expref: 8 pid: 22817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831276.455550:0:22817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94600/0x95459fb9d1d2abcb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994244b4 expref: 7 pid: 22817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831276.455560:0:22817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d22035dcb00) 00010000:00010000:1.0:1787831276.455563:0:22817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787831276.455566:0:22817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233be94600, rc 0) 00000100:00100000:1.0:1787831276.455703:0:22817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2309cf8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c60c7f3-708e-4896-8908-a503cf94fb51+7:18400:x1874676433459072:12345-192.168.203.31@tcp:101:mkdir.0 Request processed in 1163us (1366us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831276.455711:0:22817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 22 00000100:00100000:1.0:1787831276.775325:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204400000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676444009984:0@lo:400:kworker.0 00000100:00100000:3.0:1787831276.775332:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233fb41680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8057bc0f-773b-4151-9d37-d94ddea63831:3622:1874676444009600:0@lo:400:kworker.0 00000100:00100000:0.0:1787831276.775443:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233fae8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676444009728:0@lo:400:kworker.0 00000100:00100000:2.0:1787831276.775524:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233fae8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1874676444009856:0@lo:400:kworker.0 00000100:00100000:1.0:1787831276.780346:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831276.780411:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676444010496:0@lo:400:kworker.0 00000100:00100000:1.0:1787831276.780443:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831276.780463:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a792c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3621:1874676444011008:0@lo:400:kworker.0 00000100:00100000:1.0:1787831276.780488:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831276.780647:0:24321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444009984 00000100:00100000:1.0:1787831276.780654:0:24321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444009984 00000100:00100000:1.0:1787831276.780714:0:24321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444010496 00000100:00100000:1.0:1787831276.780717:0:24321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444010496 00000100:00100000:1.0:1787831276.780736:0:24321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787831276.780744:0:24321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1874676444009984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787831276.780796:0:24321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1874676444009984:12345-0@lo:400:kworker.0 Request processed in 52us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831276.780818:0:24321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787831276.780836:0:24321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787831276.780842:0:24321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a7a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676444010496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787831276.780869:0:24321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a7a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676444010496:12345-0@lo:400:kworker.0 Request processed in 29us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831276.780875:0:24321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787831276.780913:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204400000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676444009984:0@lo:400:kworker.0 00000100:00100000:1.0:1787831276.780935:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676444010496:0@lo:400:kworker.0 00000100:00080000:1.0:1787831276.780961:0:22811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787831276.780988:0:22816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444011008 00000100:00100000:1.0:1787831276.780992:0:22816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444011008 00000100:00100000:1.0:1787831276.781021:0:22816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787831276.781028:0:22816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a78780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1874676444011008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787831276.781046:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831276.781059:0:22816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a78780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1874676444011008:12345-0@lo:400:kworker.0 Request processed in 32us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831276.781065:0:22816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787831276.781071:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204403c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3622:1874676444010112:0@lo:400:kworker.0 00000100:00080000:1.0:1787831276.781092:0:22811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787831276.781095:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831276.781110:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a792c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3621:1874676444011008:0@lo:400:kworker.0 00000100:00100000:3.0:1787831276.781112:0:22815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444010112 00000100:00100000:3.0:1787831276.781114:0:22815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444010112 00000100:00100000:3.0:1787831276.781142:0:22815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787831276.781144:0:22810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444009600 00000100:00100000:1.0:1787831276.781147:0:22810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444009600 00000100:00100000:3.0:1787831276.781154:0:22815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203afe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1874676444010112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787831276.781170:0:22810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787831276.781176:0:22810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22025d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8057bc0f-773b-4151-9d37-d94ddea63831+24:3622:x1874676444009600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787831276.781181:0:22815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203afe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1874676444010112:12345-0@lo:400:kworker.0 Request processed in 29us (86us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831276.781186:0:22815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787831276.781202:0:22810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22025d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8057bc0f-773b-4151-9d37-d94ddea63831+24:3622:x1874676444009600:12345-0@lo:400:kworker.0 Request processed in 27us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831276.781208:0:22810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1787831276.781209:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204403c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3622:1874676444010112:0@lo:400:kworker.0 00000100:00100000:3.0:1787831276.781216:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a221c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3622:1874676444010624:0@lo:400:kworker.0 00000100:00100000:3.0:1787831276.781236:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831276.781252:0:22816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444010624 00000100:00100000:1.0:1787831276.781255:0:22816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444010624 00000100:00100000:3.0:1787831276.781257:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a78f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3622:1874676444011136:0@lo:400:kworker.0 00000100:00100000:1.0:1787831276.781273:0:22816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787831276.781278:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831276.781279:0:22816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203afe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1874676444010624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787831276.781291:0:22815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444011136 00000100:00100000:3.0:1787831276.781294:0:22815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444011136 00000100:00100000:1.0:1787831276.781304:0:22816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203afe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1874676444010624:12345-0@lo:400:kworker.0 Request processed in 26us (68us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831276.781310:0:22816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:1.0:1787831276.781328:0:22811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787831276.781766:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831276.781792:0:22821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444009728 00000100:00100000:0.0:1787831276.781796:0:22821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444009728 00000100:00100000:0.0:1787831276.781824:0:22821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787831276.781830:0:22821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2309cfb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676444009728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787831276.781864:0:22821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2309cfb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676444009728:12345-0@lo:400:kworker.0 Request processed in 35us (99us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831276.781870:0:22821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787831276.781896:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233fae8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676444009728:0@lo:400:kworker.0 00000100:00100000:0.0:1787831276.781903:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a212c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676444010240:0@lo:400:kworker.0 00000100:00100000:0.0:1787831276.781934:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831276.781954:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a230c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3619:1874676444010752:0@lo:400:kworker.0 00000100:00100000:0.0:1787831276.781974:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831276.782003:0:22817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444010752 00000100:00100000:0.0:1787831276.782007:0:22817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444010752 00000100:00100000:1.0:1787831276.782080:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2309cf8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676444011264:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787831276.782104:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831276.782122:0:24324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444011264 00000100:00100000:1.0:1787831276.782125:0:24324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444011264 00000100:00100000:1.0:1787831276.782147:0:24324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787831276.782153:0:24324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a792c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676444011264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787831276.782167:0:24324:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1787831276.782193:0:24324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a792c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676444011264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 41us (88us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831276.782505:0:24324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787831276.782543:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2309cf8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676444011264:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787831276.782576:0:22811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787831276.782580:0:22811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787831276.782597:0:22820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444010240 00000100:00100000:1.0:1787831276.782601:0:22820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444010240 00000100:00100000:1.0:1787831276.782645:0:22820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787831276.782652:0:22820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2309cfbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676444010240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787831276.782690:0:22820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2309cfbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676444010240:12345-0@lo:400:kworker.0 Request processed in 39us (755us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831276.782705:0:22820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787831276.782730:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a212c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676444010240:0@lo:400:kworker.0 00000100:00100000:2.0:1787831276.782878:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831276.782897:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a20780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1874676444010368:0@lo:400:kworker.0 00000100:00100000:2.0:1787831276.782918:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831276.782947:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3620:1874676444010880:0@lo:400:kworker.0 00000100:00100000:2.0:1787831276.782968:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831276.782983:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233fb1cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1874676444011392:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787831276.783002:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831276.783042:0:24322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444009856 00000100:00100000:2.0:1787831276.783051:0:24322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444009856 00000100:00100000:2.0:1787831276.783077:0:24322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444010368 00000100:00100000:2.0:1787831276.783080:0:24322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444010368 00000100:00100000:2.0:1787831276.783101:0:24322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787831276.783107:0:24322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb1da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1874676444009856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787831276.783139:0:24322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb1da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1874676444009856:12345-0@lo:400:kworker.0 Request processed in 33us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831276.783146:0:24322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787831276.783159:0:24322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787831276.783165:0:24322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb1c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1874676444010368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787831276.783187:0:22815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444010880 00000100:00100000:2.0:1787831276.783190:0:24322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb1c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1874676444010368:12345-0@lo:400:kworker.0 Request processed in 26us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831276.783191:0:22815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444010880 00000100:00100000:2.0:1787831276.783208:0:24322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787831276.783210:0:22815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787831276.783216:0:22815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203afed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1874676444011136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787831276.783224:0:24324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444011392 00000100:00100000:2.0:1787831276.783227:0:24324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444011392 00000100:00100000:2.0:1787831276.783246:0:24324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787831276.783248:0:22815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203afed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1874676444011136:12345-0@lo:400:kworker.0 Request processed in 33us (1969us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831276.783252:0:24324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb1d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1874676444011392:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787831276.783254:0:22815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00002000:00000024:2.0:1787831276.783262:0:24324:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:3.0:1787831276.783264:0:22815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787831276.783269:0:22815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb1c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1874676444010880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787831276.783288:0:22815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb1c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1874676444010880:12345-0@lo:400:kworker.0 Request processed in 19us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831276.783288:0:24324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb1d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1874676444011392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 37us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831276.783294:0:22815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787831276.783294:0:24324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1787831276.783311:0:22811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787831276.783313:0:22811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787831276.783332:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2203a78f00 x1874676444011136/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787831292 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787831276.783341:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233fae8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1874676444009856:0@lo:400:kworker.0 00000100:00100000:2.0:1787831276.783352:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a20780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1874676444010368:0@lo:400:kworker.0 00000100:00100000:3.0:1787831276.783353:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a78f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3622:1874676444011136:0@lo:400:kworker.0 00010000:00080000:2.0:1787831276.783361:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2203a78000 x1874676444010880/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787831292 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787831276.783375:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233fb41680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8057bc0f-773b-4151-9d37-d94ddea63831:3622:1874676444009600:0@lo:400:kworker.0 00000100:00100000:2.0:1787831276.783379:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3620:1874676444010880:0@lo:400:kworker.0 00000100:00100000:3.0:1787831276.783385:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a221c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3622:1874676444010624:0@lo:400:kworker.0 00000100:00100000:2.0:1787831276.783391:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233fb1cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1874676444011392:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787831276.785381:0:22817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787831276.785405:0:22817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2309cfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874676444010752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787831276.785495:0:22817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2309cfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874676444010752:12345-0@lo:400:kworker.0 Request processed in 103us (3519us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831276.785502:0:22817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787831276.785601:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a230c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3619:1874676444010752:0@lo:400:kworker.0 00010000:00010000:0.0:1787831277.158928:0:22804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787831277.479304:0:22852:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00100000:1.0:1787831277.809013:0:24316:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7c60c7f3-708e-4896-8908-a503cf94fb51 00000001:00100000:1.0:1787831277.809027:0:24316:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 805921bb-0b9c-4b6e-91c0-2cd3c152e40d 00000001:00100000:3.0:1787831277.809065:0:25136:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7c60c7f3-708e-4896-8908-a503cf94fb51 00000001:00100000:3.0:1787831277.809079:0:25136:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 805921bb-0b9c-4b6e-91c0-2cd3c152e40d 00010000:00010000:3.0:1787831278.182709:0:22805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787831278.825306:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787831278.825330:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a79e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676444011520:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787831278.825406:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831278.826302:0:24324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444011520 00000100:00100000:2.0:1787831278.826313:0:24324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444011520 00000100:00100000:2.0:1787831278.826381:0:24324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787831278.826392:0:24324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203afda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676444011520:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787831278.826420:0:24324:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787831278.826488:0:24324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203afda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1874676444011520:12345-0@lo:13:osp-pre-0-1.0 Request processed in 98us (1082us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831278.826496:0:24324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787831278.826750:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a79e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1874676444011520:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1787831278.827465:0:22811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:0.0:1787831278.828387:0:23548:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 7c60c7f3-708e-4896-8908-a503cf94fb51 00000001:00100000:0.0:1787831278.828397:0:23548:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 805921bb-0b9c-4b6e-91c0-2cd3c152e40d 00000001:00100000:1.0:1787831278.830595:0:22796:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 7c60c7f3-708e-4896-8908-a503cf94fb51 00000001:00100000:1.0:1787831278.830606:0:22796:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 805921bb-0b9c-4b6e-91c0-2cd3c152e40d 00010000:00010000:0.0:1787831279.206843:0:25152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787831279.335957:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787831279.335980:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2309cf9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676444011648:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787831279.336047:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831279.336087:0:22820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444011648 00000100:00100000:3.0:1787831279.336097:0:22820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444011648 00000100:00100000:3.0:1787831279.336164:0:22820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787831279.336174:0:22820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2309cf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676444011648:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787831279.336208:0:22820:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1787831279.336253:0:22820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2309cf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676444011648:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831279.336260:0:22820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787831279.336611:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2309cf9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676444011648:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787831279.336770:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787831279.336780:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203afe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1874676444011776:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787831279.336811:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831279.336838:0:23556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444011776 00000100:00100000:3.0:1787831279.336842:0:23556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444011776 00000100:00100000:3.0:1787831279.336868:0:23556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787831279.336887:0:23556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203afd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1874676444011776:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787831279.336922:0:23556:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787831279.336959:0:23556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203afd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1874676444011776:12345-0@lo:41:osp-pre-1-0.0 Request processed in 73us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831279.336965:0:23556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787831279.336995:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203afe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1874676444011776:0@lo:41:osp-pre-1-0.0 00000001:02000400:0.0:1787831279.906533:0:25692:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1787831280.230951:0:22804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787831280.360151:0:23569:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787831280.872322:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233fb1cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1874676444011904:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787831280.872423:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831280.876228:0:24324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444011904 00000100:00100000:2.0:1787831280.876246:0:24324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444011904 00000100:00100000:2.0:1787831280.876329:0:24324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787831280.876339:0:24324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2309cfa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1874676444011904:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787831280.876381:0:24324:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1787831280.876491:0:24324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2309cfa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1874676444011904:12345-0@lo:13:osp-pre-1-1.0 Request processed in 154us (4069us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831280.876500:0:24324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787831280.876586:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233fb1cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1874676444011904:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1787831280.876747:0:22811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787831281.237082:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831281.237130:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831281.237157:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831281.237178:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831281.237199:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831281.237220:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831281.237241:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831281.237263:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831281.237537:0:22851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433459456 00000100:00100000:0.0:1787831281.237551:0:22851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433459456 00000100:00100000:0.0:1787831281.237652:0:22851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433459968 00000100:00100000:0.0:1787831281.237656:0:22851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433459968 00000100:00100000:0.0:1787831281.237676:0:22851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433459328 00000100:00100000:0.0:1787831281.237679:0:22851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433459328 00000100:00100000:0.0:1787831281.237697:0:22851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433459840 00000100:00100000:0.0:1787831281.237699:0:22851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433459840 00000100:00100000:0.0:1787831281.237875:0:22851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 46 00000100:00100000:0.0:1787831281.237905:0:22851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a7b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+5:2396:x1874676433459456:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1787831281.238004:0:22851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a7b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+5:2396:x1874676433459456:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 112us (873us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831281.238012:0:22851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 46 00000100:00100000:0.0:1787831281.238033:0:22851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 47 00000100:00100000:0.0:1787831281.238040:0:22851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a7a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c60c7f3-708e-4896-8908-a503cf94fb51+5:2396:x1874676433459968:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1787831281.238065:0:22851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a7a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c60c7f3-708e-4896-8908-a503cf94fb51+5:2396:x1874676433459968:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 26us (886us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831281.238070:0:22851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 47 00000100:00100000:0.0:1787831281.238081:0:22851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 48 00000100:00100000:0.0:1787831281.238087:0:22851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a78b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+6:2396:x1874676433459328:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1787831281.238109:0:22851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a78b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+6:2396:x1874676433459328:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 22us (888us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831281.238114:0:22851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 48 00000100:00100000:0.0:1787831281.238124:0:22851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 49 00000100:00100000:0.0:1787831281.238130:0:22851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a7b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c60c7f3-708e-4896-8908-a503cf94fb51+6:2396:x1874676433459840:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1787831281.238151:0:22851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a7b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c60c7f3-708e-4896-8908-a503cf94fb51+6:2396:x1874676433459840:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 21us (887us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831281.238156:0:22851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 49 00000100:00100000:0.0:1787831281.238177:0:24322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433459712 00000100:00100000:0.0:1787831281.238181:0:24322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433459712 00000100:00100000:0.0:1787831281.238211:0:24322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433460224 00000100:00100000:0.0:1787831281.238214:0:24322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433460224 00000100:00100000:0.0:1787831281.238227:0:24322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433459584 00000100:00100000:0.0:1787831281.238236:0:24322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433459584 00000100:00100000:0.0:1787831281.238258:0:24322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 10 00000100:00100000:0.0:1787831281.238266:0:24322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a783c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+5:2396:x1874676433459712:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1787831281.238926:0:24322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a783c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+5:2396:x1874676433459712:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 655us (1761us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831281.238936:0:24322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 10 00000100:00100000:0.0:1787831281.238953:0:24322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 11 00000100:00100000:0.0:1787831281.238962:0:24322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a7bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7c60c7f3-708e-4896-8908-a503cf94fb51+5:2396:x1874676433460224:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1787831281.238990:0:24322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a7bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7c60c7f3-708e-4896-8908-a503cf94fb51+5:2396:x1874676433460224:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 32us (1790us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831281.238997:0:24322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 11 00000100:00100000:0.0:1787831281.239007:0:24322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 12 00000100:00100000:0.0:1787831281.239013:0:24322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a79a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+5:2396:x1874676433459584:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1787831281.239038:0:24322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a79a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+5:2396:x1874676433459584:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 25us (1796us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831281.239044:0:24322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 12 00000100:00100000:0.0:1787831281.239074:0:22809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433459200 00000100:00100000:0.0:1787831281.239078:0:22809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433459200 00000100:00100000:0.0:1787831281.239111:0:22809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 145 00000100:00100000:0.0:1787831281.239117:0:22809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22025d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c04154b7-8c89-4cf2-a4c4-5dd132db0903+13:2396:x1874676433459200:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1787831281.239162:0:22809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22025d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c04154b7-8c89-4cf2-a4c4-5dd132db0903+13:2396:x1874676433459200:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 44us (2096us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831281.239168:0:22809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 145 00000100:00080000:0.0:1787831281.239263:0:22811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787831281.239274:0:22811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787831281.239277:0:22811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787831281.240078:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831281.240126:0:24321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433460096 00000100:00100000:1.0:1787831281.240131:0:24321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433460096 00000100:00100000:1.0:1787831281.240174:0:24321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 13 00000100:00100000:1.0:1787831281.240183:0:24321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7c60c7f3-708e-4896-8908-a503cf94fb51+5:2396:x1874676433460096:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1787831281.240224:0:24321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7c60c7f3-708e-4896-8908-a503cf94fb51+5:2396:x1874676433460096:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 43us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831281.240230:0:24321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 13 00000100:00080000:0.0:1787831281.241146:0:22811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787831281.241150:0:22811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1787831281.255915:0:22805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787831281.902995:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787831281.903028:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2309cfa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676444012032:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787831281.903119:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831281.903444:0:24324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444012032 00000100:00100000:2.0:1787831281.903453:0:24324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444012032 00000100:00100000:2.0:1787831281.903526:0:24324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787831281.903536:0:24324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2309cf8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1874676444012032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787831281.903574:0:24324:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787831281.903677:0:24324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2309cf8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1874676444012032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 141us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831281.903687:0:24324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787831281.903718:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233fb1fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676444012288:0@lo:400:kworker.0 00000100:00100000:2.0:1787831281.903751:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831281.903782:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233fb1e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676444012800:0@lo:400:kworker.0 00000100:00100000:2.0:1787831281.903807:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831281.903827:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2314ed5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3619:1874676444013312:0@lo:400:kworker.0 00000100:00100000:2.0:1787831281.903852:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831281.903873:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1787831281.903879:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233fb1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676444012416:0@lo:400:kworker.0 00000100:00100000:2.0:1787831281.903911:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831281.903927:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233fb1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676444012928:0@lo:400:kworker.0 00000100:00100000:2.0:1787831281.903948:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831281.903963:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2314ed7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3619:1874676444013440:0@lo:400:kworker.0 00000100:00100000:2.0:1787831281.903988:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831281.904031:0:22821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444012288 00000100:00100000:2.0:1787831281.904035:0:22821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444012288 00000100:00100000:2.0:1787831281.904066:0:22821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787831281.904073:0:22821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2314ed52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676444012288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787831281.904117:0:22821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2314ed52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676444012288:12345-0@lo:400:kworker.0 Request processed in 44us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831281.904124:0:22821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787831281.904143:0:25005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444012800 00000100:00100000:2.0:1787831281.904147:0:25005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444012800 00000100:00100000:2.0:1787831281.904175:0:25005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444012416 00000100:00100000:2.0:1787831281.904185:0:25005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444012416 00000100:00100000:2.0:1787831281.904206:0:25005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444012928 00000100:00100000:2.0:1787831281.904208:0:25005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444012928 00000100:00100000:2.0:1787831281.904222:0:25005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787831281.904227:0:25005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2314ed61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676444012800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787831281.904259:0:25005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2314ed61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676444012800:12345-0@lo:400:kworker.0 Request processed in 32us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831281.904266:0:25005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787831281.904278:0:25005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787831281.904284:0:25005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2314ed6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676444012416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787831281.904308:0:25005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2314ed6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676444012416:12345-0@lo:400:kworker.0 Request processed in 25us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831281.904313:0:25005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787831281.904322:0:25005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787831281.904327:0:25005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2314ed43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676444012928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787831281.904348:0:25005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2314ed43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676444012928:12345-0@lo:400:kworker.0 Request processed in 21us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831281.904355:0:25005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787831281.904374:0:22851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444013312 00000100:00100000:2.0:1787831281.904377:0:22851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444013312 00000100:00100000:2.0:1787831281.904402:0:22851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444013440 00000100:00100000:2.0:1787831281.904405:0:22851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444013440 00000100:00100000:2.0:1787831281.904424:0:22851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787831281.904430:0:22851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2314ed4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874676444013312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787831281.904459:0:22851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2314ed4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874676444013312:12345-0@lo:400:kworker.0 Request processed in 29us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831281.904465:0:22851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787831281.904485:0:22851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787831281.904491:0:22851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2314ed6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874676444013440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787831281.904518:0:22851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2314ed6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874676444013440:12345-0@lo:400:kworker.0 Request processed in 28us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831281.904524:0:22851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787831281.904557:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233fb1e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3621:1874676444012544:0@lo:400:kworker.0 00000100:00100000:2.0:1787831281.904585:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831281.904604:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233fb1f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3621:1874676444013056:0@lo:400:kworker.0 00000100:00100000:2.0:1787831281.904651:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831281.904669:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2314ed4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3621:1874676444013568:0@lo:400:kworker.0 00000100:00100000:2.0:1787831281.904690:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831281.904707:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1787831281.904714:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233fb1cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8057bc0f-773b-4151-9d37-d94ddea63831:3621:1874676444012160:0@lo:400:kworker.0 00000100:00100000:2.0:1787831281.904745:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831281.904768:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233fb1cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676444012672:0@lo:400:kworker.0 00000100:00100000:2.0:1787831281.904792:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831281.904813:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2314ed4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3621:1874676444013184:0@lo:400:kworker.0 00000100:00100000:2.0:1787831281.904836:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831281.904859:0:22820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444012672 00000100:00100000:2.0:1787831281.904862:0:22820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444012672 00000100:00100000:2.0:1787831281.904901:0:22820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787831281.904908:0:22820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2314ed5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676444012672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787831281.904947:0:22820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2314ed5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676444012672:12345-0@lo:400:kworker.0 Request processed in 40us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831281.904953:0:22820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787831281.904981:0:22815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444012544 00000100:00100000:2.0:1787831281.904985:0:22815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444012544 00000100:00100000:2.0:1787831281.905002:0:22815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444013056 00000100:00100000:2.0:1787831281.905004:0:22815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444013056 00000100:00100000:2.0:1787831281.905014:0:22815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444013568 00000100:00100000:2.0:1787831281.905017:0:22815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444013568 00000100:00100000:2.0:1787831281.905030:0:22815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444013184 00000100:00100000:2.0:1787831281.905033:0:22815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444013184 00000100:00100000:2.0:1787831281.905048:0:22815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787831281.905055:0:22815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2314ed70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1874676444012544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787831281.905089:0:22815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2314ed70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1874676444012544:12345-0@lo:400:kworker.0 Request processed in 33us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831281.905095:0:22815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787831281.905107:0:22815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787831281.905112:0:22815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2314ed7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1874676444013056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787831281.905140:0:22815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2314ed7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1874676444013056:12345-0@lo:400:kworker.0 Request processed in 28us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831281.905146:0:22815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787831281.905157:0:22815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787831281.905163:0:22815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2314ed5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1874676444013568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787831281.905190:0:22815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2314ed5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1874676444013568:12345-0@lo:400:kworker.0 Request processed in 27us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831281.905195:0:22815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787831281.905206:0:22815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787831281.905212:0:22815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204706580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1874676444013184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787831281.905235:0:22815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204706580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1874676444013184:12345-0@lo:400:kworker.0 Request processed in 24us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831281.905252:0:22815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787831281.905304:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233fb1cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676444012672:0@lo:400:kworker.0 00000100:00100000:2.0:1787831281.905317:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2314ed4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3621:1874676444013184:0@lo:400:kworker.0 00000100:00100000:2.0:1787831281.905329:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233fb1e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3621:1874676444012544:0@lo:400:kworker.0 00000100:00100000:2.0:1787831281.905339:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233fb1f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3621:1874676444013056:0@lo:400:kworker.0 00010000:00080000:2.0:1787831281.905358:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2314ed4b40 x1874676444013568/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787831297 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787831281.905370:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2314ed4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3621:1874676444013568:0@lo:400:kworker.0 00000100:00100000:2.0:1787831281.905409:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233fb1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676444012416:0@lo:400:kworker.0 00000100:00100000:2.0:1787831281.905421:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233fb1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676444012928:0@lo:400:kworker.0 00000100:00100000:2.0:1787831281.905431:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2314ed7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3619:1874676444013440:0@lo:400:kworker.0 00000100:00100000:2.0:1787831281.905440:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233fb1fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676444012288:0@lo:400:kworker.0 00000100:00100000:2.0:1787831281.905449:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233fb1e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676444012800:0@lo:400:kworker.0 00010000:00080000:2.0:1787831281.905460:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d2314ed5e00 x1874676444013312/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787831297 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787831281.905469:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2314ed5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3619:1874676444013312:0@lo:400:kworker.0 00000100:00100000:1.0:1787831281.905601:0:22808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444012160 00000100:00100000:1.0:1787831281.905607:0:22808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444012160 00000100:00100000:1.0:1787831281.905682:0:22808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787831281.905692:0:22808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22025d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8057bc0f-773b-4151-9d37-d94ddea63831+24:3621:x1874676444012160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787831281.905751:0:22808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22025d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8057bc0f-773b-4151-9d37-d94ddea63831+24:3621:x1874676444012160:12345-0@lo:400:kworker.0 Request processed in 62us (1005us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831281.905759:0:22808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787831281.905828:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2309cfa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676444012032:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787831281.905897:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233fb1cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8057bc0f-773b-4151-9d37-d94ddea63831:3621:1874676444012160:0@lo:400:kworker.0 00000100:00080000:0.0:1787831281.906119:0:22811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787831281.906125:0:22811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787831281.906129:0:22811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787831281.906132:0:22811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787831281.906189:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2309cfa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676444013696:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787831281.906225:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831281.906305:0:24324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444013696 00000100:00100000:0.0:1787831281.906310:0:24324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444013696 00000100:00100000:0.0:1787831281.906352:0:24324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787831281.906360:0:24324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a79680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1874676444013696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787831281.906374:0:24324:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:0.0:1787831281.906416:0:24324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a79680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1874676444013696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831281.906422:0:24324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787831281.906452:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2309cfa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676444013696:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787831282.286288:0:25152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787831283.302945:0:22804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787831283.353705:0:25840:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcfbc37d80 20000000:00000080:3.0:1787831283.353732:0:25840:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d2202642800 uarg=0000000000000000 20000000:01000000:3.0:1787831283.353786:0:25840:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787831283.353793:0:25840:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787831283.353799:0:25840:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1787831283.354364:0:25841:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:3.0:1787831283.355110:0:25840:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1787831283.366865:0:25840:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787831283.367180:0:25840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d22034a6a00/0x95459fb9d1d2abd2 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831283.367205:0:25840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2303aa3800/0x95459fb9d1d2a836 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d2a82f expref: 23 pid: 22808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831283.367214:0:25840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2307c77c00/0x95459fb9d1d2a844 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d2a83d expref: 23 pid: 22808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831283.367241:0:25840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2307c77200/0x95459fb9d1d2a883 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d2a87c expref: 23 pid: 22810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831283.367248:0:25840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2303aa3c00/0x95459fb9d1d2a91d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d2a916 expref: 23 pid: 22809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831283.367259:0:25840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d233be94a00/0x95459fb9d1d2ab62 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424413 expref: 12 pid: 22810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831283.367267:0:25840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d22039c0600/0x95459fb9d1d2aba1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424483 expref: 12 pid: 22810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831283.367275:0:25840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d22034a6a00/0x95459fb9d1d2abd2 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831283.367332:0:25840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d22039c0600/0x95459fb9d1d2aba1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424483 expref: 12 pid: 22810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831283.367349:0:25840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d22039c0600/0x95459fb9d1d2aba1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424483 expref: 12 pid: 22810 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831283.367366:0:25840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2309cf9e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25840:1874676444013824:192.168.203.31@tcp:104: 00010000:00010000:0.0:1787831283.367511:0:25840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d233be94a00/0x95459fb9d1d2ab62 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424413 expref: 12 pid: 22810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831283.367524:0:25840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d233be94a00/0x95459fb9d1d2ab62 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424413 expref: 12 pid: 22810 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831283.367537:0:25840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2309cf83c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25840:1874676444013952:192.168.203.31@tcp:104: 00010000:00010000:0.0:1787831283.367589:0:25840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2303aa3c00/0x95459fb9d1d2a91d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x95459fb9d1d2a916 expref: 23 pid: 22809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831283.367597:0:25840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d2303aa3c00/0x95459fb9d1d2a91d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x95459fb9d1d2a916 expref: 23 pid: 22809 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831283.367607:0:25840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d23344883c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25840:1874676444014080:0@lo:104: 00000100:00100000:0.0:1787831283.367700:0:25840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787831283.367749:0:25840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2307c77200/0x95459fb9d1d2a883 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x95459fb9d1d2a87c expref: 23 pid: 22810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831283.367758:0:25840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d2307c77200/0x95459fb9d1d2a883 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x95459fb9d1d2a87c expref: 23 pid: 22810 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831283.367760:0:22800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444014080 00000100:00100000:0.0:1787831283.367765:0:25840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233448bc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25840:1874676444014208:0@lo:104: 00000100:00100000:1.0:1787831283.367768:0:22800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444014080 00000100:00100000:0.0:1787831283.367787:0:25840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831283.367816:0:22800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444014208 00010000:00010000:0.0:1787831283.367816:0:25840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2307c77c00/0x95459fb9d1d2a844 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x95459fb9d1d2a83d expref: 23 pid: 22808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831283.367818:0:22800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444014208 00010000:00010000:0.0:1787831283.367825:0:25840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d2307c77c00/0x95459fb9d1d2a844 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x95459fb9d1d2a83d expref: 23 pid: 22808 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831283.367833:0:22800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787831283.367833:0:25840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2334488000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25840:1874676444014336:0@lo:104: 00000100:00100000:1.0:1787831283.367843:0:22800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2334489e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8057bc0f-773b-4151-9d37-d94ddea63831+4:25840:x1874676444014080:12345-0@lo:104: 00000100:00100000:0.0:1787831283.367852:0:25840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787831283.367859:0:22800:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff8d2307c77000/0x95459fb9d1d2a916 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d2a91d expref: -99 pid: 25135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831283.367866:0:25840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2303aa3800/0x95459fb9d1d2a836 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x95459fb9d1d2a82f expref: 23 pid: 22808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831283.367873:0:25840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d2303aa3800/0x95459fb9d1d2a836 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x95459fb9d1d2a82f expref: 23 pid: 22808 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831283.367904:0:25840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233448a940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25840:1874676444014464:0@lo:104: 00010000:00010000:1.0:1787831283.367925:0:22800:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787831283.367930:0:22800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2334489e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8057bc0f-773b-4151-9d37-d94ddea63831+4:25840:x1874676444014080:12345-0@lo:104: Request processed in 90us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831283.367938:0:22800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787831283.367956:0:22800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444014336 00000100:00100000:1.0:1787831283.367959:0:22800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444014336 00000100:00100000:1.0:1787831283.367982:0:22800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787831283.367987:0:22800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2334488780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8057bc0f-773b-4151-9d37-d94ddea63831+4:25840:x1874676444014208:12345-0@lo:104: 00010000:00010000:1.0:1787831283.367995:0:22800:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff8d2303aa3a00/0x95459fb9d1d2a87c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d2a883 expref: -99 pid: 24315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831283.368032:0:22800:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787831283.368038:0:22800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2334488780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8057bc0f-773b-4151-9d37-d94ddea63831+4:25840:x1874676444014208:12345-0@lo:104: Request processed in 51us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831283.368044:0:22800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787831283.368057:0:22800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787831283.368062:0:22800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233448ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8057bc0f-773b-4151-9d37-d94ddea63831+3:25840:x1874676444014336:12345-0@lo:104: 00010000:00010000:1.0:1787831283.368071:0:22800:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff8d2303aa2e00/0x95459fb9d1d2a83d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d2a844 expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831283.368117:0:22800:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787831283.368122:0:22800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233448ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8057bc0f-773b-4151-9d37-d94ddea63831+3:25840:x1874676444014336:12345-0@lo:104: Request processed in 60us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831283.368128:0:22800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:1.0:1787831283.368146:0:25152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787831283.368154:0:25152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8d2307c77000/0x95459fb9d1d2a916 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d2a91d expref: -99 pid: 25135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831283.368162:0:25152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2307c77000 already unused, calling callback (ffffffffc14f9c20) 10000000:00010000:1.0:1787831283.368167:0:25152:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8d2307c77000/0x95459fb9d1d2a916 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x95459fb9d1d2a91d expref: -99 pid: 25135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831283.368177:0:25152:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8d2307c77000/0x95459fb9d1d2a916 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x95459fb9d1d2a91d expref: -99 pid: 25135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787831283.368194:0:25152:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8d2307c77000/0x95459fb9d1d2a916 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x95459fb9d1d2a91d expref: -99 pid: 25135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787831283.368201:0:25152:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787831283.368237:0:25152:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8d2307c77000/0x95459fb9d1d2a916 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d2a91d expref: -99 pid: 25135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831283.368244:0:25152:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787831283.368273:0:25152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8d2307c77000/0x95459fb9d1d2a916 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d2a91d expref: -99 pid: 25135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831283.368279:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a7ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8057bc0f-773b-4151-9d37-d94ddea63831:3619:1874676444014592:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787831283.368281:0:25152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8d2307c77000/0x95459fb9d1d2a916 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d2a91d expref: -99 pid: 25135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831283.368293:0:25152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787831283.368297:0:25152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8d2303aa3a00/0x95459fb9d1d2a87c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d2a883 expref: -99 pid: 24315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831283.368303:0:25152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2303aa3a00 already unused, calling callback (ffffffffc14f9c20) 10000000:00010000:1.0:1787831283.368306:0:25152:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8d2303aa3a00/0x95459fb9d1d2a87c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x95459fb9d1d2a883 expref: -99 pid: 24315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831283.368312:0:25152:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8d2303aa3a00/0x95459fb9d1d2a87c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x95459fb9d1d2a883 expref: -99 pid: 24315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831283.368318:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:1.0:1787831283.368319:0:25152:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8d2303aa3a00/0x95459fb9d1d2a87c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x95459fb9d1d2a883 expref: -99 pid: 24315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787831283.368329:0:25152:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787831283.368350:0:25152:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8d2303aa3a00/0x95459fb9d1d2a87c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d2a883 expref: -99 pid: 24315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831283.368356:0:25152:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787831283.368365:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a79e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8057bc0f-773b-4151-9d37-d94ddea63831:3620:1874676444014720:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787831283.368366:0:25152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8d2303aa3a00/0x95459fb9d1d2a87c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d2a883 expref: -99 pid: 24315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831283.368373:0:25152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8d2303aa3a00/0x95459fb9d1d2a87c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d2a883 expref: -99 pid: 24315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831283.368382:0:25152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787831283.368385:0:25152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8d2303aa2e00/0x95459fb9d1d2a83d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d2a844 expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831283.368391:0:25152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2303aa2e00 already unused, calling callback (ffffffffc14f9c20) 10000000:00010000:1.0:1787831283.368394:0:25152:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8d2303aa2e00/0x95459fb9d1d2a83d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x95459fb9d1d2a844 expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831283.368398:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787831283.368401:0:25152:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8d2303aa2e00/0x95459fb9d1d2a83d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x95459fb9d1d2a844 expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787831283.368407:0:25152:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8d2303aa2e00/0x95459fb9d1d2a83d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x95459fb9d1d2a844 expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787831283.368413:0:25152:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787831283.368425:0:25152:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8d2303aa2e00/0x95459fb9d1d2a83d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d2a844 expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831283.368431:0:25152:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787831283.368432:0:22803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444014592 00000100:00100000:2.0:1787831283.368435:0:22803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444014592 00010000:00010000:1.0:1787831283.368447:0:25152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8d2303aa2e00/0x95459fb9d1d2a83d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d2a844 expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831283.368457:0:22803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2303aa3c00/0x95459fb9d1d2a91d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d2a916 expref: 24 pid: 22809 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831283.368466:0:25152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8d2303aa2e00/0x95459fb9d1d2a83d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d2a844 expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831283.368475:0:25152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787831283.368477:0:22803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444014720 00010000:00010000:1.0:1787831283.368477:0:25152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787831283.368478:0:25152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787831283.368479:0:22803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444014720 00010000:00010000:1.0:1787831283.368485:0:22804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787831283.368489:0:22803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2307c77200/0x95459fb9d1d2a883 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d2a87c expref: 25 pid: 22810 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831283.368500:0:22803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787831283.368504:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8057bc0f-773b-4151-9d37-d94ddea63831:3621:1874676444014848:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787831283.368505:0:22803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204705e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8057bc0f-773b-4151-9d37-d94ddea63831+25:3619:x1874676444014592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787831283.368517:0:22803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787831283.368522:0:22803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2303aa3c00/0x95459fb9d1d2a91d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d2a916 expref: 25 pid: 22809 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831283.368533:0:22803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2303aa3c00/0x95459fb9d1d2a91d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x95459fb9d1d2a916 expref: 25 pid: 22809 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831283.368533:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787831283.368552:0:22803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787831283.368575:0:22803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204705e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8057bc0f-773b-4151-9d37-d94ddea63831+25:3619:x1874676444014592:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831283.368582:0:22803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787831283.368596:0:22803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444014848 00000100:00100000:2.0:1787831283.368599:0:22803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444014848 00010000:00010000:2.0:1787831283.368610:0:22803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2307c77c00/0x95459fb9d1d2a844 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d2a83d expref: 25 pid: 22808 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831283.368657:0:22803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787831283.368671:0:22803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204704b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8057bc0f-773b-4151-9d37-d94ddea63831+25:3620:x1874676444014720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787831283.368680:0:22803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787831283.368684:0:22803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2307c77200/0x95459fb9d1d2a883 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d2a87c expref: 25 pid: 22810 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831283.368692:0:22803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2307c77200/0x95459fb9d1d2a883 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x95459fb9d1d2a87c expref: 25 pid: 22810 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831283.368702:0:22803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787831283.368729:0:22803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204704b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8057bc0f-773b-4151-9d37-d94ddea63831+25:3620:x1874676444014720:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831283.368736:0:22803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787831283.368750:0:22803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787831283.368756:0:22803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a78f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8057bc0f-773b-4151-9d37-d94ddea63831+24:3621:x1874676444014848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787831283.368783:0:22803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787831283.368788:0:22803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2307c77c00/0x95459fb9d1d2a844 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d2a83d expref: 24 pid: 22808 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831283.368796:0:22803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2307c77c00/0x95459fb9d1d2a844 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x95459fb9d1d2a83d expref: 24 pid: 22808 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831283.368805:0:22803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787831283.368832:0:22803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a78f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8057bc0f-773b-4151-9d37-d94ddea63831+24:3621:x1874676444014848:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831283.368838:0:22803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787831283.368891:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8057bc0f-773b-4151-9d37-d94ddea63831:3621:1874676444014848:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787831283.368918:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a7ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8057bc0f-773b-4151-9d37-d94ddea63831:3619:1874676444014592:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787831283.368942:0:22805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787831283.369008:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a79e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8057bc0f-773b-4151-9d37-d94ddea63831:3620:1874676444014720:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787831283.369493:0:25840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831283.369536:0:25840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d231008cf00 going to sleep for 11 seconds 00010000:00010000:0.0:1787831283.369552:0:25840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2303aa3c00/0x95459fb9d1d2a91d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x95459fb9d1d2a916 expref: 23 pid: 22809 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831283.369565:0:25840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d23344883c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25840:1874676444014080:0@lo:104: 00010000:00010000:0.0:1787831283.369575:0:25840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2307c77200/0x95459fb9d1d2a883 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x95459fb9d1d2a87c expref: 22 pid: 22810 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831283.369583:0:25840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233448bc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25840:1874676444014208:0@lo:104: 00010000:00010000:0.0:1787831283.369592:0:25840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2307c77c00/0x95459fb9d1d2a844 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x95459fb9d1d2a83d expref: 21 pid: 22808 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831283.369599:0:25840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2334488000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25840:1874676444014336:0@lo:104: 00000100:00100000:1.0:1787831283.370018:0:22800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444014464 00000100:00100000:1.0:1787831283.370025:0:22800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444014464 00000100:00100000:1.0:1787831283.370065:0:22800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787831283.370072:0:22800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233448b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8057bc0f-773b-4151-9d37-d94ddea63831+3:25840:x1874676444014464:12345-0@lo:104: 00010000:00010000:1.0:1787831283.370087:0:22800:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff8d2303aa2800/0x95459fb9d1d2a82f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d2a836 expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831283.370175:0:22800:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787831283.370181:0:22800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233448b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8057bc0f-773b-4151-9d37-d94ddea63831+3:25840:x1874676444014464:12345-0@lo:104: Request processed in 110us (689us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831283.370188:0:22800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787831283.370356:0:25840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233448a940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25840:1874676444014464:0@lo:104: 00010000:00010000:3.0:1787831283.370493:0:25152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787831283.370502:0:25152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8d2303aa2800/0x95459fb9d1d2a82f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x95459fb9d1d2a836 expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831283.370510:0:25152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2303aa2800 already unused, calling callback (ffffffffc14f9c20) 10000000:00010000:3.0:1787831283.370514:0:25152:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8d2303aa2800/0x95459fb9d1d2a82f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x95459fb9d1d2a836 expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831283.370524:0:25152:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8d2303aa2800/0x95459fb9d1d2a82f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x95459fb9d1d2a836 expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787831283.370531:0:25152:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8d2303aa2800/0x95459fb9d1d2a82f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x95459fb9d1d2a836 expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787831283.370557:0:25152:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787831283.370604:0:25152:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8d2303aa2800/0x95459fb9d1d2a82f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d2a836 expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831283.370611:0:25152:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787831283.370659:0:25152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8d2303aa2800/0x95459fb9d1d2a82f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d2a836 expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831283.370667:0:25152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8d2303aa2800/0x95459fb9d1d2a82f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x95459fb9d1d2a836 expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831283.370684:0:25152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787831283.370686:0:25152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787831283.370687:0:25152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787831283.370754:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203afd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8057bc0f-773b-4151-9d37-d94ddea63831:3622:1874676444014976:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787831283.370804:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831283.370919:0:22803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444014976 00000100:00100000:1.0:1787831283.370924:0:22803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444014976 00010000:00010000:1.0:1787831283.370947:0:22803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2303aa3800/0x95459fb9d1d2a836 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d2a82f expref: 21 pid: 22808 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831283.370975:0:22803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787831283.370989:0:22803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204707480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8057bc0f-773b-4151-9d37-d94ddea63831+21:3622:x1874676444014976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787831283.371000:0:22803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787831283.371005:0:22803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2303aa3800/0x95459fb9d1d2a836 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x95459fb9d1d2a82f expref: 21 pid: 22808 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831283.371015:0:22803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2303aa3800/0x95459fb9d1d2a836 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x95459fb9d1d2a82f expref: 21 pid: 22808 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831283.371029:0:22803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2303aa3800/0x95459fb9d1d2a836 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x95459fb9d1d2a82f expref: 21 pid: 22808 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831283.371043:0:22803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787831283.371086:0:22803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204707480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8057bc0f-773b-4151-9d37-d94ddea63831+20:3622:x1874676444014976:12345-0@lo:103:ldlm_bl.0 Request processed in 98us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831283.371094:0:22803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787831283.371130:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203afd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8057bc0f-773b-4151-9d37-d94ddea63831:3622:1874676444014976:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787831283.373179:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831283.373179:0:25840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2309cf9e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25840:1874676444013824:192.168.203.31@tcp:104: 00000100:00100000:0.0:1787831283.373193:0:25840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2309cf83c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25840:1874676444013952:192.168.203.31@tcp:104: 00010000:00010000:0.0:1787831283.373247:0:25840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d22034a6a00/0x95459fb9d1d2abd2 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831283.373286:0:22802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433460352 00000100:00100000:2.0:1787831283.373293:0:22802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433460352 00010000:00010000:2.0:1787831283.373332:0:22802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d233be94a00/0x95459fb9d1d2ab62 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424413 expref: 13 pid: 22810 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831283.373399:0:22802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 13 00000100:00100000:2.0:1787831283.373408:0:22802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203903c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c04154b7-8c89-4cf2-a4c4-5dd132db0903+13:2397:x1874676433460352:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787831283.373426:0:22802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787831283.373431:0:22802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d233be94a00/0x95459fb9d1d2ab62 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424413 expref: 13 pid: 22810 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831283.373451:0:22802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d233be94a00/0x95459fb9d1d2ab62 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424413 expref: 13 pid: 22810 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831283.373470:0:22802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d233be94a00/0x95459fb9d1d2ab62 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424413 expref: 13 pid: 22810 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831283.373487:0:22802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787831283.373570:0:22802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203903c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c04154b7-8c89-4cf2-a4c4-5dd132db0903+12:2397:x1874676433460352:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 162us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831283.373579:0:22802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 13 00000100:00100000:0.0:1787831283.374073:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831283.374192:0:22801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433460480 00000100:00100000:2.0:1787831283.374198:0:22801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433460480 00010000:00010000:2.0:1787831283.374219:0:22801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d22039c0600/0x95459fb9d1d2aba1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424483 expref: 12 pid: 22810 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831283.374276:0:22801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 14 00000100:00100000:2.0:1787831283.374284:0:22801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233448a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c04154b7-8c89-4cf2-a4c4-5dd132db0903+12:2397:x1874676433460480:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787831283.374313:0:22801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787831283.374317:0:22801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d22039c0600/0x95459fb9d1d2aba1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424483 expref: 12 pid: 22810 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831283.374325:0:22801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d22039c0600/0x95459fb9d1d2aba1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424483 expref: 12 pid: 22810 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831283.374339:0:22801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d22039c0600/0x95459fb9d1d2aba1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424483 expref: 12 pid: 22810 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831283.374354:0:22801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d22034a6a00/0x95459fb9d1d2abd2 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831283.374364:0:22801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22034a6a00/0x95459fb9d1d2abd2 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831283.374384:0:22801:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d22034a6a00/0x95459fb9d1d2abd2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831283.374392:0:22801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d22034a6a00/0x95459fb9d1d2abd2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831283.374400:0:22801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d22034a6a00/0x95459fb9d1d2abd2 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831283.374405:0:22801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d22034a6a00/0x95459fb9d1d2abd2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831283.374410:0:22801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22034a6a00 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:2.0:1787831283.374413:0:22801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d22034a6a00/0x95459fb9d1d2abd2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831283.374428:0:22801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d22034a6a00/0x95459fb9d1d2abd2 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 25840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831283.374452:0:22801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d22034a6a00/0x95459fb9d1d2abd2 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831283.374464:0:22801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787831283.374469:0:25840:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d22034a6a00/0x95459fb9d1d2abd2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831283.374477:0:25840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d22034a6a00/0x95459fb9d1d2abd2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831283.374491:0:25840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d22034a6a00/0x95459fb9d1d2abd2 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831283.374510:0:22801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233448a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c04154b7-8c89-4cf2-a4c4-5dd132db0903+11:2397:x1874676433460480:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 227us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831283.374518:0:22801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 14 00000100:00100000:2.0:1787831283.943195:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a79e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676444015104:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787831283.943272:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831283.943328:0:24324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444015104 00000100:00100000:0.0:1787831283.943337:0:24324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444015104 00000100:00100000:0.0:1787831283.943405:0:24324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787831283.943414:0:24324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204705e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676444015104:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787831283.943442:0:24324:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787831283.943515:0:24324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204705e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676444015104:12345-0@lo:13:osp-pre-0-1.0 Request processed in 102us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831283.943522:0:24324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787831283.943617:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a79e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676444015104:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1787831283.944166:0:22811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787831284.256181:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831284.256394:0:22815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433460608 00000100:00100000:2.0:1787831284.256408:0:22815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433460608 00000100:00100000:2.0:1787831284.256523:0:22815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 23 00000100:00100000:2.0:1787831284.256538:0:22815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2334488000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+6:18869:x1874676433460608:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787831284.256565:0:22815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787831284.256596:0:22815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0c00/0x95459fb9d1d2abd9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a994244bb expref: -99 pid: 22815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831284.256762:0:22815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0200/0x95459fb9d1d2abe0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831284.256780:0:22815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0200/0x95459fb9d1d2abe0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831284.256796:0:22815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0200/0x95459fb9d1d2abe0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831284.256836:0:22815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1200/0x95459fb9d1d2abe7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831284.256843:0:22815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1200/0x95459fb9d1d2abe7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831284.256850:0:22815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1200/0x95459fb9d1d2abe7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831284.256980:0:22815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1c00/0x95459fb9d1d2abee lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831284.256989:0:22815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1c00/0x95459fb9d1d2abee lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831284.256996:0:22815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1c00/0x95459fb9d1d2abee lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787831284.257033:0:22815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787831284.257037:0:22815:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787831284.257086:0:22815:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1c00/0x95459fb9d1d2abee lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831284.257099:0:22815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0200/0x95459fb9d1d2abe0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831284.257106:0:22815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0200/0x95459fb9d1d2abe0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831284.257113:0:22815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0200/0x95459fb9d1d2abe0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831284.257129:0:22815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22039c0200 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:2.0:1787831284.257134:0:22815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0200/0x95459fb9d1d2abe0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831284.257143:0:22815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0200/0x95459fb9d1d2abe0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831284.257157:0:22815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d22035dcb00) 00010000:00010000:2.0:1787831284.257161:0:22815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787831284.257167:0:22815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0200/0x95459fb9d1d2abe0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831284.257173:0:22815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0200/0x95459fb9d1d2abe0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831284.257192:0:22815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1200/0x95459fb9d1d2abe7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831284.257198:0:22815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1200/0x95459fb9d1d2abe7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831284.257204:0:22815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1200/0x95459fb9d1d2abe7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831284.257210:0:22815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22039c1200 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:2.0:1787831284.257213:0:22815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1200/0x95459fb9d1d2abe7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831284.257219:0:22815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1200/0x95459fb9d1d2abe7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831284.257239:0:22815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8d232f6dc000) 00010000:00010000:2.0:1787831284.257242:0:22815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787831284.257245:0:22815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1200/0x95459fb9d1d2abe7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831284.257252:0:22815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1200/0x95459fb9d1d2abe7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831284.257293:0:22815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0c00/0x95459fb9d1d2abd9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994244bb expref: 8 pid: 22815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831284.257309:0:22815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1c00/0x95459fb9d1d2abee lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994244bb expref: 7 pid: 22815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831284.257316:0:22815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8d232f6dc500) 00010000:00010000:2.0:1787831284.257319:0:22815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787831284.257321:0:22815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22039c1c00, rc 0) 00000100:00100000:2.0:1787831284.257415:0:22815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2334488000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+7:18869:x1874676433460608:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 882us (1249us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831284.257425:0:22815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 23 00000100:00080000:1.0:1787831284.258306:0:22811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787831284.266959:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831284.279387:0:22827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433460736 00000100:00100000:2.0:1787831284.279408:0:22827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433460736 00000100:00100000:2.0:1787831284.279511:0:22827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 5 00000100:00100000:2.0:1787831284.279523:0:22827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a79e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+7:18869:x1874676433460736:12345-192.168.203.31@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1787831284.279653:0:22827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a79e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+7:18869:x1874676433460736:12345-192.168.203.31@tcp:900:lhsmtool_posix.0 Request processed in 132us (12709us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831284.279662:0:22827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 5 00000100:00100000:0.0:1787831284.287822:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831284.296426:0:22851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433460992 00000100:00100000:2.0:1787831284.296448:0:22851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433460992 00000100:00100000:3.0:1787831284.297035:0:22851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 24 00000100:00100000:3.0:1787831284.297049:0:22851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233448bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+7:18869:x1874676433460992:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787831284.297079:0:22851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787831284.297112:0:22851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233837b600/0x95459fb9d1d2abf5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a994244c2 expref: -99 pid: 22851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831284.297216:0:22851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233837b000/0x95459fb9d1d2abfc lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831284.297234:0:22851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233837b000/0x95459fb9d1d2abfc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831284.297271:0:22851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233837b000/0x95459fb9d1d2abfc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831284.297474:0:22851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233837aa00/0x95459fb9d1d2ac03 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831284.297499:0:22851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233837aa00/0x95459fb9d1d2ac03 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831284.297512:0:22851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233837aa00/0x95459fb9d1d2ac03 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831284.297927:0:22851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233837bc00/0x95459fb9d1d2ac0a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831284.297938:0:22851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233837bc00/0x95459fb9d1d2ac0a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831284.297947:0:22851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233837bc00/0x95459fb9d1d2ac0a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787831284.297959:0:22851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:3.0:1787831284.298122:0:22851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233837b000/0x95459fb9d1d2abfc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831284.298130:0:22851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d233837b000/0x95459fb9d1d2abfc lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831284.298136:0:22851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d233837b000/0x95459fb9d1d2abfc lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831284.298142:0:22851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233837b000 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:3.0:1787831284.298154:0:22851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233837b000/0x95459fb9d1d2abfc lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831284.298161:0:22851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233837b000/0x95459fb9d1d2abfc lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831284.298173:0:22851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8d232f6dc500) 00010000:00010000:3.0:1787831284.298177:0:22851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787831284.298181:0:22851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d233837b000/0x95459fb9d1d2abfc lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831284.298188:0:22851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233837b000/0x95459fb9d1d2abfc lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831284.298200:0:22851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233837aa00/0x95459fb9d1d2ac03 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831284.298206:0:22851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d233837aa00/0x95459fb9d1d2ac03 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831284.298211:0:22851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d233837aa00/0x95459fb9d1d2ac03 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831284.298215:0:22851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233837aa00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:3.0:1787831284.298217:0:22851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233837aa00/0x95459fb9d1d2ac03 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831284.298222:0:22851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233837aa00/0x95459fb9d1d2ac03 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831284.298228:0:22851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8d233a6f9000) 00010000:00010000:3.0:1787831284.298230:0:22851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787831284.298238:0:22851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d233837aa00/0x95459fb9d1d2ac03 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831284.298243:0:22851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233837aa00/0x95459fb9d1d2ac03 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831284.304104:0:22851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233837b600/0x95459fb9d1d2abf5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994244c2 expref: 10 pid: 22851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831284.304142:0:22851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233837bc00/0x95459fb9d1d2ac0a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994244c2 expref: 9 pid: 22851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831284.304152:0:22851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d233a6f9700) 00010000:00010000:3.0:1787831284.304160:0:22851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787831284.304165:0:22851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233837bc00, rc 0) 00000100:00100000:3.0:1787831284.304289:0:22851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233448bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+9:18869:x1874676433460992:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 7234us (16472us total) trans 12884901889 rc 0/0 00000100:00100000:3.0:1787831284.304300:0:22851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 24 00000100:00100000:0.0:1787831284.318878:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831284.319018:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831284.325031:0:22815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433461120 00000100:00100000:2.0:1787831284.325054:0:22815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433461120 00000100:00100000:3.0:1787831284.325198:0:22816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433461248 00000100:00100000:3.0:1787831284.325204:0:22816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433461248 00000100:00100000:3.0:1787831284.325260:0:22816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 25 00000100:00100000:3.0:1787831284.325292:0:22816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d23344883c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+10:18875:x1874676433461120:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:3.0:1787831284.325318:0:22816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787831284.325347:0:22816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233837b600/0x95459fb9d1d2ac18 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a994244c9 expref: -99 pid: 22816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831284.325434:0:22816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233837aa00/0x95459fb9d1d2ac1f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831284.325478:0:22816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233837aa00/0x95459fb9d1d2ac1f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831284.325492:0:22816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233837aa00/0x95459fb9d1d2ac1f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831284.325708:0:22816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233837b000/0x95459fb9d1d2ac26 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831284.325734:0:22816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233837b000/0x95459fb9d1d2ac26 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831284.325747:0:22816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233837b000/0x95459fb9d1d2ac26 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831284.325805:0:22816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233837aa00/0x95459fb9d1d2ac1f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831284.325813:0:22816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d233837aa00/0x95459fb9d1d2ac1f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831284.325818:0:22817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 26 00010000:00010000:3.0:1787831284.325830:0:22816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d233837aa00/0x95459fb9d1d2ac1f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831284.325840:0:22817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233448b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+11:18869:x1874676433461248:12345-192.168.203.31@tcp:59:lhsmtool_posix.0 00010000:00010000:3.0:1787831284.325926:0:22816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233837aa00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:3.0:1787831284.325934:0:22816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233837aa00/0x95459fb9d1d2ac1f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831284.325945:0:22816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233837aa00/0x95459fb9d1d2ac1f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831284.325959:0:22816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d22035dcb00) 00010000:00010000:3.0:1787831284.325979:0:22816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787831284.325984:0:22817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233448b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+11:18869:x1874676433461248:12345-192.168.203.31@tcp:59:lhsmtool_posix.0 Request processed in 149us (6962us total) trans 0 rc 0/0 00010000:00010000:3.0:1787831284.325989:0:22816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d233837aa00/0x95459fb9d1d2ac1f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831284.325998:0:22817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 26 00010000:00010000:3.0:1787831284.326006:0:22816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233837aa00/0x95459fb9d1d2ac1f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831284.326030:0:22816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233837b000/0x95459fb9d1d2ac26 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831284.326037:0:22816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d233837b000/0x95459fb9d1d2ac26 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831284.326043:0:22816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d233837b000/0x95459fb9d1d2ac26 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831284.326048:0:22816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233837b000 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:3.0:1787831284.326051:0:22816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233837b000/0x95459fb9d1d2ac26 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831284.326057:0:22816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233837b000/0x95459fb9d1d2ac26 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831284.326064:0:22816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8d233a6f9000) 00010000:00010000:3.0:1787831284.326066:0:22816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787831284.326069:0:22816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d233837b000/0x95459fb9d1d2ac26 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831284.326075:0:22816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233837b000/0x95459fb9d1d2ac26 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831284.326124:0:22816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233837b600/0x95459fb9d1d2ac18 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994244c9 expref: 10 pid: 22816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831284.327797:0:22816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d22035dcb00) 00010000:00010000:3.0:1787831284.327806:0:22816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787831284.327816:0:22816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233837b600/0x95459fb9d1d2ac18 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994244c9 expref: 10 pid: 22816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831284.327835:0:22816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233837b600, rc 0) 00000100:00100000:1.0:1787831284.328204:0:22816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d23344883c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+9:18875:x1874676433461120:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 2916us (9348us total) trans 0 rc 301/301 00000100:00100000:1.0:1787831284.328227:0:22816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 25 00010000:00010000:0.0:1787831284.328391:0:22804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787831284.329173:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831284.329313:0:22817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433461376 00000100:00100000:0.0:1787831284.329325:0:22817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433461376 00000100:00100000:0.0:1787831284.329452:0:22817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 27 00000100:00100000:0.0:1787831284.329464:0:22817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a78f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+5:18869:x1874676433461376:12345-192.168.203.31@tcp:59:lhsmtool_posix.0 00000100:00080000:1.0:1787831284.330104:0:22811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:0.0:1787831284.334616:0:22817:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 5085us 00000100:00100000:1.0:1787831284.342375:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831284.342492:0:22824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433461504 00000100:00100000:2.0:1787831284.342506:0:22824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433461504 00000100:00100000:2.0:1787831284.342588:0:22824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 0 00000100:00100000:2.0:1787831284.342601:0:22824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a7ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+9:18875:x1874676433461504:12345-192.168.203.31@tcp:700:lfs.0 00000100:00100000:2.0:1787831284.342725:0:22824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a7ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+9:18875:x1874676433461504:12345-192.168.203.31@tcp:700:lfs.0 Request processed in 126us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831284.342733:0:22824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 0 00000100:00100000:0.0:1787831284.345740:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831284.346670:0:22815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433461760 00000100:00100000:2.0:1787831284.346685:0:22815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433461760 00000100:00100000:2.0:1787831284.346748:0:22815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 28 00000100:00100000:2.0:1787831284.346760:0:22815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d23344892c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+9:18875:x1874676433461760:12345-192.168.203.31@tcp:36:lfs.0 00010000:00010000:2.0:1787831284.346833:0:22815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787831284.347122:0:22815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95c00/0x95459fb9d1d2ab8c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424444 expref: 9 pid: 22816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831284.347145:0:22815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d22035dcb00) 00010000:00010000:2.0:1787831284.347152:0:22815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787831284.347237:0:22815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0800/0x95459fb9d1d2ac2d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831284.347253:0:22815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94600/0x95459fb9d1d2abcb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994244b4 expref: 5 pid: 22817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831284.347263:0:22815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0800/0x95459fb9d1d2ac2d lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831284.347316:0:22815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94600/0x95459fb9d1d2abcb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0xe558a92a994244b4 expref: 5 pid: 22817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831284.347332:0:22815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94600/0x95459fb9d1d2abcb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a994244b4 expref: 5 pid: 22817 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831284.347350:0:22815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204704b40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22815:1874676444015232:192.168.203.31@tcp:104: 00000100:00100000:2.0:1787831284.354094:0:22815:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2203b30780 going to sleep for 11 seconds 00000100:00100000:0.0:1787831284.354768:0:22817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a78f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+5:18869:x1874676433461376:12345-192.168.203.31@tcp:59:lhsmtool_posix.0 Request processed in 25297us (25588us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831284.354785:0:22817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 27 00000100:00100000:3.0:1787831284.364053:0:22815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204704b40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22815:1874676444015232:192.168.203.31@tcp:104: 00010000:00010000:3.0:1787831284.364104:0:22815:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0800/0x95459fb9d1d2ac2d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831284.371868:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831284.372090:0:22802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433461888 00000100:00100000:2.0:1787831284.372105:0:22802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433461888 00010000:00010000:2.0:1787831284.372184:0:22802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94600/0x95459fb9d1d2abcb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a994244b4 expref: 6 pid: 22817 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831284.372242:0:22802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 15 00000100:00100000:2.0:1787831284.372254:0:22802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2334489680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7c60c7f3-708e-4896-8908-a503cf94fb51+6:2394:x1874676433461888:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787831284.372275:0:22802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787831284.372284:0:22802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94600/0x95459fb9d1d2abcb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a994244b4 expref: 6 pid: 22817 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831284.372300:0:22802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94600/0x95459fb9d1d2abcb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a994244b4 expref: 6 pid: 22817 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831284.372343:0:22802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94600/0x95459fb9d1d2abcb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a994244b4 expref: 6 pid: 22817 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831284.372369:0:22802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d22035dcb00) 00010000:00010000:2.0:1787831284.372399:0:22802:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0800/0x95459fb9d1d2ac2d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831284.372411:0:22802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0800/0x95459fb9d1d2ac2d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831284.372420:0:22802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0800/0x95459fb9d1d2ac2d lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831284.372461:0:22802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787831284.372534:0:22802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2334489680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7c60c7f3-708e-4896-8908-a503cf94fb51+5:2394:x1874676433461888:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 282us (678us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831284.372543:0:22802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 15 00010000:00010000:0.0:1787831284.372688:0:22815:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0800/0x95459fb9d1d2ac2d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831284.372698:0:22815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0800/0x95459fb9d1d2ac2d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831284.372757:0:22815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22034a6600/0x95459fb9d1d2ac34 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831284.372769:0:22815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22034a6600/0x95459fb9d1d2ac34 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831284.372793:0:22815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22034a6600/0x95459fb9d1d2ac34 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787831284.374038:0:22811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787831284.378470:0:22815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22034a6800/0x95459fb9d1d2ac3b lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831284.378515:0:22815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22034a6800/0x95459fb9d1d2ac3b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831284.378529:0:22815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22034a6800/0x95459fb9d1d2ac3b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787831284.378554:0:22815:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009d05590f reply state 000000006c8ba1fa transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22034a6800/0x95459fb9d1d2ac3b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831284.379120:0:22815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22034a6800/0x95459fb9d1d2ac3b lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831284.379130:0:22815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8d2334517500) 00010000:00010000:0.0:1787831284.379133:0:22815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787831284.379965:0:22815:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1787831284.379975:0:22815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1787831284.379992:0:22815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0800/0x95459fb9d1d2ac2d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831284.380000:0:22815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0800/0x95459fb9d1d2ac2d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831284.380105:0:22815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0800/0x95459fb9d1d2ac2d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831284.380115:0:22815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22039c0800 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:0.0:1787831284.380121:0:22815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0800/0x95459fb9d1d2ac2d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831284.380131:0:22815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0800/0x95459fb9d1d2ac2d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831284.380463:0:22815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d22035dcb00) 00010000:00010000:0.0:1787831284.380468:0:22815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787831284.380474:0:22815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0800/0x95459fb9d1d2ac2d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831284.380482:0:22815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0800/0x95459fb9d1d2ac2d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787831284.380525:0:22815:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009d05590f reply state 000000006c8ba1fa transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22034a6600/0x95459fb9d1d2ac34 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831284.380536:0:22815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22034a6600/0x95459fb9d1d2ac34 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831284.380543:0:22815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8d2334517f00) 00010000:00010000:0.0:1787831284.380961:0:22815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787831284.380967:0:22815:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1787831284.381706:0:22815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d23344892c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+10:18875:x1874676433461760:12345-192.168.203.31@tcp:36:lfs.0 Request processed in 34939us (35969us total) trans 12884901890 rc 0/0 00000100:00100000:0.0:1787831284.381717:0:22815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 28 00000100:00100000:0.0:1787831284.431943:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831284.432008:0:22851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433462016 00000100:00100000:3.0:1787831284.432021:0:22851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433462016 00000100:00100000:3.0:1787831284.432104:0:22851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 29 00000100:00100000:3.0:1787831284.432119:0:22851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233448a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+10:18883:x1874676433462016:12345-192.168.203.31@tcp:101:lctl.0 00010000:00010000:3.0:1787831284.432151:0:22851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787831284.432180:0:22851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233837b600/0x95459fb9d1d2ac42 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a994244d0 expref: -99 pid: 22851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831284.432264:0:22851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233837b000/0x95459fb9d1d2ac49 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831284.432292:0:22851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233837b000/0x95459fb9d1d2ac49 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831284.432307:0:22851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233837b000/0x95459fb9d1d2ac49 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787831284.432395:0:22851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787831284.432400:0:22851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787831284.432447:0:22851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d233837b000/0x95459fb9d1d2ac49 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831284.432478:0:22851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233837b600/0x95459fb9d1d2ac42 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994244d0 expref: 12 pid: 22851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831284.432501:0:22851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233837b000/0x95459fb9d1d2ac49 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994244d0 expref: 11 pid: 22851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831284.432511:0:22851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d233a6f9000) 00010000:00010000:3.0:1787831284.432515:0:22851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787831284.432519:0:22851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233837b000, rc 0) 00000100:00100000:3.0:1787831284.432733:0:22851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233448a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+11:18883:x1874676433462016:12345-192.168.203.31@tcp:101:lctl.0 Request processed in 617us (802us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831284.432743:0:22851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 29 00000100:00100000:3.0:1787831284.454888:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787831284.454914:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2334489a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676444015488:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787831284.454997:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831284.455053:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787831284.455061:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203afd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676444015360:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787831284.455080:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831284.455108:0:22820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444015488 00000100:00100000:3.0:1787831284.455123:0:22820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444015488 00000100:00100000:3.0:1787831284.455166:0:22820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444015360 00000100:00100000:3.0:1787831284.455168:0:22820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444015360 00000100:00100000:3.0:1787831284.455198:0:22820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787831284.455204:0:22820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203afcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676444015488:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787831284.455241:0:22820:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787831284.455301:0:22820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203afcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676444015488:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831284.455309:0:22820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787831284.455329:0:22820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787831284.455333:0:22820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203afc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1874676444015360:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787831284.455349:0:22820:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787831284.455373:0:22820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203afc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1874676444015360:12345-0@lo:41:osp-pre-1-0.0 Request processed in 40us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831284.455377:0:22820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787831284.455435:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203afd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676444015360:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787831284.455465:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2334489a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676444015488:0@lo:41:osp-pre-0-1.0 00000040:00080000:1.0:1787831284.457789:0:23569:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787831284.463478:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831284.463574:0:22817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433462144 00000100:00100000:0.0:1787831284.463590:0:22817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433462144 00000100:00100000:0.0:1787831284.463736:0:22817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 30 00000100:00100000:0.0:1787831284.463749:0:22817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204707480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c60c7f3-708e-4896-8908-a503cf94fb51+5:18884:x1874676433462144:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:0.0:1787831284.463778:0:22817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787831284.463810:0:22817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22034a7200/0x95459fb9d1d2ac50 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a994244d7 expref: -99 pid: 22817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831284.463914:0:22817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22034a7800/0x95459fb9d1d2ac57 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831284.463933:0:22817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22034a7800/0x95459fb9d1d2ac57 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831284.463947:0:22817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22034a7800/0x95459fb9d1d2ac57 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787831284.464013:0:22817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787831284.464017:0:22817:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787831284.464041:0:22817:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d22034a7800/0x95459fb9d1d2ac57 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831284.464066:0:22817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22034a7200/0x95459fb9d1d2ac50 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994244d7 expref: 7 pid: 22817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831284.464102:0:22817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22034a7800/0x95459fb9d1d2ac57 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994244d7 expref: 6 pid: 22817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831284.464110:0:22817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d233a6f9000) 00010000:00010000:0.0:1787831284.464113:0:22817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787831284.464116:0:22817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22034a7800, rc 0) 00000100:00100000:0.0:1787831284.464185:0:22817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204707480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c60c7f3-708e-4896-8908-a503cf94fb51+6:18884:x1874676433462144:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 441us (725us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831284.464191:0:22817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 30 00000100:00100000:2.0:1787831284.471499:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831284.471621:0:22816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433462272 00000100:00100000:0.0:1787831284.471664:0:22816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433462272 00000100:00100000:0.0:1787831284.471780:0:22816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 31 00000100:00100000:0.0:1787831284.471792:0:22816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22047052c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c60c7f3-708e-4896-8908-a503cf94fb51+6:18884:x1874676433462272:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:0.0:1787831284.471817:0:22816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787831284.471844:0:22816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22034a7200/0x95459fb9d1d2ac5e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a994244de expref: -99 pid: 22816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831284.471940:0:22816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22034a7400/0x95459fb9d1d2ac65 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831284.471958:0:22816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22034a7400/0x95459fb9d1d2ac65 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831284.471972:0:22816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22034a7400/0x95459fb9d1d2ac65 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831284.471984:0:22816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22034a6a00/0x95459fb9d1d2ac6c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831284.472008:0:22816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22034a6a00/0x95459fb9d1d2ac6c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831284.472015:0:22816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22034a6a00/0x95459fb9d1d2ac6c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831284.472118:0:22816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22034a6c00/0x95459fb9d1d2ac73 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831284.472128:0:22816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22034a6c00/0x95459fb9d1d2ac73 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831284.472135:0:22816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22034a6c00/0x95459fb9d1d2ac73 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787831284.472182:0:22816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787831284.472186:0:22816:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787831284.472211:0:22816:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d22034a6c00/0x95459fb9d1d2ac73 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831284.472224:0:22816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22034a7400/0x95459fb9d1d2ac65 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831284.472232:0:22816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22034a7400/0x95459fb9d1d2ac65 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831284.472239:0:22816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22034a7400/0x95459fb9d1d2ac65 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831284.472246:0:22816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22034a7400 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:0.0:1787831284.472250:0:22816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22034a7400/0x95459fb9d1d2ac65 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831284.472265:0:22816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22034a7400/0x95459fb9d1d2ac65 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831284.472280:0:22816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d233a6f9000) 00010000:00010000:0.0:1787831284.472283:0:22816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787831284.472290:0:22816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22034a7400/0x95459fb9d1d2ac65 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831284.472296:0:22816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22034a7400/0x95459fb9d1d2ac65 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831284.472313:0:22816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22034a6a00/0x95459fb9d1d2ac6c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831284.472319:0:22816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22034a6a00/0x95459fb9d1d2ac6c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831284.472325:0:22816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22034a6a00/0x95459fb9d1d2ac6c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831284.472331:0:22816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22034a6a00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:0.0:1787831284.472334:0:22816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22034a6a00/0x95459fb9d1d2ac6c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831284.472340:0:22816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22034a6a00/0x95459fb9d1d2ac6c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831284.472347:0:22816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8d2334517f00) 00010000:00010000:0.0:1787831284.472350:0:22816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787831284.472352:0:22816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22034a6a00/0x95459fb9d1d2ac6c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831284.472368:0:22816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22034a6a00/0x95459fb9d1d2ac6c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831284.472399:0:22816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22034a7200/0x95459fb9d1d2ac5e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994244de expref: 8 pid: 22816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831284.472413:0:22816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22034a6c00/0x95459fb9d1d2ac73 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994244de expref: 7 pid: 22816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831284.472420:0:22816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8d2334517500) 00010000:00010000:0.0:1787831284.472423:0:22816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787831284.472425:0:22816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22034a6c00, rc 0) 00000100:00100000:0.0:1787831284.472512:0:22816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22047052c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c60c7f3-708e-4896-8908-a503cf94fb51+7:18884:x1874676433462272:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 723us (1028us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831284.472521:0:22816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 31 00000100:00100000:1.0:1787831284.480783:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831284.480884:0:22827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433462400 00000100:00100000:2.0:1787831284.480896:0:22827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433462400 00000100:00100000:2.0:1787831284.480978:0:22827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 6 00000100:00100000:2.0:1787831284.480989:0:22827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:7c60c7f3-708e-4896-8908-a503cf94fb51+5:18884:x1874676433462400:12345-192.168.203.31@tcp:900:lfs.0 00000100:00100000:2.0:1787831284.481107:0:22827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:7c60c7f3-708e-4896-8908-a503cf94fb51+5:18884:x1874676433462400:12345-192.168.203.31@tcp:900:lfs.0 Request processed in 120us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831284.481116:0:22827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 6 00000100:00080000:1.0:1787831284.482004:0:22811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787831284.486988:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831284.487168:0:22815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433462656 00000100:00100000:3.0:1787831284.487182:0:22815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433462656 00000100:00100000:3.0:1787831284.487319:0:22815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 32 00000100:00100000:3.0:1787831284.487333:0:22815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204704780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c60c7f3-708e-4896-8908-a503cf94fb51+7:18884:x1874676433462656:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:3.0:1787831284.487365:0:22815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787831284.487393:0:22815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233837b600/0x95459fb9d1d2ac7a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a994244e5 expref: -99 pid: 22815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787831284.487549:0:22815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1787831284.487722:0:22815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233837b600/0x95459fb9d1d2ac7a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994244e5 expref: 9 pid: 22815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831284.487760:0:22815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d233a6f9000) 00010000:00010000:3.0:1787831284.487763:0:22815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787831284.487767:0:22815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233837b600/0x95459fb9d1d2ac7a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994244e5 expref: 9 pid: 22815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831284.487778:0:22815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233837b600, rc 0) 00000100:00100000:3.0:1787831284.487901:0:22815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204704780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c60c7f3-708e-4896-8908-a503cf94fb51+8:18884:x1874676433462656:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 572us (928us total) trans 12884901891 rc 301/301 00000100:00100000:3.0:1787831284.487910:0:22815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 32 00000100:00100000:3.0:1787831284.493710:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831284.493789:0:22851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433462912 00000100:00100000:0.0:1787831284.493804:0:22851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433462912 00000100:00100000:0.0:1787831284.493988:0:22851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 33 00000100:00100000:0.0:1787831284.494003:0:22851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203afd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c60c7f3-708e-4896-8908-a503cf94fb51+8:18884:x1874676433462912:12345-192.168.203.31@tcp:36:lfs.0 00010000:00010000:0.0:1787831284.494085:0:22851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787831284.494122:0:22851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22034a6c00/0x95459fb9d1d2ac73 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994244de expref: 8 pid: 22816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831284.494145:0:22851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8d2334517500) 00010000:00010000:0.0:1787831284.494150:0:22851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787831284.494177:0:22851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22034a7200/0x95459fb9d1d2ac88 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831284.494208:0:22851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22034a7200/0x95459fb9d1d2ac88 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831284.494217:0:22851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22034a7200/0x95459fb9d1d2ac88 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787831284.494452:0:22851:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000dd6e543 reply state 000000001e386b64 transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22034a7200/0x95459fb9d1d2ac88 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831284.494466:0:22851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22034a7200/0x95459fb9d1d2ac88 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831284.494474:0:22851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8d2334517500) 00010000:00010000:0.0:1787831284.494477:0:22851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:0.0:1787831284.494480:0:22851:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1787831284.494490:0:22851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1787831284.494602:0:22851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203afd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c60c7f3-708e-4896-8908-a503cf94fb51+9:18884:x1874676433462912:12345-192.168.203.31@tcp:36:lfs.0 Request processed in 602us (906us total) trans 12884901892 rc 0/0 00000100:00100000:0.0:1787831284.494610:0:22851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 33 00000100:00100000:1.0:1787831284.497043:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831284.497307:0:22810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433463040 00000100:00100000:2.0:1787831284.497320:0:22810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433463040 00000100:00100000:2.0:1787831284.497390:0:22810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 147 00000100:00100000:2.0:1787831284.497402:0:22810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22025d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c04154b7-8c89-4cf2-a4c4-5dd132db0903+11:18247:x1874676433463040:12345-192.168.203.31@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787831284.497424:0:22810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787831284.497467:0:22810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d22039c0600/0x95459fb9d1d2ac8f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe558a92a994244ec expref: -99 pid: 22810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831284.497512:0:22810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22039c0600/0x95459fb9d1d2ac8f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994244ec expref: 12 pid: 22810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831284.497527:0:22810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d22039c0600/0x95459fb9d1d2ac8f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994244ec expref: 12 pid: 22810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831284.497539:0:22810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22039c0600, rc 0) 00000100:00100000:2.0:1787831284.498036:0:22810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22025d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c04154b7-8c89-4cf2-a4c4-5dd132db0903+12:18247:x1874676433463040:12345-192.168.203.31@tcp:101:ll_cfg_requeue.0 Request processed in 632us (1006us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831284.498045:0:22810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 147 00000100:00100000:2.0:1787831284.498923:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831284.499163:0:22818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433463296 00000100:00100000:1.0:1787831284.499173:0:22818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433463296 00000100:00100000:1.0:1787831284.499237:0:22818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 2 00000100:00100000:1.0:1787831284.499248:0:22818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204704000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c60c7f3-708e-4896-8908-a503cf94fb51+9:18884:x1874676433463296:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:1.0:1787831284.499550:0:22818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204704000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c60c7f3-708e-4896-8908-a503cf94fb51+10:18884:x1874676433463296:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 303us (631us total) trans 12884901893 rc 0/0 00000100:00100000:1.0:1787831284.499556:0:22818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 2 00000100:00100000:3.0:1787831284.500640:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831284.500699:0:22809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433463424 00000100:00100000:2.0:1787831284.500707:0:22809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433463424 00000100:00100000:2.0:1787831284.500762:0:22809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 148 00000100:00100000:2.0:1787831284.500772:0:22809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2305ffb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c04154b7-8c89-4cf2-a4c4-5dd132db0903+12:18247:x1874676433463424:12345-192.168.203.31@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787831284.500964:0:22809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2305ffb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c04154b7-8c89-4cf2-a4c4-5dd132db0903+12:18247:x1874676433463424:12345-192.168.203.31@tcp:501:ll_cfg_requeue.0 Request processed in 192us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831284.500973:0:22809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 148 00000100:00100000:0.0:1787831284.505469:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831284.505542:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831284.505604:0:22817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433463680 00000100:00100000:1.0:1787831284.505669:0:22817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433463680 00000100:00100000:1.0:1787831284.505764:0:22817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 34 00000100:00100000:1.0:1787831284.505776:0:22817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233448a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c60c7f3-708e-4896-8908-a503cf94fb51+10:18884:x1874676433463680:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:1.0:1787831284.505805:0:22817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787831284.505833:0:22817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94600/0x95459fb9d1d2ac96 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a994244f3 expref: -99 pid: 22817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831284.505955:0:22817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95c00/0x95459fb9d1d2ac9d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831284.505989:0:22817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95c00/0x95459fb9d1d2ac9d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831284.506004:0:22817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95c00/0x95459fb9d1d2ac9d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831284.506041:0:22817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95200/0x95459fb9d1d2aca4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831284.506051:0:22817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95200/0x95459fb9d1d2aca4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831284.506059:0:22817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95200/0x95459fb9d1d2aca4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831284.506163:0:22810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433463808 00000100:00100000:2.0:1787831284.506169:0:22810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433463808 00000100:00100000:2.0:1787831284.506211:0:22810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 149 00000004:00200000:1.0:1787831284.506214:0:22817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1787831284.506222:0:22810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2305ffb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c04154b7-8c89-4cf2-a4c4-5dd132db0903+12:18247:x1874676433463808:12345-192.168.203.31@tcp:503:ll_cfg_requeue.0 00010000:00010000:1.0:1787831284.506317:0:22817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95c00/0x95459fb9d1d2ac9d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831284.506326:0:22817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95c00/0x95459fb9d1d2ac9d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831284.506334:0:22817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95c00/0x95459fb9d1d2ac9d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831284.506341:0:22817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233be95c00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:1.0:1787831284.506346:0:22817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95c00/0x95459fb9d1d2ac9d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831284.506356:0:22817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95c00/0x95459fb9d1d2ac9d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831284.506371:0:22817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d233a6f9000) 00010000:00010000:1.0:1787831284.506374:0:22817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787831284.506380:0:22817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95c00/0x95459fb9d1d2ac9d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831284.506392:0:22810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2305ffb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c04154b7-8c89-4cf2-a4c4-5dd132db0903+12:18247:x1874676433463808:12345-192.168.203.31@tcp:503:ll_cfg_requeue.0 Request processed in 172us (848us total) trans 0 rc 0/0 00010000:00010000:1.0:1787831284.506404:0:22817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95c00/0x95459fb9d1d2ac9d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831284.506423:0:22817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95200/0x95459fb9d1d2aca4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831284.506429:0:22817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95200/0x95459fb9d1d2aca4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831284.506435:0:22817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95200/0x95459fb9d1d2aca4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831284.506441:0:22817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233be95200 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:1.0:1787831284.506444:0:22817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95200/0x95459fb9d1d2aca4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831284.506450:0:22817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95200/0x95459fb9d1d2aca4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831284.506459:0:22817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8d2334517f00) 00010000:00010000:1.0:1787831284.506461:0:22817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787831284.506465:0:22817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95200/0x95459fb9d1d2aca4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831284.506471:0:22817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95200/0x95459fb9d1d2aca4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831284.506499:0:22810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 149 00010000:00010000:1.0:1787831284.506508:0:22817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94600/0x95459fb9d1d2ac96 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994244f3 expref: 12 pid: 22817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831284.506529:0:22817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d233a6f9000) 00010000:00010000:1.0:1787831284.506531:0:22817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787831284.506535:0:22817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94600/0x95459fb9d1d2ac96 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994244f3 expref: 12 pid: 22817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831284.506544:0:22817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233be94600, rc 0) 00000100:00100000:1.0:1787831284.506578:0:22817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233448a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c60c7f3-708e-4896-8908-a503cf94fb51+11:18884:x1874676433463680:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 806us (1122us total) trans 12884901894 rc 301/301 00000100:00100000:1.0:1787831284.506585:0:22817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 34 00000100:00100000:0.0:1787831284.509155:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831284.510105:0:22851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433463936 00000100:00100000:3.0:1787831284.510118:0:22851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433463936 00000100:00100000:0.0:1787831284.510148:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831284.510217:0:22808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433464064 00000100:00100000:1.0:1787831284.510223:0:22808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433464064 00000100:00100000:1.0:1787831284.510312:0:22808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 150 00000100:00100000:1.0:1787831284.510334:0:22808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2305ffa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c04154b7-8c89-4cf2-a4c4-5dd132db0903+12:18247:x1874676433464064:12345-192.168.203.31@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787831284.510357:0:22808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787831284.510382:0:22808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d233be94a00/0x95459fb9d1d2acb2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe558a92a99424501 expref: -99 pid: 22808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831284.510387:0:22851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 35 00000100:00100000:2.0:1787831284.510402:0:22851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2334488b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c60c7f3-708e-4896-8908-a503cf94fb51+11:18884:x1874676433463936:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:2.0:1787831284.510422:0:22851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787831284.510430:0:22808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d233be94a00/0x95459fb9d1d2acb2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424501 expref: 13 pid: 22808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831284.510441:0:22851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0e00/0x95459fb9d1d2acb9 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a994244fa expref: -99 pid: 22851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831284.510446:0:22808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d233be94a00/0x95459fb9d1d2acb2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424501 expref: 13 pid: 22808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831284.510463:0:22808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233be94a00, rc 0) 00000100:00100000:1.0:1787831284.510547:0:22808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2305ffa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c04154b7-8c89-4cf2-a4c4-5dd132db0903+13:18247:x1874676433464064:12345-192.168.203.31@tcp:101:ll_cfg_requeue.0 Request processed in 216us (400us total) trans 0 rc 0/0 00010000:00010000:2.0:1787831284.510571:0:22851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0000/0x95459fb9d1d2acc0 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831284.510585:0:22808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 150 00010000:00010000:2.0:1787831284.510590:0:22851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0000/0x95459fb9d1d2acc0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831284.510604:0:22851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0000/0x95459fb9d1d2acc0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787831284.510661:0:22851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787831284.510666:0:22851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787831284.510696:0:22851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0000/0x95459fb9d1d2acc0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831284.510728:0:22851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0e00/0x95459fb9d1d2acb9 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994244fa expref: 13 pid: 22851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831284.510748:0:22851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0000/0x95459fb9d1d2acc0 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994244fa expref: 12 pid: 22851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831284.510758:0:22851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8d2334517500) 00010000:00010000:2.0:1787831284.513000:0:22851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787831284.513009:0:22851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22039c0000, rc 0) 00000100:00100000:2.0:1787831284.513097:0:22851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2334488b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c60c7f3-708e-4896-8908-a503cf94fb51+12:18884:x1874676433463936:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 2693us (3949us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831284.513107:0:22851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 35 00000100:00100000:3.0:1787831284.513350:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831284.513679:0:22810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433464192 00000100:00100000:2.0:1787831284.513689:0:22810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433464192 00000100:00100000:2.0:1787831284.513792:0:22810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 151 00000100:00100000:2.0:1787831284.513803:0:22810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2305ffa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c04154b7-8c89-4cf2-a4c4-5dd132db0903+13:18247:x1874676433464192:12345-192.168.203.31@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787831284.513976:0:22810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2305ffa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c04154b7-8c89-4cf2-a4c4-5dd132db0903+13:18247:x1874676433464192:12345-192.168.203.31@tcp:501:ll_cfg_requeue.0 Request processed in 175us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831284.513984:0:22810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 151 00000100:00100000:0.0:1787831284.516706:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831284.516761:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831284.516775:0:22819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433464320 00000100:00100000:3.0:1787831284.516788:0:22819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433464320 00000100:00100000:2.0:1787831284.516883:0:22818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 3 00000100:00100000:2.0:1787831284.516898:0:22818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2334488f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c60c7f3-708e-4896-8908-a503cf94fb51+12:18884:x1874676433464320:12345-192.168.203.31@tcp:37:lfs.0 00000100:00100000:1.0:1787831284.517129:0:22808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433464448 00000100:00100000:1.0:1787831284.517134:0:22808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433464448 00000100:00100000:1.0:1787831284.517167:0:22808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 152 00000100:00100000:1.0:1787831284.517174:0:22808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2305ffa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c04154b7-8c89-4cf2-a4c4-5dd132db0903+13:18247:x1874676433464448:12345-192.168.203.31@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787831284.517675:0:22808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2305ffa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c04154b7-8c89-4cf2-a4c4-5dd132db0903+13:18247:x1874676433464448:12345-192.168.203.31@tcp:503:ll_cfg_requeue.0 Request processed in 498us (911us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831284.517684:0:22808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 152 00000100:00100000:2.0:1787831284.525997:0:22818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2334488f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c60c7f3-708e-4896-8908-a503cf94fb51+12:18884:x1874676433464320:12345-192.168.203.31@tcp:37:lfs.0 Request processed in 9085us (9287us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831284.526015:0:22818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 3 00000100:00100000:0.0:1787831284.529761:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831284.529856:0:22819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433464704 00000100:00100000:3.0:1787831284.529876:0:22819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433464704 00000100:00100000:3.0:1787831284.529950:0:22819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 4 00000100:00100000:3.0:1787831284.529961:0:22819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233f42b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c60c7f3-708e-4896-8908-a503cf94fb51+12:18884:x1874676433464704:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:3.0:1787831284.530882:0:22819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233f42b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c60c7f3-708e-4896-8908-a503cf94fb51+13:18884:x1874676433464704:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 906us (1117us total) trans 12884901895 rc 0/0 00000100:00100000:3.0:1787831284.530895:0:22819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 4 00000100:00100000:3.0:1787831284.569342:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831284.570275:0:22817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433464832 00000100:00100000:1.0:1787831284.570291:0:22817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433464832 00000100:00100000:1.0:1787831284.570442:0:22817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 36 00000100:00100000:1.0:1787831284.570456:0:22817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203afe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+11:18892:x1874676433464832:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:1.0:1787831284.570484:0:22817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787831284.570510:0:22817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94600/0x95459fb9d1d2acc7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99424508 expref: -99 pid: 22817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831284.570597:0:22817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95200/0x95459fb9d1d2acce lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831284.570615:0:22817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95200/0x95459fb9d1d2acce lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831284.570659:0:22817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95200/0x95459fb9d1d2acce lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831284.570674:0:22817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95c00/0x95459fb9d1d2acd5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831284.570709:0:22817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95c00/0x95459fb9d1d2acd5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831284.570717:0:22817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95c00/0x95459fb9d1d2acd5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831284.570820:0:22817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95e00/0x95459fb9d1d2acdc lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831284.570828:0:22817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95e00/0x95459fb9d1d2acdc lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831284.570833:0:22817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95e00/0x95459fb9d1d2acdc lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787831284.570880:0:22817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787831284.570884:0:22817:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787831284.570932:0:22817:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95e00/0x95459fb9d1d2acdc lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831284.570945:0:22817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95200/0x95459fb9d1d2acce lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831284.570953:0:22817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95200/0x95459fb9d1d2acce lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831284.570961:0:22817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95200/0x95459fb9d1d2acce lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831284.570968:0:22817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233be95200 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:1.0:1787831284.570974:0:22817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95200/0x95459fb9d1d2acce lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831284.570990:0:22817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95200/0x95459fb9d1d2acce lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831284.571006:0:22817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d233a6f9000) 00010000:00010000:1.0:1787831284.571009:0:22817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787831284.571014:0:22817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95200/0x95459fb9d1d2acce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831284.571020:0:22817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95200/0x95459fb9d1d2acce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831284.571036:0:22817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95c00/0x95459fb9d1d2acd5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831284.571043:0:22817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95c00/0x95459fb9d1d2acd5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831284.571049:0:22817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95c00/0x95459fb9d1d2acd5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831284.571055:0:22817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233be95c00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:1.0:1787831284.571057:0:22817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95c00/0x95459fb9d1d2acd5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831284.571062:0:22817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95c00/0x95459fb9d1d2acd5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831284.571067:0:22817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8d2334517f00) 00010000:00010000:1.0:1787831284.571069:0:22817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787831284.571071:0:22817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95c00/0x95459fb9d1d2acd5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831284.571083:0:22817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95c00/0x95459fb9d1d2acd5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831284.571107:0:22817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94600/0x95459fb9d1d2acc7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424508 expref: 13 pid: 22817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831284.571119:0:22817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95e00/0x95459fb9d1d2acdc lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424508 expref: 12 pid: 22817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831284.571124:0:22817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8d2334517500) 00010000:00010000:1.0:1787831284.571125:0:22817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787831284.571127:0:22817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233be95e00, rc 0) 00000100:00100000:1.0:1787831284.571204:0:22817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203afe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+12:18892:x1874676433464832:12345-192.168.203.31@tcp:101:bash.0 Request processed in 751us (1877us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831284.571213:0:22817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 36 00000100:00100000:0.0:1787831284.576725:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831284.576793:0:22826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433464960 00000100:00100000:3.0:1787831284.576807:0:22826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433464960 00000100:00100000:3.0:1787831284.576919:0:22826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 7 00000100:00100000:3.0:1787831284.576933:0:22826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2334488f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+5:18892:x1874676433464960:12345-192.168.203.31@tcp:900:bash.0 00000100:00100000:3.0:1787831284.577045:0:22826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2334488f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+5:18892:x1874676433464960:12345-192.168.203.31@tcp:900:bash.0 Request processed in 116us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831284.577053:0:22826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 7 00000100:00100000:0.0:1787831284.579244:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831284.579342:0:22816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433465216 00000100:00100000:1.0:1787831284.579352:0:22816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433465216 00000100:00100000:1.0:1787831284.579422:0:22816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 37 00000100:00100000:1.0:1787831284.579433:0:22816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2334489a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+12:18892:x1874676433465216:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:1.0:1787831284.579460:0:22816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787831284.579487:0:22816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94600/0x95459fb9d1d2ace3 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a9942450f expref: -99 pid: 22816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831284.579682:0:22816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95c00/0x95459fb9d1d2acea lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831284.579702:0:22816:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0000/0x95459fb9d1d2acc0 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a994244fa expref: 12 pid: 22851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831284.579729:0:22816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95c00/0x95459fb9d1d2acea lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831284.579773:0:22816:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0000/0x95459fb9d1d2acc0 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0xe558a92a994244fa expref: 12 pid: 22851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831284.579800:0:22816:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0000/0x95459fb9d1d2acc0 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a994244fa expref: 12 pid: 22851 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831284.579823:0:22816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233fae8b40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22816:1874676444015616:192.168.203.31@tcp:104: 00000100:00100000:1.0:1787831284.579931:0:22816:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d23063bbd80 going to sleep for 11 seconds 00000100:00100000:1.0:1787831284.582318:0:22816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233fae8b40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22816:1874676444015616:192.168.203.31@tcp:104: 00010000:00010000:1.0:1787831284.582357:0:22816:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95c00/0x95459fb9d1d2acea lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831284.582693:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831284.582816:0:22801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433465344 00000100:00100000:2.0:1787831284.582824:0:22801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433465344 00010000:00010000:2.0:1787831284.582862:0:22801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0000/0x95459fb9d1d2acc0 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a994244fa expref: 13 pid: 22851 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831284.583107:0:22801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 16 00000100:00100000:2.0:1787831284.583118:0:22801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2309cfa940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c60c7f3-708e-4896-8908-a503cf94fb51+13:2397:x1874676433465344:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787831284.583136:0:22801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787831284.583150:0:22801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0000/0x95459fb9d1d2acc0 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a994244fa expref: 13 pid: 22851 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831284.583165:0:22801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0000/0x95459fb9d1d2acc0 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a994244fa expref: 13 pid: 22851 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831284.583193:0:22801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0000/0x95459fb9d1d2acc0 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a994244fa expref: 13 pid: 22851 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831284.583212:0:22801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8d2334517500) 00010000:00010000:2.0:1787831284.583218:0:22801:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95c00/0x95459fb9d1d2acea lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831284.583229:0:22801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95c00/0x95459fb9d1d2acea lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 22816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831284.583237:0:22801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95c00/0x95459fb9d1d2acea lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 22816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831284.583269:0:22801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787831284.583337:0:22801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2309cfa940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c60c7f3-708e-4896-8908-a503cf94fb51+12:2397:x1874676433465344:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 221us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831284.583346:0:22801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 16 00010000:00010000:1.0:1787831284.583462:0:22816:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95c00/0x95459fb9d1d2acea lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831284.583471:0:22816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95c00/0x95459fb9d1d2acea lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831284.583620:0:22816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95200/0x95459fb9d1d2acf1 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831284.583677:0:22816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95200/0x95459fb9d1d2acf1 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831284.583688:0:22816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95200/0x95459fb9d1d2acf1 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831284.584127:0:22816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95a00/0x95459fb9d1d2acf8 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831284.584135:0:22816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95a00/0x95459fb9d1d2acf8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831284.584139:0:22816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95a00/0x95459fb9d1d2acf8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787831284.584148:0:22816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787831284.584167:0:22816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95c00/0x95459fb9d1d2acea lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831284.584171:0:22816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95c00/0x95459fb9d1d2acea lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831284.584175:0:22816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95c00/0x95459fb9d1d2acea lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831284.584179:0:22816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233be95c00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:1.0:1787831284.584182:0:22816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95c00/0x95459fb9d1d2acea lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831284.584186:0:22816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95c00/0x95459fb9d1d2acea lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831284.584195:0:22816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8d2334517500) 00010000:00010000:1.0:1787831284.584197:0:22816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787831284.584200:0:22816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95c00/0x95459fb9d1d2acea lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831284.584211:0:22816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95c00/0x95459fb9d1d2acea lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787831284.584220:0:22816:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fee5a724 reply state 000000006e0644af transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95200/0x95459fb9d1d2acf1 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831284.584227:0:22816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95200/0x95459fb9d1d2acf1 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831284.584231:0:22816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff8d22035dc700) 00010000:00010000:1.0:1787831284.584233:0:22816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787831284.584235:0:22816:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787831284.584271:0:22816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94600/0x95459fb9d1d2ace3 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a9942450f expref: 15 pid: 22816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831284.584282:0:22816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95a00/0x95459fb9d1d2acf8 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a9942450f expref: 14 pid: 22816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831284.584287:0:22816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8d22035dc600) 00010000:00010000:1.0:1787831284.584289:0:22816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1787831284.584290:0:22816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233be95a00, rc 0) 00000100:00100000:1.0:1787831284.584355:0:22816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2334489a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+15:18892:x1874676433465216:12345-192.168.203.31@tcp:101:bash.0 Request processed in 4924us (5121us total) trans 12884901896 rc 0/0 00000100:00100000:1.0:1787831284.584363:0:22816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 37 00000100:00100000:0.0:1787831284.608105:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831284.614520:0:22815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433465472 00000100:00100000:3.0:1787831284.614552:0:22815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433465472 00000100:00100000:3.0:1787831284.614711:0:22815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 38 00000100:00100000:3.0:1787831284.614724:0:22815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2309cf83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+15:18892:x1874676433465472:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:3.0:1787831284.614757:0:22815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787831284.614786:0:22815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233837aa00/0x95459fb9d1d2ad06 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99424516 expref: -99 pid: 22815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831284.614892:0:22815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233837b600/0x95459fb9d1d2ad0d lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831284.614909:0:22815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233837b600/0x95459fb9d1d2ad0d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831284.614923:0:22815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233837b600/0x95459fb9d1d2ad0d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787831284.617283:0:22815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1787831284.617306:0:22815:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787831284.617369:0:22815:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d233837b600/0x95459fb9d1d2ad0d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831284.617389:0:22815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233837b600/0x95459fb9d1d2ad0d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831284.617464:0:22815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233837aa00/0x95459fb9d1d2ad06 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424516 expref: 17 pid: 22815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831284.617493:0:22815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233837b600/0x95459fb9d1d2ad0d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424516 expref: 16 pid: 22815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831284.617513:0:22815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8d22035dc600) 00010000:00010000:2.0:1787831284.617517:0:22815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787831284.617521:0:22815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233837b600, rc 0) 00000100:00100000:2.0:1787831284.617616:0:22815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2309cf83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+16:18892:x1874676433465472:12345-192.168.203.31@tcp:101:bash.0 Request processed in 2894us (9526us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831284.617671:0:22815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 38 00000100:00100000:0.0:1787831284.620137:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831284.620317:0:22819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433465728 00000100:00100000:3.0:1787831284.620340:0:22819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433465728 00000100:00100000:3.0:1787831284.620426:0:22819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 5 00000100:00100000:3.0:1787831284.620437:0:22819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2309cf9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+16:18892:x1874676433465728:12345-192.168.203.31@tcp:35:bash.0 00000100:00100000:3.0:1787831284.620820:0:22819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2309cf9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+17:18892:x1874676433465728:12345-192.168.203.31@tcp:35:bash.0 Request processed in 384us (697us total) trans 12884901897 rc 0/0 00000100:00100000:3.0:1787831284.620847:0:22819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 5 00000040:00080000:2.0:1787831284.651184:0:22852:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787831284.716579:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831284.716677:0:22851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433465984 00000100:00100000:2.0:1787831284.716688:0:22851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433465984 00000100:00100000:2.0:1787831284.716754:0:22851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 39 00000100:00100000:2.0:1787831284.716763:0:22851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203afc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+17:18902:x1874676433465984:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:2.0:1787831284.716790:0:22851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787831284.716813:0:22851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0000/0x95459fb9d1d2ad14 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a9942451d expref: -99 pid: 22851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787831284.716959:0:22851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1787831284.717114:0:22851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0000/0x95459fb9d1d2ad14 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a9942451d expref: 19 pid: 22851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831284.717133:0:22851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d233a6f9000) 00010000:00010000:2.0:1787831284.717156:0:22851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787831284.717164:0:22851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0000/0x95459fb9d1d2ad14 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a9942451d expref: 19 pid: 22851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831284.717182:0:22851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22039c0000, rc 0) 00000100:00100000:2.0:1787831284.717266:0:22851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203afc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+18:18902:x1874676433465984:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 504us (702us total) trans 12884901898 rc 301/301 00000100:00100000:2.0:1787831284.717280:0:22851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 39 00000100:00100000:0.0:1787831284.723962:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831284.724058:0:22819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433466240 00000100:00100000:3.0:1787831284.724069:0:22819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433466240 00000100:00100000:3.0:1787831284.724135:0:22819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 6 00000100:00100000:3.0:1787831284.724147:0:22819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2318d543c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+18:18902:x1874676433466240:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:3.0:1787831284.724580:0:22819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2318d543c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+19:18902:x1874676433466240:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 432us (629us total) trans 12884901899 rc 0/0 00000100:00100000:3.0:1787831284.724593:0:22819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 6 00000100:00100000:0.0:1787831284.765534:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831284.765978:0:22817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433466496 00000100:00100000:1.0:1787831284.765992:0:22817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433466496 00000100:00100000:1.0:1787831284.766152:0:22817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 40 00000100:00100000:1.0:1787831284.766166:0:22817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2318d57840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+19:18905:x1874676433466496:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:1.0:1787831284.766216:0:22817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787831284.766244:0:22817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94600/0x95459fb9d1d2ad22 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99424524 expref: -99 pid: 22817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831284.766396:0:22817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95c00/0x95459fb9d1d2ad29 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831284.766424:0:22817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95c00/0x95459fb9d1d2ad29 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831284.766438:0:22817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95c00/0x95459fb9d1d2ad29 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787831284.766452:0:22817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787831284.766585:0:22817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94600/0x95459fb9d1d2ad22 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424524 expref: 22 pid: 22817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831284.766608:0:22817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95c00/0x95459fb9d1d2ad29 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424524 expref: 21 pid: 22817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831284.766618:0:22817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8d22035dc600) 00010000:00010000:1.0:1787831284.766621:0:22817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787831284.766663:0:22817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233be95c00, rc 0) 00000100:00100000:1.0:1787831284.766751:0:22817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2318d57840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+21:18905:x1874676433466496:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 586us (1230us total) trans 12884901900 rc 0/0 00000100:00100000:1.0:1787831284.766759:0:22817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 40 00000100:00100000:0.0:1787831284.770214:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831284.770261:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831284.770301:0:22816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433466624 00000100:00100000:1.0:1787831284.770318:0:22816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433466624 00000100:00100000:3.0:1787831284.770384:0:22803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433466752 00000100:00100000:3.0:1787831284.770389:0:22803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433466752 00000100:00100000:1.0:1787831284.770483:0:22816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 41 00000100:00100000:3.0:1787831284.770499:0:22803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 0 00000100:00100000:3.0:1787831284.770512:0:22803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb13c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+22:2395:x1874676433466752:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787831284.770535:0:22803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1787831284.770538:0:22816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb112c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+22:18905:x1874676433466624:12345-192.168.203.31@tcp:54:lfs.0 00010000:00010000:3.0:1787831284.770574:0:22803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95c00/0x95459fb9d1d2ad29 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424524 expref: 22 pid: 22817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831284.770601:0:22803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8d22035dc600) 00010000:00010000:3.0:1787831284.770608:0:22803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787831284.770688:0:22816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95400/0x95459fb9d1d2ad37 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787831284.770702:0:22803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb13c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+21:2395:x1874676433466752:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 193us (438us total) trans 0 rc 0/0 00010000:00010000:1.0:1787831284.770706:0:22816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95400/0x95459fb9d1d2ad37 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787831284.770714:0:22803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 0 00010000:00010000:1.0:1787831284.770731:0:22816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95400/0x95459fb9d1d2ad37 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831284.770792:0:22816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95400/0x95459fb9d1d2ad37 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831284.770801:0:22816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95400/0x95459fb9d1d2ad37 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831284.770809:0:22816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95400/0x95459fb9d1d2ad37 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831284.770822:0:22816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233be95400 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:1.0:1787831284.770829:0:22816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95400/0x95459fb9d1d2ad37 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831284.770839:0:22816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95400/0x95459fb9d1d2ad37 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831284.770848:0:22816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8d22035dc600) 00010000:00010000:1.0:1787831284.770856:0:22816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787831284.770862:0:22816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95400/0x95459fb9d1d2ad37 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831284.770879:0:22816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95400/0x95459fb9d1d2ad37 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831284.770944:0:22816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb112c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+20:18905:x1874676433466624:12345-192.168.203.31@tcp:54:lfs.0 Request processed in 411us (744us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831284.770951:0:22816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 41 00000100:00100000:0.0:1787831284.773705:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831284.773925:0:22818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433467008 00000100:00100000:2.0:1787831284.773938:0:22818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433467008 00000100:00100000:2.0:1787831284.774037:0:22818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 7 00000100:00100000:2.0:1787831284.774049:0:22818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb130c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+20:18905:x1874676433467008:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:2.0:1787831284.774417:0:22818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb130c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+21:18905:x1874676433467008:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 368us (723us total) trans 12884901901 rc 0/0 00000100:00100000:2.0:1787831284.774425:0:22818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 7 00000100:00100000:0.0:1787831284.976773:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831284.976995:0:22815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433467264 00000100:00100000:2.0:1787831284.977008:0:22815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433467264 00000100:00100000:2.0:1787831284.977164:0:22815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 42 00000100:00100000:2.0:1787831284.977176:0:22815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb10f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+21:18936:x1874676433467264:12345-192.168.203.31@tcp:101:cat.0 00010000:00010000:2.0:1787831284.977207:0:22815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787831284.977237:0:22815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0000/0x95459fb9d1d2ad3e lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a9942452b expref: -99 pid: 22815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831284.978348:0:22815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0e00/0x95459fb9d1d2ad45 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831284.978371:0:22815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0e00/0x95459fb9d1d2ad45 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831284.978585:0:22815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0e00/0x95459fb9d1d2ad45 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787831284.978603:0:22815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787831284.978778:0:22815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0000/0x95459fb9d1d2ad3e lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a9942452b expref: 24 pid: 22815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831284.978800:0:22815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0e00/0x95459fb9d1d2ad45 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a9942452b expref: 23 pid: 22815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831284.978810:0:22815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8d22035dc600) 00010000:00010000:2.0:1787831284.978813:0:22815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787831284.978817:0:22815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22039c0e00, rc 0) 00000100:00100000:2.0:1787831284.978917:0:22815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb10f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+23:18936:x1874676433467264:12345-192.168.203.31@tcp:101:cat.0 Request processed in 1743us (2160us total) trans 12884901902 rc 0/0 00000100:00100000:2.0:1787831284.978927:0:22815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 42 00000100:00100000:0.0:1787831284.983985:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831284.984085:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831284.984166:0:22802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433467648 00000100:00100000:2.0:1787831284.984178:0:22802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433467648 00000100:00100000:2.0:1787831284.984261:0:22802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 1 00000100:00100000:2.0:1787831284.984273:0:22802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb11a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+23:2395:x1874676433467648:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787831284.984293:0:22802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787831284.984334:0:22802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0e00/0x95459fb9d1d2ad45 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a9942452b expref: 23 pid: 22815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831284.984356:0:22802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8d22035dc600) 00010000:00010000:2.0:1787831284.984362:0:22802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787831284.984450:0:22802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb11a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+22:2395:x1874676433467648:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 180us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831284.984459:0:22802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 1 00000100:00100000:3.0:1787831284.985929:0:22819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433467520 00000100:00100000:3.0:1787831284.985942:0:22819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433467520 00000100:00100000:3.0:1787831284.986011:0:22819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 8 00000100:00100000:3.0:1787831284.986021:0:22819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb11e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+22:18936:x1874676433467520:12345-192.168.203.31@tcp:35:cat.0 00000100:00100000:3.0:1787831284.986417:0:22819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb11e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+23:18936:x1874676433467520:12345-192.168.203.31@tcp:35:cat.0 Request processed in 396us (2447us total) trans 12884901903 rc 0/0 00000100:00100000:3.0:1787831284.986426:0:22819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 8 00000100:00100000:0.0:1787831285.054893:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831285.056571:0:22851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433467904 00000100:00100000:2.0:1787831285.056588:0:22851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433467904 00000100:00100000:0.0:1787831285.061652:0:22851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 43 00000100:00100000:0.0:1787831285.061681:0:22851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb10780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+23:18942:x1874676433467904:12345-192.168.203.31@tcp:101:dd.0 00010000:00010000:0.0:1787831285.061717:0:22851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787831285.061747:0:22851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22034a7000/0x95459fb9d1d2ad53 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99424532 expref: -99 pid: 22851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831285.061915:0:22851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22034a6200/0x95459fb9d1d2ad5a lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831285.061932:0:22851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95a00/0x95459fb9d1d2acf8 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a9942450f expref: 24 pid: 22816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831285.061942:0:22851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233837b600/0x95459fb9d1d2ad0d lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424516 expref: 24 pid: 22815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831285.061952:0:22851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22034a6200/0x95459fb9d1d2ad5a lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831285.062040:0:22851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d233837b600/0x95459fb9d1d2ad0d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424516 expref: 24 pid: 22815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831285.062058:0:22851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233837b600/0x95459fb9d1d2ad0d lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424516 expref: 24 pid: 22815 timeout: 676 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831285.062075:0:22851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233fb12940 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:22851:1874676444015744:192.168.203.31@tcp:104: 00010000:00010000:0.0:1787831285.062236:0:22851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95a00/0x95459fb9d1d2acf8 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0xe558a92a9942450f expref: 24 pid: 22816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831285.062246:0:22851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95a00/0x95459fb9d1d2acf8 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a9942450f expref: 24 pid: 22816 timeout: 676 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831285.062256:0:22851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233fb13480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:22851:1874676444015872:192.168.203.31@tcp:104: 00000100:00100000:0.0:1787831285.062281:0:22851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d231008c000 going to sleep for 11 seconds 00000100:00100000:0.0:1787831285.069137:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831285.069190:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831285.069318:0:22851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233fb12940 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:22851:1874676444015744:192.168.203.31@tcp:104: 00000100:00100000:2.0:1787831285.069346:0:22851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233fb13480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:22851:1874676444015872:192.168.203.31@tcp:104: 00010000:00010000:2.0:1787831285.069379:0:22851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d22034a6200/0x95459fb9d1d2ad5a lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787831285.070418:0:22802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433468032 00000100:00100000:3.0:1787831285.070429:0:22802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433468032 00010000:00010000:3.0:1787831285.070484:0:22802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d233837b600/0x95459fb9d1d2ad0d lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424516 expref: 25 pid: 22815 timeout: 676 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787831285.070533:0:22802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433468160 00000100:00100000:3.0:1787831285.070537:0:22802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433468160 00010000:00010000:3.0:1787831285.070551:0:22802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95a00/0x95459fb9d1d2acf8 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a9942450f expref: 26 pid: 22816 timeout: 676 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787831285.070566:0:22802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 17 00000100:00100000:3.0:1787831285.070575:0:22802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb103c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+26:2396:x1874676433468032:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787831285.070594:0:22802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787831285.070601:0:22802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d233837b600/0x95459fb9d1d2ad0d lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424516 expref: 26 pid: 22815 timeout: 676 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831285.070615:0:22802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d233837b600/0x95459fb9d1d2ad0d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424516 expref: 26 pid: 22815 timeout: 676 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831285.070686:0:22802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233837b600/0x95459fb9d1d2ad0d lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424516 expref: 26 pid: 22815 timeout: 676 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831285.070705:0:22802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8d22035dc600) 00010000:00010000:3.0:1787831285.070712:0:22802:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22034a6200/0x95459fb9d1d2ad5a lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831285.070739:0:22802:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22034a6200/0x95459fb9d1d2ad5a lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831285.070747:0:22802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787831285.070838:0:22802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb103c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+25:2396:x1874676433468032:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 262us (1717us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831285.070847:0:22802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 17 00000100:00100000:3.0:1787831285.070880:0:22802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 18 00000100:00100000:3.0:1787831285.070888:0:22802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203902c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+24:2394:x1874676433468160:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787831285.070896:0:22802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787831285.070901:0:22802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95a00/0x95459fb9d1d2acf8 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a9942450f expref: 24 pid: 22816 timeout: 676 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831285.070911:0:22802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95a00/0x95459fb9d1d2acf8 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a9942450f expref: 24 pid: 22816 timeout: 676 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831285.070923:0:22802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95a00/0x95459fb9d1d2acf8 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a9942450f expref: 24 pid: 22816 timeout: 676 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831285.070934:0:22802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8d22035dc600) 00010000:00010000:3.0:1787831285.070938:0:22802:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22034a6200/0x95459fb9d1d2ad5a lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831285.070950:0:22802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22034a6200/0x95459fb9d1d2ad5a lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831285.070958:0:22802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22034a6200/0x95459fb9d1d2ad5a lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831285.070993:0:22802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787831285.071012:0:22802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203902c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+23:2394:x1874676433468160:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 125us (1822us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831285.071019:0:22802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 18 00010000:00010000:3.0:1787831285.071098:0:22851:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d22034a6200/0x95459fb9d1d2ad5a lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831285.071107:0:22851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22034a6200/0x95459fb9d1d2ad5a lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787831285.071727:0:22851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1787831285.071952:0:22851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22034a7000/0x95459fb9d1d2ad53 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424532 expref: 24 pid: 22851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831285.071971:0:22851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22034a6200/0x95459fb9d1d2ad5a lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424532 expref: 23 pid: 22851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831285.071979:0:22851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8d22035dc600) 00010000:00010000:3.0:1787831285.071982:0:22851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787831285.071985:0:22851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22034a6200, rc 0) 00000100:00100000:3.0:1787831285.072028:0:22851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb10780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+23:18942:x1874676433467904:12345-192.168.203.31@tcp:101:dd.0 Request processed in 10361us (17163us total) trans 12884901904 rc 0/0 00000100:00100000:3.0:1787831285.072036:0:22851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 43 00000100:00100000:0.0:1787831285.077358:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831285.077480:0:22817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433468288 00000100:00100000:1.0:1787831285.077495:0:22817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433468288 00000100:00100000:1.0:1787831285.077573:0:22817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 44 00000100:00100000:1.0:1787831285.077585:0:22817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb12d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+23:18942:x1874676433468288:12345-192.168.203.31@tcp:101:dd.0 00010000:00010000:1.0:1787831285.077615:0:22817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787831285.077677:0:22817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95400/0x95459fb9d1d2ad68 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99424539 expref: -99 pid: 22817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831285.077723:0:22817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94600/0x95459fb9d1d2ad6f lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831285.077741:0:22817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94600/0x95459fb9d1d2ad6f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831285.077756:0:22817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94600/0x95459fb9d1d2ad6f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831285.077926:0:22817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95400/0x95459fb9d1d2ad68 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424539 expref: 25 pid: 22817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831285.077950:0:22817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94600/0x95459fb9d1d2ad6f lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424539 expref: 24 pid: 22817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831285.077959:0:22817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8d22035dc600) 00010000:00010000:1.0:1787831285.077970:0:22817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787831285.077975:0:22817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233be94600, rc 0) 00000100:00100000:1.0:1787831285.078042:0:22817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb12d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+24:18942:x1874676433468288:12345-192.168.203.31@tcp:101:dd.0 Request processed in 460us (701us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831285.078051:0:22817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 44 00000100:00100000:2.0:1787831285.082401:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831285.084531:0:22816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433468544 00000100:00100000:1.0:1787831285.084550:0:22816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433468544 00000100:00100000:1.0:1787831285.084874:0:22816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 45 00000100:00100000:1.0:1787831285.084889:0:22816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22047043c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+24:18942:x1874676433468544:12345-192.168.203.31@tcp:36:dd.0 00010000:00010000:1.0:1787831285.085206:0:22816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95a00/0x95459fb9d1d2ad76 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831285.085228:0:22816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95a00/0x95459fb9d1d2ad76 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831285.085243:0:22816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95a00/0x95459fb9d1d2ad76 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22816 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787831285.085307:0:22816:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901905 00000004:00010000:1.0:1787831285.085406:0:22816:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000eaf58ea7 reply state 00000000620952d2 transno 12884901906 ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95a00/0x95459fb9d1d2ad76 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831285.085423:0:22816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95a00/0x95459fb9d1d2ad76 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831285.085432:0:22816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8d22035dc600) 00010000:00010000:1.0:1787831285.085435:0:22816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787831285.085440:0:22816:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787831285.085561:0:22816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22047043c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+27:18942:x1874676433468544:12345-192.168.203.31@tcp:36:dd.0 Request processed in 675us (3178us total) trans 12884901906 rc 0/0 00000100:00100000:1.0:1787831285.085594:0:22816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 45 00000020:00080000:1.0:1787831285.085600:0:22816:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787831285.088019:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831285.089608:0:22817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433468672 00000100:00100000:1.0:1787831285.089680:0:22817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433468672 00000100:00100000:1.0:1787831285.089803:0:22817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 46 00000100:00100000:1.0:1787831285.089816:0:22817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb10b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+27:18942:x1874676433468672:12345-192.168.203.31@tcp:101:dd.0 00010000:00010000:1.0:1787831285.089847:0:22817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787831285.089889:0:22817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95400/0x95459fb9d1d2ad7d lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99424540 expref: -99 pid: 22817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831285.089963:0:22817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95400/0x95459fb9d1d2ad7d lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424540 expref: 28 pid: 22817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831285.089980:0:22817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95400/0x95459fb9d1d2ad7d lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424540 expref: 28 pid: 22817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831285.090003:0:22817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8d22035dc600) 00010000:00010000:1.0:1787831285.090007:0:22817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787831285.090012:0:22817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233be95400, rc 0) 00000100:00100000:1.0:1787831285.090103:0:22817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb10b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+28:18942:x1874676433468672:12345-192.168.203.31@tcp:101:dd.0 Request processed in 290us (2096us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831285.090111:0:22817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 46 00000100:00100000:0.0:1787831285.103512:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831285.103678:0:22801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433468928 00000100:00100000:1.0:1787831285.103690:0:22801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433468928 00000100:00100000:1.0:1787831285.103802:0:22801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 2 00000100:00100000:1.0:1787831285.103814:0:22801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb121c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+28:18942:x1874676433468928:12345-192.168.203.31@tcp:103:dd.0 00010000:00010000:1.0:1787831285.103861:0:22801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787831285.103910:0:22801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95400/0x95459fb9d1d2ad7d lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424540 expref: 28 pid: 22817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831285.103935:0:22801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8d22035dc600) 00010000:00010000:1.0:1787831285.103940:0:22801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787831285.104013:0:22801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb121c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+27:18942:x1874676433468928:12345-192.168.203.31@tcp:103:dd.0 Request processed in 202us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831285.104022:0:22801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 2 00000100:00100000:0.0:1787831285.106419:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831285.106567:0:22851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433469056 00000100:00100000:2.0:1787831285.106579:0:22851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433469056 00000100:00100000:2.0:1787831285.106671:0:22851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 47 00000100:00100000:2.0:1787831285.106680:0:22851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+27:18942:x1874676433469056:12345-192.168.203.31@tcp:58:dd.0 00010000:00010000:2.0:1787831285.106814:0:22851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1000/0x95459fb9d1d2ad84 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831285.106831:0:22851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1000/0x95459fb9d1d2ad84 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831285.106841:0:22851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1000/0x95459fb9d1d2ad84 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22851 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787831285.109285:0:22851:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787831285.109439:0:22851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:2.0:1787831285.109775:0:22851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:2.0:1787831285.110510:0:22851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+27:18942:x1874676433469056:12345-192.168.203.31@tcp:58:dd.0 Request processed in 3820us (4104us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831285.110543:0:22851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 47 00000100:00100000:0.0:1787831285.113059:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831285.113203:0:22815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433469184 00000100:00100000:2.0:1787831285.113215:0:22815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433469184 00000100:00100000:2.0:1787831285.113290:0:22815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 48 00000100:00100000:2.0:1787831285.113302:0:22815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb11680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+27:18942:x1874676433469184:12345-192.168.203.31@tcp:101:dd.0 00010000:00010000:2.0:1787831285.113408:0:22815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787831285.113438:0:22815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1800/0x95459fb9d1d2ad8b lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99424547 expref: -99 pid: 22815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831285.113514:0:22815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1000/0x95459fb9d1d2ad84 lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831285.113533:0:22815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1800/0x95459fb9d1d2ad8b lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424547 expref: 28 pid: 22815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831285.113556:0:22815:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1000/0x95459fb9d1d2ad84 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 22851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831285.113571:0:22815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1800/0x95459fb9d1d2ad8b lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424547 expref: 28 pid: 22815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831285.113586:0:22815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8d22035dc600) 00010000:00010000:2.0:1787831285.113589:0:22815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787831285.113592:0:22815:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1800/0x95459fb9d1d2ad8b lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424547 expref: 28 pid: 22815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831285.113600:0:22815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22039c1800, rc 0) 00000100:00100000:2.0:1787831285.113908:0:22815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb11680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+28:18942:x1874676433469184:12345-192.168.203.31@tcp:101:dd.0 Request processed in 608us (861us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831285.113916:0:22815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 48 10000000:01000000:2.0:1787831285.159516:0:22812:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787831285.159527:0:22812:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d220341e000 from 13 10000000:01000000:2.0:1787831285.159535:0:22812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787831285.159601:0:22812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d22039c0a00/0x95459fb9d1d2ad92 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831285.159615:0:22812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8d22039c0a00/0x95459fb9d1d2ad92 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831285.159648:0:22812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8d22039c0a00/0x95459fb9d1d2ad92 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831285.159681:0:22812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22047061c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8057bc0f-773b-4151-9d37-d94ddea63831:22812:1874676444016000:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787831285.159786:0:22812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831285.159852:0:22812:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2203b30cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787831285.160518:0:22810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444016000 00000100:00100000:1.0:1787831285.160527:0:22810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444016000 00000100:00100000:1.0:1787831285.160600:0:22810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1787831285.160612:0:22810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2305ff8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8057bc0f-773b-4151-9d37-d94ddea63831+20:22812:x1874676444016000:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787831285.160657:0:22810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787831285.160676:0:22810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d233be95400/0x95459fb9d1d2ad99 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d2ad92 expref: -99 pid: 22810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831285.160716:0:22810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d233be95400/0x95459fb9d1d2ad99 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d2ad92 expref: 21 pid: 22810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831285.160729:0:22810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d233be95400/0x95459fb9d1d2ad99 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d2ad92 expref: 21 pid: 22810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831285.160739:0:22810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233be95400, rc 0) 00000100:00100000:1.0:1787831285.160793:0:22810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2305ff8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8057bc0f-773b-4151-9d37-d94ddea63831+21:22812:x1874676444016000:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 184us (1008us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831285.160801:0:22810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1787831285.162085:0:22812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22047061c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8057bc0f-773b-4151-9d37-d94ddea63831:22812:1874676444016000:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787831285.162455:0:22812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8d22039c0a00/0x95459fb9d1d2ad92 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2ad99 expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831285.162469:0:22812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8d22039c0a00/0x95459fb9d1d2ad92 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d2ad99 expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831285.162569:0:22812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22047061c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8057bc0f-773b-4151-9d37-d94ddea63831:22812:1874676444016128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787831285.162666:0:22812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831285.162728:0:22812:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2203b30cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787831285.163603:0:22808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444016128 00000100:00100000:1.0:1787831285.163612:0:22808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444016128 00000100:00100000:1.0:1787831285.163717:0:22808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1787831285.163729:0:22808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2305ff8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8057bc0f-773b-4151-9d37-d94ddea63831+21:22812:x1874676444016128:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787831285.164565:0:22808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2305ff8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8057bc0f-773b-4151-9d37-d94ddea63831+21:22812:x1874676444016128:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 835us (1896us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831285.164575:0:22808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1787831285.164966:0:22812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22047061c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8057bc0f-773b-4151-9d37-d94ddea63831:22812:1874676444016128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787831285.165065:0:22812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d22047061c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8057bc0f-773b-4151-9d37-d94ddea63831:22812:1874676444016256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787831285.165472:0:22812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831285.165563:0:22812:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2203b30cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787831285.165618:0:22809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444016256 00000100:00100000:0.0:1787831285.165659:0:22809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444016256 00000100:00100000:0.0:1787831285.165970:0:22809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1787831285.165982:0:22809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2305ffb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8057bc0f-773b-4151-9d37-d94ddea63831+21:22812:x1874676444016256:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787831285.166150:0:22809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2305ffb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8057bc0f-773b-4151-9d37-d94ddea63831+21:22812:x1874676444016256:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 170us (679us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831285.166158:0:22809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1787831285.166243:0:22812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d22047061c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8057bc0f-773b-4151-9d37-d94ddea63831:22812:1874676444016256:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787831285.170095:0:25854:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1787831285.170379:0:22812:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1787831285.170409:0:22812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787831285.170424:0:22812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d22039c0a00/0x95459fb9d1d2ad92 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2ad99 expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831285.170437:0:22812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8d22039c0a00/0x95459fb9d1d2ad92 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2ad99 expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787831285.170451:0:22812:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787831285.170455:0:22812:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d232aef4800 from 13 10000000:01000000:2.0:1787831285.170458:0:22812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787831285.170509:0:22812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d22039c1a00/0x95459fb9d1d2ada0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831285.170518:0:22812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8d22039c1a00/0x95459fb9d1d2ada0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831285.170530:0:22812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8d22039c1a00/0x95459fb9d1d2ada0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831285.170562:0:22812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204705680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8057bc0f-773b-4151-9d37-d94ddea63831:22812:1874676444016384:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787831285.170668:0:22812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831285.170713:0:22812:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2203b30240 going to sleep for 11 seconds 00000100:00100000:1.0:1787831285.170897:0:22808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444016384 00000100:00100000:1.0:1787831285.170906:0:22808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444016384 00000100:00100000:1.0:1787831285.170963:0:22808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787831285.170973:0:22808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2305ff8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8057bc0f-773b-4151-9d37-d94ddea63831+21:22812:x1874676444016384:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787831285.170989:0:22808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787831285.171004:0:22808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d233be95c00/0x95459fb9d1d2ada7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d2ada0 expref: -99 pid: 22808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831285.171033:0:22808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d233be95c00/0x95459fb9d1d2ada7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d2ada0 expref: 22 pid: 22808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831285.171046:0:22808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d233be95c00/0x95459fb9d1d2ada7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d2ada0 expref: 22 pid: 22808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831285.171056:0:22808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233be95c00, rc 0) 00000100:00100000:1.0:1787831285.171109:0:22808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2305ff8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8057bc0f-773b-4151-9d37-d94ddea63831+22:22812:x1874676444016384:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831285.171117:0:22808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1787831285.171604:0:22812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204705680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8057bc0f-773b-4151-9d37-d94ddea63831:22812:1874676444016384:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787831285.171641:0:22812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8d22039c1a00/0x95459fb9d1d2ada0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2ada7 expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831285.171651:0:22812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8d22039c1a00/0x95459fb9d1d2ada0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d2ada7 expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831285.171724:0:22812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233fb12580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8057bc0f-773b-4151-9d37-d94ddea63831:22812:1874676444016512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787831285.171757:0:22812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831285.171794:0:22812:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d231008c900 going to sleep for 11 seconds 00000100:00100000:3.0:1787831285.172065:0:22809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444016512 00000100:00100000:3.0:1787831285.172071:0:22809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444016512 00000100:00100000:3.0:1787831285.172121:0:22809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787831285.172130:0:22809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2305ff9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8057bc0f-773b-4151-9d37-d94ddea63831+22:22812:x1874676444016512:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787831285.172317:0:22809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2305ff9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8057bc0f-773b-4151-9d37-d94ddea63831+22:22812:x1874676444016512:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 181us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831285.172326:0:22809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1787831285.172555:0:22812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233fb12580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8057bc0f-773b-4151-9d37-d94ddea63831:22812:1874676444016512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787831285.172593:0:22812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233fb12580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8057bc0f-773b-4151-9d37-d94ddea63831:22812:1874676444016640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787831285.172674:0:22812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831285.172686:0:22812:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d231008c900 going to sleep for 11 seconds 00000100:00100000:2.0:1787831285.172744:0:22810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444016640 00000100:00100000:2.0:1787831285.172749:0:22810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444016640 00000100:00100000:2.0:1787831285.172773:0:22810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787831285.172787:0:22810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2305ffbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8057bc0f-773b-4151-9d37-d94ddea63831+23:22812:x1874676444016640:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787831285.174132:0:22810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2305ffbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8057bc0f-773b-4151-9d37-d94ddea63831+22:22812:x1874676444016640:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1337us (1449us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831285.174145:0:22810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1787831285.174459:0:22812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233fb12580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8057bc0f-773b-4151-9d37-d94ddea63831:22812:1874676444016640:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787831285.181531:0:25855:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1787831285.183462:0:22812:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1787831285.183518:0:22812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787831285.183533:0:22812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d22039c1a00/0x95459fb9d1d2ada0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2ada7 expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831285.183547:0:22812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8d22039c1a00/0x95459fb9d1d2ada0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2ada7 expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787831285.183591:0:22812:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787831285.183594:0:22812:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d2201e09000 from 13 10000000:01000000:0.0:1787831285.183597:0:22812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787831285.183685:0:22812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d22034a7400/0x95459fb9d1d2adae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831285.183694:0:22812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8d22034a7400/0x95459fb9d1d2adae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831285.183705:0:22812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8d22034a7400/0x95459fb9d1d2adae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831285.183736:0:22812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233fb12580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8057bc0f-773b-4151-9d37-d94ddea63831:22812:1874676444016768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787831285.183835:0:22812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831285.183900:0:22812:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d231008c900 going to sleep for 11 seconds 00000100:00100000:1.0:1787831285.184853:0:22808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444016768 00000100:00100000:1.0:1787831285.185051:0:22808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444016768 00000100:00100000:1.0:1787831285.185180:0:22808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1787831285.185190:0:22808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2305ff9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8057bc0f-773b-4151-9d37-d94ddea63831+22:22812:x1874676444016768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787831285.185206:0:22808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787831285.185227:0:22808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2301668800/0x95459fb9d1d2adb5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d2adae expref: -99 pid: 22808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831285.185255:0:22808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2301668800/0x95459fb9d1d2adb5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d2adae expref: 23 pid: 22808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831285.185267:0:22808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2301668800/0x95459fb9d1d2adb5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d2adae expref: 23 pid: 22808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831285.185339:0:22808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2301668800, rc 0) 00000100:00100000:1.0:1787831285.185425:0:22808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2305ff9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8057bc0f-773b-4151-9d37-d94ddea63831+23:22812:x1874676444016768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 237us (1589us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831285.185432:0:22808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1787831285.186549:0:22812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233fb12580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8057bc0f-773b-4151-9d37-d94ddea63831:22812:1874676444016768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787831285.186585:0:22812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8d22034a7400/0x95459fb9d1d2adae lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2adb5 expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831285.186600:0:22812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8d22034a7400/0x95459fb9d1d2adae lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d2adb5 expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831285.186733:0:22812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233fb12580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8057bc0f-773b-4151-9d37-d94ddea63831:22812:1874676444016896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787831285.186797:0:22812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831285.186837:0:22812:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d231008c900 going to sleep for 11 seconds 00000100:00100000:2.0:1787831285.186969:0:22810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444016896 00000100:00100000:2.0:1787831285.186976:0:22810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444016896 00000100:00100000:2.0:1787831285.187029:0:22810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1787831285.187038:0:22810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2305ff9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8057bc0f-773b-4151-9d37-d94ddea63831+23:22812:x1874676444016896:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787831285.187212:0:22810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2305ff9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8057bc0f-773b-4151-9d37-d94ddea63831+23:22812:x1874676444016896:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 175us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831285.187220:0:22810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1787831285.187974:0:22812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233fb12580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8057bc0f-773b-4151-9d37-d94ddea63831:22812:1874676444016896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787831285.188022:0:22812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233fb12580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8057bc0f-773b-4151-9d37-d94ddea63831:22812:1874676444017024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787831285.188171:0:22812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831285.188262:0:22812:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d231008c900 going to sleep for 11 seconds 00000100:00100000:3.0:1787831285.192474:0:22809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444017024 00000100:00100000:3.0:1787831285.192493:0:22809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444017024 00000100:00100000:3.0:1787831285.192611:0:22809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1787831285.192621:0:22809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233cd45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8057bc0f-773b-4151-9d37-d94ddea63831+23:22812:x1874676444017024:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787831285.192854:0:22809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233cd45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8057bc0f-773b-4151-9d37-d94ddea63831+23:22812:x1874676444017024:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 234us (4682us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831285.192876:0:22809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1787831285.192995:0:22812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233fb12580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8057bc0f-773b-4151-9d37-d94ddea63831:22812:1874676444017024:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787831285.197698:0:25856:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1787831285.198101:0:22812:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1787831285.198135:0:22812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787831285.198147:0:22812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d22034a7400/0x95459fb9d1d2adae lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2adb5 expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831285.198158:0:22812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8d22034a7400/0x95459fb9d1d2adae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2adb5 expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787831285.198169:0:22812:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787831285.198172:0:22812:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d233fad3000 from 13 10000000:01000000:0.0:1787831285.198175:0:22812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787831285.198209:0:22812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d22034a6400/0x95459fb9d1d2adbc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831285.198217:0:22812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8d22034a6400/0x95459fb9d1d2adbc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831285.198227:0:22812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8d22034a6400/0x95459fb9d1d2adbc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831285.198253:0:22812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233fb12580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8057bc0f-773b-4151-9d37-d94ddea63831:22812:1874676444017152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787831285.198338:0:22812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831285.198895:0:22812:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d231008c900 going to sleep for 11 seconds 00000100:00100000:2.0:1787831285.198937:0:22810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444017152 00000100:00100000:2.0:1787831285.198944:0:22810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444017152 00000100:00100000:2.0:1787831285.198989:0:22810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1787831285.198999:0:22810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233cd44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8057bc0f-773b-4151-9d37-d94ddea63831+23:22812:x1874676444017152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787831285.199012:0:22810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787831285.199027:0:22810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d22039c0000/0x95459fb9d1d2adc3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x95459fb9d1d2adbc expref: -99 pid: 22810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831285.199052:0:22810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22039c0000/0x95459fb9d1d2adc3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x95459fb9d1d2adbc expref: 24 pid: 22810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831285.199063:0:22810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d22039c0000/0x95459fb9d1d2adc3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x95459fb9d1d2adbc expref: 24 pid: 22810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831285.199072:0:22810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22039c0000, rc 0) 00000100:00100000:2.0:1787831285.199316:0:22810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233cd44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8057bc0f-773b-4151-9d37-d94ddea63831+24:22812:x1874676444017152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 318us (977us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831285.199337:0:22810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1787831285.199543:0:22812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233fb12580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8057bc0f-773b-4151-9d37-d94ddea63831:22812:1874676444017152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787831285.199559:0:22812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8d22034a6400/0x95459fb9d1d2adbc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2adc3 expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831285.199575:0:22812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8d22034a6400/0x95459fb9d1d2adbc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x95459fb9d1d2adc3 expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831285.199671:0:22812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233fb12580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8057bc0f-773b-4151-9d37-d94ddea63831:22812:1874676444017280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787831285.199702:0:22812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831285.199718:0:22812:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d231008c900 going to sleep for 11 seconds 00000100:00100000:3.0:1787831285.199834:0:22809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444017280 00000100:00100000:3.0:1787831285.199840:0:22809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444017280 00000100:00100000:3.0:1787831285.199881:0:22809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1787831285.199889:0:22809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233cd44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8057bc0f-773b-4151-9d37-d94ddea63831+24:22812:x1874676444017280:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787831285.199995:0:22809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233cd44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8057bc0f-773b-4151-9d37-d94ddea63831+24:22812:x1874676444017280:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 107us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831285.200001:0:22809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1787831285.200076:0:22812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233fb12580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8057bc0f-773b-4151-9d37-d94ddea63831:22812:1874676444017280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787831285.200106:0:22812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233fb12580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8057bc0f-773b-4151-9d37-d94ddea63831:22812:1874676444017408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787831285.200149:0:22812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787831285.200179:0:22812:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d231008c900 going to sleep for 11 seconds 00000100:00100000:2.0:1787831285.200650:0:22810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444017408 00000100:00100000:2.0:1787831285.200656:0:22810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444017408 00000100:00100000:0.0:1787831285.200718:0:22810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1787831285.200727:0:22810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233cd46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8057bc0f-773b-4151-9d37-d94ddea63831+24:22812:x1874676444017408:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787831285.200824:0:22810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233cd46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8057bc0f-773b-4151-9d37-d94ddea63831+24:22812:x1874676444017408:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 97us (673us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831285.200831:0:22810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1787831285.200996:0:22812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233fb12580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8057bc0f-773b-4151-9d37-d94ddea63831:22812:1874676444017408:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787831285.202135:0:25857:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1787831285.202315:0:22812:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1787831285.202348:0:22812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787831285.202360:0:22812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8d22034a6400/0x95459fb9d1d2adbc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2adc3 expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831285.202371:0:22812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8d22034a6400/0x95459fb9d1d2adbc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x95459fb9d1d2adc3 expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831285.350784:0:22805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787831285.670829:0:22852:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1787831285.670838:0:22852:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787831285.670896:0:22852:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:2.0:1787831285.670905:0:22852:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:2.0:1787831285.671058:0:22852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204707c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22852:1874676444017536:192.168.203.31@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787831285.671162:0:22852:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2203b30b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787831285.674086:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831285.674193:0:22816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433469312 00000100:00100000:1.0:1787831285.674203:0:22816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433469312 00000100:00100000:1.0:1787831285.674277:0:22816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 49 00000100:00100000:1.0:1787831285.674287:0:22816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb13840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+29:18943:x1874676433469312:12345-192.168.203.31@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787831285.674318:0:22816:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787831285.674437:0:22816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb13840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+29:18943:x1874676433469312:12345-192.168.203.31@tcp:53:lhsmtool_posix.0 Request processed in 151us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831285.674446:0:22816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 49 00000100:00100000:2.0:1787831285.674991:0:22852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204707c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22852:1874676444017536:192.168.203.31@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787831285.686334:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831285.686511:0:22817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433469440 00000100:00100000:1.0:1787831285.686521:0:22817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433469440 00000100:00100000:1.0:1787831285.686595:0:22817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 50 00000100:00100000:1.0:1787831285.686616:0:22817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb12580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+28:18943:x1874676433469440:12345-192.168.203.31@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787831285.686720:0:22817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668e00/0x95459fb9d1d2adca lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831285.686738:0:22817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668e00/0x95459fb9d1d2adca lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831285.686750:0:22817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668e00/0x95459fb9d1d2adca lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831285.686768:0:22817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7200/0x95459fb9d1d2add1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831285.686774:0:22817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7200/0x95459fb9d1d2add1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831285.686781:0:22817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7200/0x95459fb9d1d2add1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831285.686802:0:22817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7000/0x95459fb9d1d2add8 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831285.686811:0:22817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7000/0x95459fb9d1d2add8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831285.686817:0:22817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7000/0x95459fb9d1d2add8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787831285.686870:0:22817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1787831285.686875:0:22817:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787831285.686892:0:22817:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7000/0x95459fb9d1d2add8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831285.686908:0:22817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668e00/0x95459fb9d1d2adca lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831285.686915:0:22817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668e00/0x95459fb9d1d2adca lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831285.686922:0:22817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668e00/0x95459fb9d1d2adca lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831285.686929:0:22817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2301668e00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:1.0:1787831285.686933:0:22817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668e00/0x95459fb9d1d2adca lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831285.686941:0:22817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668e00/0x95459fb9d1d2adca lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831285.686954:0:22817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d233a6f9700) 00010000:00010000:1.0:1787831285.686958:0:22817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787831285.686963:0:22817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668e00/0x95459fb9d1d2adca lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831285.686970:0:22817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2301668e00/0x95459fb9d1d2adca lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831285.686985:0:22817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7200/0x95459fb9d1d2add1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831285.686993:0:22817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7200/0x95459fb9d1d2add1 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831285.686998:0:22817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7200/0x95459fb9d1d2add1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831285.687009:0:22817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d23344b7200 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:1.0:1787831285.687012:0:22817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7200/0x95459fb9d1d2add1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831285.687019:0:22817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7200/0x95459fb9d1d2add1 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831285.687027:0:22817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff8d22035dc100) 00010000:00010000:1.0:1787831285.687029:0:22817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787831285.687032:0:22817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7200/0x95459fb9d1d2add1 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831285.687038:0:22817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7200/0x95459fb9d1d2add1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831285.687051:0:22817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7000/0x95459fb9d1d2add8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831285.687058:0:22817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7000/0x95459fb9d1d2add8 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831285.687063:0:22817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7000/0x95459fb9d1d2add8 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831285.687068:0:22817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d23344b7000 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:1.0:1787831285.687071:0:22817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7000/0x95459fb9d1d2add8 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831285.687076:0:22817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7000/0x95459fb9d1d2add8 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831285.687094:0:22817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8d22035dc600) 00010000:00010000:1.0:1787831285.687096:0:22817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787831285.687099:0:22817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7000/0x95459fb9d1d2add8 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831285.687105:0:22817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7000/0x95459fb9d1d2add8 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831285.687177:0:22817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb12580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+28:18943:x1874676433469440:12345-192.168.203.31@tcp:34:lhsmtool_posix.0 Request processed in 572us (851us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831285.687185:0:22817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 50 00000100:00100000:0.0:1787831285.692554:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831285.692789:0:22851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433469696 00000100:00100000:3.0:1787831285.692802:0:22851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433469696 00000100:00100000:3.0:1787831285.692890:0:22851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 51 00000100:00100000:3.0:1787831285.692901:0:22851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb13c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+28:18943:x1874676433469696:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787831285.692926:0:22851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787831285.692954:0:22851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233837b600/0x95459fb9d1d2addf lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a9942454e expref: -99 pid: 22851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831285.693123:0:22851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233837b200/0x95459fb9d1d2ade6 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831285.693142:0:22851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233837b200/0x95459fb9d1d2ade6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831285.693157:0:22851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233837b200/0x95459fb9d1d2ade6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787831285.693169:0:22851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1787831285.693278:0:22851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233837b200/0x95459fb9d1d2ade6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831285.693287:0:22851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d233837b200/0x95459fb9d1d2ade6 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831285.693294:0:22851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d233837b200/0x95459fb9d1d2ade6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831285.693301:0:22851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233837b200 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:3.0:1787831285.693816:0:22851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233837b200/0x95459fb9d1d2ade6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831285.693829:0:22851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233837b200/0x95459fb9d1d2ade6 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831285.693844:0:22851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8d22035dc600) 00010000:00010000:3.0:1787831285.693847:0:22851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787831285.693905:0:22851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d233837b200/0x95459fb9d1d2ade6 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831285.693925:0:22851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233837b200/0x95459fb9d1d2ade6 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831285.693980:0:22851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233837b600/0x95459fb9d1d2addf lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a9942454e expref: 30 pid: 22851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831285.693990:0:22851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d233a6f9700) 00010000:00010000:3.0:1787831285.693992:0:22851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787831285.693996:0:22851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233837b600/0x95459fb9d1d2addf lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a9942454e expref: 30 pid: 22851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831285.694004:0:22851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233837b600, rc 0) 00000100:00100000:3.0:1787831285.694083:0:22851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb13c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+29:18943:x1874676433469696:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 1184us (1542us total) trans 12884901907 rc 301/301 00000100:00100000:3.0:1787831285.694092:0:22851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 51 00000100:00100000:3.0:1787831285.698787:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831285.699073:0:22817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433469824 00000100:00100000:1.0:1787831285.699085:0:22817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433469824 00000100:00100000:1.0:1787831285.699152:0:22817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 52 00000100:00100000:1.0:1787831285.699163:0:22817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203aff840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+29:18943:x1874676433469824:12345-192.168.203.31@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787831285.699210:0:22817:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787831285.699394:0:22817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203aff840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+29:18943:x1874676433469824:12345-192.168.203.31@tcp:53:lhsmtool_posix.0 Request processed in 232us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831285.699410:0:22817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 52 00000100:00100000:3.0:1787831285.703124:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831285.703211:0:22815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433470080 00000100:00100000:2.0:1787831285.703226:0:22815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433470080 00000100:00100000:2.0:1787831285.703303:0:22815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 53 00000100:00100000:2.0:1787831285.703314:0:22815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233448a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+29:18943:x1874676433470080:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787831285.703333:0:22815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787831285.703354:0:22815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0e00/0x95459fb9d1d2adf4 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99424555 expref: -99 pid: 22815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787831285.703778:0:22815:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x23:0x0], count =31 00000004:00080000:2.0:1787831285.703786:0:22815:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x23:0x0]+31 in llog 00000004:00080000:2.0:1787831285.703807:0:22815:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x42:0x0], index 1: 0 00010000:00010000:2.0:1787831285.703959:0:22815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1e00/0x95459fb9d1d2adfb lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831285.703992:0:22815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1e00/0x95459fb9d1d2adfb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831285.704004:0:22815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1e00/0x95459fb9d1d2adfb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831285.704058:0:22815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0e00/0x95459fb9d1d2adf4 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424555 expref: 32 pid: 22815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831285.704077:0:22815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1e00/0x95459fb9d1d2adfb lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424555 expref: 31 pid: 22815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831285.704085:0:22815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8d232f6dce00) 00010000:00010000:2.0:1787831285.704088:0:22815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787831285.704092:0:22815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22039c1e00, rc 0) 00000100:00100000:2.0:1787831285.704168:0:22815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233448a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+31:18943:x1874676433470080:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 856us (1058us total) trans 12884901908 rc 0/0 00000100:00100000:2.0:1787831285.704180:0:22815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 53 00000100:00100000:3.0:1787831285.707056:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831285.707203:0:22817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433470336 00000100:00100000:1.0:1787831285.707216:0:22817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433470336 00000100:00100000:1.0:1787831285.707285:0:22817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 54 00000100:00100000:1.0:1787831285.707296:0:22817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2334489680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+31:18943:x1874676433470336:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787831285.707441:0:22817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787831285.707475:0:22817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1e00/0x95459fb9d1d2adfb lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424555 expref: 31 pid: 22815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831285.707516:0:22817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8d232f6dce00) 00010000:00010000:1.0:1787831285.707529:0:22817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787831285.707557:0:22817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7000/0x95459fb9d1d2ae09 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831285.707572:0:22817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7000/0x95459fb9d1d2ae09 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831285.707583:0:22817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7000/0x95459fb9d1d2ae09 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831285.707598:0:22817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7200/0x95459fb9d1d2ae10 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb423cec9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831285.707605:0:22817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7200/0x95459fb9d1d2ae10 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb423cec9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831285.707611:0:22817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7200/0x95459fb9d1d2ae10 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb423cec9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831285.707701:0:22817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7000/0x95459fb9d1d2ae09 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831285.707709:0:22817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7000/0x95459fb9d1d2ae09 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831285.707717:0:22817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7000/0x95459fb9d1d2ae09 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831285.707724:0:22817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d23344b7000 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:1.0:1787831285.707729:0:22817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7000/0x95459fb9d1d2ae09 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831285.707743:0:22817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7000/0x95459fb9d1d2ae09 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831285.707751:0:22817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8d2334517500) 00010000:00010000:1.0:1787831285.707754:0:22817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787831285.707758:0:22817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7000/0x95459fb9d1d2ae09 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831285.707764:0:22817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7000/0x95459fb9d1d2ae09 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831285.707773:0:22817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7200/0x95459fb9d1d2ae10 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb423cec9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831285.707779:0:22817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7200/0x95459fb9d1d2ae10 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb423cec9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831285.707784:0:22817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7200/0x95459fb9d1d2ae10 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb423cec9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831285.707788:0:22817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d23344b7200 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:1.0:1787831285.707790:0:22817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7200/0x95459fb9d1d2ae10 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb423cec9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831285.707795:0:22817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7200/0x95459fb9d1d2ae10 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb423cec9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831285.707800:0:22817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb423cec9 (ffff8d22035dc100) 00010000:00010000:1.0:1787831285.707801:0:22817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787831285.707803:0:22817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7200/0x95459fb9d1d2ae10 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb423cec9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831285.707817:0:22817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7200/0x95459fb9d1d2ae10 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb423cec9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831285.708544:0:22817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2334489680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+30:18943:x1874676433470336:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 Request processed in 1243us (1497us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787831285.708554:0:22817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 54 00000100:00100000:1.0:1787831285.713586:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831285.713857:0:22851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433470464 00000100:00100000:3.0:1787831285.713878:0:22851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433470464 00000100:00100000:3.0:1787831285.713947:0:22851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 55 00000100:00100000:3.0:1787831285.713956:0:22851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fae8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+30:18943:x1874676433470464:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787831285.713983:0:22851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787831285.714011:0:22851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233837b600/0x95459fb9d1d2ae17 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a9942455c expref: -99 pid: 22851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831285.714077:0:22851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233837b200/0x95459fb9d1d2ae1e lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831285.714093:0:22851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233837b200/0x95459fb9d1d2ae1e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831285.714106:0:22851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233837b200/0x95459fb9d1d2ae1e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831285.714244:0:22851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233837b600/0x95459fb9d1d2ae17 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a9942455c expref: 32 pid: 22851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831285.714262:0:22851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233837b200/0x95459fb9d1d2ae1e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a9942455c expref: 31 pid: 22851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831285.714271:0:22851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8d233a6f9800) 00010000:00010000:3.0:1787831285.714274:0:22851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787831285.714278:0:22851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d233837b200, rc 0) 00000100:00100000:3.0:1787831285.714526:0:22851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fae8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+31:18943:x1874676433470464:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 568us (951us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831285.714534:0:22851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 55 00000100:00100000:3.0:1787831285.725595:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831285.725882:0:22816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433470720 00000100:00100000:1.0:1787831285.725896:0:22816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433470720 00000100:00100000:1.0:1787831285.725965:0:22816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 56 00000100:00100000:1.0:1787831285.725978:0:22816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2309cfa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+31:18943:x1874676433470720:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787831285.726094:0:22816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7200/0x95459fb9d1d2ae25 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831285.726118:0:22816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7200/0x95459fb9d1d2ae25 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831285.726134:0:22816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7200/0x95459fb9d1d2ae25 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22816 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787831285.727570:0:22816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].2, 88 off8344 00000004:00080000:1.0:1787831285.727587:0:22816:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 576727961724ns, next at 577727958796ns, rc = 0 00000004:00010000:1.0:1787831285.730132:0:22816:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009dc45cc1 reply state 00000000a30dbbb4 transno 12884901909 ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7200/0x95459fb9d1d2ae25 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831285.730169:0:22816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7200/0x95459fb9d1d2ae25 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831285.730179:0:22816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8d233a6f9800) 00010000:00010000:1.0:1787831285.730205:0:22816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1787831285.730211:0:22816:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787831285.731501:0:22816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2309cfa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+33:18943:x1874676433470720:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 Request processed in 5513us (5906us total) trans 12884901909 rc 0/0 00000100:00100000:1.0:1787831285.731515:0:22816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 56 00000100:00100000:0.0:1787831285.739695:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831285.739918:0:22815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433470848 00000100:00100000:2.0:1787831285.739931:0:22815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433470848 00000100:00100000:2.0:1787831285.740003:0:22815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 57 00000100:00100000:2.0:1787831285.740014:0:22815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb11a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+33:18943:x1874676433470848:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787831285.740044:0:22815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787831285.740070:0:22815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0e00/0x95459fb9d1d2ae2c lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99424563 expref: -99 pid: 22815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831285.740143:0:22815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0e00/0x95459fb9d1d2ae2c lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424563 expref: 34 pid: 22815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831285.740178:0:22815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0e00/0x95459fb9d1d2ae2c lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424563 expref: 34 pid: 22815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831285.740201:0:22815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8d233a6f9800) 00010000:00010000:2.0:1787831285.740204:0:22815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787831285.740209:0:22815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22039c0e00, rc 0) 00000100:00100000:2.0:1787831285.740289:0:22815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb11a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+34:18943:x1874676433470848:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 277us (678us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831285.740297:0:22815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 57 00000100:00100000:3.0:1787831285.743828:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831285.743996:0:25005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433470976 00000100:00100000:2.0:1787831285.744008:0:25005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433470976 00000100:00100000:2.0:1787831285.744095:0:25005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 20 00000100:00100000:2.0:1787831285.744106:0:25005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220442cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+5:2397:x1874676433470976:12345-192.168.203.31@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1787831285.744877:0:22811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787831285.748202:0:25005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220442cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+6:2397:x1874676433470976:12345-192.168.203.31@tcp:2:lhsmtool_posix.0 Request processed in 4080us (4371us total) trans 12884901891 rc 0/0 00000100:00100000:2.0:1787831285.748220:0:25005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 20 00000100:00100000:0.0:1787831285.751206:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831285.751490:0:22819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433471232 00000100:00100000:3.0:1787831285.751503:0:22819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433471232 00000100:00100000:3.0:1787831285.751662:0:22819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 9 00000100:00100000:3.0:1787831285.751674:0:22819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb103c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+34:18943:x1874676433471232:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787831285.752163:0:22819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb103c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+35:18943:x1874676433471232:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 Request processed in 490us (968us total) trans 12884901910 rc 0/0 00000100:00100000:3.0:1787831285.752171:0:22819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 9 00000100:00100000:0.0:1787831285.755793:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831285.755961:0:22817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433471488 00000100:00100000:1.0:1787831285.755974:0:22817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433471488 00000100:00100000:1.0:1787831285.756043:0:22817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 58 00000100:00100000:1.0:1787831285.756054:0:22817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+35:18943:x1874676433471488:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787831285.756211:0:22817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+35:18943:x1874676433471488:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 Request processed in 158us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831285.756220:0:22817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 58 00000100:00100000:1.0:1787831285.761058:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831285.761180:0:22815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433471616 00000100:00100000:2.0:1787831285.761193:0:22815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433471616 00000100:00100000:2.0:1787831285.761269:0:22815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 59 00000100:00100000:2.0:1787831285.761281:0:22815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fae8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+35:18943:x1874676433471616:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787831285.761321:0:22815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787831285.761364:0:22815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0c00/0x95459fb9d1d2ae33 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a9942456a expref: -99 pid: 22815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831285.761462:0:22815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1200/0x95459fb9d1d2ae3a lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831285.761496:0:22815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1200/0x95459fb9d1d2ae3a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831285.761509:0:22815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1200/0x95459fb9d1d2ae3a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787831285.761567:0:22815:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787831285.761591:0:22815:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1200/0x95459fb9d1d2ae3a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831285.761621:0:22815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0c00/0x95459fb9d1d2ae33 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a9942456a expref: 37 pid: 22815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831285.761846:0:22815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1200/0x95459fb9d1d2ae3a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a9942456a expref: 36 pid: 22815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831285.761857:0:22815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8d233a6f9800) 00010000:00010000:2.0:1787831285.761876:0:22815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787831285.761880:0:22815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22039c1200, rc 0) 00000100:00100000:2.0:1787831285.761950:0:22815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fae8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+36:18943:x1874676433471616:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 672us (906us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831285.761958:0:22815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 59 00000100:00100000:0.0:1787831285.764951:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831285.765071:0:24321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433471744 00000100:00100000:1.0:1787831285.765085:0:24321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433471744 00000100:00100000:1.0:1787831285.765168:0:24321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 21 00000100:00100000:1.0:1787831285.765179:0:24321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb12940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+6:2396:x1874676433471744:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787831285.765203:0:24321:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787831285.765230:0:24321:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a0588e1c/0x95459fb9d1d2ae41 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99424571 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787831285.765263:0:24321:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9023f6, blocks: 0x0 00010000:00010000:1.0:1787831285.765288:0:24321:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=576s v=(0 0) 00010000:00010000:1.0:1787831285.765294:0:24321:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787831285.765473:0:24321:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0588e1c/0x95459fb9d1d2ae41 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424571 expref: 7 pid: 24321 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831285.765527:0:24321:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a0588e1c/0x95459fb9d1d2ae41 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424571 expref: 7 pid: 24321 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831285.765544:0:24321:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d23344b6000, rc 0) 00000100:00100000:1.0:1787831285.765734:0:24321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb12940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+7:2396:x1874676433471744:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 556us (799us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831285.765743:0:24321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 21 00000100:00100000:2.0:1787831285.769001:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831285.769099:0:22817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433472000 00000100:00100000:1.0:1787831285.769112:0:22817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433472000 00000100:00100000:1.0:1787831285.769192:0:22817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 60 00000100:00100000:1.0:1787831285.769204:0:22817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204707c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+36:18943:x1874676433472000:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787831285.769582:0:22817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204707c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+36:18943:x1874676433472000:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 Request processed in 379us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831285.769591:0:22817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 60 00000100:00100000:2.0:1787831285.773013:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831285.773147:0:22815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433472128 00000100:00100000:0.0:1787831285.773163:0:22815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433472128 00000100:00100000:0.0:1787831285.773281:0:22815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 61 00000100:00100000:0.0:1787831285.773295:0:22815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204706d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+36:18943:x1874676433472128:12345-192.168.203.31@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1787831285.776179:0:22796:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901910 is committed 00000004:00080000:1.0:1787831285.776210:0:22796:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:2.0:1787831285.776582:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787831285.776611:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676444017664:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1787831285.776845:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00080000:1.0:1787831285.777170:0:22796:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00010000:00010000:0.0:1787831285.777339:0:3606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22034a6600/0x95459fb9d1d2ac34 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831285.777460:0:3606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22034a6600/0x95459fb9d1d2ac34 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831285.777470:0:3606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22034a6600/0x95459fb9d1d2ac34 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831285.777478:0:3606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22034a6600 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:0.0:1787831285.777483:0:3606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22034a6600/0x95459fb9d1d2ac34 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831285.777494:0:3606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22034a6600/0x95459fb9d1d2ac34 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831285.777518:0:3606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8d2334517f00) 00010000:00010000:0.0:1787831285.777521:0:3606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787831285.777527:0:3606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22034a6600/0x95459fb9d1d2ac34 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831285.777559:0:3606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22034a6600/0x95459fb9d1d2ac34 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831285.777594:0:3606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22034a6800/0x95459fb9d1d2ac3b lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831285.777602:0:3606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22034a6800/0x95459fb9d1d2ac3b lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831285.777609:0:3606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22034a6800/0x95459fb9d1d2ac3b lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831285.777614:0:3606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22034a6800 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:0.0:1787831285.777617:0:3606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22034a6800/0x95459fb9d1d2ac3b lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831285.777673:0:3606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22034a6800/0x95459fb9d1d2ac3b lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831285.777683:0:3606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8d2334517500) 00010000:00010000:0.0:1787831285.777853:0:3606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787831285.777870:0:3606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22034a6800/0x95459fb9d1d2ac3b lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831285.777877:0:3606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22034a6800/0x95459fb9d1d2ac3b lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831285.777893:0:3606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95200/0x95459fb9d1d2acf1 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831285.777899:0:3606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95200/0x95459fb9d1d2acf1 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831285.777912:0:3606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95200/0x95459fb9d1d2acf1 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831285.777917:0:3606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233be95200 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:0.0:1787831285.777920:0:3606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95200/0x95459fb9d1d2acf1 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831285.777928:0:3606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95200/0x95459fb9d1d2acf1 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831285.777938:0:3606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff8d22035dc700) 00010000:00010000:0.0:1787831285.777940:0:3606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787831285.777943:0:3606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95200/0x95459fb9d1d2acf1 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831285.777949:0:3606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95200/0x95459fb9d1d2acf1 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831285.777971:0:3606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95a00/0x95459fb9d1d2ad76 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831285.777978:0:3606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95a00/0x95459fb9d1d2ad76 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831285.777985:0:3606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95a00/0x95459fb9d1d2ad76 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831285.777991:0:3606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233be95a00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:0.0:1787831285.777994:0:3606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95a00/0x95459fb9d1d2ad76 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831285.778011:0:3606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95a00/0x95459fb9d1d2ad76 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831285.778021:0:3606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8d22035dc600) 00010000:00010000:0.0:1787831285.778024:0:3606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787831285.778027:0:3606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95a00/0x95459fb9d1d2ad76 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831285.778033:0:3606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be95a00/0x95459fb9d1d2ad76 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831285.778048:0:3606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7200/0x95459fb9d1d2ae25 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831285.778054:0:3606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7200/0x95459fb9d1d2ae25 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831285.778060:0:3606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7200/0x95459fb9d1d2ae25 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831285.778065:0:3606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d23344b7200 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:0.0:1787831285.778067:0:3606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7200/0x95459fb9d1d2ae25 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831285.778074:0:3606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7200/0x95459fb9d1d2ae25 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831285.778082:0:3606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8d233a6f9800) 00010000:00010000:0.0:1787831285.778084:0:3606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787831285.778087:0:3606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7200/0x95459fb9d1d2ae25 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831285.778105:0:3606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7200/0x95459fb9d1d2ae25 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831285.778143:0:24322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444017664 00000100:00100000:0.0:1787831285.778155:0:24322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444017664 00000100:00100000:0.0:1787831285.778240:0:24322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787831285.778252:0:24322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204705a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1874676444017664:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1787831285.779001:0:24322:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1787831285.779009:0:24322:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1787831285.779012:0:24322:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1787831285.779014:0:24322:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb ctime from disk: 1787831286 -> 1787831286 00002000:00010000:0.0:1787831285.779017:0:24322:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1787831285.779169:0:24322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204705a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3621:x1874676444017664:12345-0@lo:2:osp-syn-1-0.0 Request processed in 917us (2322us total) trans 12884901892 rc 0/0 00000100:00100000:0.0:1787831285.779182:0:24322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:0.0:1787831285.779226:0:22811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1787831285.779719:0:3621:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d2204706940/2, rc 0, transno 12884901892 00000100:00100000:3.0:1787831285.779731:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676444017664:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1787831285.780107:0:22815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204706d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+15:18943:x1874676433472128:12345-192.168.203.31@tcp:44:lhsmtool_posix.0 Request processed in 6811us (7107us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831285.780118:0:22815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 61 00000100:00100000:0.0:1787831285.784920:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831285.785047:0:24319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433472256 00000100:00100000:1.0:1787831285.785059:0:24319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433472256 00000100:00100000:1.0:1787831285.785125:0:24319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 23 00000100:00100000:1.0:1787831285.785135:0:24319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220261ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+7:2396:x1874676433472256:12345-192.168.203.31@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1787831285.785275:0:24319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220261ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+7:2396:x1874676433472256:12345-192.168.203.31@tcp:16:lhsmtool_posix.0 Request processed in 141us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831285.785285:0:24319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 23 00000100:00100000:3.0:1787831285.788795:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831285.788991:0:22816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433472512 00000100:00100000:1.0:1787831285.789004:0:22816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433472512 00000100:00100000:1.0:1787831285.789070:0:22816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 62 00000100:00100000:1.0:1787831285.789079:0:22816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb43840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+15:18943:x1874676433472512:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787831285.789179:0:22816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787831285.789214:0:22816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1200/0x95459fb9d1d2ae3a lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a9942456a expref: 15 pid: 22815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831285.789238:0:22816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8d233a6f9800) 00010000:00010000:1.0:1787831285.789244:0:22816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787831285.789285:0:22816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6200/0x95459fb9d1d2ae48 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831285.789300:0:22816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6200/0x95459fb9d1d2ae48 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831285.789312:0:22816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6200/0x95459fb9d1d2ae48 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787831285.790474:0:22816:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e73ba6e2 reply state 000000001d9bd972 transno 12884901911 ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6200/0x95459fb9d1d2ae48 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831285.790503:0:22816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b6200/0x95459fb9d1d2ae48 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831285.790510:0:22816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8d233a6f9800) 00010000:00010000:1.0:1787831285.790513:0:22816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787831285.790517:0:22816:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787831285.790935:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22034a7200/0x95459fb9d1d2ac88 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831285.790961:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22034a7200/0x95459fb9d1d2ac88 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831285.790970:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22034a7200/0x95459fb9d1d2ac88 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831285.790977:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22034a7200 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:2.0:1787831285.790982:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22034a7200/0x95459fb9d1d2ac88 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831285.790991:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22034a7200/0x95459fb9d1d2ac88 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831285.791005:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8d2334517500) 00010000:00010000:2.0:1787831285.791007:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1787831285.791013:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22034a7200/0x95459fb9d1d2ac88 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831285.791020:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22034a7200/0x95459fb9d1d2ac88 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831285.791191:0:22816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb43840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+16:18943:x1874676433472512:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 Request processed in 2106us (2406us total) trans 12884901911 rc 0/0 00000100:00100000:1.0:1787831285.791211:0:22816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 62 00000100:00100000:3.0:1787831285.802792:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831285.803015:0:24322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433472640 00000100:00100000:1.0:1787831285.803029:0:24322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433472640 00000100:00100000:1.0:1787831285.803106:0:24322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 24 00000100:00100000:1.0:1787831285.803118:0:24322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb41680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+7:2397:x1874676433472640:12345-192.168.203.31@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787831285.803334:0:24322:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1787831285.803338:0:24322:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb mtime from disk: 0 -> 1787831285 00002000:00010000:1.0:1787831285.803341:0:24322:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb atime from disk: 0 -> 1787831285 00002000:00010000:1.0:1787831285.803353:0:24322:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb ctime from disk: 1787831286 -> 1787831285 00002000:00010000:1.0:1787831285.803356:0:24322:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1787831285.803437:0:24322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb41680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+8:2397:x1874676433472640:12345-192.168.203.31@tcp:2:lhsmtool_posix.0 Request processed in 321us (660us total) trans 12884901893 rc 0/0 00000100:00100000:1.0:1787831285.803447:0:24322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 24 00000100:00100000:1.0:1787831285.807113:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831285.807202:0:24319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433472768 00000100:00100000:2.0:1787831285.807215:0:24319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433472768 00000100:00100000:2.0:1787831285.807290:0:24319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 25 00000100:00100000:2.0:1787831285.807302:0:24319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d232af35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+8:2396:x1874676433472768:12345-192.168.203.31@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787831285.807376:0:24319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000063e78156/0x95459fb9d1d2ae4f lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831285.807398:0:24319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787831285.807421:0:24319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787831285.807430:0:24319:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000063e78156/0x95459fb9d1d2ae4f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831285.807447:0:24319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000063e78156/0x95459fb9d1d2ae4f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831285.807480:0:24319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000063e78156/0x95459fb9d1d2ae4f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831285.807489:0:24319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000063e78156/0x95459fb9d1d2ae4f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831285.807498:0:24319:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000063e78156/0x95459fb9d1d2ae4f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831285.807506:0:24319:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22039c0200 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:2.0:1787831285.807510:0:24319:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000063e78156/0x95459fb9d1d2ae4f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831285.807520:0:24319:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000063e78156/0x95459fb9d1d2ae4f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831285.807538:0:24319:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000063e78156/0x95459fb9d1d2ae4f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831285.807546:0:24319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000063e78156/0x95459fb9d1d2ae4f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831285.808025:0:24319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d232af35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+8:2396:x1874676433472768:12345-192.168.203.31@tcp:1:lhsmtool_posix.0 Request processed in 721us (925us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831285.808035:0:24319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 25 00000100:00100000:3.0:1787831285.820675:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831285.821025:0:22851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433473024 00000100:00100000:1.0:1787831285.821037:0:22851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433473024 00000100:00100000:1.0:1787831285.821115:0:22851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 63 00000100:00100000:1.0:1787831285.821125:0:22851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb42d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+16:18943:x1874676433473024:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787831285.821229:0:22851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7e00/0x95459fb9d1d2ae56 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831285.821250:0:22851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94600/0x95459fb9d1d2ad6f lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424539 expref: 16 pid: 22817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831285.821261:0:22851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7e00/0x95459fb9d1d2ae56 lrc: 4/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831285.821340:0:22851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94600/0x95459fb9d1d2ad6f lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424539 expref: 16 pid: 22817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831285.821356:0:22851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94600/0x95459fb9d1d2ad6f lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424539 expref: 16 pid: 22817 timeout: 676 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831285.821372:0:22851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233faea940 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:22851:1874676444017792:192.168.203.31@tcp:104: 00000100:00100000:1.0:1787831285.821476:0:22851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d23063bb6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787831285.823747:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831285.823842:0:22803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433473152 00000100:00100000:0.0:1787831285.823854:0:22803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433473152 00010000:00010000:0.0:1787831285.823914:0:22803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94600/0x95459fb9d1d2ad6f lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424539 expref: 17 pid: 22817 timeout: 676 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831285.823963:0:22803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 19 00000100:00100000:0.0:1787831285.823973:0:22803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a23840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+17:2397:x1874676433473152:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787831285.824008:0:22803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787831285.824016:0:22803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94600/0x95459fb9d1d2ad6f lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424539 expref: 17 pid: 22817 timeout: 676 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831285.824030:0:22803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94600/0x95459fb9d1d2ad6f lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424539 expref: 17 pid: 22817 timeout: 676 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831285.824057:0:22803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8d22035dc600) 00010000:00010000:0.0:1787831285.824064:0:22803:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1800/0x95459fb9d1d2ad8b lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424547 expref: 17 pid: 22815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831285.824075:0:22803:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7e00/0x95459fb9d1d2ae56 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831285.824085:0:22803:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7e00/0x95459fb9d1d2ae56 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 22851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831285.824093:0:22803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7e00/0x95459fb9d1d2ae56 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 22851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831285.824117:0:22803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787831285.824177:0:22803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a23840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+17:2397:x1874676433473152:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 205us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831285.824185:0:22803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 19 00010000:00010000:3.0:1787831285.824351:0:22851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233be94600/0x95459fb9d1d2ad6f lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424539 expref: 16 pid: 22817 timeout: 676 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787831285.824374:0:22851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233faea940 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:22851:1874676444017792:192.168.203.31@tcp:104: 00010000:00010000:3.0:1787831285.824397:0:22851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7e00/0x95459fb9d1d2ae56 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831285.824417:0:22851:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7e00/0x95459fb9d1d2ae56 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831285.824423:0:22851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7e00/0x95459fb9d1d2ae56 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831285.824734:0:22851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233837b600/0x95459fb9d1d2ae5d lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831285.824747:0:22851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0e00/0x95459fb9d1d2ae2c lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424563 expref: 16 pid: 22815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831285.824755:0:22851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d233837b600/0x95459fb9d1d2ae5d lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831285.824795:0:22851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0e00/0x95459fb9d1d2ae2c lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424563 expref: 16 pid: 22815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831285.824810:0:22851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0e00/0x95459fb9d1d2ae2c lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424563 expref: 16 pid: 22815 timeout: 676 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787831285.824826:0:22851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233fb430c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:22851:1874676444017920:192.168.203.31@tcp:104: 00000100:00100000:3.0:1787831285.825016:0:22851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2302bf3c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787831285.828095:0:22851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233fb430c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:22851:1874676444017920:192.168.203.31@tcp:104: 00010000:00010000:1.0:1787831285.828135:0:22851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d233837b600/0x95459fb9d1d2ae5d lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831285.829576:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831285.829868:0:22801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433473280 00000100:00100000:0.0:1787831285.829880:0:22801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433473280 00010000:00010000:0.0:1787831285.829934:0:22801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0e00/0x95459fb9d1d2ae2c lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424563 expref: 17 pid: 22815 timeout: 676 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831285.830006:0:22801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 20 00000100:00100000:0.0:1787831285.830017:0:22801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a21e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+17:2397:x1874676433473280:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787831285.830037:0:22801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787831285.830045:0:22801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0e00/0x95459fb9d1d2ae2c lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424563 expref: 17 pid: 22815 timeout: 676 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831285.830059:0:22801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0e00/0x95459fb9d1d2ae2c lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424563 expref: 17 pid: 22815 timeout: 676 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831285.830088:0:22801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0e00/0x95459fb9d1d2ae2c lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424563 expref: 17 pid: 22815 timeout: 676 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831285.830108:0:22801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8d233a6f9800) 00010000:00010000:0.0:1787831285.830114:0:22801:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d233837b600/0x95459fb9d1d2ae5d lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831285.830124:0:22801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233837b600/0x95459fb9d1d2ae5d lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831285.830131:0:22801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233837b600/0x95459fb9d1d2ae5d lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831285.830164:0:22801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787831285.830242:0:22801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a21e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+16:2397:x1874676433473280:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 227us (676us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831285.830251:0:22801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 20 00010000:00010000:3.0:1787831285.830948:0:22851:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d233837b600/0x95459fb9d1d2ae5d lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831285.830961:0:22851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233837b600/0x95459fb9d1d2ae5d lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22851 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787831285.831106:0:22851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901912 00000001:00080000:3.0:1787831285.831254:0:22851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901913 00000001:00080000:3.0:1787831285.831295:0:22851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901914 00000100:00100000:3.0:1787831285.831445:0:22851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d233fb40b40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:22851:1874676444018048:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787831285.831519:0:22851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831285.831565:0:22851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2302bf36c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787831285.832003:0:22820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444018048 00000100:00100000:2.0:1787831285.832012:0:22820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444018048 00000100:00100000:2.0:1787831285.832069:0:22820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787831285.832079:0:22820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb41a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22851:x1874676444018048:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787831285.832188:0:22820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb41a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22851:x1874676444018048:12345-0@lo:1000:mdt00_003.0 Request processed in 111us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831285.832196:0:22820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787831285.832291:0:22851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d233fb40b40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:22851:1874676444018048:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1787831285.832516:0:22851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901915 00000100:00100000:1.0:1787831285.832577:0:22851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a22d00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:22851:1874676444018176:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787831285.832615:0:22851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787831285.832715:0:22851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2310003000 going to sleep for 11 seconds 00000100:00100000:0.0:1787831285.833463:0:23556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444018176 00000100:00100000:0.0:1787831285.833484:0:23556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444018176 00000100:00100000:0.0:1787831285.833536:0:23556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787831285.833544:0:23556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a203c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22851:x1874676444018176:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787831285.833747:0:23556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a203c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:22851:x1874676444018176:12345-0@lo:1000:mdt00_003.0 Request processed in 203us (1130us total) trans 12884901894 rc 0/0 00000100:00100000:0.0:1787831285.833755:0:23556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787831285.833917:0:22851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a22d00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:22851:1874676444018176:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1787831285.833965:0:22851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233837b600/0x95459fb9d1d2ae5d lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831285.833976:0:22851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d233837b600/0x95459fb9d1d2ae5d lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831285.833995:0:22851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d233837b600/0x95459fb9d1d2ae5d lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831285.834001:0:22851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233837b600 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:1.0:1787831285.834005:0:22851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233837b600/0x95459fb9d1d2ae5d lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831285.834015:0:22851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233837b600/0x95459fb9d1d2ae5d lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831285.834032:0:22851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8d233a6f9800) 00010000:00010000:1.0:1787831285.834035:0:22851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787831285.834040:0:22851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d233837b600/0x95459fb9d1d2ae5d lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831285.834046:0:22851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233837b600/0x95459fb9d1d2ae5d lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831285.834082:0:22851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1000/0x95459fb9d1d2ad84 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 22851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831285.834087:0:22851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1000/0x95459fb9d1d2ad84 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 22851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831285.834092:0:22851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1000/0x95459fb9d1d2ad84 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 22851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831285.834097:0:22851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22039c1000 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:1.0:1787831285.834100:0:22851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1000/0x95459fb9d1d2ad84 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 22851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831285.834114:0:22851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1000/0x95459fb9d1d2ad84 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 22851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831285.834122:0:22851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8d22035dc600) 00010000:00010000:1.0:1787831285.834124:0:22851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787831285.834132:0:22851:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1800/0x95459fb9d1d2ad8b lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424547 expref: 19 pid: 22815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831285.834144:0:22851:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1800/0x95459fb9d1d2ad8b lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424547 expref: 19 pid: 22815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831285.834154:0:22851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1800/0x95459fb9d1d2ad8b lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424547 expref: 19 pid: 22815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831285.834216:0:22851:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1800/0x95459fb9d1d2ad8b lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424547 expref: 19 pid: 22815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831285.834230:0:22851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a230c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:22851:1874676444018304:192.168.203.31@tcp:105: 00000100:00100000:1.0:1787831285.834440:0:22851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2310003900 going to sleep for 11 seconds 00000100:00100000:3.0:1787831285.837046:0:22851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a230c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:22851:1874676444018304:192.168.203.31@tcp:105: 00010000:00010000:3.0:1787831285.837086:0:22851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1000/0x95459fb9d1d2ad84 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 22851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831285.837097:0:22851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1000/0x95459fb9d1d2ad84 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 22851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831285.837140:0:22851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233837b800/0x95459fb9d1d2ae64 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831285.837175:0:22851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d233837b800/0x95459fb9d1d2ae64 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831285.837189:0:22851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d233837b800/0x95459fb9d1d2ae64 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831285.837202:0:22851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d233837b800/0x95459fb9d1d2ae64 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831285.837208:0:22851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d233837b800/0x95459fb9d1d2ae64 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831285.837216:0:22851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d233837b800/0x95459fb9d1d2ae64 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831285.837222:0:22851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d233837b800 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:3.0:1787831285.837227:0:22851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233837b800/0x95459fb9d1d2ae64 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831285.837235:0:22851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d233837b800/0x95459fb9d1d2ae64 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831285.837248:0:22851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8d22035dc600) 00010000:00010000:3.0:1787831285.837251:0:22851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787831285.837255:0:22851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d233837b800/0x95459fb9d1d2ae64 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831285.837261:0:22851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d233837b800/0x95459fb9d1d2ae64 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831285.837272:0:22851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7e00/0x95459fb9d1d2ae56 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831285.837287:0:22851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7e00/0x95459fb9d1d2ae56 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831285.837293:0:22851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7e00/0x95459fb9d1d2ae56 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831285.837298:0:22851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d23344b7e00 already unused, calling callback (ffffffffc1b094f0) 00010000:00010000:3.0:1787831285.837301:0:22851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7e00/0x95459fb9d1d2ae56 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831285.837380:0:22851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7e00/0x95459fb9d1d2ae56 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831285.837389:0:22851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8d22035dc600) 00010000:00010000:3.0:1787831285.837391:0:22851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787831285.837394:0:22851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7e00/0x95459fb9d1d2ae56 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831285.837399:0:22851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d23344b7e00/0x95459fb9d1d2ae56 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787831285.837617:0:22851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb42d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+19:18943:x1874676433473024:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 Request processed in 16491us (16955us total) trans 12884901916 rc 0/0 00000100:00100000:3.0:1787831285.837666:0:22851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 63 00000020:00080000:3.0:1787831285.837673:0:22851:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1787831285.837877:0:22852:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1787831285.837883:0:22852:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787831285.837921:0:22852:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:2.0:1787831285.837929:0:22852:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:0.0:1787831285.840022:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831285.840116:0:22818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433473408 00000100:00100000:2.0:1787831285.840127:0:22818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433473408 00000100:00100000:2.0:1787831285.840189:0:22818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 10 00000100:00100000:2.0:1787831285.840199:0:22818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233f42ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+19:18942:x1874676433473408:12345-192.168.203.31@tcp:49:dd.0 00000100:00100000:2.0:1787831285.840375:0:22818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233f42ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+19:18942:x1874676433473408:12345-192.168.203.31@tcp:49:dd.0 Request processed in 176us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831285.840384:0:22818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 10 00000100:00100000:0.0:1787831285.842249:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831285.842356:0:22818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433473664 00000100:00100000:2.0:1787831285.842366:0:22818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433473664 00000100:00100000:2.0:1787831285.842436:0:22818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 11 00000100:00100000:2.0:1787831285.842446:0:22818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220261d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+19:18943:x1874676433473664:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787831285.843048:0:22818:0:(mdd_object.c:4014:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787831285.843088:0:22818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901917 00010000:00010000:2.0:1787831285.843129:0:22818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0800/0x95459fb9d1d2ae6b lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831285.843152:0:22818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0800/0x95459fb9d1d2ae6b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 22818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831285.843166:0:22818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0800/0x95459fb9d1d2ae6b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831285.843177:0:22818:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0800/0x95459fb9d1d2ae6b lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831285.843184:0:22818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0800/0x95459fb9d1d2ae6b lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831285.843192:0:22818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0800/0x95459fb9d1d2ae6b lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831285.843219:0:22818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787831285.843443:0:25152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787831285.843451:0:25152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0800/0x95459fb9d1d2ae6b lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831285.843460:0:25152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22039c0800 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:3.0:1787831285.843477:0:25152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0800/0x95459fb9d1d2ae6b lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831285.843486:0:25152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0800/0x95459fb9d1d2ae6b lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 22818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831285.843502:0:25152:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8d233a6f9800) 00010000:00010000:3.0:1787831285.843505:0:25152:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787831285.843511:0:25152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0800/0x95459fb9d1d2ae6b lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831285.843518:0:25152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0800/0x95459fb9d1d2ae6b lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831285.843534:0:25152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787831285.843536:0:25152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787831285.843538:0:25152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787831285.843766:0:22818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220261d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+21:18943:x1874676433473664:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 Request processed in 1317us (1523us total) trans 12884901918 rc 0/0 00000100:00100000:2.0:1787831285.843776:0:22818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 11 00000020:00080000:2.0:1787831285.843783:0:22818:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787831285.848080:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831285.848240:0:22817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433473792 00000100:00100000:2.0:1787831285.848253:0:22817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433473792 00000100:00100000:2.0:1787831285.848330:0:22817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 64 00000100:00100000:2.0:1787831285.848342:0:22817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a20780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+21:18942:x1874676433473792:12345-192.168.203.31@tcp:101:dd.0 00010000:00010000:2.0:1787831285.848370:0:22817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787831285.848422:0:22817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0400/0x95459fb9d1d2ae72 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe558a92a99424578 expref: -99 pid: 22817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831285.848465:0:22817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1600/0x95459fb9d1d2ae79 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831285.848482:0:22817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1600/0x95459fb9d1d2ae79 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831285.848494:0:22817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1600/0x95459fb9d1d2ae79 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831285.848822:0:22817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c0400/0x95459fb9d1d2ae72 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424578 expref: 23 pid: 22817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831285.848845:0:22817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22039c1600/0x95459fb9d1d2ae79 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424578 expref: 22 pid: 22817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831285.848868:0:22817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8d22035dc600) 00010000:00010000:2.0:1787831285.848872:0:22817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787831285.848877:0:22817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22039c1600, rc 0) 00000100:00100000:2.0:1787831285.849131:0:22817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a20780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+22:18942:x1874676433473792:12345-192.168.203.31@tcp:101:dd.0 Request processed in 790us (1064us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831285.849140:0:22817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 64 00000100:00100000:3.0:1787831285.990947:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676444018432:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787831285.991056:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831285.991834:0:24324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444018432 00000100:00100000:2.0:1787831285.991846:0:24324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444018432 00000100:00100000:2.0:1787831285.991933:0:24324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787831285.991943:0:24324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb412c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676444018432:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787831285.991987:0:24324:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1787831285.992074:0:24324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb412c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676444018432:12345-0@lo:13:osp-pre-1-1.0 Request processed in 132us (1017us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831285.992081:0:24324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787831285.992138:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676444018432:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1787831285.992445:0:22811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787831286.078267:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831286.078477:0:24325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433473920 00000100:00100000:1.0:1787831286.078489:0:24325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433473920 00000100:00100000:1.0:1787831286.078577:0:24325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 0 00000100:00100000:1.0:1787831286.078590:0:24325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220261d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+8:2396:x1874676433473920:12345-192.168.203.31@tcp:4:dd.0 00010000:00010000:1.0:1787831286.078656:0:24325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003acf69f2/0x95459fb9d1d2ae80 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831286.078695:0:24325:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a0588e1c/0x95459fb9d1d2ae41 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe558a92a99424571 expref: 8 pid: 24321 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831286.078705:0:24325:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1787831286.078709:0:24325:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787831286.078715:0:24325:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003acf69f2/0x95459fb9d1d2ae80 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831286.078756:0:24325:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a0588e1c/0x95459fb9d1d2ae41 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424571 expref: 8 pid: 24321 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831286.078772:0:24325:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a0588e1c/0x95459fb9d1d2ae41 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424571 expref: 8 pid: 24321 timeout: 677 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787831286.078788:0:24325:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a221c0 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0001_UUID:24325:1874676444018560:192.168.203.31@tcp:104: 00000100:00100000:1.0:1787831286.078902:0:24325:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d2310003180 going to sleep for 11 seconds 00000100:00100000:1.0:1787831286.083300:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787831286.084750:0:24327:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1787831286.084768:0:24327:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:2.0:1787831286.087548:0:24325:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a221c0 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0001_UUID:24325:1874676444018560:192.168.203.31@tcp:104: 00010000:00010000:2.0:1787831286.087599:0:24325:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003acf69f2/0x95459fb9d1d2ae80 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831286.088002:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831286.088212:0:24327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433474048 00000100:00100000:1.0:1787831286.088223:0:24327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433474048 00000100:00100000:3.0:1787831286.088563:0:22802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433474176 00000100:00100000:3.0:1787831286.088568:0:22802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433474176 00010000:00010000:3.0:1787831286.088599:0:22802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a0588e1c/0x95459fb9d1d2ae41 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424571 expref: 10 pid: 24321 timeout: 677 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787831286.088664:0:22802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 21 00000100:00100000:3.0:1787831286.088676:0:22802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220261cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+10:2397:x1874676433474176:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787831286.088695:0:22802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787831286.088724:0:22802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a0588e1c/0x95459fb9d1d2ae41 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424571 expref: 10 pid: 24321 timeout: 677 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831286.088758:0:22802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a0588e1c/0x95459fb9d1d2ae41 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424571 expref: 10 pid: 24321 timeout: 677 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831286.088794:0:22802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a0588e1c/0x95459fb9d1d2ae41 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.31@tcp remote: 0xe558a92a99424571 expref: 10 pid: 24321 timeout: 677 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831286.088815:0:22802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787831286.088820:0:22802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787831286.088827:0:22802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003acf69f2/0x95459fb9d1d2ae80 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831286.088838:0:22802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003acf69f2/0x95459fb9d1d2ae80 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831286.090472:0:22802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787831286.090573:0:22802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220261cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+9:2397:x1874676433474176:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 1890us (3234us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831286.090587:0:22802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 21 00010000:00010000:1.0:1787831286.090967:0:24325:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003acf69f2/0x95459fb9d1d2ae80 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787831286.090981:0:24325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003acf69f2/0x95459fb9d1d2ae80 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787831286.096276:0:25858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 1 00000100:00100000:0.0:1787831286.096302:0:25858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2203a212c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+8:2396:x1874676433474048:12345-192.168.203.31@tcp:4:dd.0 00010000:00010000:0.0:1787831286.096355:0:25858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f06123c1/0x95459fb9d1d2ae87 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831286.096378:0:25858:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787831286.096383:0:25858:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787831286.096392:0:25858:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f06123c1/0x95459fb9d1d2ae87 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787831286.096409:0:25858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f06123c1/0x95459fb9d1d2ae87 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787831286.209702:0:25136:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901895 is committed 00000001:00080000:3.0:1787831286.209722:0:25136:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901894 is committed 00002000:00010000:2.0:1787831286.209917:0:24325:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:2.0:1787831286.209921:0:24325:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb mtime from disk: 1787831285 -> 1787831286 00002000:00010000:2.0:1787831286.209924:0:24325:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb ctime from disk: 1787831285 -> 1787831286 00002000:00010000:2.0:1787831286.209927:0:24325:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 0 -> 8192 00010000:00010000:2.0:1787831286.209945:0:24325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003acf69f2/0x95459fb9d1d2ae80 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831286.209958:0:24325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003acf69f2/0x95459fb9d1d2ae80 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831286.209967:0:24325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003acf69f2/0x95459fb9d1d2ae80 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831286.209974:0:24325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d23344b6c00 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:2.0:1787831286.209979:0:24325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003acf69f2/0x95459fb9d1d2ae80 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831286.210003:0:24325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003acf69f2/0x95459fb9d1d2ae80 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831286.210023:0:24325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003acf69f2/0x95459fb9d1d2ae80 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787831286.210031:0:24325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003acf69f2/0x95459fb9d1d2ae80 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787831286.210128:0:24325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220261d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+7:2396:x1874676433473920:12345-192.168.203.31@tcp:4:dd.0 Request processed in 131535us (131867us total) trans 12884901895 rc 0/0 00000100:00100000:2.0:1787831286.210142:0:24325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 0 00000001:00080000:0.0:1787831286.252366:0:25136:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901896 is committed 00002000:00010000:3.0:1787831286.252789:0:25858:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 4194304 -> 7654321 00002000:00010000:3.0:1787831286.252795:0:25858:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 8192 -> 14952 00010000:00010000:3.0:1787831286.252811:0:25858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f06123c1/0x95459fb9d1d2ae87 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831286.252825:0:25858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f06123c1/0x95459fb9d1d2ae87 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831286.252834:0:25858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f06123c1/0x95459fb9d1d2ae87 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831286.252873:0:25858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22034a6000 already unused, calling callback (ffffffffc0ed6420) 00010000:00010000:3.0:1787831286.252878:0:25858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f06123c1/0x95459fb9d1d2ae87 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831286.252888:0:25858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f06123c1/0x95459fb9d1d2ae87 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831286.252908:0:25858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f06123c1/0x95459fb9d1d2ae87 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787831286.252916:0:25858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f06123c1/0x95459fb9d1d2ae87 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787831286.253157:0:25858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2203a212c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+5:2396:x1874676433474048:12345-192.168.203.31@tcp:4:dd.0 Request processed in 156860us (169867us total) trans 12884901896 rc 0/0 00000100:00100000:3.0:1787831286.253168:0:25858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 1 00000100:00100000:2.0:1787831286.358670:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831286.358712:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831286.358742:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831286.358845:0:22815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433474432 00000100:00100000:0.0:1787831286.358867:0:22815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433474432 00000100:00100000:0.0:1787831286.358932:0:22815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433474688 00000100:00100000:0.0:1787831286.358949:0:22815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433474688 00000100:00100000:0.0:1787831286.358994:0:22815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 56 00000100:00100000:0.0:1787831286.359005:0:22815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204705a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+5:2394:x1874676433474432:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1787831286.359076:0:22815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204705a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+5:2394:x1874676433474432:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 73us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831286.359096:0:22815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 56 00000100:00100000:0.0:1787831286.359114:0:22815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 57 00000100:00100000:0.0:1787831286.359120:0:22815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22047070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c60c7f3-708e-4896-8908-a503cf94fb51+6:2394:x1874676433474688:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1787831286.359150:0:22815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22047070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c60c7f3-708e-4896-8908-a503cf94fb51+6:2394:x1874676433474688:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 30us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831286.359156:0:22815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 57 00000100:00080000:0.0:1787831286.359282:0:22811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787831286.359286:0:22811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787831286.359369:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831286.359413:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787831286.359455:0:22809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433474304 00000100:00100000:0.0:1787831286.359459:0:22809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433474304 00000100:00100000:0.0:1787831286.359488:0:22809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 165 00000100:00100000:0.0:1787831286.359495:0:22809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233cd47850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c04154b7-8c89-4cf2-a4c4-5dd132db0903+13:2394:x1874676433474304:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1787831286.359523:0:22809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233cd47850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c04154b7-8c89-4cf2-a4c4-5dd132db0903+13:2394:x1874676433474304:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 29us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831286.359528:0:22809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 165 00000100:00100000:1.0:1787831286.368061:0:24322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433474944 00000100:00100000:1.0:1787831286.368086:0:24322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433474944 00000100:00080000:0.0:1787831286.368404:0:22811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787831286.368568:0:25005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433474560 00000100:00100000:3.0:1787831286.368574:0:25005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433474560 00000100:00100000:3.0:1787831286.368650:0:25005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 17 00000100:00100000:3.0:1787831286.368661:0:25005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204705680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7c60c7f3-708e-4896-8908-a503cf94fb51+5:2394:x1874676433474944:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1787831286.368740:0:25005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204705680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7c60c7f3-708e-4896-8908-a503cf94fb51+5:2394:x1874676433474944:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 82us (9997us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831286.368749:0:25005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 17 00000100:00100000:3.0:1787831286.368768:0:25005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 18 00000100:00100000:3.0:1787831286.368775:0:25005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22047061c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+5:2394:x1874676433474560:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1787831286.368812:0:25005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22047061c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:805921bb-0b9c-4b6e-91c0-2cd3c152e40d+5:2394:x1874676433474560:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 38us (9398us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831286.368819:0:25005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 18 00000100:00080000:0.0:1787831286.369052:0:22811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787831286.371760:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787831286.371874:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787831286.372173:0:24322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433475072 00000100:00100000:1.0:1787831286.372183:0:24322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433475072 00000100:00100000:1.0:1787831286.372239:0:24322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 19 00000100:00100000:1.0:1787831286.372249:0:24322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204704b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7c60c7f3-708e-4896-8908-a503cf94fb51+5:2394:x1874676433475072:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1787831286.372327:0:24322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204704b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7c60c7f3-708e-4896-8908-a503cf94fb51+5:2394:x1874676433475072:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 79us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1787831286.372405:0:24322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 19 00000100:00080000:1.0:1787831286.372428:0:22811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787831286.373518:0:22815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676433474816 00000100:00100000:0.0:1787831286.373527:0:22815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676433474816 00000100:00100000:0.0:1787831286.373696:0:22815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 58 00000100:00100000:0.0:1787831286.373706:0:22815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204704000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c60c7f3-708e-4896-8908-a503cf94fb51+5:2394:x1874676433474816:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1787831286.373789:0:22815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204704000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c60c7f3-708e-4896-8908-a503cf94fb51+5:2394:x1874676433474816:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 84us (2037us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831286.373796:0:22815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 58 00000100:00080000:1.0:1787831286.373982:0:22811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1787831286.374810:0:22804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787831287.015139:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220261c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676444019072:0@lo:400:kworker.0 00000100:00100000:3.0:1787831287.015212:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831287.015256:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220261e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676444019584:0@lo:400:kworker.0 00000100:00100000:3.0:1787831287.015279:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831287.015297:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220261f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3619:1874676444020096:0@lo:400:kworker.0 00000100:00100000:3.0:1787831287.015321:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831287.015341:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1787831287.015347:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220261f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8057bc0f-773b-4151-9d37-d94ddea63831:3619:1874676444018688:0@lo:400:kworker.0 00000100:00100000:3.0:1787831287.015373:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831287.015395:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220261de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874676444019200:0@lo:400:kworker.0 00000100:00100000:3.0:1787831287.015417:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831287.015431:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220261cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874676444019712:0@lo:400:kworker.0 00000100:00100000:3.0:1787831287.015449:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831287.015461:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220261e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3619:1874676444020224:0@lo:400:kworker.0 00000100:00100000:3.0:1787831287.015477:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831287.015498:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220261e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676444018816:0@lo:400:kworker.0 00000100:00100000:3.0:1787831287.015521:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831287.015534:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220261da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676444019328:0@lo:400:kworker.0 00000100:00100000:3.0:1787831287.015550:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831287.015561:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220261f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3621:1874676444019840:0@lo:400:kworker.0 00000100:00100000:3.0:1787831287.015595:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831287.015608:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1787831287.015613:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220261fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676444018944:0@lo:400:kworker.0 00000100:00100000:3.0:1787831287.015653:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831287.015670:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220261c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676444019456:0@lo:400:kworker.0 00000100:00100000:3.0:1787831287.015689:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831287.015701:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d220261c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3621:1874676444019968:0@lo:400:kworker.0 00000100:00100000:3.0:1787831287.015719:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787831287.015741:0:24321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444019072 00000100:00100000:3.0:1787831287.015748:0:24321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444019072 00000100:00100000:3.0:1787831287.015880:0:24321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444019584 00000100:00100000:3.0:1787831287.015884:0:24321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444019584 00000100:00100000:3.0:1787831287.015901:0:24321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444018944 00000100:00100000:3.0:1787831287.015904:0:24321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444018944 00000100:00100000:3.0:1787831287.015919:0:24321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444019456 00000100:00100000:3.0:1787831287.015922:0:24321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444019456 00000100:00100000:3.0:1787831287.015940:0:24321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787831287.015948:0:24321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb41680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676444019072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787831287.016002:0:24321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb41680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1874676444019072:12345-0@lo:400:kworker.0 Request processed in 55us (790us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831287.016010:0:24321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787831287.016027:0:24321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787831287.016034:0:24321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb40b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676444019584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787831287.016062:0:24321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb40b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676444019584:12345-0@lo:400:kworker.0 Request processed in 29us (782us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831287.016068:0:24321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787831287.016080:0:24321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787831287.016096:0:24321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2314e72d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1874676444018944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787831287.016129:0:24321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2314e72d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1874676444018944:12345-0@lo:400:kworker.0 Request processed in 35us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831287.016136:0:24321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787831287.016148:0:24321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787831287.016154:0:24321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2314e72580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676444019456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787831287.016181:0:24321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2314e72580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676444019456:12345-0@lo:400:kworker.0 Request processed in 28us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831287.016188:0:24321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787831287.016228:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220261fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676444018944:0@lo:400:kworker.0 00000100:00100000:3.0:1787831287.016238:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220261c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676444019456:0@lo:400:kworker.0 00000100:00100000:3.0:1787831287.016266:0:3619:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901894 gen 2 00000004:00080000:3.0:1787831287.016271:0:3619:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d2204706940, transno 12884901892 00000004:00080000:3.0:1787831287.016280:0:3619:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884901894 committed transno 12884901894 00000100:00100000:3.0:1787831287.016294:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220261c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1874676444019072:0@lo:400:kworker.0 00000100:00100000:3.0:1787831287.016304:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220261e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676444019584:0@lo:400:kworker.0 00000100:00100000:3.0:1787831287.016322:0:22851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444020096 00000100:00100000:3.0:1787831287.016325:0:22851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444020096 00000100:00100000:3.0:1787831287.016346:0:22851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444019200 00000100:00100000:3.0:1787831287.016348:0:22851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444019200 00000100:00100000:3.0:1787831287.016357:0:22851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444019712 00000100:00100000:3.0:1787831287.016359:0:22851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444019712 00000100:00100000:3.0:1787831287.016368:0:22851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444020224 00000100:00100000:3.0:1787831287.016371:0:22851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444020224 00000100:00100000:3.0:1787831287.016381:0:22851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444019840 00000100:00100000:3.0:1787831287.016383:0:22851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444019840 00000100:00100000:3.0:1787831287.016405:0:22851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444019968 00000100:00100000:3.0:1787831287.016408:0:22851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444019968 00000100:00100000:3.0:1787831287.016421:0:22851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787831287.016427:0:22851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233fb430c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874676444020096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787831287.016464:0:22851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233fb430c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874676444020096:12345-0@lo:400:kworker.0 Request processed in 37us (1142us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831287.016473:0:22851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787831287.016498:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220261f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3619:1874676444020096:0@lo:400:kworker.0 00000100:00100000:3.0:1787831287.016513:0:22851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787831287.016518:0:22851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233faea940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874676444019200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787831287.016549:0:22851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233faea940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874676444019200:12345-0@lo:400:kworker.0 Request processed in 31us (1131us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831287.016554:0:22851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787831287.016576:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220261de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874676444019200:0@lo:400:kworker.0 00000100:00100000:3.0:1787831287.016594:0:22851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787831287.016599:0:22851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2314e730c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874676444019712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787831287.016651:0:22851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2314e730c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874676444019712:12345-0@lo:400:kworker.0 Request processed in 52us (1201us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831287.016656:0:22851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787831287.016678:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220261cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874676444019712:0@lo:400:kworker.0 00000100:00100000:3.0:1787831287.016692:0:22851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787831287.016698:0:22851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2314e71a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874676444020224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787831287.016731:0:22851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2314e71a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874676444020224:12345-0@lo:400:kworker.0 Request processed in 33us (1252us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831287.016746:0:22851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:3.0:1787831287.016769:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d220261e580 x1874676444020224/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787831303 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787831287.016785:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220261e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3619:1874676444020224:0@lo:400:kworker.0 00000100:00100000:3.0:1787831287.016802:0:22851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787831287.016808:0:22851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2314e71e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1874676444019840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787831287.016840:0:22851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2314e71e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1874676444019840:12345-0@lo:400:kworker.0 Request processed in 33us (1244us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831287.016844:0:22851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787831287.016880:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220261f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3621:1874676444019840:0@lo:400:kworker.0 00000100:00100000:3.0:1787831287.016896:0:22851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787831287.016902:0:22851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2314e72940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1874676444019968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787831287.016936:0:22851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2314e72940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1874676444019968:12345-0@lo:400:kworker.0 Request processed in 35us (1216us total) trans 0 rc 0/0 00000100:00100000:3.0:1787831287.016941:0:22851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00080000:3.0:1787831287.016962:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d220261c3c0 x1874676444019968/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787831303 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787831287.016972:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220261c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3621:1874676444019968:0@lo:400:kworker.0 00000100:00100000:2.0:1787831287.017455:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787831287.017468:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204704f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676444020352:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787831287.017506:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831287.017547:0:22820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444018816 00000100:00100000:2.0:1787831287.017553:0:22820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444018816 00000100:00100000:2.0:1787831287.017583:0:22820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444019328 00000100:00100000:2.0:1787831287.017586:0:22820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444019328 00000100:00100000:2.0:1787831287.017611:0:22820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787831287.017617:0:22820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2314e703c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1874676444018816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787831287.017674:0:22820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2314e703c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1874676444018816:12345-0@lo:400:kworker.0 Request processed in 57us (2151us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831287.017680:0:22820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787831287.017698:0:22820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787831287.017704:0:22820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2314e70b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676444019328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787831287.017729:0:22820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2314e70b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1874676444019328:12345-0@lo:400:kworker.0 Request processed in 26us (2179us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831287.017735:0:22820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787831287.017845:0:24324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444020352 00000100:00100000:2.0:1787831287.017849:0:24324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444020352 00000100:00100000:2.0:1787831287.017900:0:24324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787831287.017906:0:24324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204707840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1874676444020352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787831287.017925:0:24324:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915845632 avail 3684323328 00000100:00100000:2.0:1787831287.017963:0:24324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204707840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1874676444020352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831287.017969:0:24324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787831287.018007:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204704f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676444020352:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1787831287.018429:0:22811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787831287.018435:0:22811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787831287.018439:0:22811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787831287.018441:0:22811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787831287.018506:0:22810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444018688 00000100:00100000:0.0:1787831287.018511:0:22810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444018688 00000100:00100000:0.0:1787831287.018550:0:22810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1787831287.018557:0:22810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d233cd45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8057bc0f-773b-4151-9d37-d94ddea63831+24:3619:x1874676444018688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787831287.018603:0:22810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d233cd45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8057bc0f-773b-4151-9d37-d94ddea63831+24:3619:x1874676444018688:12345-0@lo:400:kworker.0 Request processed in 47us (3229us total) trans 0 rc 0/0 00000100:00100000:0.0:1787831287.018609:0:22810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1787831287.018683:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220261f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8057bc0f-773b-4151-9d37-d94ddea63831:3619:1874676444018688:0@lo:400:kworker.0 00000100:00100000:0.0:1787831287.018872:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2204704f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676444020480:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787831287.018899:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831287.019045:0:24324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444020480 00000100:00100000:2.0:1787831287.019049:0:24324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444020480 00000100:00100000:2.0:1787831287.019091:0:24324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787831287.019100:0:24324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d220261f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1874676444020480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787831287.019121:0:24324:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787831287.019164:0:24324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d220261f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1874676444020480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831287.019185:0:24324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787831287.019364:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2204704f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1874676444020480:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787831287.019574:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220261e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1874676444018816:0@lo:400:kworker.0 00000100:00100000:3.0:1787831287.019587:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d220261da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1874676444019328:0@lo:400:kworker.0 00010000:00010000:0.0:1787831287.400041:0:22805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787831287.812055:0:25895:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: expected /mnt/pcc.d1d.sanity-pcc/d1d.sanity-pcc/13a3/0x2000013a1:0x2:0x0 size: 7654321 got: 0 00000040:00080000:2.0:1787831287.910798:0:22852:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1787831287.910806:0:22852:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787831287.910824:0:22852:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:2.0:1787831287.910830:0:22852:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:3.0:1787831288.422903:0:25152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787831289.069372:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d2203a22d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676444020608:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787831289.069469:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787831289.069594:0:24324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874676444020608 00000100:00100000:2.0:1787831289.069611:0:24324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874676444020608 00000100:00100000:2.0:1787831289.069854:0:24324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787831289.069864:0:24324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2204706940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676444020608:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787831289.069898:0:24324:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787831289.069947:0:24324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2204706940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874676444020608:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1787831289.069955:0:24324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787831289.070018:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d2203a22d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1874676444020608:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1787831289.070175:0:22811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787831289.447858:0:22804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 56005 lines, 56005 kept, 0 dropped, 0 bad.